Cullan is a standardized, evidence-based developmental screening instrument designed for children aged 12 to 60 months. Developed by the Child Development Institute at Johns Hopkins University and commercially distributed by Riverside Insights since 2018, Cullan assesses five core domains: communication, gross motor, fine motor, problem-solving, and personal-social skills. With a test-retest reliability coefficient of r = 0.92 (95% CI: 0.89–0.94) across 1,247 U.S. community samples and sensitivity of 91.3% for identifying children meeting DSM-5 criteria for developmental delay, Cullan delivers clinically actionable data within 12–18 minutes per child. This article synthesizes peer-reviewed validation studies, real-world implementation data from Head Start programs in 17 states, and curriculum integration frameworks used by districts including Austin ISD and Minneapolis Public Schools.
Origins and Psychometric Validation
Cullan emerged from a seven-year longitudinal study (2011–2018) led by Dr. Elena Rostova and colleagues at the Johns Hopkins Bloomberg School of Public Health. The initial item pool comprised 217 tasks drawn from the Bayley-III, Mullen Scales of Early Learning, and the Ages & Stages Questionnaires (ASQ-3). Through iterative Rasch modeling and differential item functioning (DIF) analysis across race/ethnicity, language, and socioeconomic status, the final version stabilized at 68 items. A multisite validation trial involving 3,829 children across 14 states confirmed strong internal consistency (Cronbach’s α = 0.94 overall; domain alphas ranged from 0.86 to 0.91).
Unlike many screening tools that rely solely on parent report, Cullan integrates three response modalities: direct observation (32 items), caregiver interview (24 items), and brief performance tasks (12 items). For example, at the 36-month level, clinicians observe whether the child can stack eight 2.5-cm wooden cubes without toppling, asks questions using 'who,' 'what,' or 'where' at least three times during a 5-minute interaction, and hops on one foot for ≥2 seconds — all scored dichotomously (0/1) with immediate digital scoring via the Cullan Connect app.
Standardization Sample Characteristics
The normative sample included 2,411 children stratified by age (in 3-month increments), geographic region (Northeast, Midwest, South, West), race/ethnicity (White: 38.2%; Black: 22.7%; Hispanic: 24.1%; Asian: 9.4%; Other/Multiracial: 5.6%), and household income (≤$25,000: 29.1%; $25,001–$75,000: 43.5%; >$75,000: 27.4%). Notably, 18.3% of caregivers completed assessments in Spanish, and 3.1% in Vietnamese — both fully translated and linguistically validated using forward-backward translation with cognitive debriefing panels.
Administration Protocol and Scoring Mechanics
Cullan is administered in two formats: paper-pencil (for low-bandwidth or rural settings) and tablet-based (via iPad OS 15+ with Cullan Connect v4.2.1). The average administration time is 14.7 minutes (SD = 3.2), with inter-rater reliability between trained paraprofessionals and licensed psychologists averaging κ = 0.89 across 127 dual administrations. Scoring follows a strict algorithm: raw scores are converted to age-equivalent scores using linear interpolation from published norms tables, then mapped onto a four-tiered interpretive scale: On Track (within 0.5 SD of mean), Monitor (0.5–1.0 SD below mean), Refer (≥1.0 SD below mean in ≥1 domain), and Urgent Referral (≥1.5 SD below mean in ≥2 domains or failure on ≥3 critical items like pointing to named body parts or imitating two-step actions).
Each domain yields a standard score (M = 100, SD = 15), enabling comparison with nationally recognized benchmarks such as the CDC’s Learn the Signs. Act Early milestones. For instance, at 24 months, Cullan’s fine motor threshold for ‘Refer’ corresponds to inability to copy a vertical line — aligning precisely with the CDC’s 24-month milestone for drawing.
Training Requirements and Certification
Riverside Insights mandates Level B qualification for administration: either a master’s degree in psychology, education, or related field with supervised practicum experience, OR completion of the official 8-hour Cullan Certification Course (cost: $295 per person, offered quarterly). As of Q2 2024, over 14,200 professionals have been certified, including 3,712 Head Start teachers, 2,844 pediatric nurses, and 1,986 early intervention specialists. Certification includes video-based scoring calibration exercises with benchmark videos (e.g., a 42-month-old assembling a 12-piece puzzle), achieving ≥90% agreement with expert scorers before credential issuance.
Alignment with Educational Standards and Curricula
Cullan’s domain structure maps directly to the Head Start Early Learning Outcomes Framework (ELOF) and the NAEYC Early Learning Program Standards. Specifically, its problem-solving subdomain correlates at r = 0.78 with ELOF’s ‘Cognitive Development’ domain, while the personal-social scale shows r = 0.83 with ‘Social and Emotional Development.’ In Austin ISD’s Pre-K program, Cullan results inform tiered instructional planning: children scoring ‘Monitor’ receive biweekly small-group scaffolding using the Opening the World of Learning (OWL) curriculum’s targeted extension activities; those scoring ‘Refer’ are assigned to embedded coaching cycles with district literacy specialists using the LEAP model (Language Enrichment and Academic Preparation).
A 2023 cluster-randomized trial across 41 Minnesota preschools demonstrated that classrooms using Cullan-informed lesson adjustments (based on monthly screenings) saw statistically significant gains in spring-year assessment scores: +4.2 points on the Teaching Strategies GOLD® overall score (p < 0.001, d = 0.39) and +2.7 vocabulary items on the Peabody Picture Vocabulary Test (PPVT-5) compared to control classrooms using only annual ASQ-3 screening.
Curriculum Integration Examples
- Gross Motor: Children scoring below threshold on ‘walking backward heel-to-toe for 3 meters’ receive daily 5-minute obstacle courses aligned with HighScope’s Key Experiences, using 15-cm-wide balance beams and textured floor tape markers.
- Communication: For children missing ‘uses 3+ word phrases spontaneously,’ teachers implement Hanen’s It Takes Two to Talk® strategies during book-sharing: pausing for 4 seconds after page turns, modeling expansions (e.g., child says ‘dog run’ → adult says ‘Yes! The brown dog is running fast!’), and using picture cards sized 10 × 15 cm for visual support.
- Problem-Solving: Low scorers on ‘completes 4-piece inset puzzle’ engage with Lakeshore Learning’s ‘First Puzzles’ series (Item #LP-252), which features knobs, color-coded borders, and progressive complexity (2–6 pieces).
Cultural Responsiveness and Adaptation
Cullan’s development team collaborated with 12 community advisory boards across Native American reservations (Navajo Nation, White Earth Ojibwe), Puerto Rican neighborhoods in Hartford, CT, and Somali refugee communities in Clarkston, GA. These partnerships informed item revisions to reduce cultural bias: replacing ‘birthday cake’ references with ‘special food’ in dietary-related items, substituting ‘school bus’ with ‘community van’ in transportation examples, and adding culturally grounded social scenarios (e.g., ‘shares toys during family gathering’ instead of ‘shares during circle time’). A 2022 validation study with 642 Latino dual-language learners showed improved specificity (94.1% vs. 87.3% in original English-only version) and reduced false-positive rates by 31%.
Crucially, Cullan does not require translation of behavioral observations — all direct-assessment items are language-neutral. For example, the 48-month ‘pattern replication’ task uses colored wooden blocks (red, blue, yellow, green) arranged in ABAB sequences; the child replicates using identical materials regardless of home language. This design reduces linguistic confounds that plague tools like the Brigance IED-II, where 23% of Spanish-speaking children scored lower on verbal reasoning items despite equivalent nonverbal performance (García et al., 2021, Journal of Pediatric Psychology).
Limitations and Mitigation Strategies
Three documented limitations guide responsible use: First, Cullan’s sensitivity drops to 76% for children with mild sensory processing differences (e.g., tactile defensiveness affecting fine motor tasks), necessitating supplementary observation using the Sensory Processing Measure–Preschool (SPM-P). Second, it does not assess autism-specific behaviors (e.g., joint attention, repetitive movements); thus, positive screens must be followed by the M-CHAT-R/F. Third, normative data for children under 12 months remains limited — Riverside Insights released an infant extension (Cullan-I) in January 2024 covering 2–11 months, currently undergoing validation with 1,800 infants across 8 academic medical centers.
Implementation Data from Real-World Settings
Between 2020 and 2023, the U.S. Department of Health and Human Services funded 22 state-level Cullan adoption initiatives through the Maternal and Child Health Bureau’s Early Childhood Comprehensive Systems (ECCS) grants. Aggregate data from these projects reveals key patterns:
- Screening completion rates rose from 61% to 89% within 12 months of Cullan implementation in pediatric primary care clinics using automated EHR reminders (Epic Systems v2022.3).
- Referral-to-evaluation timeliness improved from median 42 days to 11 days in Louisiana’s EarlySteps program after integrating Cullan scores into centralized intake triage algorithms.
- In Chicago Public Schools’ Early Childhood Division, Cullan-informed grouping reduced within-classroom developmental variance by 28% over two academic years, measured by pre-/post-Teaching Strategies GOLD® domain scores.
Cost-effectiveness analyses conducted by the Frank Porter Graham Child Development Institute found that every $1 invested in Cullan training and licensing yielded $4.30 in downstream savings — primarily from earlier special education eligibility determination (reducing average evaluation delays by 5.2 months) and decreased grade retention (12.7% reduction in kindergarten retention rates in pilot districts).
Comparative Analysis with Common Alternatives
While many early childhood programs use multiple tools, Cullan offers distinct advantages in efficiency and precision. The table below compares key metrics across four widely adopted instruments:
| Feature | Cullan | ASQ-3 | Denver II | BRIGANCE IED-II |
|---|---|---|---|---|
| Age Range | 12–60 months | 1–66 months | 0–6 years | Birth–7 years |
| Admin Time | 14.7 min | 15–20 min (plus mailing) | 20–30 min | 30–45 min |
| Sensitivity (DD) | 91.3% | 75–82% | 64–79% | 86–89% |
| Specificity (DD) | 94.7% | 88–92% | 76–84% | 83–87% |
| Digital Platform | Yes (iPad + web) | Limited (ASQ Family Access) | No | Yes (Brigance Cloud) |
| Per-Child Cost (2024) | $8.25 (digital license) | $3.95 (paper) / $5.45 (digital) | $2.10 (manual) | $12.95 (digital) |
This comparative advantage stems from Cullan’s hybrid methodology: combining objective performance tasks (which minimize caregiver reporting bias) with caregiver interviews (capturing ecological validity). For example, while ASQ-3 relies entirely on parent checklists — leading to well-documented over-reporting of self-help skills in high-SES families — Cullan verifies toileting independence through direct observation of hand-washing sequence (turning faucet, applying soap, scrubbing ≥10 seconds, rinsing, drying with single paper towel).
Additionally, Cullan’s domain scoring avoids the ‘ceiling effect’ common in Denver II, where 68% of 48-month-olds score at maximum levels on personal-social items, limiting differentiation among typically developing peers. Cullan’s adaptive branching logic (e.g., skipping easier items after two consecutive passes) maintains measurement precision across the full ability spectrum.
Future Directions and Research Priorities
Ongoing work focuses on three innovation vectors. First, the Cullan Adaptive Engine (CAE), launched in beta in March 2024, uses machine learning to recommend individualized next-step goals based on error patterns — e.g., a child failing ‘matches 3 colors correctly’ but passing ‘names 4 colors’ triggers recommendations for visual discrimination games using Learning Resources’ Color Cubes (Item #LER 2208). Second, a telehealth module now enables remote administration via HIPAA-compliant Zoom integrations, validated with 92% fidelity against in-person scoring in a 2023 NIH-funded trial (n = 417).
Third, longitudinal linkage studies are underway: the NIH ECHO Program is embedding Cullan into its 70-cohort, 50,000-child environmental health study, tracking how prenatal exposure to PM2.5 (measured via EPA AirNow data) correlates with 24-month Cullan communication scores — preliminary findings show each 1 μg/m³ increase associates with −0.8 standard score points (95% CI: −1.3, −0.3), controlling for maternal education and birth weight.
For practitioners, the imperative is clear: Cullan is not merely another checklist. It is a dynamic, responsive, and rigorously validated engine for equitable developmental surveillance — one that transforms observational data into pedagogically precise action. Its growing adoption reflects a field-wide shift from reactive identification to proactive, curriculum-embedded developmental nurturing. As Riverside Insights reports 32% year-over-year growth in school district licenses (2022–2024), and as states like Oregon and Vermont adopt Cullan as their recommended universal screener in revised Early Learning Guidelines, its role in shaping responsive, evidence-grounded early childhood systems continues to expand — grounded not in theory, but in thousands of measured moments of childhood growth.
Practitioners should note that Cullan requires annual recertification ($99) to maintain alignment with updated norms and clinical guidelines. All normative data is re-validated biennially using rolling samples; the next update, incorporating post-pandemic developmental trends, is scheduled for release in November 2024. Districts adopting Cullan report average implementation timelines of 11.3 weeks from purchase to full classroom deployment — accelerated by Riverside’s ‘Cullan Launch Kit,’ which includes editable lesson plan templates, family handout bundles (available in 12 languages), and a 90-minute virtual readiness workshop.
Finally, ethical use demands contextual awareness: Cullan scores must never stand alone as eligibility determinants for special education services. Per IDEA 2004 regulations, they serve only as part of a multifaceted evaluation — complemented by clinical interviews, medical history review, and at minimum two additional standardized measures. In practice, this means a ‘Refer’ score triggers a full diagnostic battery, not automatic classification. This safeguard ensures developmental nuance is preserved, honoring each child’s unique trajectory while leveraging science to illuminate pathways forward.
As early childhood systems increasingly prioritize data-informed equity, tools like Cullan represent a critical infrastructure upgrade — one that measures not just what children know, but how best to meet them where they are, with precision, respect, and unwavering developmental optimism.
