Abstract
Purpose
Accurate assessment of cognitive development of young children is a vital component of developmental evaluations. Direct assessment of developmental skills is not always feasible, but there is limited information on the agreement between direct assessment and caregiver-reported cognitive skills. There is limited information regarding the accuracy of the parent-reported Developmental Profile 4 (DP-4) in comparison to the widely-used developmental measure, the Bayley Scales of Infant and Toddler Development, Fourth Edition (Bayley-4). The purpose of the current study was to evaluate whether a standardized parent interview can effectively identify children at risk for cognitive developmental delays.
Methods
We compared the agreement between the Bayley-4 Cognitive and the Developmental Profile 4 (DP-4) in young children being evaluated in-person for early developmental delays. 182 children (134 with an autism diagnosis), ages 6–42 months, completed both assessments.
Results
Results showed that Bayley-4 Cognitive scores had a moderately strong correlation with DP4-Cognitive scores (r = 0.70, p < 0.001). A cutoff of 70 or 69 on the DP-4 Cognitive was determined as ideal for identifying developmental delay based on diagnosis of global developmental delay or the Bayley-4 Cognitive.
Conclusions
Our analyses revealed good agreement between DP-4 and Bayley-4 Cognitive scores, even after controlling for confounding variables such as degree of ASD characteristics, age, and sex. These results suggest that caregiver-report measures can be a valid and useful tool in the assessment of young children, particularly when direct developmental assessment is not feasible.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Identifying early developmental delays has been recognized by medical organizations such as the American Academy of Pediatrics (AAP) as an essential way to promote well-being of all children (Lipkin et al., 2020). The AAP recommends routine screening for developmental conditions at 9-, 18- and 30-month well-child visits (Lipkin et al., 2020) in addition to screening specifically for autism spectrum disorder (ASD) at 18- and 24-month visits (Hyman et al., 2020). After children are identified as having higher risk for developmental concern, a comprehensive evaluation should follow. Important developmental domains for young children include cognition, language and communication, physical development (including fine and gross motor skills), social/emotional functioning, and adaptive skills (Alpern, 2020; Bayley & Aylward, 2019).
Developmental testing can provide awareness of which children need early intervention services. Developmental testing can also be used to predict cognitive functioning in later childhood. In a large study with a representative US sample, scores on the Mullen Scale of Early Learning (Mullen, 1995) at 2 years of age were moderately correlated with Stanford-Binet 5th Edition Abbreviated Battery IQ (Roid, 2003) scores at age 6 (r = 0.46). Notably, Mullen scores at one month had a substantially lower relationship with future IQ (r = 0.17). Similar results were found in a German sample of typically-developing children with correlations between FSIQ at 4 years and third edition of the Bayley Scales of Infant Development at 18 months (r = 0.43) and 26 months (r = 0.50) (Klein-Radukic & Zmyj, 2023). The relationship between developmental and future cognitive functioning is higher for very preterm or low birth weight children, based on the results of a meta-analysis (aggregated r = 0.61) (Luttikhuizen dos Santos et al., 2013).
Early detection of developmental delays leads to earlier access to appropriate intervention and, in turn, better long-term outcomes for the health of the individual (Orinstein et al., 2014). Similarly, studies have shown that early intervention and level of cognitive functioning are the most significant variables predicting outcomes for children with developmental delays and ASD (Dawson, 2008; Rogers et al., 2012). However, access to early evidence-based interventions, especially intensive therapies based on applied behavior analysis, typically requires a detailed assessment of development and formal diagnosis obtained through a specialized clinic (Alfuraydan et al., 2020). Unfortunately, there are often extensive delays between first concerns related to developmental delays and detailed assessments. These long periods of waiting have been explained by many factors, including a shortage of appropriately trained healthcare professionals and lengthy evaluations composed of several appointments (Crane et al., 2016; Thomas et al., 2007). There are also disparities in wait times and access to care for individuals from minority backgrounds (Aylward et al., 2021; Liu et al., 2023). One promising solution to the access-to-care issue is the use of telehealth. Using telehealth can decrease the wait time for referrals from primary care to connection with specialist care (Pfeil et al., 2023) and can also significantly reduce no-show rates in medical care, particularly among Black individuals (Sumarsono et al., 2023). However, the data on the appropriateness of telehealth-based methods for developmental assessments is needed to ensure that these alternative service delivery models are equivalent to existing in-person models in quality.
Although still in the early stages of empirical support, initial studies provide encouraging results for the validity of telehealth approaches for evaluating and diagnosing developmental conditions. Valentine et al. (2021) completed a systematic review of telehealth services for assessment, monitoring, and treatment of individuals with neurodevelopmental disorders. They found preliminary evidence for the accuracy of telehealth evaluations in diagnosing ASD, with one study showing an increased likelihood of families attending appointments via telehealth, strong provider and family satisfaction, as well as time to diagnosis being reduced by 11–12 months (Stainbrook et al., 2019). A second systematic review by Liu and Ma (2022) summarizes evidence for the screening and diagnostic validity of several telehealth tools. In addition to having accurate diagnostic assessments, such as those used in ASD, having valid ways of evaluating developmental skills in telehealth settings is also important.
Two primary sources of information used for assessing development in pediatric populations are parent report and direct assessment (Miller et al., 2017; Nordahl-Hansen et al., 2014). As the length of waiting time for families referred to complete clinical evaluations continues to grow, parent-report measures may serve as a time- and cost-efficient method for characterizing development for children who require immediate access to intervention. Parent-report measures are an attractive option in healthcare as they are quick, easy to use, and more cost-effective compared to direct assessments (Nordahl-Hansen et al., 2014). Additionally, parent report data can bring forth historical and functional perspectives that are not naturally accessible in a clinical testing environment (Ebert, 2017). Finally, parent-report assessment allows for better access for families in remote locations, as well as during unprecedented events, which has been highlighted through the COVID-19 pandemic, and lends itself well to use in telehealth contexts.
Despite the benefits of using parent report measures for assessing developmental delays, there may be some limitations. Some providers may consider parent report to be subjective as it reflects caregiver perception of their child’s functioning, however data suggests that parent report of language ability can be a valid and efficient tool (Sachse & Suchodoletz, 2008). Several other studies have found strong agreement between parent report and direct assessment for language and fine motor ability (Bennetts et al., 2016; James et al., 2023; Miller et al., 2017; Nordahl-Hansen et al., 2014; Sachse & Suchodoletz, 2008). There is evidence that parent report might be most accurate for children at the extreme ends of language ability (i.e., very low or very high; Bennetts et al., 2016). There is mixed evidence for diagnostic differences in the degree of agreement of direct assessment and parents report, with a recent study using a large dataset showing possible nuanced differences among children with ASD, autistic features, or developmental delay (James et al., 2023). Specifically, when matching diagnostic subgroups on sex assigned at birth, age, and nonverbal IQ, James et al. (2023) found that fine motor skills were rated lower by caregivers, compared to direct assessment, in children with ASD, autistic features, and developmental delays and receptive language skills were rated lower, compared to direct assessment, in children with ASD and autistic features. Effects sizes of these differences were small to moderate.
On the other hand, there is less research on the agreement between parent report and direct assessment of cognitive abilities in children. A recent study found evidence of a strong ability of parents to recall specific IQ scores their children received in previous testing (∼ 75% agreement; Lee et al., 2023). Estimating cognitive level relative to age or grade (e.g., above age or grade level, at age or grade level, slightly below age or grade level, and significantly below age or grade level in most abilities) resulted in 65% agreement with standardized testing (Lee et al., 2023). However, parents’ judgements of their children’s ability in this study may have been informed by previous assessments. In another study (Chandler et al., 2016), researchers asked parents to estimate the functional age or developmental age of their children with either ASD or ADHD + ID. This was converted to a developmental quotient and compared to standardized IQ testing. The majority (74%) of parents in the ADHD + ID group were able to estimate their child’s intellectual functioning within one standard deviation (i.e., 15 IQ points) whereas only 58% of parents in the ASD group estimated within one standard deviation. However, the autistic parents’ estimate might have been more based on adaptive functioning rather than cognitive functioning.
Using structured and standardized parent-report measures may lead to a higher agreement. A study of two-year-olds (Saudino et al., 1998) found a parent-report measure of non-verbal cognitive abilities created by the researchers correlated at r = 0.49 with a direct measure of early cognitive abilities (Mental Scale of the Bayley Scales of Infant Development-II). However, our review of the current peer-reviewed literature did not result in finding other studies making such a comparison between parent-report and direct assessment of child cognitive abilities. So, while there is some recent emerging research on the agreement of information from parents and direct assessment of early cognitive ability in children, there is a current lack of studies evaluating standardized parent ratings of cognitive ability and the relationship with direct measures.
Aims of the Current Study
The primary aim of the current study was to evaluate whether a standardized parent interview can accurately identify children at risk for cognitive developmental delays. We specifically investigated retrospective clinical data from in-person evaluations which included the parent-reported Developmental Profile 4 (DP-4; Alpern, 2020) in comparison to the widely used direct assessment developmental measure, the Bayley Scales of Infant and Toddler Development, Fourth Edition (Bayley-4; Bayley & Aylward, 2019). Although the present study did not involve telehealth testing procedures, our goal was to find information on the validity of the DP-4, which can be easily administered either in person or through telehealth. The main hypotheses for the study were that the DP-4 would significantly correlate with the Bayley-4 Cognitive, show strong diagnostic accuracy compared to both a clinical diagnosis of global developmental delay (GDD) as well as a cutoff for significant developmental delay on the Bayley-4 Cognitive (Standard Score ≤ 70), and display acceptable sensitivity and specificity (i.e., sensitivity + specificity ≥ 1.5; Power et al., 2013).
Method
Measures
Bayley Scales of Infant Development, Fourth Edition (Bayley-4; Bayley & Aylward, 2019)
The Bayley-4 is a norm-referenced developmental assessment for young children. The Bayley-4 contains five scales: Cognitive, Language, Motor, Social-Emotional, and Adaptive Behavior. The evaluations for this study specifically included clinically administered Bayley-4 Cognitive scores. The Cognitive scale measures early cognitive processing skills, including item exploration and manipulation, sensorimotor development, memory, concept formation, and object relatedness. As reported in the manual (Bayley & Aylward, 2019), the Bayley-4 was highly correlated with the previous version of the Bayley (Bayley-III; corrected r = 0.70) and with FSIQ (r = 0.79) on the Wechsler Preschool and Primary Scale of Intelligence, 4th Edition (WPPSI-IV). The Bayley-4 scales also have high classification accuracy (82%) for identifying children with developmental delays. As reported in the Bayley-4 manual, test-retest reliability for the Cognitive scale across different ages ranges from r = 0.80 – 0.83 and internal consistency is high (average rxx = 0.95).
Developmental Profile, Fourth Edition (DP-4; Alpern, 2020)
The DP-4 is a norm-referenced assessment that provide standardized information about development functioning across five domains (Physical [37 items], Adaptive Behavior [41 items], Social-emotional [36 items], Cognitive [42 items], and Communication [34 items]) for individuals from birth through 21 years. There is also a General Development Score which is a composite of general developmental ability across the five domains. Ratings for items are based on a dichotomous format (i.e., Yes/No) of a particular skill being present. Higher scores indicate better developmental skills. The standardization sample was based on 2,259 cases with a demographic breakdown similar to the 2019 U.S. Census. There are four forms including Parent/Caregiver Interview, Parent/Caregiver Checklist, Teacher Checklist, and Clinician Rating. For the current study, only the Parent/Caregiver Interview Form was used. Internal consistency for the interview form is high (r = 0.80 – 0.98). Test-retest reliability (average of two weeks) of the DP-4 is generally fair to good (r = 0.65 – 0.84). There is also evidence of validity of the DP-4 supported by exploratory common factor analysis, correlations with the previously published version (5 domains: rs = 0.80 − 0.89; General Development: r = 0.93), and with another developmental measure (i.e., Developmental Assessment of Young Children, Second Edition; DAYC-2; domains: rs = 0.49 − 0.67; General Development: r = 0.64).
Procedure
Participants
Participant characteristics are found in Table 1. Participants in the study included 167 children (60 female, 35.9%), between 6 and 42 months old, referred for an in-person developmental evaluation between September 2021 through May 2023 at a large pediatric hospital in the Midwestern United States. The sample was racially diverse (56.3% White, 24.6% Black/African American, 10.2% Bi-racial/Multi-racial, 6.6% Asian, 2.4% Unknown). Most participants received a diagnosis of autism spectrum disorder (n = 122, 73.1%). A small number of children were evaluated after having non-accidental head trauma (n = 15, 9%). Level of autistic traits, as measured by the Childhood Autism Rating Scale, Second Edition (CARS-2; Schopler et al., 2010), was available for 80% (n = 133) of the sample. The CARS-2 is a clinician-rated measure of autistic traits based on both direct observation as well as information from caregivers. Higher scores reflect greater degree of autistic symptoms. Data were obtained through retrospective chart review of patients referred for an evaluation due to developmental delay and were administered both the DP-4 and Bayley-4 in person. The hospital’s Institutional Review Board (IRB) approved this retrospective study.
Clinical Evaluation Procedures
All children were evaluated by English-speaking clinicians through routine, standard of care developmental evaluations. Evaluations were completed by psychology providers who consisted of clinical psychologists with extensive experience in neurodevelopmental assessment or pre- or post-doctoral psychology trainees supervised by clinical psychologists and typically consisted of a single day of evaluation. Trained psychometricians (bachelor’s or master’s level technicians) under the supervision of clinical psychologists assisted in administration of the Bayley-4. All DP-4 interviews were completed by psychology providers. Interpreters were used for the DP-4 interview with caregivers who did not speak English (3 Somali, 3 Nepali, 2 Spanish, 1 French, 1 Hindi, and 1 Urdu). Ratings on the CARS-2 were based on both direct in-person observations of and interactions with the child as well as caregiver report from a clinical interview. Final clinical diagnoses were based on expert clinical judgement integrating data from standardized assessments, information from a clinical interview, and available collateral information (e.g., review of medical record).
Statistical Analysis
We used Pearson correlations to investigate bivariate relationships between DP-4 subscales, Bayley-4 Cognitive, and CARS-2 scores. Using multiple regression we predicted Bayley-4 Cognitive scores using DP-4 subscale scores. CARS-2 scores, age, and biological sex were also included as covariates. We then ran a regression model with all DP-4 subscale scores as predictors of Bayley-4 Cognitive scores to find the best overall predictor. Raw scores were used for correlation and regression analyses due to floor effects for standardized scores in our sample which would have resulted in a restriction of range in the analyses. The accuracy of the DP-4 Cognitive scale in identifying significant developmental delay as defined by clinical diagnosis of GDD. However, due to the retrospective nature of the data, we did not have DP-4 ratings that were independent of the final diagnostic decision. We also evaluated the accuracy of the DP-4 as measured by the Bayley-4 Cognitive scale (SS ≤ 70) as an independent measure given that the information from the DP-4 did not influence the Bayley-4 administration. We completed a receiver operating characteristic (ROC) analysis including calculating the area under the ROC curve (AUC). We also calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the DP-4 Cognitive scale (Standard Score). Data were analyzed using R v.4.3.0. Accuracy analyses were completed using the pROC package (Robin et al., 2011, 2023).
Results
Correlation and Regression Analyses
Bayley-4 Cognitive scores were significantly and positively correlated with all DP-4 subscales (see Table 2). Among the DP-4 subscales, the Cognitive score had the strongest correlation with the Bayley-4 Cognitive score (r = 0.70, 95% CI [0.60, 0.78]; see Fig. 1). This relationship continued to be significant after controlling for CARS-2 scores, age, and sex (β = 0.42, 95% CI [0.28, 0.56]). Age (β = 0.22, 95% CI [0.10, 0.33]) and CARS-2 scores (β = − 0.37, 95% CI [-0.50, − 0.24]) were also significant predictors in the multiple regression model. When all DP-4 subscales were included as predictors of Bayley-4 scores (i.e., accounting for shared variance between the scales), the DP-4 Cognitive scale remained the best overall predictor among the DP-4 subscores (β = 0.32, 95% CI [0.10, 0.53]). The DP-4 Physical score also predicted unique variance, but to a lesser degree (β = 0.17, 95% CI [0.01, 0.33]).
Classification Accuracy (ROC Analysis)
Sensitivity/specificity analyses are summarized in Table 3 (for GDD diagnosis) and Table 4 (for Bayley-4 Cognitive score). A similar optimal cut-off (based on Youden criteria) on the DP-4 Cognitive emerged for predicting both GDD diagnosis (SS = 70) and the Bayley-4 Cognitive score ≤ 70 (SS = 69). For predicting GDD diagnosis, the DP-4 had an AUC of 0.894 (95% CI [0.836, 0.952]) with a specificity of 0.88 and a sensitivity of 0.83 (see Fig. 2). The AUC for predicting Bayley-4 Cognitive ≤ 70 was 0.827 (95% CI [0.762, 0.893]) with a specificity of 0.75 and sensitivity of 0.80 (see Fig. 3). We compared the ROC curves of those with ASD to those without ASD using DeLong’s test and there were no significant differences for the GDD outcome [D(147.12) = -0.96, p = 0.34] or the Bayley-4 Cognitive outcome [D(80.31) = 0.41, p = 0.69].
Discussion
The current study aimed to evaluate the consistency between parent report and direct assessment of child development. Overall, our results suggest that parent report of child cognitive ability is significantly related to and reliably predictive of a clinical diagnosis of GDD and performance on a direct assessment measure of cognitive development. When investigating an optimal cut-off point on the DP-4, a Scaled Score of 70 or 69 optimized sensitivity while maintaining an acceptable level of specificity when using these measures in a clinical context with a high base rate of developmental delay. These values align with typical clinical cutoffs such as “significantly delayed”, as commonly defined in clinical contexts by 2 standard deviations below the mean.
In our sample, we found that age of the child and level of autistic traits were significant predictors of Bayley-4 Cognitive scores, above and beyond DP-4 Cognitive scores. Older children generally had higher cognitive functioning, which is expected given our use of raw scores. The negative relationship between autistic traits and developmental abilities has been seen in other work (e.g., Shan et al., 2022) and highlights possible patterns of global delays in children with more profound autism traits.
The DP-4 Cognitive scale had an acceptable level of predictive accuracy in identifying children with developmental delays. However, after accounting for overlap (shared variance) between DP-4 subscales, the Physical scale also predicted unique variance in Bayley-4 Cognitive scores in a multiple regression analysis. Although we did not anticipate this finding, previous research has shown a relationship between motor skills and cognitive functioning in toddlers (Martzog et al., 2019; Veldman et al., 2019). Further research should explore this finding to better understand the relationship between motor functioning and cognitive skills, especially in children with developmental delays.
Our findings of moderately strong agreement between parent-reported and direct assessment of early cognitive development add to evidence for agreement across other developmental domains (Miller et al., 2017; Nordahl-Hansen et al., 2014; Sachse & Suchodoletz, 2008). Overall, the data from this study offer evidence that the DP-4 can be accurate in detecting developmental delays in early cognitive ability and has the potential to become an acceptable choice in routine assessment. However, there is still a need to identify specific skills as targets for intervention, which may be most feasible with in-person assessments. Despite this evidence of the utility of parent-reported developmental measures, this is not to imply that these measures can or should unilaterally replace direct assessment. Combining both direct assessment and standardized parent-report measures can increase the predictive validity of the results (Saudino et al., 1998). This follows standard guidelines from the American Psychological Association which call for multi-informant and multi-method approaches for evaluation (American Psychological Association, 2020).
Limitations and Future Directions
Our results cannot be interpreted without identifying key limitations. While this sample included children from diverse cultural, ethnic, and language backgrounds, our sample size was not large enough to analyze potential differences within minority demographic groups. Additionally, given the young age and high prevalence of developmental delay in our sample, it is unclear how well these results will generalize to older children or those will less severe developmental delays. Further research with larger samples, particularly including a higher proportion of individuals from diverse backgrounds, is needed to confirm and expand our results. Because DP-4 scores were used among other test data in informing final diagnosis, the accuracy of DP-4 scores and diagnosis of GDD may have been artificially higher. However, we found similar results with the Bayley-4, which was independent of DP-4 ratings. While we demonstrated strong agreement between the DP-4 and Bayley-4 Cognitive scores, future research should explore agreement between the DP-4 and other cognitive measures, including IQ tests, to see if the same agreement exists at later stages of development.
Implications
To our knowledge, this is one of few studies investigating agreement between parent report and direct assessment of child cognitive ability in a sample of children being evaluated for developmental delay. Our results suggest that parents are accurate reporters of their young child’s cognitive skills, particularly on a standardized parent interview. Additionally, degree of autism severity, age, and biological sex did not appear to impact the observed findings. While these findings demonstrate that parents are a reliable source for measuring early cognitive ability, we stress the continued need for multimodal and multi-informant evaluations when assessing development in early childhood.
References
Alfuraydan, M., Croxall, J., Hurt, L., Kerr, M., & Brophy, S. (2020). Use of telehealth for facilitating the diagnostic assessment of Autism Spectrum disorder (ASD): A scoping review. PLOS ONE, 15(7), e0236415. https://doi.org/10.1371/journal.pone.0236415
Alpern, G. D. (2020). Developmental Profile 4 (DP-4) [Manual]. Western Psychological Services.
American Psychological Association (2020). APA Guidelines for Psychological Assessment and Evaluation. APA Task Force on Psychological Assessment and Evaluation Guidelines. https://www.apa.org/about/policy/guidelines-psychological-assessment-evaluation.pdf
Aylward, B. S., Gal-Szabo, D. E., & Taraman, S. (2021). Racial, ethnic, and Sociodemographic Disparities in diagnosis of children with Autism Spectrum Disorder. Journal of Developmental and Behavioral Pediatrics, 42(8), 682. https://doi.org/10.1097/DBP.0000000000000996
Bayley, N., & Aylward, G. P. (2019). Bayley scales of infant and toddler development: Fourth edition. Pearson.
Bennetts, S. K., Mensah, F. K., Westrupp, E. M., Hackworth, N. J., & Reilly, S. (2016). The Agreement between Parent-Reported and Directly Measured Child Language and Parenting Behaviors. Frontiers in Psychology, 7. https://www.frontiersin.org/articles/https://doi.org/10.3389/fpsyg.2016.01710
Chandler, S., Howlin, P., Simonoff, E., Kennedy, J., & Baird, G. (2016). Comparison of parental estimate of developmental age with measured IQ in children with neurodevelopmental disorders. Child: Care Health and Development, 42(4), 486–493. https://doi.org/10.1111/cch.12346
Crane, L., Chester, J. W., Goddard, L., Henry, L. A., & Hill, E. (2016). Experiences of autism diagnosis: A survey of over 1000 parents in the United Kingdom. Autism, 20(2), 153–162. https://doi.org/10.1177/1362361315573636
Dawson, G. (2008). Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder. Development and Psychopathology, 20(3), 775–803. https://doi.org/10.1017/S0954579408000370
Luttikhuizen dos Santos, E. S., de Kieviet, J. F., Königs, M., van Elburg, R. M., & Oosterlaan, J. (2013). Predictive value of the Bayley scales of Infant Development on development of very preterm/very low birth weight children: A meta-analysis. Early Human Development, 89(7), 487–496. https://doi.org/10.1016/j.earlhumdev.2013.03.008
Ebert, K. D. (2017). Convergence between parent report and direct assessment of language and attention in culturally and linguistically diverse children. PLOS ONE, 12(7), e0180598. https://doi.org/10.1371/journal.pone.0180598
Hyman, S. L., Levy, S. E., Myers, S. M., & Council on Children with Disabilities, S. on D. and B. P. (2020). Identification, evaluation, and management of children with autism spectrum disorder. Pediatrics, 145(1). https://doi.org/10.1542/peds.2019-3447
James, S., Hallur, S., Anbar, J., Matthews, N., Pierce, K., & Smith, C. J. (2023). Consistency between parent report and direct assessment of development in toddlers with autism spectrum disorder and other delays: Does sex assigned at birth matter? Autism Research, 16(6), 1174–1184. https://doi.org/10.1002/aur.2927
Klein-Radukic, S., & Zmyj, N. (2023). The predictive value of the cognitive scale of the Bayley scales of Infant and Toddler Development-III. Cognitive Development, 65, 101291. https://doi.org/10.1016/j.cogdev.2022.101291
Lee, C. M., Snyder, G., Carpenter, L., Harris, L. A., Kanne, J., Taylor, S., Sarver, C. M., Stephenson, D. E., Shulman, K. G., Wodka, L. H., Esler, E. L., & SPARK Consortium. (2023). Agreement of parent-reported cognitive level with standardized measures among children with autism spectrum disorder. Autism Research, 1–15. https://doi.org/10.1002/aur.2934. & On behalf of the.
Lipkin, P. H., Macias, M. M., & COUNCIL ON CHILDREN WITH DISABILITIES, SECTION ON DEVELOPMENTAL AND BEHAVIORAL PEDIATRICS. (2020). Promoting Optimal Development: Identifying infants and Young Children with Developmental disorders through Developmental Surveillance and Screening. Pediatrics, 145(1), e20193449. https://doi.org/10.1542/peds.2019-3449
Liu, M., & Ma, Z. (2022). A systematic review of telehealth screening, assessment, and diagnosis of autism spectrum disorder. Child and Adolescent Psychiatry and Mental Health, 16(1), 79. https://doi.org/10.1186/s13034-022-00514-6
Liu, B. M., Paskov, K., Kent, J., McNealis, M., Sutaria, S., Dods, O., Harjadi, C., Stockham, N., Ostrovsky, A., & Wall, D. P. (2023). Racial and ethnic disparities in Geographic Access to Autism resources across the US. JAMA Network Open, 6(1), e2251182. https://doi.org/10.1001/jamanetworkopen.2022.51182
Martzog, P., Stoeger, H., & Suggate, S. (2019). Relations between Preschool Children’s Fine Motor skills and General Cognitive abilities. Journal of Cognition and Development, 20(4), 443–465. https://doi.org/10.1080/15248372.2019.1607862
Miller, L. E., Perkins, K. A., Dai, Y. G., & Fein, D. A. (2017). Comparison of parent Report and Direct Assessment of Child Skills in toddlers. Research in Autism Spectrum Disorders, 41–42, 57–65. https://doi.org/10.1016/j.rasd.2017.08.002
Mullen, E. M. (1995). Mullen scales of early learning. AGS.
Nordahl-Hansen, A., Kaale, A., & Ulvund, S. E. (2014). Language assessment in children with autism spectrum disorder: Concurrent validity between report-based assessments and direct tests. Research in Autism Spectrum Disorders, 8(9), 1100–1106. https://doi.org/10.1016/j.rasd.2014.05.017
Orinstein, A. J., Helt, M., Troyb, E., Tyson, K. E., Barton, M. L., Eigsti, I. M., Naigles, L., & Fein, D. A. (2014). Intervention for optimal outcome in children and adolescents with a history of Autism. Journal of Developmental & Behavioral Pediatrics, 35(4), 247–256. https://doi.org/10.1097/DBP.0000000000000037
Pfeil, J. N., Rados, D. V., Roman, R., Katz, N., Nunes, L. N., Vigo, Á., & Harzheim, E. (2023). A telemedicine strategy to reduce waiting lists and time to specialist care: A retrospective cohort study. Journal of Telemedicine and Telecare, 29(1), 10–17. https://doi.org/10.1177/1357633X20963935
Power, M., Fell, G., & Wright, M. (2013). Principles for high-quality, high-value testing. Evidence-Based Medicine, 18(1), 5–10. https://doi.org/10.1136/eb-2012-100645
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., Müller, M., code), Fast, S. S., Multiclass), D., & Hand, M. D.T.,CI) (Eds.). Z. B. (DeLong paired test. (2023). pROC: Display and Analyze ROC Curves (1.18.4). https://cran.r-project.org/web/packages/pROC/index.html
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., & Müller, M. (2011). pROC: An open-source package for R and S + to analyze and compare ROC curves. Bmc Bioinformatics, 12(1), 77. https://doi.org/10.1186/1471-2105-12-77
Rogers, S. J., Estes, A., Lord, C., Vismara, L., Winter, J., Fitzpatrick, A., Guo, M., & Dawson, G. (2012). Effects of a brief early start Denver Model (ESDM)–Based parent intervention on toddlers at risk for Autism Spectrum disorders: A Randomized Controlled Trial. Journal of the American Academy of Child & Adolescent Psychiatry, 51(10), 1052–1065. https://doi.org/10.1016/j.jaac.2012.08.003
Roid, G. H. (2003). Stanford-Binet Intelligence scales, Fifth Edition (SB:V). Riverside Publishing.
Sachse, S., & Suchodoletz, W. V. (2008). Early Identification of Language Delay by Direct Language Assessment or parent report? Journal of Developmental & Behavioral Pediatrics, 29(1), 34–41. https://doi.org/10.1097/DBP.0b013e318146902a
Saudino, K. J., Dale, P. S., Oliver, B., Petrill, S. A., Richardson, V., Rutter, M., Simonoff, E., Stevenson, J., & Plomin, R. (1998). The validity of parent-based assessment of the cognitive abilities of 2-year-olds. British Journal of Developmental Psychology, 16(3), 349–362. https://doi.org/10.1111/j.2044-835X.1998.tb00757.x
Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood Autism Rating Scale, Second Edition. Western Psychological Services.
Shan, L., Feng, J. Y., Wang, T. T., Xu, Z. D., & Jia, F. Y. (2022). Prevalence and Developmental Profiles of Autism Spectrum Disorders in Children With Global Developmental Delay. Frontiers in Psychiatry, 12. https://www.frontiersin.org/articles/https://doi.org/10.3389/fpsyt.2021.794238
Stainbrook, J. A., Weitlauf, A. S., Juárez, A. P., Taylor, J. L., Hine, J., Broderick, N., Nicholson, A., & Warren, Z. (2019). Measuring the service system impact of a novel telediagnostic service program for young children with autism spectrum disorder. Autism, 23(4), 1051–1056. https://doi.org/10.1177/1362361318787797
Sumarsono, A., Case, M., Kassa, S., & Moran, B. (2023). Telehealth as a Tool to improve Access and reduce No-Show rates in a large Safety-Net Population in the USA. Journal of Urban Health, 100(2), 398–407. https://doi.org/10.1007/s11524-023-00721-2
Thomas, K. C., Ellis, A. R., McLaurin, C., Daniels, J., & Morrissey, J. P. (2007). Access to Care for Autism-Related services. Journal of Autism and Developmental Disorders, 37(10), 1902–1912. https://doi.org/10.1007/s10803-006-0323-7
Valentine, A. Z., Hall, S. S., Young, E., Brown, B. J., Groom, M. J., Hollis, C., & Hall, C. L. (2021). Implementation of Telehealth Services to Assess, Monitor, and treat Neurodevelopmental disorders: Systematic review. Journal of Medical Internet Research, 23(1), e22619. https://doi.org/10.2196/22619
Veldman, S. L. C., Santos, R., Jones, R. A., Sousa-Sá, E., & Okely, A. D. (2019). Associations between gross motor skills and cognitive development in toddlers. Early Human Development, 132, 39–44. https://doi.org/10.1016/j.earlhumdev.2019.04.005
Acknowledgements
We gratefully acknowledge all the families who made this work possible.
Funding
No funding was received for conducting this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest Disclosures
The authors have no relevant financial or non-financial interests to disclose.
Ethics Approval
This research study was conducted retrospectively from data obtained for clinical purposes. The Human Investigation Committee (IRB) of Nationwide Children’s Hospital approved this study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Stephenson, K.G., Vargo, K.C., Cacciato, N.M. et al. Developmental Assessment in Children at Higher Likelihood for Developmental Delays - Comparison of Parent Report and Direct Assessment. J Autism Dev Disord (2024). https://doi.org/10.1007/s10803-024-06420-4
Accepted:
Published:
DOI: https://doi.org/10.1007/s10803-024-06420-4