Abstract
Due to lack of previous studies, we aimed at evaluating the use of the Five to Fifteen (FTF) questionnaire in adults with neurodevelopmental disorders (NDD) and in controls without NDD. The NDD group consisted of adults with autism spectrum disorder ASD (n = 183) or attention-deficit/hyperactivity disorder (ADHD) (n = 174) without intellectual disability, recruited from a tertiary outpatient clinic. A web survey was used to collect data from general population adult control group without NDD (n = 738). The participants were retrospectively rated by their parents regarding childhood symptoms, using five to fifteen-collateral informant questionnaire (FTF-CIQ). Adults with NDD had higher FTF-CIQ domain and subdomain scores than controls, and displayed similar test profiles as children with corresponding diagnosis in previous studies. Based on the FTF-CIQ domain scores, 84.2% of the study participants (93% of the controls; 64% of the adults with NDD) were correctly classified in a logistic regression analysis. Likewise, Receiver Operating Characteristic (ROC) curve analysis on FTF-CIQ total sum score indicated that a cut-off value of 20.50 correctly classified 90% of the controls and 67% of the clinical cases, whilst a cut-off value of 30.50 correctly classified 84% of the controls and 77% of the clinical cases. The factor analysis revealed three underlying components: learning difficulties, cognitive and executive functions; social skills and emotional/behavioural symptoms; as well as motor and perceptual skills. Whilst not designed as a diagnostic instrument, the FTF-CIQ may be useful for providing information on childhood symptoms and associated difficulties in individuals assessed for NDD as adults.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The neurodevelopmental disorders (NDD:s) autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder (ADHD) are amongst the most common and fastest growing diagnostic groups in psychiatry. The increase in NDD diagnoses requires a corresponding increase in efforts and resources from clinical psychiatry to meet the needs for assessment and treatment of the patients.
A decade ago, the worldwide prevalence of ASD was estimated to about 1% [1], and for ADHD, 5–6% in children [2, 3] and 2.5–3.4% in adults [4, 5]. In the United States (US), biannual reports from the Centers for Disease Control and Prevention (CDC) have found an increase in ASD from 0.6% in 2002 to 1.69% in 2014 in 8-year-old children using a two-step surveillance system with multiple sources of information [6]. In a study of parent-reported diagnosis of ASD amongst school children, the prevalence had increased from 1.16% in 2007 to 2% in 2011–12 [7]. In a total population study of a community in South Korea, an ASD prevalence of 2.64% amongst 7- to 12-year-old children was found using a multi-informant screening procedure followed by a standardised clinical assessment [8]. Correspondingly, 2.5% of teenagers in the Stockholm County were reported to have a clinical diagnosis of ASD [9]. For ADHD, the age-specific prevalence in Scandinavia has increased 1.83‐fold in Finland, 2.95‐fold in Denmark and 7.21‐fold in Sweden during the period 1990–2007 according to a population-based study [10]. In Sweden, the 1-year prevalence of clinical ADHD diagnosis increased more than fourfold, and the annual prevalence doubled, between the years 2006 and 2011 [11]. In the US, population-based surveys have found that the estimated prevalence of diagnosed ADHD in children and adolescents increased from 6.1% in 1997–1998 to 10.2% in 2015–2016 [12]. In Taiwan, a national insurance record study indicated a 27-fold 1-year prevalence of clinical ADHD diagnosis from 1996–2005 and a 17-fold increase in incidence [13].
The rapid increase in prevalence of NDD:s has raised the question whether it reflects a true increase in prevalence, a capture of previously undiagnosed patients, or overdiagnosis. A number of factors contributing to the increase have been discussed including broadening of diagnostic criteria, increased awareness both amongst the public and amongst professionals, diagnostic substitution and access to healthcare. A comprehensive meta-analysis of 135 worldwide studies conducted over the last 3 decades found no evidence of a true increase of ADHD [14]. In addition, epidemiological studies of the underlying ASD and ADHD phenotypes found no increase over time in ASD- and ADHD-like traits on the extreme end during a 10-year period when the prevalence of ASD and ADHD diagnosis registered in the healthcare system increased several folds [15, 16]. Further support for lack of phenotypic increase of ASD comes from a familial study showing no increase in relative recurrence risks in family members regardless of increase in ASD diagnosis in the population [17]. Taken together, these results demonstrating stability in the ASD and ADHD phenotypes suggest that the increased prevalence in clinical diagnosis of ASD is more likely to reflect changes in environmental factors such as diagnostic practices, better access to medical services and/or current overdiagnosis, rather than a true increase in prevalence of NDD:s. Therefore, in clinical context, scientifically evaluated methods are of great importance for rigorous assessment and appropriate diagnostic processes.
Although the global trend is increased NDD prevalence, there are large national as well as regional differences suggesting underdiagnosis may still pose a problem. In the US, the ASD prevalence in children is 3% in New Jersey but only 1.3% in Arkansas. In Sweden, the number of children receiving pharmacological treatment for ADHD varies regionally between 2 and 14%. Clearly, these differences reflect a number of different factors including demographic variables, access to healthcare and awareness of NDD:s in society, and also differences in clinical practice in assessment of NDD:s. A recent meta-analysis of 15 Italian prevalence studies with varying rates of ADHD found that studies based on symptom reported a rate of 5.9% whereas those based on full clinical assessment of ADHD reported only 1.9% in paediatric populations [18], illustrating the profound effect of different diagnostic practices. A correct diagnosis, including assessment of associated difficulties and potential co-morbidity, is crucial for choice of interventions, and underdiagnosis poses as severe a problem as overdiagnosis in terms of lack of access to adequate treatment. Hence, the importance of comprehensive clinical assessment of NDD:s using validated instruments cannot be overstressed.
However, ASD and ADHD are clinically and aetiologically heterogeneous conditions, associated with, but not limited to, a variety of symptoms that can also be observed in other conditions. Some of the core symptoms such as concentration difficulties, social interaction difficulties and repetitive behaviour overlap partially with other conditions. Co-morbidity with depression, anxiety and OCD in adults with NDD:s has been estimated to over 50%, and overlap between different NDD:s is also common [19,20,21,22,23,24]. Thus, diagnosis of NDD:s requires a broader clinical assessment including developmental history and focusing not only at core symptoms [24,25,26].
In clinical settings, diagnosing NDD:s in the growing group of adult patients with IQ in the average range seeking assessment proves a challenge where emphasis on retrospective identification of neurodevelopmental symptoms is necessary since the vast majority of patients diagnosed with NDD:s in adulthood have a history of symptoms in childhood. However, in a subgroup of individuals, symptoms may have been less overt in childhood, and it is also common that adults seeking evaluation describe typical symptoms that are not currently included in the formal diagnostic DSM/ICD criteria [27] (e.g. executive dysfunctions [28], underperforming). Further, the number of symptom criteria fulfilled is not in concordance with the level of functional impairment experienced by the patients [29, 30]. Narrow assessments focusing on the criteria for a specific diagnosis without careful consideration of associated difficulties, co-morbidities and differential diagnoses may contribute to both over- and underdiagnosis. Hence, it is important to identify not only presence of formal ASD and ADHD core symptoms but also associated symptoms that belong to the developmental trajectories of ASD and ADHD.
In clinical assessment of NDD:s, self-rating questionnaires are commonly used for screening of symptoms. A number of questionnaires for self- and parent assessment of NDD symptoms exist, but few of these instruments are adapted for retrospective childhood assessment of adults. The Wender Utah Rating Scale (WURS) [31] is a questionnaire for adults’ self-rating of childhood symptoms of ADHD and the Social Communication Questionnaire (SCQ) [32] includes retrospective parent-rating of ASD symptoms, but none of these inventories systematically probe into other diagnoses. For a broad screening of NDD and psychiatric symptoms, the Autism–Tics, ADHD and other Comorbidities inventory (A-TAC) have been developed [33, 34]. Originally based on a screening questionnaire, A-TAC has been validated in children and adolescents cross-sectionally and longitudinally in population and community samples [26, 33, 34] administered as a telephone interview with parents. It has however not been validated for retrospective parent-rating of childhood symptoms in adults. A-TAC was developed using items from another instrument, the Five to Fifteen (FTF) questionnaire (freely available for download at www.5-15.org). The FTF was originally developed as a parent-rating questionnaire for assessment of ADHD, and its common co-morbid conditions and associated problems in children and adolescents aged 5–15 years [35]. It was constructed from a combination of clinical experience and symptom criteria in diagnostic manuals, and the factor structure was later examined in different child populations yielding somewhat different factor solutions [36,37,38]. The hitherto largest study of FTF included adolescents up to 17 years thus suggesting that FTF can be used for assessment in individuals older than 15 years [38]. However, studies examining retrospective use of FTF in older adolescents or adults still are lacking. The aim of the present study was to investigate the usefulness of the FTF questionnaire in retrospective parental assessment of childhood symptoms in the context of clinical assessment of NDD:s in adults; henceforth called five to fifteen-collateral informant questionnaire (FTF-CIQ). First, we examined the face validity of the FTF-CIQ scores obtained in adulthood by comparing the profiles of an adult clinical group and adult control group, to the profiles of comparable groups assessed during childhood and reported previously [35, 39]. Second, the questionnaire’s ability to discriminate between adult clinical and non-clinical groups was analysed. Finally, we extracted underlying factors of the FTF-CIQ in an adult population.
Methods
The study was approved by the Regional Ethics Committee in Stockholm, Sweden, and has therefore been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.
The five to fifteen-collateral informant questionnaire (FTF-CIQ)
FTF-CIQ consists of the same 181 items (scored 0 = “Does not apply”; 1 = “Applies sometimes/to some extent”; 2 = “Definitely applies”) as the original FTF, divided in eight domains covering motor skills, executive functions, perception, memory, language, learning competencies, social skills and emotional/behavioural problems. The eight domains can be further divided into 22 subdomains, e.g. motor skills include subdomains gross and fine motor skills; executive functions include subdomains attention, hyperactivity–impulsivity, hypoactivity, as well as planning/organising, etc. (see Supplementary Table A for domains, subdomains and representative items).
Studies of the factor structure (parent- or teacher-reported profiles in children) have been conducted on the level of the 22 subdomains and have yielded different results; Bohlin and Janols found a two-factor solution of learning difficulties and socio-emotional problems [36], whereas Beltran-Ortiz et al. found one broad general development factor and three additional factors of (1) socio-emotional problems/control, (2) cognition/motor function/language, and (3) communication/school learning [37]. Bruce et al. reported six factors in a sample of children with ADHD: (1) cognitive skills, (2) motor/perception, (3) emotion/socialisation/behaviour, (4) attention, (5) literacy skills, and (6) activity control. The latter factor solution was similar to that in the hitherto largest study of FTF in children by Lambek and Trillingsgaard [38]. Other psychometric properties of the FTF domain and subdomain scores have been demonstrated in several studies finding acceptable to good internal consistency, test–retest reliability, and interrater agreement [35] and significant associations with relevant scores from other questionnaires [36] and performance-based measures [40, 41].
Participants
Adults with neurodevelopmental disorders (clinical sample)
The clinical sample was consecutively recruited from a tertiary clinic for assessment and treatment of adults with NDD:s in Stockholm, Sweden, during the years 2001–2013. The diagnostic assessment at the clinic was based on multiple sources of information: a clinical interview based on the DSM-IV criteria (American Psychiatric Association, 1994) was conducted in all cases. The patients also completed standardised self-rating questionnaires such as the Wender Utah Rating Scale, WURS [31] for the assessment of childhood ADHD symptoms. Collateral information was gathered by interviewing the participants’ significant others/family members to obtain a more complete diagnostic history of each individual. When available, additional information was obtained from records from child- and adolescent psychiatry, school health services, as well as adult psychiatry. The assessment also included neuropsychological testing with WAIS-R [42] or WAIS-III [43] and, in most cases, also other standardised tests, such as a continuous performance test [44, 45]. The diagnosis of ADHD or ASD was established after reaching consensus between the managing psychiatrist and clinical psychologist, both of whom had solid professional experience in the field of developmental disorders.
The instrument used in the assessment process differed somewhat during the time period for the study, depending on, e.g. availability of Swedish translations. However, a majority of patients (63% of individuals with ASD and 60% of individuals with ADHD) had a FTF-CIQ completed by a relative who knew them as a child. The FTF-CIQ was completed in almost all cases by the patients’ parents (in approximately two-thirds of cases mothers, although the sex of the parent was not recorded systematically).
The final clinical study group thus consisted of 174 adults with ADHD and 183 adults with ASD. In cases having both diagnoses, ASD was considered as the primary diagnosis and the individual with both ASD and ADHD (i.e. one-third of the ASD group) was thus classified to the ASD group. The demographic data for the study participants are summarised in Table 1.
The control group
The control group was recruited using an invitation e-mail letter distributed to a web panel of adults in Sweden who had volunteered to participate in web surveys via a survey company (Bisnode/PFM). To increase the likelihood that the recipients were parents to at least one adult child, 25% of all e-mails were sent to individuals aged 45–50 years and 75% of e-mails were sent to individuals aged > 50 years. Only responders, who answered that they had at least one child > 18 years of age and with no NDD diagnoses, were eligible to fill out the FTF-CIQ. To reflect the distribution between mothers and fathers completing the FTF in both previous studies on children [38] and in the clinical sample (adults with NDD) in the current study, the gender distribution in our recipients was 75% females and 25% males. The final gender distribution amongst our control respondents was 23% fathers and 77% mothers. For other demographic data, see Table 1. To facilitate the retrospective completion of the FTF-CIQ, and to match to the instructions given to the parents of the clinical cases, a short text introduced the FTF-CIQ for the control group. The participants were instructed to “try to recall how their (now adult) offspring was when she/he was at school age”. Thus, the referred age range was more narrow than the original age range of the FTF (5–15 years), since the concept of “school age” in Swedish is generally interpreted as approximately 7–12 years.
Statistical analyses
Missing data in single items in the clinical group were handled by calculating the domain and subdomain mean scores based on existing data. However, if there were more than single items missing in the subdomains, the mean scores were not calculated and these individuals were excluded either list-wise or pairwise depending on the analyses (see below).
Eighteen out of the 737 (2.44%) questionnaires completed by the parents from the control group were excluded due to age of the offspring (< 18 years). Due to the technical quality of the questionnaire (forced completion of each item before proceeding to the next one), there was only 0.1% missing data amongst the remaining/included 719 questionnaires.
To explore the face validity of using the FTF in the context of retrospective assessment of adults (i.e. the FTF-CIQ), the 5–15 profiles were drawn for the general population controls (n = 719), individuals with ADHD diagnosed as adults (n = 174) and individuals with ASD diagnosed as adults (n = 183), as well as comparable groups assessed during childhood reported in previous studies (controls n = 854; ADHD n = 57 and ASD n = 34) [39]. As a first proof of parents’ ability to rate childhood symptoms retrospectively for their adult offspring (face validity), the profiles were expected to resemble those obtained for children in previous studies.
The descriptive statistics of the FTF-CIQ domains and subdomains were expressed as mean values and standard deviations, and the between-group comparisons (control group; ADHD group; ASD group) were calculated using one-way ANOVA with post-hoc comparisons.
To analyse the classification ability of the FTF-CIQ, we conducted a logistic regression analysis and a receiver operating characteristics (ROC) curve analysis [46]. For these purposes, we combined the clinical NDD groups since the FTF was not designed for diagnostic assessment and is not expected to differ between different clinical groups, but may be expected to categorise clinical cases from non-clinical cases.
For the direct logistic regression analysis, the FTF-CIQ subscales (Motor skills, Executive functions, Perception, Memory, Language, Learning, Social skills, Emotional and behavioural problems) were entered simultaneously and the questionnaires’ ability to categorise the controls (specificity) and clinical cases (sensitivity; the clinical groups were combined) was calculated. The clinical cases missing data for one or more subscales (n = 26, i.e. 7.28%) were excluded list-wise. The examination of the residuals indicated that in total 7 cases were somewhat outside of the recommended limits (± 2.5), i.e. considered as outliers. However, since all cases had DFBeta values < 1 (in all subscales), and both leverage statistics and Cook’s distance indicated absence of any influential cases having an effect on the model, the data were deemed to be adequate for the analysis. Moreover, the Hosmer and Lemeshow Test indicated a good fit of the data in the model [χ2 (8) = 36.97, p < 0.001]. For the ROC curve, the total sum score of the FTF-CIQ was entered as the test variable whilst the dichotomous categorisation (clinical i.e. NDD/control) was used as the state variable. The area under the curve (AUC) was calculated with 95% confidence intervals.
To study the underlying factor structure of the FTF-CIQ (i.e. in the context of retrospective assessment of adults with NDD), we conducted a principal component analysis on the 22 FTF-CIQ subdomains for the sample of 719 controls. Missing data were handled by pairwise exclusion. Based on previous literature and the theoretical background, the factors were expected to correlate with each other why an oblimin rotation method with Kaiser Normalisation was chosen [46]. Both the Kaiser–Meyer–Olkin measure value (0.96) and highly significant Bartlett’s test (p < 0.001) indicated excellent sampling adequacy. Finally, the three groups’ (control, ADHD, ASD) sum scores were calculated for the obtained factors, and between-group comparisons were conducted using ANOVA. Effect sizes were expressed as partial eta squared (\(\eta_{{\text{p}}}^{2}\)) and interpreted as 0.01 = small effect size, 0.06 = moderate effect size, and 0.14 = large effect size [47].
Results
Descriptive statistics of adult patient and control groups and comparison to previous studies on children
Sample characteristics for the three groups (control group, ASD and ADHD, respectively) are depicted in Table 1. There were no between-group differences regarding age at assessment/when the FTF-CIQ was completed by parents, whilst the gender distribution differed slightly: the ASD group had proportionally more males compared to the controls or to the ADHD group. Psychiatric co-morbidity was common in both clinical groups. A clear majority of the clinical cases had completed IQ assessment as part of the clinical assessment procedure and both clinical groups had full scale IQ (FSIQ) within average range, well corresponding to population norm of M = 100, SD = 15.
Figure 1 shows the FTF-CIQ profiles for the adult groups included in current study compared to corresponding groups of FTF profiles regarding children from previous studies. The retrospective profiles for adults were similar to children’s profiles although the mean values were consequently somewhat lower in all three adult groups (controls, ADHD, ASD) compared to corresponding profiles in children.
Table 2 depicts the descriptive statistics and group comparisons in the FTF-CIQ domains and subdomains. Both NDD groups were reported to have more childhood symptoms in all domains compared to the controls, whilst the differences between the two NDD groups (ADHD versus ASD) were small. In one domain ADHD group was reported to have more difficulties than the ASD group (executive functions), whilst ASD group was reported to have more difficulties in three domains (motor skills, perception, and language). In four domains, there were no significant differences between the two NDD groups (memory, comprehension, learning, emotional and behavioural problems).
Classification accuracy of controls and clinical cases
After exclusion of the cases missing one or more FTF-CIQ domain scores, the logistic regression analysis included n = 719 controls and n = 331 individuals with ADHD and/or ASD (the clinical group). The model included the eight FTF-CIQ domain as predictors of group status, and the test of the full model was statistically significant χ2 (8, n = 1050) = 484.35, p < 0.001, indicating that the model reliably distinguished between clinical and control cases. The variance in the group status accounted for by the model varied between small (Cox and Snell R2 = 0.37) and medium (Nagelkerke R2 = 0.52) depending on the used statistics.
Classification was excellent regarding specificity but poorer regarding sensitivity; 93% of the controls and 65% of clinical cases were correctly classified, consequential overall classification percentage being 83% (Table 3). Table 4 shows the Wald statistics, and the exponentiations of the beta coefficients (i.e. odds ratios) with 95% confidence intervals. The Executive functions subscale and the Social skills subscale contributed most to the logistic regression model; one unit change in the EF subscale resulted in 4.49 higher likelihood of being categorised in the clinical group whilst the corresponding odds ratio (exp Beta) for Social skills subscale was 5.65. The Memory and Language domains did not contribute to the regression model at the level of statistical significance or trend.
The ROC analysis (Fig. 2) using the FTF-CIQ sum score (sum of all item scores) also indicated a good classification ability. The AUC was 0.88 (95% CI 0.86–0.90), p < 0.001. A cut-off value of 20.50 indicated that 90% of the controls and 67% of the clinical cases (ADHD and ASD combined) were correctly classified, whilst a cut-off value of 30.50 classified 84% of the controls and 77% of the clinical cases.
Factor analysis
Three factors with eigenvalues > 1 were extracted from the principal component analysis including the data from the controls (n = 719). Table 5 depicts the factor loadings and factor correlations. Before rotation, the model explained 68.37% of the total variance (since we conducted an oblique rotation, the components were allowed to covary and thus the sums of squared loadings cannot be added to obtain a total variance after the rotation). The three factors had medium strong correlations with each other, further supporting the choice of oblique rather than orthogonal rotation method.
The factor loadings < 0.40 were suppressed and the inspection of the pattern matrix showed strong factor loading (all but one > 0.50) for all subdomains and only one subdomain loading on two factors: expressive language skills had a factor loading > 0.45 for both components 1 and 3. This may be explained by the items tapping both cognitive aspects of expressive language such as finding words and expressing him/herself with grammatically correct sentences (that may load on factor 1) and motor aspects of expressive language such as speech sounds and pronunciation of difficult words (probably loading on factor 3).
In summary, the factors were labelled (1) learning difficulties, cognitive and executive functions; (2) social skills and emotional/behavioural symptoms; (3) motor and perceptual skills. The comparison of the three groups’ (control, ADHD, ASD) sum scores on the three obtained factors, as well as between-group comparisons and ANOVA statistics are depicted in Table 6. The effect of the diagnostic status was large in all three factors. However, the large difference was between controls compared to both groups with NDD, whilst the results were more overlapping between the ADHD and the ASD groups, as indicated by the mean values and the standard deviations (Table 6).
Discussion
In this study of retrospective assessment of childhood symptoms of NDD:s in adults, we found that the FTF-CIQ profiles for the adult ASD, ADHD and general population control groups had high similarity to the profiles for the corresponding FTF profiles of children in prior studies. This result indicates good face validity of the FTF-CIQ for retrospective parent-rating of childhood NDD symptoms in adults.
The retrospective mean values for our three adult groups were consistently lower compared to the corresponding values for children, which is expected as individuals diagnosed with NDD:s in adult age differ in their cognitive and symptom profiles from those diagnosed in childhood [48]. The phenotypic manifestation of ASD and ADHD varies throughout development and into adulthood, and it is not known to what extent these variations represent an age-related change in the phenotype, or capture phenotypical differences in patient subgroups [49, 50]. ASD and ADHD have heterogeneous geno- and phenotypes with subgroups with different developmental trajectories existing in both diagnostic groups. Individuals receiving a first diagnosis of ASD or ADHD in adult age typically have intellectual abilities in the normal range, facilitating their ability to “camouflage” their difficulties and develop partially compensatory strategies “masking” symptoms [50, 51]. Compared to early diagnosed individuals, they may differ also with regard to quality and quantity of symptom presentation, access to assessment services and level of support from social environments.
The factor structure of FTF has been previously investigated only regarding children and adolescents. A study of children from a Swedish population register (n = 1500) found a two-factor solution of learning difficulties and socio-emotional problems [36], whereas a population-based study of children in Chile (n = 322) resulted in one broad general development factor and three additional factors representing socio-emotional problems/control, cognition/motor function/language, and communication/school learning [37]. In a Swedish clinical sample of children with ADHD (n = 76), a similar factor structure was identified as in a study of Danish children and adolescents rated by both parents (n = 4258) and teachers (n = 1298); a factor solution of six domains including cognitive skills, motor/perception, emotion/socialisation/behaviour, attention, literacy skills and activity control [38]. In our study, a three-factor solution was revealed consisting of (1) learning difficulties/cognitive and executive functions, (2) social skills/emotional/behavioural symptoms, and (3) motor and perceptual skills. The first two factors comprise subdomains corresponding well to core symptoms and associated problems of ADHD and ASD, respectively. The third factor, motor and perceptual skills, is related to symptoms that have long been under-researched. For ASD, hyper- and hyposensitivity to sensory stimuli were included in the diagnostic criteria only in DSM-5 [52]. Sensory sensitivity has a high prevalence both amongst individuals with ASD and individuals with autistic traits [53]. Many individuals with ASD perceive perceptual symptoms as more impairing than the socio-communicative symptoms [54], and sensory sensitivity have also been associated with sleep disturbances [55]. Anomalies in sensory perception are however not unique to ASD; in ADHD atypical sensory profiles and hypersensitivity are common [56, 57], also irrespective of co-occurring autistic symptoms [58]. Motor skill impairments are common in both ASD and ADHD, with higher prevalence in children with ASD [59]. Identification of childhood motor impairments is of particular importance, since poor motor skills are highly correlated to risk of being bullied in school [60], and thus related to social difficulties as well.
In the retrospective childhood data on adults, we observed between-group differences (controls versus clinical cases) comparable to previous studies on children [38, 39]. Also in line with studies of the FTF on children, the differences in the FTF-CIQ domains and subdomains between the two clinical groups (ASD and ADHD) were relatively small, and the two clinical groups were combined in the logistic regression and ROC analyses. Using the FTF-CIQ domain scores as predictors in a logistic regression analysis, 84% of the total sample could be correctly classified (93% of the controls, and 65% of the clinical groups). Likewise, in the ROC analysis, a cut-off value of 20.50 in the summed score for all items correctly classified 90% of the controls and 67% of the clinical cases (ADHD and ASD combined). Using a cut-off value of 30.50 of the total summed score, 84% of the controls and 77% of the clinical cases were correctly classified. Thus, the FTF-CIQ is clearly not a diagnostic instrument due to the poor ability to discriminate between different clinical groups (ASD versus ADHD) and due to the relatively poor sensitivity. However, it should be noted that the FTF was not developed for diagnostic purposes but for broad clinical assessment and description of NDD symptoms and associated difficulties and relative strengths in children. Our results indicate that the FTF-CIQ can be used for gathering additional collaborative information also in the context of retrospective assessment of adults. In clinical practise, adult diagnoses of NDD may be missed due to co-morbid psychiatric conditions partially overlapping with and obscuring ASD and ADHD symptoms. It is well known that adults with NDD:s have difficulties recalling childhood symptoms [24], often underestimating symptom severity compared to parent reports and failing to identify the connection between symptoms and function disability [30, 61, 62]. Although report bias exist in both patients and parents, it is generally recommended that retrospective information is collected from several informants in clinical practice [63, 64]. For this purpose, FTF-CIQ can be used. To our knowledge, the only alternative instrument encompassing a broad, systematic assessment of both ASD, ADHD and associated NDD and psychiatric symptoms is the A-TAC which has been validated as a telephone interview. However, it has not been validated for retrospective assessment of childhood symptoms in adults.
The global increase in prevalence of ASD and ADHD has been extensively debated in recent years, as has the increase in the number of individuals treated for NDD:s. The prescription of ADHD medication has increased between two- and sevenfold in both Europe and the US [16]; for example, ninefold for children and adults in the UK from 2000 to 2015 [65] and in Sweden, medication more than doubled from 2006 to 2009 for both children and adults with the most prominent increase for adults [66]. The number of young adults receiving healthcare for ADHD and/or ASD has more than doubled from the year 2011 to 2016 [67]. For ADHD, the prevalence of diagnosis and subsequent pharmacological treatment is expected to increase even further with the application of the DSM-5 criteria that allow children with sub-threshold symptoms and no functional impairment to meet the diagnostic criteria for ADHD later in life [68]. Simultaneously, the large regional differences in prevalence suggest that underdiagnosis still occurs. Both over- and underdiagnosis have profound effects for the patients and their families in terms of inadequate, or lack of, treatment. For ADHD, wide prevalence ranges have been reported in older as well as recent studies and the prevalence of both ADHD diagnosis and medication has increased more in the US than in Europe [12, 69, 70]. Some factors influencing the prevalence have been identified, such as lower income households having lower prevalence [4]. In the US, CDC studies have demonstrated a relationship between prevalence and accessibility to specialised healthcare centres performing assessments, with higher prevalence in areas with better access to services. In Sweden, the National Board of Health and Welfare recently published a report concluding that socioeconomic factors do not contribute to the varying geographic prescription rate of ADHD medication, but access to healthcare and differences in clinical treatment practise do. Similarly, it is likely that differences in clinical diagnostic assessment practise play a role in the varying prevalence rates. In a meta-analysis of 86 studies of children and adolescents (N = 163,688 individuals) and 11 studies of adults (N = 14,112 individuals) of ADHD prevalence, almost all (97–99%) children who eventually met the criteria for ADHD, exhibited symptoms and impairment by the age of 10 [3]. Hence, validated instruments for assessment of childhood symptoms in adults seeking assessment for NDD are required.
The results of our study indicate that the FTF-CIQ can be useful in this context. Due to the limited sensitivity of FTF-CIQ, it should not be used as the only screening instrument for decision of whether to perform a clinical assessment of NDD or not. Using the lower cut-off value (20.50) would miss 33% of true NDD cases and using the higher cut-off value (30.50) would still miss 23% of NDD cases. Further, the FTF-CIQ cut-offs cannot be used to discriminate between ASD and ADHD. Rather than screening for the specific diagnoses, the FTF-CIQ is a suitable instrument for rigorous, systematic assessment of broader developmental difficulties commonly associated and co-morbid with NDD:s. Due to the instability of categorical core symptoms over time [71] and large overlap between symptoms from several different NDD and psychiatric diagnostic categories, use of a broader instrument yielding a deeper phenotype characterisation beyond mere diagnostic criteria can aid the clinician in identifying the presence of developmental abnormalities in adults early in the assessment, and assist decisions of which diagnoses to focus on more narrowly.
Limitations
The major limitation of the present study is that the control parents were recruited from a self-selected web panel. Putative selection biases cannot be identified since non-response analysis cannot be performed. A common limitation with web panels is that individuals who do not use internet are not randomly distributed and have a systematic bias for younger age and higher educational level. However, at the time when the general population data were collected, 93% of the Swedish population had access to internet and 91% actively used internet. In the age group > 46 years, approximately 2/3 of the population used internet for information searching. The e-mail invitation to participate in the study was sent to a stratified sample of individuals in the age range 45–50 years (25%) and > 50 years (75%), thus addressing the potential overrepresentation of younger respondents. The gender distribution of mothers and fathers completing the FTF in the original study by Kadesjöö et al. in children was closely replicated with 77% mothers and 23% fathers in our final sample, proportions that are in line with our clinical experience. Data on educational level for the respondents were not available, why our control group potentially could differ from the general population as well as from the clinical groups in this regard. Another limitation is the identification of absence of NDD in the control parents’ rating of their now adult offspring. Since no clinical assessment of the control group was performed, we cannot rule out the possibility of inclusion of undiagnosed NDD cases in the control group. This would result in an underestimation of the differences between control parents and parents to clinical cases, why the differences presented here should be viewed as a conservative estimate of the differences between non-NDD controls and NDD patients in retrospective parent FTF-CIQ rating.
Despite these limitations, our results indicate that FTF-CIQ in retrospective assessment of childhood NDD symptoms yields results comparable to those previously obtained for children, thus indicating a good face validity. Thus, FTF is an accessible (www.5-15.org) instrument that can enrich the assessment procedure of adult NDD:s in clinical practice by providing retrospective collateral information on childhood symptoms and difficulties.
References
Baird G, Simonoff E, Pickles A et al (2006) Prevalence of disorders of the autism spectrum in a population cohort of children in South Thames: the Special Needs and Autism Project (SNAP). Lancet 368:210–215. https://doi.org/10.1016/S0140-6736(06)69041-7
Polanczyk G, de Lima MS, Horta BL et al (2007) The worldwide prevalence of ADHD: a systematic review and metaregression analysis. Am J Psychiatry 164:942–948. https://doi.org/10.1176/ajp.2007.164.6.942
Willcutt EG (2012) The prevalence of DSM-IV attention-deficit/hyperactivity disorder: a meta-analytic review. Neurotherapeutics 9:490–499. https://doi.org/10.1007/s13311-012-0135-8
Fayyad J, De Graaf R, Kessler R et al (2007) Cross-national prevalence and correlates of adult attention-deficit hyperactivity disorder. Br J Psychiatry 190:402–409. https://doi.org/10.1192/bjp.bp.106.034389
Simon V, Czobor P, Bálint S et al (2009) Prevalence and correlates of adult attention-deficit hyperactivity disorder: meta-analysis. Br J Psychiatry 194:204–211. https://doi.org/10.1192/bjp.bp.107.048827
Baio J, Wiggins L, Christensen DL et al (2018) Prevalence of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 Sites, United States, 2014. MMWR Surveill Summ 67:1–23. https://doi.org/10.15585/mmwr.ss6706a1
Blumberg SJ, Bramlett MD, Kogan MD, et al (2013) Changes in prevalence of parent-reported autism spectrum disorder in school-aged U.S. children: 2007 to 2011–2012. Natl Health Stat Report 1–11, 1 p following 11
Kim YS, Leventhal BL, Koh Y-J et al (2011) Prevalence of autism spectrum disorders in a total population sample. Am J Psychiatry 168:904–912. https://doi.org/10.1176/appi.ajp.2011.10101532
Idring S, Lundberg M, Sturm H et al (2015) Changes in prevalence of autism spectrum disorders in 2001–2011: findings from the Stockholm Youth Cohort. J Autism Dev Disord 45:1766–1773. https://doi.org/10.1007/s10803-014-2336-y
Atladottir HO, Gyllenberg D, Langridge A et al (2015) The increasing prevalence of reported diagnoses of childhood psychiatric disorders: a descriptive multinational comparison. Eur Child Adolesc Psychiatry 24:173–183. https://doi.org/10.1007/s00787-014-0553-8
Giacobini M, Medin E, Ahnemark E et al (2018) Prevalence, patient characteristics, and pharmacological treatment of children, adolescents, and adults diagnosed with ADHD in Sweden. J Atten Disord 22:3–13. https://doi.org/10.1177/1087054714554617
Xu G, Strathearn L, Liu B et al (2018) Twenty-year trends in diagnosed attention-deficit/hyperactivity disorder among US children and adolescents, 1997–2016. JAMA Netw Open 1:e181471. https://doi.org/10.1001/jamanetworkopen.2018.1471
Chien I-C, Lin C-H, Chou Y-J, Chou P (2012) Prevalence, incidence, and stimulant use of attention-deficit hyperactivity disorder in Taiwan, 1996–2005: a national population-based study. Soc Psychiatry Psychiatr Epidemiol 47:1885–1890. https://doi.org/10.1007/s00127-012-0501-1
Polanczyk GV, Willcutt EG, Salum GA et al (2014) ADHD prevalence estimates across three decades: an updated systematic review and meta-regression analysis. Int J Epidemiol 43:434–442. https://doi.org/10.1093/ije/dyt261
Lundström S, Chang Z, Råstam M et al (2012) Autism spectrum disorders and Autisticlike Traits. Arch Gen Psychiatry 69:46. https://doi.org/10.1001/archgenpsychiatry.2011.144
Rydell M, Lundström S, Gillberg C et al (2018) Has the attention deficit hyperactivity disorder phenotype become more common in children between 2004 and 2014? Trends over 10 years from a Swedish general population sample. J Child Psychol Psychiatry 59:863–871. https://doi.org/10.1111/jcpp.12882
Sandin S, Lichtenstein P, Kuja-Halkola R et al (2014) The familial risk of autism. JAMA 311:1770. https://doi.org/10.1001/jama.2014.4144
Reale L, Bonati M (2018) ADHD prevalence estimates in Italian children and adolescents: a methodological issue. Ital J Pediatr 44:108
Simonoff E, Pickles A, Charman T et al (2008) Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample. J Am Acad Child Adolesc Psychiatry 47:921–929. https://doi.org/10.1097/CHI.0b013e318179964fS0890-8567(08)60059-3
Anckarsater H, Larson T, Hansson SL et al (2008) Child neurodevelopmental and behavioural problems are intercorrelated and dimensionally distributed in the general population. Open Psychiatr J 2:5–11. https://doi.org/10.2174/1874354400802010005
Russell AJ, Murphy CM, Wilson E et al (2016) The mental health of individuals referred for assessment of autism spectrum disorder in adulthood: a clinic report. Autism 20:623–627. https://doi.org/10.1177/1362361315604271
Murphy CM, Wilson CE, Robertson DM et al (2016) Autism spectrum disorder in adults: diagnosis, management, and health services development. Neuropsychiatr Dis Treat 12:1669–1686. https://doi.org/10.2147/NDT.S65455
Reale L, Bartoli B, Cartabia M et al (2017) Comorbidity prevalence and treatment outcome in children and adolescents with ADHD. Eur Child Adolesc Psychiatry 26:1443–1457. https://doi.org/10.1007/s00787-017-1005-z
Kooij JJS, Bijlenga D, Salerno L et al (2019) Updated European Consensus Statement on diagnosis and treatment of adult ADHD. Eur Psychiatry 56:14–34. https://doi.org/10.1016/J.EURPSY.2018.11.001
Bölte S, de Schipper E, Robison JE et al (2014) Classification of functioning and impairment: the development of ICF core sets for autism spectrum disorder. Autism Res 7:167–172. https://doi.org/10.1002/aur.1335
Larson T, Lundström S, Nilsson T et al (2013) Predictive properties of the A-TAC inventory when screening for childhood-onset neurodevelopmental problems in a population-based sample. BMC Psychiatry 13:233. https://doi.org/10.1186/1471-244X-13-233
Solanto MV (2019) The Prevalence of “Late-Onset” ADHD in a clinically referred adult sample. J Atten Disord 23:1026–1034. https://doi.org/10.1177/1087054718765672
Barkley RA (2013) Distinguishing sluggish cognitive tempo from ADHD in children and adolescents: executive functioning, impairment, and comorbidity. J Clin Child Adolesc Psychol 42:161–173. https://doi.org/10.1080/15374416.2012.734259
Gathje RA, Lewandowski LJ, Gordon M (2008) The role of impairment in the diagnosis of ADHD. J Atten Disord 11:529–537. https://doi.org/10.1177/1087054707314028
Sibley MH, Pelham WE, Molina BSG et al (2012) When diagnosing ADHD in young adults emphasize informant reports, DSM items, and impairment. J Consult Clin Psychol 80:1052–1061. https://doi.org/10.1037/a0029098
Ward MF, Wender PH, Reimherr FW (1993) The Wender Utah Rating Scale: an aid in the retrospective diagnosis of childhood attention deficit hyperactivity disorder [published erratum appears in Am J Psychiatry 1993 Aug; 150(8):1280]. Am J Psychiatry 150:885–890. https://doi.org/10.1176/ajp.150.6.885
Rutter M, Bailey A, Lord C (2003) The social communication questionnaire: manual. Western Psychological Service, Los Angeles
Hansson SL, Röjvall AS, Rastam M et al (2005) Psychiatric telephone interview with parents for screening of childhood autism—tics, attention-deficit hyperactivity disorder and other comorbidities (A-TAC): Preliminary reliability and validity. Br J Psychiatry 187:262–267
Larson T, Anckarsäter H, Gillberg C et al (2010) The autism—Tics, AD/HD and other comorbidities inventory (A-TAC): further validation of a telephone interview for epidemiological research. BMC Psychiatry. https://doi.org/10.1186/1471-244X-10-1
Kadesjö B, Janols L-O, Korkman M et al (2004) The FTF (Five to Fifteen): the development of a parent questionnaire for the assessment of ADHD and comorbid conditions. Eur Child Adolesc Psychiatry 13(Suppl 3):3–13. https://doi.org/10.1007/s00787-004-3002-2
Bohlin G, Janols LO (2004) Behavioural problems and psychiatric symptoms in 5–13 year-old Swedish children—a comparison of parent ratings on the FTF (Five to Fifteen) with the ratings on CBCL (Child Behavior Checklist). Eur Child Adolesc Psychiatry, Suppl. https://doi.org/10.1007/s00787-004-3003-1
Beltrán-Ortiz MF, Todd de Barra H, Franzani P et al (2012) El cuestionario Five to Fifteen (FTF) para una Evaluación Integral del Desarrollo: Propiedades Psicométricas y Caracterización de Muestra de Niños Chilenos. Ter psicológica 30:31–47. https://doi.org/10.4067/S0718-48082012000300004
Lambek R, Trillingsgaard A (2015) Elaboration, validation and standardization of the five to fifteen (FTF) questionnaire in a Danish population sample. Res Dev Disabil 38:161–170. https://doi.org/10.1016/j.ridd.2014.12.018
Trillingsgaard A, Damm D, Sommer S et al (2004) Developmental profiles on the basis of the FTF (Five to Fifteen) questionnaire-clinical validity and utility of the FTF in a child psychiatric sample. Eur Child Adolesc Psychiatry 13(Suppl 3):39–63. https://doi.org/10.1007/s00787-004-3006-y
Korkman M, Jaakkola M, Ahlroth A et al (2004) Screening of developmental disorders in 5-year-olds using the FTF (Five to Fifteen) questionnaire: a validation study. Eur Child Adolesc Psychiatry. https://doi.org/10.1007/s00787-004-3005-z
Lind A, Haataja L, Rautava L et al (2010) Relations between brain volumes, neuropsychological assessment and parental questionnaire in prematurely born children. Eur Child Adolesc Psychiatry 19:407–417. https://doi.org/10.1007/s00787-009-0070-3
Wechsler D (1981) The psychometric tradition: developing the Wechsler Adult Intelligence Scale. Contemp Educ Psychol 6:82–85. https://doi.org/10.1016/0361-476X(81)90035-7
Wechsler D (1997) Wechsler Adult Intelligence Scale, 3rd edn. The Psychological Corporation, San Antonio
Conners C (2000) Conners’ Continuous Performance Test (CPT-2) computer program for windows, technical guide, and software manual. Multi Health Systems, Toronto
Leark R, Dupuy T, Greenberg L et al (1996) TOVA test of variables of attention: professional manual version 7.0. Universal Attention Disorders, Los Alamitos
Tabachnick BG, Fidell LS (2007) Using multivariate statistics, 5th edn. Pearson/Allyn & Bacon, Boston
Cohen J (1988) Statistical power analysis for the behavioural sciences, 2nd edn. Psychology Press, New York
Mårland C, Lichtenstein P, Degl’Innocenti A et al (2017) The autism-Tics, ADHD and other comorbidities inventory (A-TAC): previous and predictive validity. BMC Psychiatry 17:403. https://doi.org/10.1186/s12888-017-1563-0
Franke B, Michelini G, Asherson P et al (2018) Live fast, die young? A review on the developmental trajectories of ADHD across the lifespan. Eur Neuropsychopharmacol 28:1059–1088
Abbott P, Happé FG, Charlton RA (2018) Exploratory study of executive function abilities across the adult lifespan in individuals receiving an ASD diagnosis in adulthood. J Autism Dev Disord 48:4193–4206. https://doi.org/10.1007/s10803-018-3675-x
Lecendreux M, Konofal E, Cortese S, Faraone SV (2015) A 4-year follow-up of attention-deficit/hyperactivity disorder in a population sample. J Clin Psychiatry 76:712–719. https://doi.org/10.4088/JCP.14m09555
American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders. American Psychiatric Association, Philadelphia
Robertson AE, Simmons DR (2013) The relationship between sensory sensitivity and autistic traits in the general population. J Autism Dev Disord 43:775–784. https://doi.org/10.1007/s10803-012-1608-7
Kuiper MWM, Verhoeven EWM, Geurts HM (2019) Stop making noise! Auditory sensitivity in adults with an autism spectrum disorder diagnosis: physiological habituation and subjective detection thresholds. J Autism Dev Disord 49:2116–2128. https://doi.org/10.1007/s10803-019-03890-9
Tzischinsky O, Meiri G, Manelis L et al (2018) Sleep disturbances are associated with specific sensory sensitivities in children with autism. Mol Autism 9:22. https://doi.org/10.1186/s13229-018-0206-8
Shimizu VT, Bueno OFA, Miranda MC (2014) Sensory processing abilities of children with ADHD. Braz J Phys Ther 18:343–352. https://doi.org/10.1590/BJPT-RBF.2014.0043
Puts NAJ, Harris AD, Mikkelsen M et al (2017) Altered tactile sensitivity in children with attention-deficit hyperactivity disorder. J Neurophysiol 118:2568–2578. https://doi.org/10.1152/jn.00087.2017
Bijlenga D, Tjon-Ka-Jie JYM, Schuijers F, Kooij JJS (2017) Atypical sensory profiles as core features of adult ADHD, irrespective of autistic symptoms. Eur Psychiatry 43:51–57. https://doi.org/10.1016/j.eurpsy.2017.02.481
Ament K, Mejia A, Buhlman R et al (2015) Evidence for specificity of motor impairments in catching and balance in children with autism. J Autism Dev Disord 45:742–751. https://doi.org/10.1007/s10803-014-2229-0
Bejerot S, Plenty S, Humble A, Humble MB (2013) Poor motor skills: a risk marker for bully victimization. Aggress Behav 39:453. https://doi.org/10.1002/AB.21489
Barkley RA, Fischer M, Smallish L, Fletcher K (2002) The persistence of attention-deficit/hyperactivity disorder into young adulthood as a function of reporting source and definition of disorder. J Abnorm Psychol 111:279–289. https://doi.org/10.1037/0021-843X.111.2.279
Mörstedt B, Corbisiero S, Bitto H, Stieglitz RD (2015) Attention-Deficit/Hyperactivity Disorder (ADHD) in adulthood: concordance and differences between self- and informant perspectives on symptoms and functional impairment. PLoS ONE. https://doi.org/10.1371/journal.pone.0141342
Möricke E, Buitelaar JK, Rommelse NNJ (2016) Do we need multiple informants when assessing autistic traits? The degree of report bias on offspring, self, and spouse ratings. J Autism Dev Disord 46:164–175. https://doi.org/10.1007/s10803-015-2562-y
Breda V, Rohde LA, Menezes AMB et al (2019) Revisiting ADHD age-of-onset in adults: to what extent should we rely on the recall of childhood symptoms? Psychol Med 50:857–866. https://doi.org/10.1017/S003329171900076X
Renoux C, Shin J-Y, Dell’Aniello S et al (2016) Prescribing trends of attention-deficit hyperactivity disorder (ADHD) medications in UK primary care, 1995–2015. Br J Clin Pharmacol 82:858–868. https://doi.org/10.1111/bcp.13000
Zetterqvist J, Asherson P, Halldner L et al (2013) Stimulant and non-stimulant attention deficit/hyperactivity disorder drug use: total population study of trends and discontinuation patterns 2006–2009. Acta Psychiatr Scand 128:70–77. https://doi.org/10.1111/acps.12004
Center of Epidemiology and Community Medicine, Stockholm County Council (2017) Autismspektrumtillstånd och ADHD bland barn och unga i Stockholms län: Förekomst i befolkningen samt vårdsökande under åren 2011 till 2016. In: Faktabl. 20171. https://www.ces.sll.se/globalassets/verksamheter/forskning-och-utveckling/centrum-for-epidemiologi-och-samhallsmedicin/folkhalsoguiden/rapporter-och-faktablad/ast-och-adhd-bland-barn-och-unga-i-stockholms-lan-faktablad-2017.1.pdf. Accessed 15 Aug 2019
Asherson P, Buitelaar J, Faraone SV, Rohde LA (2016) Adult attention-deficit hyperactivity disorder: key conceptual issues. Lancet Psychiatry 3:568–578. https://doi.org/10.1016/S2215-0366(16)30032-3
Visser SN, Danielson ML, Bitsko RH et al (2014) Trends in the parent-report of health care provider-diagnosed and medicated attention-deficit/hyperactivity disorder: United States, 2003–2011. J Am Acad Child Adolesc Psychiatry 53:34–46.e2. https://doi.org/10.1016/j.jaac.2013.09.001
Verkuijl N, Perkins M, Fazel M (2015) Childhood attention-deficit/hyperactivity disorder. BMJ 350:h2168–h2168. https://doi.org/10.1136/bmj.h2168
Copeland WE, Adair CE, Smetanin P et al (2013) Diagnostic transitions from childhood to adolescence to early adulthood. J Child Psychol Psychiatry Allied Discip 54:791–799. https://doi.org/10.1111/jcpp.12062
Acknowledgements
Open access funding provided by Karolinska Institute. The authors wish to thank all participants in this study. Moreover, we would like to express our gratitude for the clinical staff members who collected the data on the NDD groups.
Funding
Funding was provided for clinical research by Stockholm County Council (Grant no. 20130630).
Author information
Authors and Affiliations
Consortia
Contributions
TH and JB designed the study and the web survey. ER entered the clinical data to the database together with several research assistants. TH designed and conducted the statistical analyses, designed the tables and draw the figures. TH and JB wrote the first draft. All authors participated in the interpretations of the results and commented upon the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hirvikoski, T., Lajic, S., Jokinen, J. et al. Using the five to fifteen-collateral informant questionnaire for retrospective assessment of childhood symptoms in adults with and without autism or ADHD. Eur Child Adolesc Psychiatry 30, 1367–1381 (2021). https://doi.org/10.1007/s00787-020-01600-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00787-020-01600-w