Computer-Based instrument for Low motor Language Testing

COA At-a-Glance

Evidence of cognitive interviewing of draft instrument in target patient population

Evidence of internal consistency

Evidence of test-retest or inter-rater reliability

Evidence of concurrent validity

Evidence of known-groups validity

Evidence of ability to detect change over time

Evidence of responder thresholds

Inclusion of the COA in product labelling

Communication/Language
Daily function

Overview

Instrument Name: Computer-Based instrument for Low motor Language Testing

Abbreviation: C-BiLLT

Points for Consideration:

If this instrument can be used with other populations with severe motor impairments and AAC then that would be ideal. The alternative methods of response are important for a population whose motor function may be well below their cognitive or communication function.

Description of Tool:

The Computer-Based instrument for Low motor Language Testing is a PerfO developed to assess spoken language comprehension in unintelligible or non-speaking children with (severe) motoric impairment caused by cerebral palsy (CP) aged 1.5-7.0 years. May be used in older children or young adults when intellectual disability is suspected (Communication Disorders, Cerebral Palsy Cerebral Palsy).

Minimum Qualification Required by COA Administrator: MA or BA

Comment:

With its different access methods, the C-BiLLT enables reliable assessments in children with (severe) CP and provides valuable information to optimize the child’s language environment in daily activities and participation. Child responds to oral questions pertaining to visual stimuli presented on a personal computer, by using at least 5 alternative access methods requiring very limited motoric responses:
- touch screen operated by any body part (e.g., hand, foot, nose)
- input switch(es) adjusted to any body part
- child’s own wheelchair head support (used as an input switch)
- eye gaze to the touch screen interpreted by the examiner
- independent eye gaze computer control

Year: 2010

Objective of Development:

To assess spoken language comprehension in unintelligible or non-speaking children with (severe) motoric impairment caused by cerebral palsy (CP)

Population of Development: Age range (therapeutic indication):

1.5-7.0 years; May be used in older children or young adults when intellectual disability is suspected (Communication Disorders, Cerebral Palsy Cerebral Palsy)

Pediatric Population(s) in which COA has been used:

Nervous System Diseases

COA type:

Number of Items 87

Mode of Administration:

Data Collection Mode:

Time for Completion: None identified

Response Scales: Dichotomous: 1 (= correct identification) / 0 (= incorrect identification) Other: number of target objects identified in the pre-test (<5 objects = 0; ≥5 real objects or photographs = 1; ≥5 real objects and photographs = 2); if pre-test score = 0, the computer-based test is not administered

Summary of Scoring:

Available Scores:
Global score (including pre-test score, Part I (range 0-30) and Part II (range 0-56)): range 0-88
Scores by items: Pre-test (0-2)

- Scores are compared to norm data (in percentile scores, for children younger than 7.0 years, and in age equivalents for children older than 7.0 years)

Weighting:
No

Score Direction:
Higher score = Better comprehension of spoken language


Content Validity

Evidence of Literature Review: None identified

Evidence of Instrument Review: Yes

Evidence of Clinical or Expert Input: Yes

Evidence of concept elicitation in target patient population: Yes

Evidence of a Saturation Grid: None identified

Evidence for Selection of Data Collection Method: None identified

Recall/Observation Period:

Evidence for Selection of Reponse Options: None identified

Evidence of cognitive interviewing of draft instrument in target patient population: None identified

Evidence of Preliminary Scoring of Items and Domains: Yes

Evidence related to respondent and administrator burden: None identified

Evidence of a Conceptual Framework: None identified

Evidence of an item-tracking matrix: None identified

Evidence related to item selection: Yes

Evidence of re-testing the final version: Yes


Reliability

Internal consistency (Cronbach's alpha): Yes

Evidence of internal consistency:

Test-retest Reliability (ICC):

Geytenbeek JJ (2014)
76-item version
Intraclass Correlation Coefficient (ICC):
Children with TD: 0.97 (95%CI=0.94-0.99)
Children with CP: 0.97 (95%CI=0.95-0.99)
Was a definition of stability applied to identify stable patients: No
Time frame or interval between the two administrations: 2 weeks
Population/Disease: Children with TD (age range= 1 year 6 months - 6 years 10 months; n=137) or CP (age range= 1 year 11 months - 12 years; n=32)

Inter-rater/ inter-interviewer reliability (kappa):

Geytenbeek JJ (2014)
76-item version
Intraclass Correlation Coefficient (ICC):
Children with TD: 0.96 (95%CI=0.94-0.97)
Children with CP: 0.97 (95%CI=0.95-0.98)
Population/Disease: Children with TD (age range= 1 year 8 months - 7 years; n=37) or CP (age range= 1 year 7 months - 11 years 4 months; n=35)

Evidence of test-retest or inter-rater reliability: Yes


Validity

Concurrent validity (convergent, divergent):

Geytenbeek JJ (2014)
76-item version
Correlation coefficient used: Pearson's correlation coefficient
Measure: Peabody Picture Vocabulary Test (PPVT-III)
Results: A high correlation was observed between the C-BiLLT and the PPVT-III scores in children with and without disabilities (p not stated):
Children with TD: r=0.88
Children with CP: r=0.87
Population/Disease: Children with TD (2 years 3 months - 7 years; n=117) or CP (3 years 2 months - 12 years; n=33)

Known-group validity:

Geytenbeek JJ (2014)
76-item version
Measure/Groups of patients: Age
A priori hypotheses: A higher correlation between the C-BiLLT and age should be observed in children with TD than in children with CP and complex communication needs because of a wider variation in language comprehension skills in the latter
Were hypotheses confirmed: Yes
-Results: Pearson's correlation coefficient :
Children with TD: r=0.82 (p not stated)
Children with CP: r=0.36; p<0.0001 Population/Disease: Children with TD (n=806) or CP (n=87) aged 1.5-12 years Known-groups validity - 76-item version 1) Measure/Groups of patients: Children with TD: n=806 Children with CP: n=87 A priori hypotheses: A significant difference should be observed between the mean scores on the C-BiLLT of children with TD and children with CP and complex communication needs, with the latter group receiving lower scores on average Were hypotheses confirmed: Yes Results: A significant difference was observed between both groups (t-test: data not shown; p<0.0001): Children with TD: mean (SD) score = 59.72 (13.19); CI=58.81-60.63 Children with CP: mean (SD) score = 36.38 (25.08); CI=31.03-41.72 Population/Disease: Children with TP or CP aged 1.5-12 years; n=893 2) Measure/Groups of patients: Age (years;months): 1 - 1;11: n=45 2 - 2;11: n=129 3 - 3;11: n=137 4 - 4;11: n=191 5 - 5;11: n=202 6 - 6;11: n=91 7 - 7;5: n=11 A priori hypotheses: A significant difference should be observed between the mean scores on the C-BiLLT of children with TD within age groups Were hypotheses confirmed: Yes Results: The Mean (SD) C-BiLLT scores [95%CI] increased with age and the difference between age intervals is significant (univariate ANOVA: data not shown; p<0.0001) 1 - 1;11: 23.84 (11.19) [20.84-27.21] 2 - 2;11: 46.24 (9.04) [44.68-47.83] 3 - 3;11: 57.91 (5.88) [56.92-58.90] 4 - 4;11: 64.35 (4.70) [63.68-65.02] 5 - 5;11: 67.55 (4.27) [66.96-68.14] 6 - 6;11: 70.64 (3.34) [69.94-71.33] 7 - 7;5: 72.18 (1.60) [71.11-73.26] Comparison of mean score differences [95%CI] using Bonferoni correction, showed that the C-BiLLT significantly discriminated between age groups of children with TD until 6 years (p<0.001): Age 2 versus 1 years: 22.41 [19.31-25.51] Age 3 vs 2 y: 11.66 [9.46-13.85] Age 4 vs 3 y: 6.43 [4.43-8.44] Age 5 vs 4 y: 3.20 [1.40-5.01] Age 6 vs 5 y: 3.25 [1.08-5.43] Population/Disease: Children with TD (age range= 1 year 8 months - 7 years); n=806 Geytenbeek JJ (2015) 1- Measure/Groups of patients: Type of CP Spastic CP: n=47 Dyskinetic CP: n=40 A priori hypotheses: Not stated Were hypotheses confirmed: Not applicable Results: A significant difference was observed in the mean (SD) C-BiLLT raw scores between both types of CP, with lower scores in children with spastic CP: Spastic CP: 29.09 (24.01) [95%CI=22.04-36.13] Dyskinetic CP: 44.98 (23.78) [95%CI=37.37-52.58] t-test: t=-3.092; CI=-26.14 to -5.68; p=0.003 In children < 6 years 6 months, the C-BiLLT z-scores were lower in the spastic group, as shown by the significant difference in the proportions of children with z-scores ≥-1.6 (average to mild disability) and <-1.6 (moderate to severe disability): Spastic CP (n=21): 100% with a z-score <-1.6 Dyskinetic CP (n=21): 47.6% with a z-score <-1.6 and 52.4% with a z-score ≥-1.6 Fisher's exact test: F=14.903; p<0.001 In children > 6 years 6 months, the C-BiLLT age-equivalent (AE) scores were lower in the spastic group, as shown by the significant difference in the proportions of children with AE scores < and ≥ 6 years: Spastic CP (n=26): 96.2% with AE < 6 years and 3.8% with AE ≥ 6 years Dyskinetic CP (n=19): 68.4% with AE < 6 years and 31.6% with AE ≥ 6 years Fisher's exact test: F=6.428; p=0.031 Population/Disease: Children with CP (age range 1y 9mo–12y, mean age 6y 8mo [SD 2y 11mo]); n=87 2- Measure/Groups of patients: Levels of Gross Motor Function Classification System (GMFCS) Level IV: n=34 Level V: n=53 A priori hypotheses: Not stated Were hypotheses confirmed: Not applicable Results: A significant difference in the mean (SD) C-BiLLT raw scores was observed between both levels of GMFCS, with higher scores in children with level IV: Level IV: 43.33 (21.63) [95%CI=35.67-51.00] Level V: 31.60 (26.23) [95%CI=24.37-38.83] t-test: t=2.270; CI=1.518 to 22.921; p=0.026 In children < 6 years 6 months, significant differences in the C-BiLLT z-scores were observed between GMFCS levels: Level IV (n=19): 57.9%% with a z-score <-1.6 (moderate to severe disability) and 42.1% with a z-score ≥-1.6 (average to mild disability) Level V (n=23): 87.0% with a z-score <-1.6 and 13.0% with a z-score ≥-1.6 Fisher's exact test: F=4.546; p=0.043 Population/Disease: Children with CP (age range 1y 9mo–12y, mean age 6y 8mo [SD 2y 11mo]); n=87

Evidence of Translatability Assessment: None identified

Evidence related to missing data: None identified

Evidence for Selection of Recall Period: None identified

Evidence of Administration Instructions and Training Provided: Yes

Evidence of concurrent validity: Yes

Evidence of known-groups validity: Yes

Evidence of ability to detect change over time: None identified


Ability to Detect Change

Ability to detect change (Responsiveness):

None identified


Responder Thresholds

Responder Thresholds:

None identified

Evidence of responder thresholds: None identified


Reference(s) of development / validation

Geytenbeek JJ, Oostrom KJ, Harlaar L, Becher JG, Knol DL, Barkhof F, Pinto PS, Vermeulen RJ. Language comprehension in nonspeaking children with severe cerebral palsy: Neuroanatomical substrate? Eur J Paediatr Neurol. 2015 Sep;19(5):510-20
PubMed abstract: https://pubmed.ncbi.nlm.nih.gov/26112263/

Geytenbeek JJ, Vermeulen RJ, Becher JG, Oostrom KJ. Comprehension of spoken language in non-speaking children with severe cerebral palsy: an explorative study on associations with motor type and disabilities. Dev Med Child Neurol. 2015 Mar;57(3):294-300
Full-text article: https://onlinelibrary.wiley.com/doi/10.1111/dmcn.12619

Geytenbeek JJ, Mokkink LB, Knol DL, et al. Reliability and validity of the C-BiLLT: a new instrument to assess comprehension of spoken language in young children with cerebral palsy and complex communication needs. Augment Altern Commun. 2014 Sep;30(3):252-66
PubMed abstract: https://pubmed.ncbi.nlm.nih.gov/24948533/

Harlaar L, Pouwels PJ, Geytenbeek J, et al. Language comprehension in young people with severe cerebral palsy in relation to language tracts: a diffusion tensor imaging study. Neuropediatrics. 2013 Oct;44(5):286-90
PubMed abstract: https://pubmed.ncbi.nlm.nih.gov/23564318/

Geytenbeek JJ, Heim MM, Vermeulen RJ, et al. Assessing comprehension of spoken language in nonspeaking children with cerebral palsy: application of a newly developed computer-based instrument. Augment Altern Commun. 2010 Jun;26(2):97-107
PubMed abstract: https://pubmed.ncbi.nlm.nih.gov/20497073/

C-BiLLT website: https://c-billt.com/


Other references

See (PubMed results)
https://pubmed.ncbi.nlm.nih.gov/?term=(C-BiLLT%5BTitle%2FAbstract%5D)+AND+((%222010%22%5BDate+-+Publication%5D+%3A+%223000%22%5BDate+-+Publication%5D))&sort=

CanChild website: https://www.canchild.ca/en/research-in-practice/current-studies/c-billt


Inclusion of the COA in product labelling

None identified


Existence of Scoring / Interpretation / User Manual


Original language and translations

Original language:
Dutch for the Netherlands

Translations:
Dutch for Belgium
English for Canada
English for the UK
French
German
Norwegian for Norway
Romanian
Swedish


References of translations

Norwegian:
Fiske SI, Haddeland AL, Skipar I, Bootsma JN, Geytenbeek JJ, Stadskleiv K. Assessing language comprehension in motor impaired children needing AAC: validity and reliability of the Norwegian version of the receptive language test C-BiLLT. Augment Altern Commun. 2020 Jun;36(2):95-106


Authors and contact information

Author:
Dr. Johanna Geytenbeek, PhD, SLP, Clinical researcher
Amsterdam UMC
The Netherlands
E-mail: J.geytenbeek@amsterdamumc.nl


Website


Review copy

N/A