Volume 18, Issue 4 (December 2020)                   Iranian Rehabilitation Journal 2020, 18(4): 465-474 | Back to browse issues page


XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Haresabadi F, Ghasisin L, Schindler A, Heidarian Miri H, Dabirian M, Ghayoumi-Anaraki Z. Developing and Examining the Psychometrics of Single-word Quick Repetition Test for Speech Sound Production in Persian-speaking Children. Iranian Rehabilitation Journal 2020; 18 (4) :465-474
URL: http://irj.uswr.ac.ir/article-1-1153-en.html
1- Department of Speech Therapy, School of Paramedical Sciences, Mashhad University of Medical Sciences, Mashhad, Iran.
2- Department of Speech Therapy, Communication Disorders Research Center, School of Rehabilitation, Isfahan University of Medical Sciences, Isfahan, Iran.
3- Department of Biomedical and Clinical Sciences ‘‘L. Sacco’’, University of Milan, Milan, Italy.
4- Department of Epidemiology, Social Determinants of Health Research Center, Mashhad University of Medical Sciences, Mashhad, Iran.
Full-Text [PDF 610 kb]   (796 Downloads)     |   Abstract (HTML)  (2051 Views)
Full-Text:   (662 Views)
1. Introduction
peech Sound Disorder (SSD) comprises any problem or composition of problems with the perception, motor production, or phonological representation of speech sounds, either in the sound itself or in speech segments [1]. This condition is among the most common communication disorders in children. SSD is highly prevalent among preschool children; this disorder has a prevalence rate of almost 16% among 3-year-old children [2]. This rate has been reported as 13.1% among the children in the first year of primary school in Yazd City, Iran [3].
Fluharty [4] has underscored the necessity of performing highly reliable and valid articulation tests; such inventories are suggested to be culturally and phonemically feasible, simple, comprehensive, and quick to administer and can represent the articulation competence in the pediatric population. Picture naming tests are clinically applied for speech assessment during childhood across the world in different languages Arabic [5], English [6], European-Portuguese [7], Italian [8], and Farsi [9, 10, 11]. Such tests target the assessment of the production of all consonant phonemes (23 consonants) in all word positions, namely initial, middle, and final. Implementing the picture naming tests requires the elicitation of long-list words (e.g. 80 words [9] or 180 words [8]). 
These tests are time-consuming and caseload management is a significant burden for numerous speech-language pathologists serving children with SSDs [12]; thus, developing a tool facilitating a concurrent assessment within a shorter time with a favorable diagnostic power could be very beneficial. In this direction, Schindler’s repetition test has been developed for Italian children [13]. Besides, Tresoldi et al. determined its reliability and validity [14].
Despite the demand for the evaluation and treatment of SSDs, no specific quick tool has been developed for Persian-speaking children. The high prevalence of this disorder and its association with reading disabilities during the school years [151617] highlights the necessity of developing quick tests to apply on large populations aged 3-8 years. Accordingly, developing a reliable and valid instrument facilitating a rapid repetition could be beneficial in the pediatric field. Such tools could help to screen children in need of referral to a complete assessment of speech and language pathology. 
The present study aimed to develop and validate a quick repetition test using familiar, culture-based, and visually transparent words for assessing Persian-speaking children with SSDs. We also provided the descriptive data related to sound development per age group.
2. methods
The current study protocol was approved by the Ethics Committee of Mashhad University of Medical Sciences (Code: IR.MUMS.REC.1398.071). The current study was conducted on 455 Persian-speaking 3-8-year-old children. The study population was divided into two groups of children, including 419 participants without any clinical signs of speech impairment (231 males and 188 females, aged 3;0-8;11 years) and 36 cases with SSDs.
The children of the first group were randomly selected from the kindergartens and schools categorized into 6 age groups with a one-year interval (Table 1). 


The exclusion criteria for the control group were hearing loss, cerebral palsy, cleft lip and palate, autism spectrum disorders, intellectual disability, and developmental disabilities with social, emotional/behavioral deficits. These criteria were controlled by the child’s medical history and reports from teachers and parents. Additionally, each child was subjected to a clinical speech and language assessment by a Speech-Language Pathologist (SLP) to exclude the children with SSDs. Unfortunately, due to limited access to younger children, the number of children in lower age groups was less than that of the older children; this issue is mentioned in the limitations section.
The case group entailed 36 children, including 28 males and 8 females, within the age range of 3-8 years (Table 2). 


These children were selected from the patients referring to the centers delivering speech and language services in 3 months. The patients with normal hearing (according to their audiogram) and SSD diagnosis according to the phonetic test [9] were included in this group. Children who presented errors of <4 consonants, distortion error type, as well as apraxia and dysarthria were excluded from the study.
After developing the single-word quick repetition test, its validity and reliability were examined.To develop a reliable and valid test, the items were selected from the existing resources by a comprehensive review [18, 19]. It was also ensured that all the items were familiar and culturally-appropriate to 3-8-year-olds.
The quick repetition test consists of 30 one-syllable words with CVC syllable shape (Appendix A), including all Persian phonemes, except the only glottal stop consonant (22 consonants) in the word-initial and word-final positions. 

Besides, vowels are not assessed in this screening test. The maximum total score for the test is 44 target phonemes (i.e. 22 + 22). This work was generated based on Schindler’s repetition test, i.e. developed for the Italian children. This test consists of a 30-word list, which includes Italian phonemes (21 consonants). Most of these phonemes are present in the initial and medial positions of words. In the Italian language, final consonants are very rare; therefore, they are not part of this articulation test. The task requests child to repeat the uttered target words by the examiner.
The descriptive data were obtained by calculating correct production for a target phoneme in terms of percentage and percentile ranks for the subjects’ total score per group. For each consonant, the accuracy percentage was calculated to determine the mastery age (≥90% of children in an age group produce the sound correctly), acquisition age (≥75%), customary production age (≥50%), and the age of approximate production (<50%) [14, 20].
To estimate the inter-rater reliability of our test, 10 children in the control group were simultaneously and independently examined by two speech-language pathologists (a PhD and an MSc in Speech Therapy). Furthermore, the test-retest reliability was investigated by administering the repetition test to 16 children in the case group twice with a 2-week interval.
Content validity is described by the extent to which the content of a test addresses the conceptual domain that it was intended to cover [21]. In the present study, evaluating the content validity of the devised test was investigated by 5 speech and language pathologists who were experienced in working with children with SSDs. Accordingly, the proposed test was thoroughly reviewed by the given therapists to reach a consensus on the suitability of the tested consonant position in the word; the suitability of the age group for ensuring the quality of the material applied in the test; and the familiarity and cultural suitability of the selected words for the children per selected test item. 
The responses of the control group participants were subjected to psychometric analysis. The construct validity of the designed test was examined by evaluating its ability to discriminate between different age groups. Moreover, to determine the convergent validity as another subtype of the construct validity, our quick repetition test, along with a more comprehensive articulation test, namely phonetic information test [9], involving a picture-naming test of 80 words that included all Persian consonants in different positions within the word, were administered to 100 healthy children within the age range of 3;0-8;11. Subsequently, the correlation between the results obtained from the two aforementioned tests was calculated. Furthermore, the extent to which a test can facilitate the detection or prediction of a disorder is referred to as its clinical validity [22]. The clinical validity of the quick repetition test was investigated by comparing the data of the case and control groups. However, to make these two groups more comparable regarding gender and age, we fitted a multiple logistic regression model and entered age and gender as independent variables (to adjust them) besides the correct responses. 
The concurrent validity of our test was determined by assessing the speech abilities of all controls through the proposed quick repetition test and phonetic information test [9]. The children were selected from rehabilitation clinics (group 2), kindergartens, and schools (group 1) in Mashhad City, Iran. They were examined by a speech-language pathologist with 5 years of experience and expertise regarding articulation testing and phonetic transcription. 
The articulation skills were individually assessed in each child. Accordingly, the children were requested to repeat each target word after producing it by the examiner. As the words were elicited by imitation, no cues and additional trials were provided.
Thereafter, the examiner scored each word as 1 or 0 in case the target phoneme was uttered correctly or omitted/distorted/substituted, respectively based on an auditory-perceptual evaluation. Accordingly, the minimum and maximum scores in this test are 0 (all target phonemes are omitted/distorted) and 44 (all target phonemes are correctly produced), respectively. The administration of this test takes approximately two minutes per subject. 
The obtained data were analyzed in SPSS and R software. The collected data were expressed as frequency, mean, and standard deviation. To achieve descriptive data, for each target phoneme, the correct production percentages, as well as percentile ranks, were calculated for the total scores of each age group.
Data analysis was performed using the Cronbach’s alpha coefficient (for internal consistency), Intraclass Correlation Coefficient (ICC; for test-retest and inter-rater reliability); inflated beta-binomial regression (for discriminant validity -the subtype of construct validity-); Pearson’s correlation coefficient (for convergent validity- the subtype of construct validity-); a multiple logistic regression analysis between pathological and healthy speaking children (clinical validity), and Bland-Altman plot for concurrent validity. 
3. Results
Tables 1 and 2 present the mean and standard deviation scores of the quick repetition test scores in 6 age groups.The test proposed in this study was developed to assess children’s ability to accurately repeat all phonemes in the initial and final positions of the target words. Figure 1 presents the data obtained from the test in children with healthy speech development. 

The age group-wise percentile ranks of the test’s total scores are presented in Table 3


Based on the evidence, Persian-speaking children are mastered in producing nasals, frontal plosives, and /x/ consonant at the age of 3;0-3;11 years. However, the three consonants of /z/, /ʒ/, and /dʒ/ are already mastered by children aged 6;0-6;11 years. Besides, /s/ is the last consonant that children have mastered at the age of 7;0-7;11 years. 
The internal consistency of the quick repetition test was confirmed, rendering a Cronbach’s alpha coefficient of 0.75; thus, all test items measure a single variable. Moreover, investigating the test-retest reliability among 16 subjects with a 2-week interval reflected a significant correlation between the study subjects’ performance at two different times (ICC=74.0, 95%CI=0.3-0.9, P≤0.05). Therefore, the test was concluded to have relatively satisfactory repeatability. Furthermore, exploring the scale’s inter-rater reliability revealed that the scores of the two different examiners were close in the 10 subjects and demonstrated a significant correlation (ICC=99.99%, 95%CI=0.99-1.00, P≤0.05).
A method for determining tests’ validity is to examine the correlation between the results of the test and those of other tests measuring the same skill (convergent validity). As a result, the correlation of the results of the quick repetition test with those of the phonetic test [9]was investigated in the current study. The relevant results demonstrated a significant correlation, indicating an acceptable convergence validity of the scale (rp=0.71, P≤0.05). Besides, the discriminant validity of different age groups is a construct validity type; it indicates the test’s ability to differentiate various age groups based on the subjects’ scores. Results of the inflated beta-binomial regression indicated a significant improvement of the test’s performance with increasing age.
Comparing the scores of the normally-developing children and those with SSDs (clinical validity) suggested that the odds of correct responses in healthy-speaking children was about 1.3 times greater than that of the children with SSD (OR: 1.38; 95%CI 1.254218-1.526261 ; P<0.001). 
Figure 2 illustrates the Bland-Altman plot demonstrating the scores of the quick repetition test and phonetic test. 

The relevant results indicated that at a 95%CI, the two measurements had an agreement range of 27-6.7, i.e. relatively low and acceptable.
4. Discussion
The present study has targeted the development and psychometric validation of a quick repetition test. This scale was generated to assess speech sound abilities in Persian-speaking children within the age group of 3;0-8;11 years. The test presented in this study can serve different purposes. Our proposed test requires a short time for administration (i.e. about 2 min); thus, it can be used as a quick speech test or in an early clinical assessment.
The proposed test was investigated among 419 children without any clinical signs of speech impairment and 36 children diagnosed with SSDs. The present study results suggested the acceptable reliability and validity of the quick repetition test. 
The desirable internal consistency of the presented quick repetition test reflects that all items of the devised test were measuring the same performance [23]. Investigating the inter-rater reliability of the quick repetition test revealed an agreement rate of 99%, representing a strong concordance [24]. Therefore, our test can be applied by the clinicians, since it can produce consistent results without being affected by the examiners’ bias. Considering the test-retest reliability, an agreement rate of 0.74% indicated the consistency of our proposed test over time; with little effect of the external factors of error and the same score for a participant, the same data would be obtained if being examined with the test several times [24]. The correlational results obtained for our test were in line with those reported for other instruments assessing speech sound [7, 8, 9, 14, 25, 26]. 
In the current study, the construct validity of the quick repetition test was determined by exploring its subtypes, namely discriminant validity and convergent validity. Regarding the age group discrimination, the obtained results presented a high discriminant validity, and as expected, the test’s scores increase with children’s age. 
The scale’s convergent validity was examined by calculating the correlation between the scores of the quick repetition test and those of the phonetic information test, i.e. a comprehensive articulation test. The obtained result (r=0.71) indicated the overlap between the scores of the two tests. Accordingly, the quick repetition test can provide a profile of children’s consonant inventory.
Additionally, our results indicated a significant difference between the scores gained by the children with SSDs and those obtained by their healthy age- and gender-matched counterparts. Consequently, our proposed quick repetition test has the potential to easily distinguish the children with speech sound impairments. 
Our findings revealed a relatively strong correlation between the results of the phonetic information test and those of the quick repetition test. The phonetic information test is a picture-naming test, i.e. a detailed and common tool assessing speech abilities in children. Therefore, the correlation between the two tests supports the concurrent validity of our devised test.
In the current study, descriptive data were established through administrating the quick repetition test to a large group of Persian-speaking children (N=419). Comparing the data with the normative data reported in other studies investigating the children who speak other languages suggests numerous similarities in speech development. For instance, consistent with other studies, Persian-speaking children acquire nasal consonants and frontal stop consonants sooner and affricatives and /s/, /z/, and /ʒ/ consonants later [8, 14, 272829]. In the present study, the age for the mastery of the utterance of /s/ consonant was determined as 7;0-7;11 years, i.e. in line with the results reported by Poole [28], and Tresoldi [8].
The present study entailed several limitations. First, the number of children in different age groups was heterogeneous; due to the small size of some groups, normative data could not be reported and descriptive data were reported instead. Second, the size of the case group consisting of the children with SSD was relatively small. It is suggested to perform further studies using more homogeneous subgroups of children according to age to obtain normative data. Additionally, it is suggested to administer this test on children with SSDs of different severities and etiologies regarding the efficiency of quick repetition test in the diagnosis of speech impairment in children.
5. Conclusion
Like the Italian quick repetition test, the Persian quick repetition test proposed in the present study was a reliable and valid instrument facilitating the assessment of speech sound abilities. Moreover, the conciseness of this test makes it easily applicable in clinical practice as a screening test and epidemiological investigations. Furthermore, reported descriptive data from a large sample can facilitate the comparing of child speech ability to the speech development standards. 

Ethical Considerations
Compliance with ethical guidelines

The current study protocol was approved by the Ethics Committee of Mashhad University of Medical Sciences (Code: IR.MUMS.REC.1398.071).

Funding
This work was part of a major work supported by the Mashhad University of Medical Sciences (Grant number: 980024).

Authors' contributions
Substantial contributions to drafting the article; final approval of the version to be published: Fatemeh Haresabadi; Substantial contributions to the data collection as well as revising the work critically for important intellectual content: Leila Ghasisin; Substantial contributions to revising the work critically for important intellectual content: Antonio Schindler; Substantial contributions to data analysis:Hamid Heidarian Miri; Substantial contributions to data collection: Mohadese Dabirian; Substantial contributions to the conception and design of the work, the interpretation of data, and writing the article: Zahra Ghayoumi-Anaraki; The manuscript has been read and approved by all the authors and each author believes that the manuscript represents honest work.

Conflict of interest
The authors declared no conflicts of interest.


References
  1. American Speech-Language-Hearing Association. Speech sound disorders: Articulation and phonology. Practice Portal nd. 2017.
  2. Shriberg LD. Classification and misclassification of child speech sound disorders. Proceedings of the Annual Convention of the American Speech-Language- Hearing Association. 2002. https://www.sid.ir/en/journal/ViewPaper.aspx?ID=462195
  3. Karbasi SA, Fallah R, Golestan M. The prevalence of speech disorder in primary school students in Yazd-Iran. Acta Medica Iranica. 2011; 49(1):33-7. https://acta.tums.ac.ir/index.php/acta/article/view/3688
  4. Fluharty NB. preschool speech and language screening test: Teaching Resources; 1978. https://www.proedinc.com/Products/9345/fluharty2-fluharty-preschool-speech-and-language-screening-testsecond-edition.aspx
  5. Abou-Elsaad T, Baz H, El-Banna M. Developing an articulation test for Arabic-speaking school-age children. Folia Phoniatrica et Logopaedica. 2009; 61(5):275-82. [DOI:10.1159/000235650] [PMID]
  6. Dodd B, Hua Z, Crosbie S, Holm A, Ozanne A. Diagnostic Evaluation of Articulation and Phonology-US Edition (DEAP). London: Pearson; 2009. http://images.pearsonassessments.com/images/tmrs/tmrs_rg/deap_techreport.pdf
  7. Lousada M, Mendes A, Valente AR, Hall A. Standardization of a phonetic-phonological test for European-Portuguese children. Folia Phoniatrica et Logopaedica. 2012; 64(3):151-6. [DOI:10.1159/000264712] [PMID]
  8. Tresoldi M, Barillari MR, Ambrogi F, Sai E, Barillari U, Tozzi E, et al. Normative and validation data of an articulation test for Italian-speaking children. International Journal of Pediatric Otorhinolaryngology. 2018; 110:81-6. [DOI:10.1016/j.ijporl.2018.05.002] [PMID]
  9. Ghasisin L, Ahmadipour T, Mostajeran F, Moazam M, Derakhshandeh F. Evaluating the reliability and validity of phonetic information test in normal 5-6 year-old children of Isfahan city. 2013; 9(2):153-60. [DOI: 10.22122/jrrs.v9i2.811]
  10. Zarifian T, Modarresi Y, Tehrani LG, Kazemi MD, Salavati M, Sadeghi A, et al. Persian articulation assessment for children aged 3-6 years: A validation study. Iranian Journal of Pediatrics. 2017; 27(4):e8217. [DOI:10.5812/ijp.8217]
  11. Ahmadi A, Ebadi A, Kamali M, Zarifian T, Kazemi MD, Mohamadi R. Single word test for the assessment of speech sound production in Persian speaking children: Development, validity and reliability. International Journal of Pediatric Otorhinolaryngology. 2018; 114:61-6. [DOI:10.1016/j.ijporl.2018.08.018] [PMID]
  12. Cabbage K. Speech sound disorders in children. Seminars in speech and language. 2019; 40(2):79-80. [DOI:10.1055/s-0039-1677758] [PMID]
  13. Schindler O. Manuale di audiofonologopedia. Torino: Propedeutica, Omega Edizion; 1972.
  14. Tresoldi M, Ambrogi F, Favero E, Colombo A, Barillari MR, Velardi P, et al. Reliability, validity and normative data of a quick repetition test for Italian children. International Journal of Pediatric Otorhinolaryngology. 2015; 79(6):888-94. [DOI:10.1016/j.ijporl.2015.03.025] [PMID]
  15. Smith SD, Pennington BF, Boada R, Shriberg LD. Linkage of speech sound disorder to reading disability loci. Journal of Child Psychology and Psychiatry. 2005; 46(10):1057-66. [DOI:10.1111/j.1469-7610.2005.01534.x] [PMID]
  16. Stein CM, Schick JH, Taylor HG, Shriberg LD, Millard C, Kundtz-Kluge A, et al. Pleiotropic effects of a chromosome 3 locus on speech-sound disorder and reading. The American journal of human genetics. 2004; 74(2):283-97. [DOI:10.1086/381562] [PMID] [PMCID]
  17. Clarke T, Strug LJ, Murphy PL, Bali B, Carvalho J, Foster S, et al. High risk of reading disability and speech sound disorder in rolandic epilepsy families: case-control study. Epilepsia. 2007; 48(12):2258-65. [DOI:10.1111/j.1528-1167.2007.01276.x] [PMID] [PMCID]
  18. Nematzadeh s, Dadras M, Kazemi MD, Mansoorizadeh M. [Persian core vocabulary based on Iranian children (Persian)]. Tehran: Madreseh; 2011.
  19. Mahmoudi-Bakhtiyari B, Soraya M, Badiee Z, Kazemi Y, Soleimani B. The size of expressive lexicon in 18-36 month old children raised in Persiam-speaking families: a compative study. Research in rehabilitataion Sciences. 2012; 7(Supple 5):681-7. [DOI: 10.22122/jrrs.v7i5.190]
  20. Amayreh MM, Dyson AT. The acquisition of Arabic consonants. Journal of Speech, Language, and Hearing Research. 1998; 41(3):642-53. [DOI:10.1044/jslhr.4103.642] [PMID]
  21. Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy. 2019; 15(2):214-21. [DOI:10.1016/j.sapharm.2018.03.066]
  22. Kroese M, Elles R, Zimmern RL. The evaluation of clinical validity and clinical utility of genetic tests. Summary of an expert workshop, 26 and 27 June 2006, PHG Foundation; 2007.
  23. Pasha-Sharifi H. [Psychometric foundations and psychological testing (Persian)]. Tehran: Roshd; 2010.
  24. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of chiropractic medicine. 2016; 15(2):155-63. [DOI:10.1016/j.jcm.2016.02.012] [PMID] [PMCID]
  25. Shahshahani S, Vameghi R, Azari N, Sajedi F, Kazemnejad A. Validity and reliability determination of Denver developmental screening test-II in 0-6 year-olds in Tehran. Iranian journal of pediatrics. 2010; 20(3):313-22. [PMCID]
  26. Abou-Elsaad T, Quriba A, Baz H, Elkassaby R. Standardization of nasometry for normal Egyptian Arabic speakers. Folia Phoniatrica et Logopaedica. 2012; 64(6):271-7. [DOI:10.1159/000343999] [PMID]
  27. Wellman BL, Case IM, Mengert IG, Bradbury DE. Speech sounds by young children.      University of Iowa studies; 1931. https://psycnet.apa.org/record/1932-01603-001
  28. Poole I. Genetic development of articulation of consonant sounds in speech. The Elementary English Review. 1934; 11(6):159-61. https://www.jstor.org/stable/41381777?seq=1
  29. Priester GH, Post WJ, Goorhuis-Brouwer SM. Phonetic and phonemic acquisition: Normative data in English and Dutch speech sound development. International journal of pediatric otorhinolaryngology. 2011; 75(4):592-6. [DOI:10.1016/j.ijporl.2011.01.027.] [PMID]
 
Article type: Original Research Articles | Subject: Speech therapy
Received: 2020/04/8 | Accepted: 2020/10/19 | Published: 2020/12/1

Send email to the article author


Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Designed & Developed by : Yektaweb