Volume 20, Issue 3 (September 2022)                   Iranian Rehabilitation Journal 2022, 20(3): 327-332 | Back to browse issues page


XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Siminghalam M, Alibakhshi H, Bakhtiyari J, Salmani M, Doostian Y. Investigation of the Sensitivity and Specificity of the Persian Version of the New Multidimensional Depression Scale in Diagnosing Depressive Disorder. Iranian Rehabilitation Journal 2022; 20 (3) :327-332
URL: http://irj.uswr.ac.ir/article-1-1494-en.html
1- Neuro-Muscular Rehabilitation Research Center, Semnan University of Medical Sciences, Semnan, Iran.
2- Department of Speech Therapy, Faculty of Rehabilitation, Semnan University of Medical Sciences, Semnan, Iran.
3- Department of Counseling, University of Social Welfare and Rehabilitation Sciences, Tehran, Iran.
Full-Text [PDF 489 kb]   (185 Downloads)     |   Abstract (HTML)  (550 Views)
Full-Text:   (79 Views)
1. Introduction
Depression as one of the most prevalent psychiatric disorders makes people to be referred to psychiatric clinics. Depression includes up to 75% of inpatients in psychiatric wards [1]. Precise and accurate evaluation of depression signs and symptoms is the key step to diagnose and design appropriate and effective therapeutic interventions [2, 3]. To this point, clinical observations and empirical studies categorized depression semiotics around four symptomatic axes, including emotional, cognitive, physical, and interpersonal symptoms [4]. However, looking at current studies on depression symptoms show that only three categories (emotional, cognitive, and physical symptoms) have been a major concern and interpersonal symptoms have been underestimated [5]. The diagnostic and statistical manual of mental disorders , 5th edition (DSM-5) also eliminated most of the interpersonal defects from the diagnostic criteria of depression [6]. 
The lack of research on interpersonal symptoms of people with depression may be a result of structures of the most common tools structures designed to assess depression symptoms. Cheung and Power investigated 15 measures designed to evaluate depression symptoms and found out that only 3% of items in these measures were assigned to interpersonal symptoms [7]. Even, Beck depression inventory-II (BDI- II) as the main self-report scale [8] does not evaluate any depression interpersonal symptoms. It seems one of the solutions to fill the gap in the literature related to interpersonal symptoms of people with depression is to develop valid and reliable tools which have optimal sensitivity and specificity to diagnose and intervene accurately. The new multidimensional depression scale (NMDS) developed by Cheung and Power was probably the first tool to assess all four axes of depression symptoms [7].
The NMDS has been adapted to the Persian. Investigating psychometric features of the Persian NMDS showed that it had satisfactory convergent and divergent validity and high validity among people with depression (Cronbach’s alpha coefficients between 0.70-0.83), and healthy students (Cronbach’s alpha coefficients between 0.89-0.93) [9, 10]. However, this tool needs further psychometric evaluation before it becomes a daily clinical tool to evaluate depressive symptoms. The crucial feature that needs to be described is the accuracy of the Persian version of the new multidimensional depression scale (P-NMDS) in the report of the presence or absence of depression compared to the diagnosis of a psychiatrist. Such features should be evaluated in the terms of sensitivity, specificity, and cut-off score. 
The trade-off between specificity and sensitivity in the ROC curve is considered an exchange between true positive rate and false positive rate. To achieve this aim, this study was implemented to calculate the diagnostic accuracy of the Persian NMDS by calculating sensitivity, specificity, and the ROC curve analysis. 
2. Materials and Methods
Participants 
The experimental group included 55 patients with major depressive disorder in a stable phase recruited by the convenience sampling method. An experienced psychologist conducted a structured clinical interview one by one in a quiet and proper room in the department of psychiatry of Taleghani Hospital, Tehran City, Iran, to select participants according to the inclusion and exclusion criteria of the current study. Participants should be between 18 and 40 years of age and have major depressive disorder diagnosed by a psychiatrist according to the DSM-5 criteria. People with other types of mood disorders, such as bipolar disorder, any intense psychotic symptoms, and depression caused by drug abuse or a general medical illness were excluded from the study. 
Study sample size
The sample size was calculated via Equation 1 [11]:



 
The research team considered α=0.05, (Zα/2: 1.96). The values of sensitivity and prevalence of depression (‘Se’, and ‘Prev’ sequentially) were predetermined to be 95% and 73% [12]. The maximum marginal error or ‘d’ (the precision of estimate which is usually a predetermined value by the clinical judgment of the research team) was inserted at 0.1 with a 95% confidence level. 
The number of controls was twice of the participants with depression (n=95) matched by age. They were selected from students at three major universities in Tehran using the multi-stage using cluster sampling method (this method of sampling allows researchers to apply random sampling after determining the groups. With this approach, the researcher reaches the desired size or type of group). According to the participants’ self-report, the controls did not have any history of depression or other types of psychiatric disorders and a history of using psychiatric medicine and drug abuse in the past and present. All participants read the information sheet and signed the consent form to enter the study.
Study tools
Structured Clinical Interview for Axis I Disorders (SCID): Two different versions of the SCID are designed by First et al. for clinical and research purposes [13, 14]. The research version of the SCID abbreviated, as SCID-RV is more comprehensive and longer than the clinical version, and covers all psychiatric disorders, their subtypes, and criteria related to the intensity and the cause of the disorder. However, the present study implemented the clinical version of SCID, which was able to evaluate major psychiatric disorders because its validity and reliability have been reported for Iranian people. Sharifi et al. showed a moderate to high level of concordance (Kappa higher than 60%) for general and specific diagnoses. Moreover, the overall agreement obtained was satisfactory (the total Kappa of the current diagnoses was 52% and the total lifetime diagnoses were 55%), indicating the proper validity and desirable applicability of this interview in the Iranian community [14]. 
The Persian version of the new multidimensional depression scale (P-NMDS): Darharaj and colleagues developed the new multidimensional depression scale. This is a 48-factor scale designed to assess 4 areas of depression, including cognitive, emotional, physical, and interpersonal symptoms (12 questions for each area, a total of 48 questions) [9, 10]. Studies have indicated good internal consistency for all subscales; Cronbach’s alpha factor ranged from 0.70 for the emotional subscale to 0.83 for the interpersonal subscale [9]. Implementing the factor analysis in a non-clinical sample approved the four-factor structure of the NMDS. In this study, the internal consistency of the NMDS was satisfactory and the Cronbach’s alpha had a range from 0.89 for the somatic subscale to 0.93 for the cognitive subscale [10]. Its items are scored based on a five-point Likert scale (0=never to 4=always). Therefore, the total score for each subscale has range from 0 to 48. The P-NMDS after being implemented on a group of Iranian patients with major depressive disorder and non-depressed individuals showed a satisfactory convergent validity (i.e., the correlation of the scale’s total score with the total score of the BDI-II questionnaire) and the re-test reliability in the sample of patients with depression (with validity reliability of 0.52 and the re-test reliability of 0.76) and non-depressed subjects (with a reliability coefficient of 0.68 and a re-test reliability of 0.78). Thus, the P-NMDS can evaluate the presence and intensity of depression symptoms in Iranian people well [9].
Study procedure
The present study was designed to evaluate some psychometric features of the P-NMDS. To run the study, the examiner who was a Ph.D. student in psychology was introduced to the department of psychiatry of Taleghani Hospital. Each patient who visited the clinic received the research information sheet, and the clients who signed the consent form were interviewed according to the clinical version of SCID. The clinical version of SCID was implemented in one session for 45 to 90 minutes. Participants of both groups (experimental and control) filled out the P-NMDS individually according to the instructions on the scale. The examiner was present during the whole session to help in case of any ambiguity or difficulty with the items’ meanings.
Study statistical analysis
In SPSS 21, in addition to descriptive analysis of data, analytical tests including Shapiro-Wilk and independent t test were used to find possible data distribution and differences. To calculate the diagnostic accuracy of the P-NMDS, the receiver operating characteristic (ROC) curve was implemented [15]. 
3. Results
Table 1 presents the demographic characteristics of the participants, including gender distribution, age, and marital status. The Mean±SD of total depression scores in the group of patients with major depressive disorder was 137.56±12.01 and 47.42±29.98 in the control group. To summarize, highlight, and emphasize the differences between the two groups, the compare means procedure was applied. Based on the results of the independent t test, the difference in the total score of depression between the two groups was significant (P˂0.001; t (148)=-21.30), so that the average depression score in the clinical group was significantly higher than the control group (Table 1).



The ability of the P-NMDS to categorize people in clinical and control groups was evaluated via ROC analysis. Table 2 lists the new psychometric features of this scale according to the ROC analysis. 
Table 2 lists the best score calculated based on Youden Index. This score showed high sensitivity and specificity, and the best balance between these two psychometric features was 106. Therefore, 106 was considered the best cut-off score of the P-NMDS with a sensitivity of 100 (true positive), specificity of 95.79 (true negative), positive prediction of 93.2 and negative prediction of 100.



Analysis of the ROC curve revealed a critical value of 106 as the best cut-off score to assess the perceived P-NMDS. As seen in Table 3, the area beneath the curve was 99%, which is significantly different from 50% of the random estimations suggesting the high accuracy of the scale according to Strainer and Cairney [16].



4. Discussion
P-NMDS is one of the most comprehensive scales used to assess the symptoms of depression. It has already been validated in 2016 by Darharaj et al. [9]. The sample size of the present study (n=55) can be considered proper for investigating the diagnostic accuracy of the P-NMDS. Our results indicated that the P-NMDS was able to discriminate patients from controls with a sensitivity of 100 and a specificity of 95.79. To find out the best cut-off score to categorize clients into two groups with depression and without depression in the P-NMDS, the ROC curve analysis was applied and the score of 106 had the highest sensitivity and specificity.
Cheung and Power developed the original version of NMDS and evaluated the reliability, validity, and confirmatory factor analysis. However, the diagnostic accuracy of the NMDS was not their aim [17]. When Darharaj and colleagues adapted the NMDS for the Persian community, the diagnostic accuracy of the P-NMDS was not in their perspective, too [9, 10]. Therefore, the results of the present study should be compared with the results of other studies administered to assess the diagnostic accuracy of other questionnaires on depression. Iverson & Remick reported a cut-off score of 9, a sensitivity of 0.92, and a specificity of 0.99 for the British Colombia major depression inventory, the test did not identify about 8% of the cases with depression and had 1.5% false positives [18]. Krishnamoorthy and colleagues in a systematic and meta-analysis article reviewed the diagnostic accuracy of all versions of the geriatric depression scale. Among 53 papers with 17,018 participants, the sensitivity and specificity of all forms of the geriatric depression scale were 86-74% and 75-71% in order [19]. Basker and colleagues evaluated the psychometric features of the Beck depression inventory to be used in the diagnosis of depression in adolescence. They reported a cut-off score ≥22, sensitivity of 27.3%, and specificity of 90% for Beck depression inventory in adolescence [20].
5. Conclusion
Since the NMDS and the adapted version have not been investigated in many different studies, it is difficult to reach a firm conclusion. However, regarding the figures obtained in the present study and with a rough comparison with results reported for other types of tools to diagnose depression, the professional can use this scale to diagnose the depression. The present study confirmed that this tool is highly sensitive and specific to diagnose and differentiate depression in nonclinical populations, which means the P-NMDS can be considered a proper tool in the diagnosis of depression especially when the experts want to take the interpersonal symptoms of depression into their accounts to diagnose this disorder.
Limitation
It is important to note that the widespread use of PNMDS requires clinical and non-clinical settings and further evaluation in different cultures. Since the sample of this study was limited to students and outpatients, generalizing the results to other people without a university education or hospitalization should be done with caution. Future studies may be conducted in larger samples and different populations.
Ethical Considerations
Compliance with ethical guidelines

The Ethics Committee of the Semnan University of Medical Sciences approved the project (IR.SEMUMS.REC.1395.68).
Funding
Semnan University of Medical Sciences financially supported this study (Grant No.: 1072)
Authors' contributions
All authors equally contributed to preparing this article.
Conflict of interest
The authors declared no conflict of interest.
Acknowledgments
The authors thank the participants for their contribution in the present study. They also thank the financial support of the Semnan University of Medical Sciences.


References
  1. Brown GW, Harris T. Social origins of depression: A study of psychiatric disorder in women. London: Routledge; 2001. [DOI:10.4324/9780203714911]
  2. Hammen CL, Gotlib IH. Handbook of depression. New York: Guilford Press; 2008. [Link]
  3. Kistner JA, David CF, White BA. Ethnic and sex differences in children’s depressive symptoms: Mediating effects of perceived and actual competence. Journal of Clinical Child and Adolescent Psychology. 2003; 32(3):341-50. [PMID]
  4. Consultant Clinical Psychologist Mick Power. Mood disorders: A handbook of science and practice. New Jersey: Wiley; 2004. [Link]
  5. Baker ZG, Krieger H, LeRoy AS. Fear of missing out: Relationships with depression, mindfulness, and physical symptoms. Translational Issues in Psychological Science. 2016; 2(3):275-82. [DOI:10.1037/tps0000075]
  6. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. Washington, DC: American psychiatric association; 2013. [DOI:10.1176/appi.books.9780890425596]
  7. Cheung HN, Power MJ. The development of a new multidimensional depression assessment scale: Preliminary results. Clinical Psychology & Psychotherapy. 2012; 19(2):170-8. [PMID]
  8. Beck AT, Steer RA, Brown G. Beck depression inventory-II. Psychological Assessment. 1996; 78(2):490-8. [DOI:10.1037/t00742-000]
  9. Darharaj M, Habibi M, Power MJ, Farzadian F, Rahimi M, Kholghi H, et al. Inpatients with major depressive disorder: Psychometric properties of the new Multidimensional Depression Scale. Asian Journal of Psychiatry. 2016; 24:103-9. [PMID]
  10. Darharaj M, Habibi M, Power MJ, Pirirani S, Tehrani F. Factor structure and psychometric properties of the new multidimensional depression scale in a nonclinical sample. Clinical Psychologist. 2018; 22(1):63-71. [DOI:10.1111/cp.12106]
  11. Hajian-Tilaki K. Sample size estimation in diagnostic test studies of biomedical informatics. Journal of Biomedical Informatics. 2014; 48:193-204. [DOI:10.1016/j.jbi.2014.02.013] [PMID]
  12. Montazeri A, Mousavi SJ, Omidvari S, Tavousi M, Hashemi A, Rostami T. [Depression in Iran: A systematic review of research (Persian)]. Payesh. 2013; 12(6):567-94. [Link]
  13. Spitzer RL, Williams JB, Gibbon M, First MB. The structured clinical interview for DSM-III-R (SCID): I: history, rationale, and description. Archives of General Psychiatry. 1992; 49(8):624-9. [DOI:10.1001/archpsyc.1992.01820080032005] [PMID]
  14. Sharifi V, Asadi SM, Mohammadi MR, Amini H, Kaviani H, Semnani Y, et al. [Reliability and feasibility of the Persian version of the structured diagnostic interview for DSM-IV (SCID) (Persian)]. Advances in Cognitive Science. 2004; 6(2):10-22. [Link]
  15. Mohammadi K, Borjali A, Eskandari H, Delavar A. Clinical effectiveness of children’s depression inventory for diagnosing depression disorder of children and adolescents. Journal of Clinical Psycology. 2010; 2(1):1-8. [Link]
  16. Streiner DL, Cairney J. What’s under the ROC? An introduction to receiver operating characteristics curves. The Canadian Journal of Psychiatry. 2007; 52(2):121-8. [PMID]
  17. Cheung HN, Chan SW, Williams JM. Validation of Chinese Multidimensional Depression Assessment Scale (MDAS) in Inner Mongolia pregnant women and risk factors of antenatal depression in Inner Mongolia in the era of one-child policy. PLoS One. 2020; 15(3):e0227944. [DOI:10.1371/journal.pone.0227944] [PMID] [PMCID]
  18. Iverson GL, Remick R. Diagnostic accuracy of the British Columbia major depression inventory. Psychological Reports. 2004; 95(3 Pt 2):1241-7. [DOI:10.2466/pr0.95.3f.1241-1247] [PMID]
  19. Krishnamoorthy Y, Rajaa S, Rehman T. Diagnostic accuracy of various forms of geriatric depression scale for screening of depression among older adults: Systematic review and meta-analysis. Archives of Gerontology and Geriatrics. 2020; 87:104002. [PMID]
  20. Basker M, Moses PD, Russell S, Russell PS. The psychometric properties of Beck Depression Inventory for adolescent depression in a primary-care paediatric setting in India. Child and Adolescent Psychiatry and Mental Health. 2007; 1(1):8. [PMID] [PMCID]
Article type: Original Research Articles | Subject: Occupational therapy
Received: 2021/10/22 | Accepted: 2022/03/13 | Published: 2022/09/19

Send email to the article author


Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Designed & Developed by : Yektaweb