Volume 21, Issue 1 (March 2023)                   Iranian Rehabilitation Journal 2023, 21(1): 147-156 | Back to browse issues page


XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Meimandi M, Azad A, Niketeghad G, Lajevardi L. Psychometric Features of the Patient Evaluation Measure in Iranian Individuals With Wrist Disorders. Iranian Rehabilitation Journal 2023; 21 (1) :147-156
URL: http://irj.uswr.ac.ir/article-1-1692-en.html
1- Department of Occupational Therapy, Rehabilitation Research Center, School of Rehabilitation Sciences, Iran University of Medical Sciences, Tehran, Iran.
Full-Text [PDF 660 kb]   (311 Downloads)     |   Abstract (HTML)  (897 Views)
Full-Text:   (238 Views)
1. Introduction
The wrist is recognized as a key joint in upper extremity functionality. Impairments in the wrist lead to pain, instability, dysfunction, and decreased quality of life (QoL) [1, 2, 3]. Approximately, 20% of referrals to emergency rooms are due to wrist injuries [4]. Assessment is considered an essential part of the intervention process for these injuries [5, 6]. Most assessment tools for wrist injuries are objective measures (i.e. sensation, strength, range of motion). Due to the complexity of hand function, these tools can not reflect the patient’s subjective experience, such as pain and patient satisfaction [7, 8].
Over the past decade, assessment has shifted towards activity and participation levels. Occupational therapy, with a client-centered approach, calls for evaluation tools for evidence-based clinical decisions to maximize activity and participation in daily life [5, 6]. The importance of patient-reported outcome (PRO) measures is well-known [7, 9] and they are classified into general, regional, and specific disease groups [10]. Numerous PROs have been designed in this regard, but most of them have time-consuming administration and scoring procedures [7, 11]. 
The patient evaluation measure (PEM) designed by Macey et al. evaluates the treatment process and the hand’s current state [12]. This measure has been used and validated for individuals with carpal tunnel syndrome [7, 13, 14], Dupuytren contracture [15], trigger finger [16], scaphoid fracture [11], and distal radius fracture [17] in English and Polish languages. Compared to the disabilities of the arm, shoulder, and hand (DASH) and Michigan hand outcome questionnaire (MHQ), the PEM has more comprehensibility and less administration time [7, 11]. Moreover, clinical and objective evaluations, such as range of motion have been reported to be less sensitive and reliable than self-report measures [18]. The subjective experience of patients can assist clinicians in designing suitable treatment approaches. The original version of the PEM is a valid and reliable tool for assessing hand outcomes. However, there are no data regarding its use for patients with the Persian language, which may limit its use in the Persian-speaking population. The purpose of this study was to examine the psychometric features of the Iranian version of the PEM in people with wrist disorders. We hypothesized that the Persian version of the PEM would show equivalent results to previous psychometric studies, with acceptable reliability and validity. 

2. Materials and Methods
Participants 

Ninety individuals (Mean±SD of age, range: 40.86±12.99, 19-72) with wrist disorders (fracture, nerve impairment, tendinopathy, and rheumatoid arthritis) were recruited from Shariati Hospital and rehabilitation centers in Tehran, Iran. Inclusion criteria were: (a) diagnosis of wrist disorders according to the physician or medical records; (b) no significant cognitive impairments (a score of ≥21 on mini-mental status examination [19]); (c) absence of neurological disorders, such as multiple sclerosis, stroke, and Parkinson’s disease; and (d) ability to read and write in Persian language. Written informed consent was provided by all participants. The minimum sample size was 5-10 times more than the number of measure’s items (i.e. 14 items). The recruitment ended with 90 individuals as the power exceeded 0.8 [20]. 

Instruments
PEM is a well-documented tool for assessing hand outcomes. This measure consists of 19 questions in three sections: (A) Treatment: five questions regarding the patient’s point of view toward the therapist ;(B) Hand health profile: 11 questions regarding hand health and function, such as pain, dexterity, strength, activities of daily living, and general assessment; and (C) Overall assessment: three questions regarding patient’s viewpoint regarding satisfaction with the treatment process. This measure is administered for each wrist separately. Questions are scored on a 7-point Likert scale (normal to severe injury). The total score is calculated by summing the score of section B and C questions and represented as the percentage of the maximum possible score. Higher scores denote a worse outcome [12]. Acceptable validity (construct validity: ρ=0.66-0.85), reliability (internal consistency: Cronbach’s α=0.94), and responsiveness (effect size=0.97) has been reported for the English version.
Quick-disabilities of the arm, shoulder, and hand (Q-DASH) evaluates the extent of upper extremity disability. The Q-DASH is an 11-item questionnaire, with each item scored from 1 to 5. Each item is scored on a 5-point Likert scale. The total score (0=no disability; 100=maximum disability) is calculated with the Equation 1

 Higher scores reflect more severity of functional problems. The Persian version with acceptable validity and reliability was used in the present study. The Persian Q-DASH has acceptable reliability (Cronbach’s α=0.90) and validity (convergent validity: 0.67) [21, 22].
Visual analogue scale-pain (VAS-P) is a subjective measure of pain. The individuals are asked to rate the severity of their pain by marking a 10-cm line between two extremes of 0 (no pain) and 10 (maximum pain) [23]. This analogue scale has high reliability [24].
JAMAR hand-grip dynamometer is used to evaluate grip strength. The participant sits on a chair with the shoulder in adduction and neutral rotation, the arm in 90° flexion, and the forearm and wrist in a neutral position. The individual is asked to press the second handle with minimal pain. The average value of three trials (kilograms) was reported as the participant’s score. Grip strength has high reliability in symptomatic and asymptomatic patients [25].

Translation process
After obtaining translation permission from the developer [12], the forward-backward translation process was done in accordance with the international QoL assessment guidelines [26]. Two independent naïve Persian translators translated the English PEM into Persian. These forward versions were discussed in a panel of authors and translators and a preliminary forward version was created. For the backward translation phase, another two translators who were unfamiliar with the original PEM translated the forward version into English. The inconsistencies between backward versions were debated. The final Persian version is provided in Appendix 1.

Procedures
Demographic and patient-related characteristics were recorded. An experienced occupational therapist administered the PEM, Q-DASH, VAS-P, and JAMAR hand-grip dynamometer in a random manner. The PEM was administered two weeks later for determining test-retest reliability. All assessments were performed in the morning. The average assessment time was 20 minutes.

Data analysis
The normal distribution of data was checked via the Shapiro-wilk test. Descriptive statistics (Mean±SD, and frequency) were used for demographic and patient-related characteristics. Face validity was determined with 20 patients with wrist disorders in both qualitative and quantitative methods. They were asked to provide their opinion regarding the ambiguity and comprehensibility of questions in the qualitative method. Item impact score was calculated for each question with a 5-point Likert scale with the Equation 2:

An item impact score of ≥1.5 was considered acceptable for each question [27]. Content validity was examined with 20 specialists (i.e. occupational therapists, physical therapists, and physicians) with at least five years of experience in qualitative and quantitative methods. Specialists were asked to express their opinion regarding simplicity, clarity, wording, and grammar. The content validity ratio (CVR) was calculated according to Lawshe [28], with values ≥0.42 considered acceptable. Content validity index (CVI) values of >0.79, 0.79-0.70, and <0.70 were deemed acceptable, questionable, and unacceptable, respectively [29]. The acceptability of the PEM was determined by floor and ceiling (cut-off < 15%) effects. Convergent validity was explored by examining the relationship between PEM and Q-DASH, VAS-P, and grip strength by the means of Spearman rank correlation coefficient (strong: ρ≥0.70; moderate: 0.3<ρ<0.7; weak: ρ<0.30) [30]. Internal consistency was assessed using Cronbach’s α, with a value >0.7 deemed as acceptable [31]. Test-retest reliability was evaluated by calculating the intra-class correlation (ICC) coefficient (two-way random, absolute agreement). An ICC >0.7 is considered acceptable [31, 32]. Absolute reliability was examined by the standard error of measurement (SEM) and minimal detectable change (MDC) values. The SEM and MDC values were estimated by the following formulas: An SEM value of <½ SD denotes good precision of the measure. A P-value of less than 0.05 was deemed significant in all analyses. Statistical analysis was conducted using IBM SPSS software, version 16.0.

3. Results
The study population (n=90) consisted of 41 males (45.6%) and 55.55% had left wrist disorders. The mean age ± SD of the participants was 40.86±12.99. Detailed demographic characteristics are illustrated in Table 1.

The total score of the PEM was not normally distributed. As shown in Table 2, all questions were comprehensive and understandable, with an item impact score and CVR score of >1.5 and >0.42, respectively. All questions except for questions 1 (CVI=0.76) and 10 (CVI=0.73) of section B had a CVI score of <0.79.

Therefore, question 1 was changed from “The feeling in my hand is now” to “The tactile feeling in my hand is now” based on experts’ opinions. Moreover, the Likert response score of question 10 was changed from “embarrassed & self-conscious” to “feeling bad & embarrassed”. After changes were applied, the CVI score for these questions (question 1=0.83; Question 10=0.87) reached acceptable criteria. There was a significant (P<0.001) moderate correlation between the “Hand health profile” section of the PEM score with Q-DASH (ρ=0.47) and VAS-P (ρ=0.64). The “Hand health profile” section of the PEM showed a weak and insignificant (P>0.05) correlation with grip strength. The “overall assessment” section of the PEM showed a significant (P<0.01) weak correlation (ρ=0.25) with Q-DASH and an insignificant (P>0.05) weak correlation with VAS-P (ρ=0.12) and grip strength (ρ=0.02). The total score of the PEM showed a significant moderate correlation with Q-DASH (ρ=0.51; P<0.001) and VAS-P (ρ=0.55; P<0.001) and an insignificant weak correlation with grip strength (ρ=-0.11; P>0.05) (Table 3).

Floor and ceiling effects were 0% for the “hand health profile” and “overall assessment” sections and total PEM score, indicating sufficient acceptability. The Cronbach’s α coefficient values for the “hand health profile” and “overall assessment” sections and total PEM score were 0.72, 0.87, and 0.77, respectively. The ICCs for the “Hand health profile” and “overall assessment” sections and total PEM score was 0.98, 0.97, and 0.96, respectively. The SEM and MDC values were low for the “hand health profile” (SEM=1.01; MDC: 2.81) and “overall assessment” (SEM=0.45; MDC: 1.24) sections and total PEM score (SEM=2.43; MDC=6.72) (Table 3).


4. Discussion
The aim of this study was to evaluate the psychometric properties of the PEM in Iranian individuals with wrist disorders. The results suggest that the PEM has acceptable reliability and validity.
The results showed that this measure has favorable translation and all questions have satisfactory face and content validity. The face and content validity of the PEM was established in a consensus meeting by hand surgeon attendees [6, 12]. Schoneveld et al. stated that the PEM has doubtful content validity [6]. However, qualitative content validity was reported as appropriate in the present study. To the authors’ best knowledge, no studies have been conducted to investigate the face and content validity of the quantitative method. Therefore, the item impact score, CVR, and CVI values presented in the present study are novel information and cannot be compared with previous studies.
The total score of the PEM showed a significant moderate correlation with Q-DASH and VAS-P. Forward et al. [17] and Hobby et al. [7] reported a significant high (ρ=0.66-0.85) correlation between the PEM and DASH scores. Higher correlation coefficients in these studies may be explained by the fact that they had a homogenous sample (i.e. carpal tunnel syndrome or distal radius fracture). The moderate correlation between the PEM and VAS-P is justifiable due to the impact of pain on performance and satisfaction [33]. Additionally, an insignificant weak correlation was demonstrated with grip strength, a finding consistent with the results of Forward et al. [17]. Grip strength is an objective outcome while the PEM is a subjective measure. Moreover, this finding can be explained through the fact that the PEM measures grip alongside other outcomes (i.e. feeling, cold intolerance, pain, dexterity, flexibility, activities of daily living, work, self-consciousness, and distress). Therefore, grip strength alone has a weak correlation with the PEM. 
The acceptability analysis revealed no floor or ceiling effect for the PEM. Schoneveld et al. reported that no information exists for this feature of the measure [6]. Acceptable internal consistency was found for PEM, indicating the homogeneity of the PEM questions. This result was in line with previous studies [7, 11, 14, 17, 34, 35]. The ICC values obtained for the PEM reflect high reliability, which is consistent with the results of Sharma et al. [35]. The SEM and MDC values obtained in this study indicated a small measurement error and sufficient accuracy for use in therapeutic interventions.
The strength of this study was the inclusion of individuals with various wrist disorders. Future studies should be conducted on other populations with different diagnoses, such as neurological disorders.

5. Conclusion
The present study suggests that the PEM has acceptable validity and reliability for measuring performance and satisfaction in individuals with wrist disorders. This measure might contribute as an outcome measure in research and routine assessments in clinical practice.

Ethical Considerations
Compliance with ethical guidelines

The study was approved by the ethics committee of the Iran University of Medical Sciences (IR.IUMS.REC.1394.9211255207). In order to protect the confidentiality, a code was given to each participant.

Funding
This research did not receive any grant from funding agencies in the public, commercial, or non-profit sectors. 

Authors' contributions
Conceptualization, methodology: Laleh Lajevardi and Akram Azad; Investigation and resources: Golara Niketeghad; Writing the original draft: Mahsa Meimandi; Writing, review & editing: Mahsa Meimandi, Laleh Lajevardi and Akram Azad; Funding acquisition and supervision: Laleh Lajevardi.

Conflict of interest
The authors declared no conflict of interest. 

Acknowledgments
The authors would like to thank Reza Shahriar Kamrani and the patients in the orthopedic clinic of Dr. Shariati Hospital.


References
  1. Simmen B, Kolling C, Herren D. (iv) The management of the rheumatoid wrist. Current Orthopaedics. 2007; 21(5):344-57. [DOI:10.1016/j.cuor.2007.09.003]
  2. Smith J. Fundamentals of hand therapy: Clinical reasoning and treatment guidelines for common diagnoses of the upper extremity. The Canadian Journal of Occupational Therapy. 2015; 82(2):128. [DOI:10.1177/0008417415570472]
  3. Abolfazli M, Lajevardi L, Mirzaei L, Abdorazaghi HA, Azad A, Taghizadeh G. The effect of early intervention of mirror visual feedback on pain, disability and motor function following hand reconstructive surgery: A randomized clinical trial. Clinical Rehabilitation. 2019; 33(3):494-503. [DOI:10.1177/0269215518811907] [PMID]
  4. Van Eck M, Lameijer C, El Moumni M. Structural validity of the Dutch version of the disability of arm, shoulder and hand questionnaire (DASH-DLV) in adult patients with hand and wrist injuries. BMC Musculoskeletal Disorders. 2018; 19(1):1-10. [DOI:10.1186/s12891-018-2114-7] [PMID] [PMCID]
  5. Taylor J, Kersten P. The patient-rated wrist and hand Evaluation: A systematic review of its validity and reliability. New Zealand Journal of Physiotherapy. 2014; 42(2):139-45. [DOI:10.1080/03014223.2014.886600]
  6. Schoneveld K, Wittink H, Takken T. Clinimetric evaluation of measurement tools used in hand therapy to assess activity and participation. Journal of Hand Therapy. 2009; 22(3):221-36. [DOI:10.1016/j.jht.2008.11.005] [PMID]
  7. Hobby J, Watts C, Elliot D. Validity and responsiveness of the patient evaluation measure as an outcome measure for carpal tunnel syndrome. Journal of Hand Surgery. 2005; 30(4):350-4. [DOI:10.1016/J.JHSB.2005.03.009] [PMID]
  8. Bindra R, Dias JJ, Heras-Palau C, Amadio P, Chung K, Burke F. Assessing outcome after hand surgery: The current state. Journal of Hand Surgery. 2003; 28(4):289-94. [DOI:10.1016/S0266-7681(03)00108-6] [PMID]
  9. Cooper C. Fundamentals of hand therapy-e-book: Clinical reasoning and treatment guidelines for common diagnoses of the upper extremity. Amsterdam: Elsevier Health Sciences; 2013. [Link]
  10. Squire R. Fundamentals of hand therapy: Clinical reasoning and treatment guidelines for common diagnosis of the upper extremity. British Journal of Occupational Therapy. 2014; 77(8):435-6. [DOI:10.1177/030802261407700806]
  11. Dias J, Bhowal B, Wildin C, Thompson J. Assessing the outcome of disorders of the hand: Is the patient evaluation measure reliable, valid, responsive and without bias? The Journal of Bone and Joint Surgery British volume. 2001; 83(2):235-40. [DOI:10.1302/0301-620X.83B2.0830235] [PMID]
  12. Macey A, Burke F, Abbott K, Barton N, Bradbury E, Bradley A, et al. Outcomes of hand surgery. The Journal of Hand Surgery: British & European Volume. 1995; 20(6):841-55. [DOI:10.1016/S0266-7681(95)80059-X] [PMID]
  13. Cartwright-Terry M, Miah A, Savage R. Using the patient evaluation measure for patients undergoing carpal tunnel decompression. InOrthopaedic Proceedings. 2011; 93(6). [Link]
  14. Piotuch B, Żyluk A. An Assessment of the usefulness of patient evaluation measure questionnaire as an outcome measure after carpal tunnel surgery. Polish Journal of Surgery. 2010; 6(82):347-53. [DOI:10.2478/v10035-010-0050-9]
  15. Dias J, Sayeed L, Bhowal B, editors. MCID for the patient evaluation measure as a patient rated outcome measure for Dupuytren contracture. International conference on Dupuytren disease and related disorders Groningen, Netherlands, Werker, Paul & Dias, Joseph for International Dupuytren Society Videorecording; 2015. [DOI:10.1007/978-3-319-32199-8_55]
  16. Papiez K, Trybus M, Stepańczak B, Łoboda K, Pokrowiecki W, Gadek A. Evaluation of trigger finger operative treatment and quality of life improvement with PEM (patient evaluation measure) questionnaire. Przeglad Lekarski. 2013; 70(7):437-9. [Link]
  1. Forward D, Sithole J, Davis T. The internal consistency and validity of the patient evaluation measure for outcomes assessment in distal radius fractures. Journal of Hand Surgery (European Volume). 2007; 32(3):262-7. [DOI:10.1016/J.JHSB.2007.01.010] [PMID]
  2. Watts A, Greenstock M, Cole R. Outcome following the rehabilitation of hand trauma patients: The importance of a subjective functional assessment. Journal of Hand Surgery. 1998; 23(4):485-9. [DOI:10.1016/S0266-7681(98)80128-9] [PMID]
  3. Foroughan M, Jafari Z, Shirin Bayan P, Ghaem Magham Farahani Z, Rahgozar M. [validation of mini- mental state examination (mmse) in the elderly population of Tehran (Persian)]. Advances in Cognitive Science. 2008; 10(2):29-37. [Link]
  4. Munro BH. Statistical methods for health care research. Philadelphia: Lippincott Williams & Wilkins; 2005. [Link]
  5. Gummesson C, Ward MM, Atroshi I. The shortened disabilities of the arm, shoulder and hand questionnaire (Quick DASH): Validity and reliability based on responses within the full-length DASH. BMC Musculoskeletal Disorders. 2006; 7(1):1-7. [DOI:10.1186/1471-2474-7-44] [PMID] [PMCID]
  6. Ebrahimzadeh MH, Moradi A, Vahedi E, Kachooei AR, Birjandinejad A. Validity and reliability of the Persian version of shortened disabilities of the arm, shoulder and hand questionnaire (quick-DASH). International Journal of Preventive Medicine. 2015; 6. [DOI:10.4103/2008-7802.160336] [PMID] [PMCID]
  7. Sriwatanakul K, Kelvie W, Lasagna L, Calimlim JF, Weis OF, Mehta G. Studies with different types of visual analog scales for measurement of pain. Clinical Pharmacology & Therapeutics. 1983; 34(2):234-9. [DOI:10.1038/clpt.1983.159] [PMID]
  8. Bijur PE, Silver W, Gallagher EJ. Reliability of the visual analog scale for measurement of acute pain. Academic Emergency Medicine. 2001; 8(12):1153-7. [DOI:10.1111/j.1553-2712.2001.tb01132.x] [PMID]
  9. Coldham F, Lewis J, Lee H. The reliability of one vs. three grip trials in symptomatic and asymptomatic subjects. Journal of Hand Therapy. 2006; 19(3):318-27. [DOI:10.1197/j.jht.2006.04.002] [PMID]
  10. Aaronson N, Acquadro C, Alonso J, Apolone G, Bucquet D, Bullinger M, et al. International quality of life assessment (IQOLA) project. Quality of Life Research. 1992; 1(5):349-51. [DOI:10.1007/BF00434949] [PMID]
  11. Lacasse Y, Godbout C, Series F. Health-related quality of life in obstructive sleep apnoea. European Respiratory Journal. 2002; 19(3):499-503. [DOI:10.1183/09031936.02.00216902] [PMID]
  12. Lawshe CH. A quantitative approach to content validity. Personnel Psychology. 1975; 28(4):563-75. [DOI:10.1111/j.1744-6570.1975.tb01393.x]
  13. Polit DF, Yang FM. Measurement and the measurement of change: A primer for the health professions. Philadelphia: Wolters Kluwer; 2016. [Link]
  14. Simon SD. Statistical evidence in medical trials: What do the data really tell us? Baylor University Medical Center. 2006; 19(4):419. [PMID]
  15. Piedmont RL. Inter-item correlations. Encyclopedia of Quality of Life and Well-Being Research. 2014; 1:3303-4. [DOI:10.1007/978-94-007-0753-5_1493] [PMID]
  16. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology. 2007; 60(1):34-42. [DOI:10.1016/j.jclinepi.2006.03.012] [PMID]
  17. Dorich J, Cornwall R. Results of a grip strengthening protocol for nonspecific wrist pain in adolescents. Journal of Hand Therapy. 2018; 31(1):147. [DOI:10.1016/j.jht.2017.11.010]
  18. Dias JJ, Rajan RA, Thompson JR. Which questionnaire is best? The reliability, validity and ease of use of the patient evaluation measure, the disabilities of the arm, shoulder and hand and the michigan hand outcome measure. Journal of Hand Surgery (European Volume). 2008; 33(1):9-17. [DOI:10.1016/j.jhse.2007.07.002]
  19. Sharma R, Dias J. Validity and reliability of three generic outcome measures for hand disorders. Journal of Hand Surgery. 2000; 25(6):593-600. [DOI:10.1054/jhsb.2000.0398] [PMID]
Article type: Original Research Articles | Subject: Occupational therapy
Received: 2022/06/4 | Accepted: 2022/12/21 | Published: 2023/03/1

Send email to the article author


Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Designed & Developed by : Yektaweb