1. Introduction
easuring The Range of Motion (ROM) is an integral part of the physical and functional evaluation of patients with musculoskeletal disorders [
1,
2]. Accurate ROM evaluations of the cervical spine are challenging due to multiple joint axes and movement coupling [
3]. This likely explains why various techniques, ranging from inclinometer to radiographic evaluation and three-dimensional motion analyses, have been used to measure the Cervical Range of Motion (CROM) in clinical practice and scientific studies [
4,
5]. Despite high accuracy, some of these techniques are difficult to be implemented in routine rehabilitation practice. This is because their use is associated with more expenses and time. Most studies suggest employing the CROM device, universal goniometer, and digital inclinometer; however, in practice, some clinicians prefer smartphones to either one of the mentioned expensive instruments or just due to being satisfied with visual estimation [
6]. Smartphone applications have become increasingly popular in recent years for their convenience, user-friendly design, and cost-effectiveness. However, a systematic review failed to support smartphone use for evaluating the CROM due to limited studies on smartphone reliability and validity; accordingly, they noted the need for further studies [
7]. Most therapists frequently use these applications; thus, it seems necessary to provide information on the extent to which differences would be expected with these instruments, compared to clinical diagnostic tools. Accordingly, this study aimed to compare the reproducibility and concurrent validity of clinometer (accelerometer-based) and compass (magnetometer-based), as known applications on IOS (used for iPhone) and Android to those of the CROM device, as the gold standard for non-invasive evaluations [
6].
We also investigated the validity and reliability of the dual digital inclinometer here. This is because despite it being the recommended method in the American Medical Association Guide [
8], to our knowledge, no study has evaluated its inter- and intra-rater reliability.
2. methods
A convenience sample of Iran University of Medical Sciences students was recruited for this cross-sectional study through advertisements and announcements. Using G-Power software for a minimal significant Intraclass Correlation Coefficient (ICC) value of 0.70 (1-β=0.80; α=0.05), with a 95% confidence interval of ±0.2, and an effect size of 0.63, a minimum of 23 subjects was required. The study participants aged 18-45 years and underwent clinical examinations. Those with a previous head or spinal injury, who underwent surgery for spinal or shoulder girdle disease or pain, or those who reported an intermittent headache within the last 6 months were excluded from the survey [
9]. Each study subject provided an informed consent form to participate in the study. The study was approved by the Ethics Committee of Iran University of Medical Sciences (no. 27284).
Four non-invasive tools were assessed in the present research, as follows: CROM device (Performance Attainment Associates, Roseville, MN, USA), JTechDualer IQ Digital Inclinometer (JTech Medical, Salt Lake City, UT, USA), Android smartphone (Galaxy A5; Samsung Electronics, Vietnam), and iPhone (6S; Apple Inc, USA). The iPhone 6S was equipped with a 6-axis combination gyroscope-accelerometer (InvenSense) and 3-axis accelerometer (Bosch BsMA280). The accuracy and reproducibility of hand-operated tools may be directly influenced by the examiner’s expertise; therefore, two orthoses and prostheses doctoral candidates with several years of clinical experience conducted the assessments. An independent observer recorded the data. Before initiating the data gathering process, to warm up and familiarization, after providing instructions on the correct way of performing each cervical motion, the study subjects were allowed to practice the movements for 5 times.
For the CROM assessments in the sagittal and frontal planes, the research subjects sat upright on an 18-in chair with the knees at 90° of flexion, feet flat on the ground, arms relaxed at the sides, and head and neck in a neutral position [
10,
11,
12]. The assessment tool selection process was randomized to reduce learning effects, fatigue, and flexibility alterations [
13]. Each examiner measured each movement 3 times per tool. Besides, the mean scores of the measurement were used in the statistical analysis. To determine intra-rater reliability, the test-retest sessions were conducted 7 days apart [
5] by the lead researcher (F. Gh). All test-retest conditions, including time, place, tools, and inter-trial rest interval were similar. Both examiners independently evaluated the study participants and recorded their data. Additionally, the examiners were blinded to each other’s measurements.
For the sagittal assessments, the examiner secured the CROM device to the study participant’s head (
Figure 1).
To assess cervical movements in the sagittal plane, a digital inclinometer was employed. When measuring the smartphone’s clinometer application, the examiner snugly held the smartphone in both hands (
Figure 2).
The examiner stood beside the research subject, who was instructed to flex the neck to the point of tightness or discomfort; return it to a neutral position by staring at the spot on the wall; then extend it as much as possible.
Frontal motion assessments by the CROM device were performed with the examiner in front of the study participant reading the values on the forehead. For the digital inclinometer, a primary sensor was attached to a head strap at the back of the head. Moreover, a secondary sensor was similarly held by the examiner on the scapular spine (
Figure 3).
The smartphone was held at the back of the study participant’s head to measure the frontal plane motions using the clinometer application. After calibration, the research subject was instructed to start in a neutral position; laterally flex the neck to the right maximally; return to the neutral position, and laterally flex the neck to the maximum left.
The rotation arm of the CROM device was added to the tool. Next, the magnetic yoke was placed on the study subject’s shoulder for calibration. The examiner was standing directly behind and above the research subject and could see the subject’s top of head and tip of the nose. The examiner then stated: “when staring at an imaginary horizontal line on the wall, turn your head to the point of tightness or discomfort”. To avoid thoracic and shoulder girdle movements, the study subject was also instructed as follows: “do not move your shoulders or change the extent of pressure being applied to the backrest of your chair”.
Cervical ROM assessments were conducted according to the digital inclinometer’s catalog using only the primary sensor. The rotation was measured with the study subjects in the supine position on a bench; the examiner was also sitting on a chair holding the primary sensor on the research subject’s forehead. A 10-min rest was allowed between conditions. For the horizontal motion assessment using the smartphone compass application, the examiner stood behind the study participant. Accordingly, the examiner adjusted the neutral position and snugly secured the phone on the study subject’s vertex using the fingers and palms (
Figure 4).
After reading the initial degree, the examiner instructed the research subject to rotate to the right and pause for a second, when the assistant read the appearing degree. The study participant then returned to the neutral position, the assistant read the degree, and the participant rotated to the left.
Data normality was investigated using the Shapiro-Wilk test. ICC models 3, k, and 2, k were used for the inter-and intra-rater analyses, respectively. Cicchetti’s [
14] classification was used to interpret the relative reliability indices. Accordingly, reliability of ICC<0.40 was poor, 0.40-0.59 was moderate, 0.60-0.74 was good, and 0.75-1 was excellent. The Standard Error of Measurement (SEM=SD×√(1-ICC)) was calculated to evaluate absolute reliability. This is an estimate of the error value associated with the measurement, i.e. used to calculate the Minimal Detectable Change (MDC=√2×1.96×SEM). This measure indicates a clinically-significant inter-measurement difference. The Pearson correlation coefficient was calculated to verify the validity of the iPhone, Android smartphone, and dual digital inclinometer. The same test was applied to determine the correlations between their measured ROM and that of the CROM device. The correlation size with the rule of thumb suggested by Mukaka was interpreted as negligible (0.00-0.30), low (0.30-0.50), moderate (0.50-0.70), high (0.70-0.90), or very high (0.90-1). A Bland-Altman plot was drawn to determine the agreement in ROM measured with the iPhone, the Android smartphone, and the dual digital inclinometer to the ROM measured using the CROM device. The Bland-Altman plot was plotted per tool from the average mean measurements obtained by a tool and the gold standard versus their differences (
Appendix A,
B &
C).
The 95% limits of agreement were calculated using the equation Limits of Agreement (LOA) = 95% Mean Difference ± 1.96 SD, which specifies the limit of difference between the two tools for 95% of the time. The main investigator (F.Gh) rated intra-rater reliability and criterion validity.
3. Results
Twenty-four volunteers (11 women, 13 men) with the Mean±SD age of 28.78±1.15 years (range: 22-40 years) participated in this study.
Table 1 displays the study subjects’ demographic details.
One research participant failed to attend the second evaluation session; therefore, the intra-rater results include 23 cases. The Mean±SD scores of the ROM measurements for all devices and directions are provided in
Table 2.
The CROM device and digital inclinometer presented excellent reliability for all planes (ICC=0.76-0.92 & 0.76-0.91, respectively) and desirable inclinometer reliability for flexion (ICC=0.62). The iPhone’s clinometer and compass applications indicated excellent intra-rater reliability for measuring cervical motion (ICC=0.75-0.88). In cervical motion assessments, the intra-rater reliability of the Android’s smartphone clinometer and compass in the sagittal and frontal planes revealed excellent inter-rater reliability (ICC=0.76-0.93); whereas that of the compass application was moderate for the left rotation (ICC=0.43) and poor for the right rotation (ICC=0.20) (
Table 3).
For the CROM device assessments, the inter-rater reliabilities in the sagittal, frontal, and horizontal planes were measured as excellent (ICC=0.84–0.96). The digital inclinometer demonstrated excellent reliability (ICC=0.75-0.86), except for the right lateral flexion (ICC=0.74) and left rotation (ICC=0.72). The inter-rater reliability of the iPhone applications for measuring cervical motion in three planes was excellent (ICC=0.79-0.91) for all movements, but flexion, i.e. moderate (ICC=0.5). The assessments of sagittal and frontal motions using the Android clinometer application were excellent (ICC=0.88–0.89); however, the reliabilities of the compass application for measuring the right and left rotations were poor (ICC=-0.01 & ICC=0.21, respectively) (
Table 4).
The validity analysis of the dual digital inclinometer indicated a high correlation between extension and right lateral flexion; a moderate correlation between left lateral flexion, flexion, and right rotation; as well as a low correlation for left rotation (
Table 5).
The iPhone presented a high or very high correlation for all movements, except flexion. The validation analysis of the Android smartphone measurements indicated a high correlation for extension and lateral flexion; moderate correlation for flexion; and low correlation for rotation. The Bland-Altman plots revealed that the dual digital inclinometer suggested a higher ROM for rotation and lower for other movements, compared to the CROM device. The iPhone illustrated a lower ROM for flexion and extension and a higher ROM for other movements. The Android smartphone tended to reflect greater ROM for right lateral flexion than the CROM device and lower ROM for other motions than the CROM device.
4. Discussion
Recently, with the emergence of multiple goniometric applications, smartphones have become popular medical devices among healthcare professionals. Several studies have evaluated the reliability and validity of smartphones for measuring cervical ROM [
6,
15,
16,
17]. However, no study has compared iPhone and Android smartphone measurements; nor has any study investigated the reliability and validity of the new gyroscope-accelerometer technology of the iPhone 6. Furthermore, despite dual inclinometry being recommended by the American Medical Association [
8], no study has verified its validity and reliability. Therefore, the present study aimed to determine the accuracy and inter- and intra-rater reliabilities of the iPhone, Android smartphone, and digital inclinometer. We also intended to determine their correlations with the gold standard (i.e. the CROM device) [
6].
The present study data demonstrated that the CROM device had excellent inter-day reliability for all cervical motion measurements. Moreover, this is not a new finding and has been supported by numerous studies [
4,
11,
12,
18,
19,
20,
21,
22]. The dual digital inclinometer also presented excellent inter-day reliability for all cervical motion measurements; the only exception was flexion, which revealed desirable inter-day reliability. Data on the reproducibility of the dual digital inclinometer are scarce. Therefore, it is impossible to compare our results with those of the previous studies. Prushansky et al. [
23] investigated the intra-rater reliability of a single digital inclinometer and reported good to excellent reproducibility in all planes. We found excellent intra-rater reliability concerning all planes for the clinometer and compass applications of the iPhone. Tousignant-Laflamme et al. [
6] reported moderate to excellent intra-rater reliability for the clinometer application of the iPhone. These data concerned movements in the frontal and sagittal planes. They also found poor to moderate intra-rater reliability for the compass application of the iPhone. Such discrepancy between our data and their results may be attributed to the difference in the number of trials. This is because the number of trials affects the ICC. Consistent with our study findings, Quek et al. [
15] reported the intra-rater reliability of the Android smartphone clinometer application to be excellent (ICC=0.82-0.9). The Android smartphone compass application indicated poor to moderate inter-day reliability in rotation, whereas Quek et al. [
15] reported poor intra-rater reliability in this regard (ICC=0.05-0.33).
Clinically, absolute reliability indices, such as SEM and MDC are more essential than the relative reliability of measurements. This is because the ICC provides information about the ability to maintain position over repeated measurements [
24]. It was unable to identify actual CROM changes that occur as a result of therapeutic interventions. For this reason, SEM and MDC values were extracted from the test-retest paradigm. The patterns of absolute reliability indices were slightly different from those of the relative reliability. Accordingly, the dual digital inclinometer revealed the highest absolute reliability, signifying the lowest SEM and MDC.
The MDC of the iPhone was 5.3 degrees for left lateral flexion to 14.3 degrees for flexion. Concerning the Android smartphone, the lowest MDC was obtained for the left lateral flexion but equaled 16.5 degrees for the left rotation and 25 degrees for the right rotation. These results indicated that a real change in cervical flexion should be equal to >14.3 degrees for detection by the iPhone clinometer application. However, a real change in the right and left rotations should be as >25 degrees and >16.5 degrees, respectively, for detection by the Android compass application. Thus, as the minimum detectable alternations presented high rates, the instrument could not detect the actual changes that occur in a course of treatment. Therefore, the Android smartphone seems to be unable to distinguish individual variations in the horizontal plane. It also fails to detect clinically-relevant changes in re-evaluations during the therapeutic course.
For the CROM device, the inter-rater reliability of the measurements of all motions was obtained as excellent. The inter-rater reliability of the inclinometer and iPhone applications was high, like the intra-rater reliability. Subsequently, consistent results were obtained in measurements repeated by an examiner as were those by a different examiner using the same evaluation procedures. Tousignant-Laflamme et al. [
6] reported moderate inter-rater reliability for assessing flexion/extension and lateral/flexion by the iPhone clinometer. There exist possible explanations for such difference between our results and those of Tousignant-Laflamme and associates [
6]. In the present study, the tool selection order was randomized to reduce the variability caused by fatigue, learning effect, and flexibility alteration; however, measurement tool use order was the same in the study of Tousignant -Laflamme et al. [
6] and iPhone measurements were always performed before CROM device assessments. For rotation, the iPhone compass application revealed poor inter-rater reliability (ICC=0.07-0.09). Moreover, the Android clinometer reflected excellent inter-rater reliability values, whereas the Android compass application suggested poor reliability for assessing rotation. Quek et al. [
15] performed no inter-rater reliability evaluations of the Android smartphone.
The correlation coefficients of the inclinometer were calculated as moderate to high, compared to those of the CROM device; the only exception was left rotation, which revealed a low correlation. This is probably because the rotation measurement with the inclinometer was performed in the supine instead of the sitting position. However, based on the 95% limit of agreement, the differences in the inclinometer and CROM device varied (2-27 degrees) by movement direction. The iPhone revealed a high to very high correlation with the CROM device for movements, but flexion. However, the differences in the iPhone and CROM device measurements were 1.2-18.6 degrees. The differences between the Android smartphone and CROM device measurements were obtained as 7.8-24.2 degrees. This degree of difference from the gold standard cannot be clinically-overlooked. This is because it affects cervical disorder diagnosis as well as the rating of cervical disorders and therapeutic strategy planning. Another possible justification for interpreting the findings may relate to how we determined neutral head position in the present study. We visually controlled the neutral head position using self-balancing maneuvers. This may have resulted in inconsistent starting positions of all trials and measurement errors with the Android smartphone, iPhone, and dual inclinometer. However, such errors did not occur with the CROM device, because we measured the total range (final minus initial position). In addition, the weaker correlation of the Android smartphone with the CROM device can be attributed to the characteristics of this smartphone, i.e. the Android smartphone calibration likely has low accuracy [
25]. Besides, the compass application used to measure horizontal plane motion is highly sensitive to mobile orientation; it is a magnetometer-based application and may easily drift, leading to greater measurement errors.
We acknowledge that this study had a few limitations. The smartphones used in this study were only a few months old; thus, we cannot claim that the same results will be achieved using older smartphones.
5. Conclusion
The current research results indicated that the dual inclinometer, iPhone clinometer, and compass applications have acceptable absolute and relative reliability for measuring neck movements in all planes. The reproducibility and accuracy of the Android clinometer application were also acceptable for use in the sagittal and frontal planes; however, its compass application in the horizontal plane revealed the lowest ICC and largest error. According to our results, the assessed tools differed from the gold standard depending on the movement direction; this should be considered when diagnosing cervical disorders and determining therapeutic plans.
Ethical Considerations
Compliance with ethical guidelines
The purpose of the study and the data collection process was explained to the subjects. All subjects participated in this research voluntarily. The study was confirmed by the ethics committee of Iran University of Medical Sciences (no. 27284).
Funding
This article extracted from a research project and the resource funding was provided by Research Deputy of IUMS at School of Rehabilitation Sciences.
Authors' contributions
Conceptualization: Mojtaba Kamyab, Fatemeh Azadinia, Faezeh Ghorbani; Methodology, software, validation, formal analysis: All authors; Investigation, visualization: Faezeh Ghorbani, Fatemeh Azadinia; Writing – original draft: Faezeh Ghorbani, Fatemeh Azadinia; Writing – review & editing: Mojtaba Kamyab, Fatemeh Azadinia; Funding acquisition: Mojtaba Kamyab; Resources: Mojtaba Kamyab, Amir Ahmadi; Supervision: Mojtaba Kamyab.
Conflict of interest
All authors declared no conflicts of interest.
Acknowledgments
The authors appreciate Shahrbanoo Bidari and Azin Jalali for assisting with the data collection and the study participants.
References
- Kolber MJ, Hanney WJ. The reliability and concurrent validity of shoulder mobility measurements using a digital inclinometer and goniometer: a technical report. International journal of sports physical therapy. 2012; 7(3):306-13. [PMCID]
- Reese NB, Bandy WD. Joint range of motion and muscle length testing. 3th ed. Philadelphia: Saunders; 2016. https://www.elsevier.com/books/joint-range-of-motion-and-muscle-length-testing/reese/978-1-4557-5882-1
- Bogduk N, Mercer S. Biomechanics of the cervical spine. I: Normal kinematics. Clinical Biomechanics. 2000; 15(9):633-48. [DOI:10.1016/S0268-0033(00)00034-6]
- Youdas JW, Carey JR, Garrett TR. Reliability of measurements of cervical spine range of motion-comparison of three methods. Physical therapy. 1991; 71(2):98-104. [DOI:10.1093/ptj/71.2.98] [PMID]
- ordan K, Dziedzic K, Jones PW, Ong BN, Dawes PT. The reliability of the three‐dimensional FASTRAK measurement system in measuring cervical spine and shoulder range of motion in healthy subjects. Rheumatology. 2000; 39(4):382-8. [DOI:10.1093/rheumatology/39.4.382] [PMID]
- Tousignant-Laflamme Y, Boutin N, Dion AM, Vallée CA. Reliability and criterion validity of two applications of the iPhone™ to measure cervical range of motion in healthy participants. Journal of neuroengineering and rehabilitation. 2013; 10(1):69. [DOI:10.1186/1743-0003-10-69] [PMID] [PMCID]
- Rehan Youssef A, Gumaa M. Validity and reliability of smartphone applications for clinical assessment of the neuromusculoskeletal system. Expert review of medical devices. 2017; 14(6):481-93. [DOI:10.1080/17434440.2017.1325319] [PMID]
- Cocchiarella L, Andersson CBJ. Guides to the evaluation of permanent impairment. 5th ed. Chicago: American Medical Association; 2000. https://www.amazon.com/Guides-Evaluation-Permanent-Impairment-Fifth/dp/1579470858
- Evans NR, Hooper G, Edwards R, Whatling G, Sparkes V, Holt C, et al. A 3D motion analysis study comparing the effectiveness of cervical spine orthoses at restricting spinal motion through physiological ranges. European Spine Journal. 2013; 22(1):10-15. [DOI:10.1007/s00586-012-2641-0] [PMID] [PMCID]
- Sforza C, Grassi G, Fragnito N, Turci M, Ferrario VF. Three-dimensional analysis of active head and cervical spine range of motion: effect of age in healthy male subjects. Clinical Biomechanics. 2002; 17(8):611-4. [DOI:10.1016/S0268-0033(02)00071-2]
- Fletcher JP, Bandy WD. Intrarater reliability of CROM measurement of cervical spine active range of motion in persons with and without neck pain. Journal of Orthopaedic & Sports Physical Therapy. 2008; 38(10):640-5. [DOI:10.2519/jospt.2008.2680] [PMID]
- Audette I, Dumas JP, Côté JN, De Serres SJ. Validity and between-day reliability of the Cervical Range of Motion (CROM) device. Journal of Orthopaedic & Sports Physical Therapy. 2010; 40(5):318-23. [DOI:10.2519/jospt.2010.3180] [PMID]
- Werner BC, Holzgrefe RE, Griffin JW, Lyons ML, Cosgrove CT, Hart JM, et al. Validation of an innovative method of shoulder range-of-motion measurement using a smartphone clinometer application. Journal of shoulder and elbow surgery. 2014; 23(11):e275-82. [DOI:10.1016/j.jse.2014.02.030] [PMID]
- Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment. 1994; 6(4):284-90. [DOI:10.1037/1040-3590.6.4.284]
- Quek J, Brauer SG, Treleaven J, Pua YH, Mentiplay B, Clark RA. Validity and intra-rater reliability of an Android phone application to measure cervical range-of-motion. Journal of neuroengineering and rehabilitation. 2014; 11:65. [DOI:10.1186/1743-0003-11-65] [PMID] [PMCID]
- Pourahmadi MR, Bagheri R, Taghipour M, Takamjani IE, Sarrafzadeh J, Mohseni-Bandpei MA. A new iPhone application for measuring active craniocervical range of motion in patients with non-specific neck pain: a reliability and validity study. The Spine Journal. 2018; 18(3):447-57. [DOI:10.1016/j.spinee.2017.08.229] [PMID]
- Guidetti L, Placentino U, Baldari C. Reliability and criterion validity of the smartphone inclinometer application to quantify cervical spine mobility. Clinical spine surgery. 2017; 30(10):E1359-66. [DOI:10.1097/BSD.0000000000000364] [PMID]
- Williams MA, Williamson E, Gates S, Cooke MW. Reproducibility of the cervical range of motion (CROM) device for individuals with sub-acute whiplash associated disorders. European spine journal. 2012; 21(5):872-8. [DOI:10.1007/s00586-011-2096-8] [PMID] [PMCID]
- Hickey ER, Rondeau MJ, Corrente JR, Abysalh J, Seymour CJ. Reliability of the cervical range of motion (CROM) device and plumb-line techniques in measuring resting head posture (RHP). Journal of Manual & Manipulative Therapy. 2000; 8(1):10-7. [DOI:10.1179/106698100790811346]
- Rheault W, Albright B, Byers C, Franta M, Johnson A, Skowronek M, et al. Intertester reliability of the cervical range of motion device. Journal of Orthopaedic & Sports Physical Therapy. 1992; 15(3):147-50. [DOI:10.2519/jospt.1992.15.3.147] [PMID]
- Capuano-Pucci D, Rheault W, Aukai J, Bracke M, Day R, Pastrick M. Intratester and intertester reliability of the cervical range of motion device. Archives of physical medicine and rehabilitation. 1991; 72(5):338-40. archives-pmr.org/article/0003-9993(91)90254-G/pdf
- Tousignant M, Smeesters C, Breton AM, Breton É, Corriveau H. Criterion validity study of the cervical range of motion (CROM) device for rotational range of motion on healthy adults. Journal of Orthopaedic & Sports Physical Therapy. 2006; 36(4):242-8. [DOI:10.2519/jospt.2006.36.4.242] [PMID]
- Prushansky T, Dvir Z. Cervical motion testing: methodology and clinical implications. Journal of manipulative and physiological therapeutics. 2008; 31(7):503-8. [DOI:10.1016/j.jmpt.2008.08.004] [PMID]
- Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports medicine, 1998; 26(4):217-38. [DOI:10.2165/00007256-199826040-00002] [PMID]
- McGhee B. How to calibrate the compass on your Android phone [Internet]. 2018 [Updated 2018 August 4]. Available from: https://www.nextpit.com/how-to-calibrate-compass-on-android