- Open Access
Reliability and measurement error of frontal and horizontal 3D spinal motion parameters in 219 patients with chronic low back pain
Chiropractic & Manual Therapiesvolume 24, Article number: 13 (2016)
In order for measurements to be clinically useful, data on psychometric conditions such as reliability should be available in the population for which the measurements are intended to be used. This study comprises a test-retest design separated by 7 to 14 days, and evaluates the intra and interrater reliability of regional frontal and horizontal spinal motion in 219 chronic LBP patients using the CA6000 Spine Motion Analyzer. In addition, it compares these results on the frontal and horizontal plane with previously published results on the sagittal plane. 219 individuals with chronic mechanical LBP, classified as either Quebec Task Force group 1, 2, 3 or 4 were included, and kinematics of the lumbar spine were sampled during standardized spinal lateral flexion and rotation motion using a 6-df instrumented spatial linkage system. Test-retest reliability and measurement error were evaluated using intraclass correlation coefficients ICC(1,1) and Bland-Altman limits of agreement (LOAs).
The reliability analysis based on the whole study sample showed ICC(1,1) coefficients varying between 0.68 and 0.73 for the frontal plane and 0.33 and 0.49 for the horizontal plane. Relatively wide LOAs were observed for all parameters. Reliability measures in patient subgroups ICC(1,1) ranged between 0.55 and 0.81 for the frontal plane and 0.28 and 0.69 for the horizontal plane. Greater ICC(1,1) coefficients and smaller LOA were observed when patients were examined by the same examiner, had a stable pain level between tests, and were male. ROM measurements were more reliable in patients with a BMI higher than 30, and measurements on patients with LBP and leg pain showed higher reliability and smaller measurement error in all parameters except for the jerk index.
Frontal plane measurements obtained using the CA6000 Spine Motion Analyzer are sufficiently reliable to be used for group comparisons but not individual comparisons. Measurements in the horizontal plane can be used for neither group nor individual comparisons.
It is widely assumed that Low Back Pain (LBP) with mechanical pain behavior is significantly influenced by biomechanical factors [1–4]. Therefore kinematics obtained using noninvasive 3-dimensional (3D) regional lumbar spinal motion instruments may be of value in generating functional diagnoses, evaluating the mechanisms of therapies, and prescribing specific rehabilitation programs [1, 2, 5], as for example in a recent clinical study on mobilization with movements in mechanical LBP patients .
In order for measurements to be clinically useful, data on psychometric conditions such as reliability should be available in the population for which the measurements are intended to be used. [7, 8]. Most reliability studies evaluating 3D regional lumbar instruments have been performed using convenience samples of asymptomatic individuals , and therefore little is known about the reliability of these methods when they are used on clinically relevant populations. In addition, it is unclear if or how movement characteristics may differ among subgroups of LBP patients, which in turn may affect reliability.
We recently presented values and estimates for reliability and measurement error of sagittal plane spinal motion using a 3D lumbar spinal motion instrument called the CA6000 Spine Motion Analyzer in chronic and care seeking LBP patients and further stratified the sample into subgroups based on body mass index (BMI), gender, differences in pain level, and Quebec Task Force classification . We found that the estimates differed substantially between the subgroups with intraclass correlation coefficients (ICC(1,1)) ranging from 0.34 to 0.77 , and a number of characteristic subgroup patterns were observed. These patterns where in general greater ICC(1,1) coefficients and smaller limits of agreement (LOA) when patients were examined by the same examiner, had a BMI below 30, had a stable pain level between test one and two, were men and could be classified in the Quebec Task Force classifications Group 1.
Previous studies using the same type of 3D regional lumbar instruments have found measures of flexion/extension and lateral bending movements to be more reliable than axial rotation [11–16] possibly related to technical difficulties with measurements performed in the horizontal plane, e.g. slipping of the mounting plates across the skin .
The overall aim of the present study is to evaluate the reliability of regional frontal and horizontal spinal motion in 219 chronic LBP patients using the CA6000 Spine Motion Analyzer. In addition, we aim to discuss potential differences between frontal and horizontal plane motion, and compare results on the frontal and horizontal plane with previously published results on the sagittal plane .
We hypothesize that frontal plane movements show better reliability and have smaller measurement error when compared to similar measures in the horizontal plane. In addition, that reliability and measurement errors in the subgroups (same or different examiner, BMI below or above 30, stable or unstable pain, gender, low back pain with or without leg pain) will follow the same pattern as in the sagittal plane motion .
During a period of 3 years from 2001 to 2004, 219 subjects were recruited for inclusion in a randomized clinical trial at the Wolfe Harris Center for Clinical Studies at Northwestern Health Science University, Minneapolis, MN, USA . Recruitment was done through local newspaper advertisements, community posters, postcard mailings, and followed by an initial screening conducted by telephone. Eligible participants included individuals from 18 to 65 years of age who had a primary complaint of mechanical low back pain of at least 6-week duration and could be classified as Quebec Task Force 1,2,3 or 4 .
Mechanical LBP was defined as pain with no specific identifiable etiology but reproducible by back movements or provocations tests. Exclusion criteria were previous lumbar spine fusion surgery, progressive neurological deficits, aortic or peripheral vascular disease, pain scores of less than 3 points (on a 0–10 point scale), ongoing treatment for back pain by other healthcare providers, or participation in pending or current litigation.
The study was approved by the institutional review boards of the Northwestern Health Sciences University, the Minneapolis Medical Research Foundation, and the University of Minnesota. Written informed consent was obtained from all the study participants.
The test-retest design was conducted as part of the baseline examination for a randomized clinical trial  and included two visits separated by 7 to 14 days. At the first visit, the participants completed a self-administered questionnaire on health history and demographics, data regarding the participants’ height and weight were recorded, and a complete neurologic examination, orthopedic tests and manual static and motion palpation of the lumbar spine and lower extremities were performed. Licensed chiropractic and medical clinicians conducted the physical examination. Nine blinded, trained and certified research clinicians conducted the objective 3D movement measurements described in detail in this article.
Subjects who qualified for the clinical trial and agreed to participate were scheduled for a second baseline visit in the clinic 7 to 14 days later, at which time the 3D motion measurements were repeated.
Kinematics of the lumbar spine movements in the frontal and horizontal plane were sampled following a standardized test protocol using a 6-df instrumented spatial linkage system with a sampling rate of 100 Hz (CA6000 Spine Motion Analyzer; OSI, Union City, CA, USA).
Attachment and procedure
Each participant wore a loose T-shirt and pants. We have previously described the attachment of the measuring device . After the participant had performed a backward and forward bending they were given the following verbal instruction to perform a left and right turning “Again, for this one, find your neutral position with your arms over your chest. Turn your torso to your left and then to your right and the back to neutral. Be sure to turn from your waist and to go as far as you can go in both directions at your own pace without pausing”. The instructor simultaneously showed the movement as he was giving the instructions. The patient was allowed to practice the movement once, and the equipment was checked before recording started. The procedure was repeated until two valid ROMs were recorded (The total ROM of one trial should be within 4° of a second trial). The outcomes of the two trials were averaged and used for the analysis.
When the left and right turning had been performed the participant was asked to stand straight and was then given the following instructions both verbally and visually “Ok, this time find your neutral position with your palms on the side of your thighs. Slide your hand down your leg as you lean to the left, then to the right, and then back to neutral. Be sure to go as far as you can go in both directions at your own pace without pausing”. The patient was allowed to practice the movement once, and the equipment was checked before recording started.
The procedure was repeated until two valid measurements had been recorded (The total ROM between two should be within 4° of each other). The outcomes of the two trials were averaged and used for the analysis.
Data processing and analysis
A comprehensive description of data processing procedure including MATLAB programming, computerized trial selection algorithm has been published elsewhere . This MATLAB program was also used to reduce the 3D data into numbered motion parameters, that where selected on the current study hypothesis, previous study findings [5, 19, 20] and clinical experience.
The following motion parameters were selected for the frontal plane:
ROM lateral flexion defined as the total angular range of spine motion in the frontal plane expressed in degrees from maximum left to right.
Mean velocity lateral flexion (°/s) defined as the central limit theorem as the average angular speed from maximum left to right.
Phase-plot area lateral flexion (°2/s) defined as the area composed by the phase-plot of lateral flexion left to right angular motion versus velocity. Phase-plot area was calculated based on cross-product calculations between vectors drawn from neutral position to each coordinate point.
Jerk index lateral flexion defined as maximum lateral flexion left to right as the mean spectral frequency of the first derivative of the angular acceleration signal multiplied by movement duration. In this way this parameter calculates the number of changes in acceleration and thereby indicates the smoothness of the motion .
The following motion parameters were determined for the horizontal plane:
ROM rotation defined as the total angular range of spine motion in the horizontal plane expressed in degrees from maximum left to right.
Mean velocity rotation (°/s) defined as the central limit theorem as the average angular speed from maximum left to right
Phase-plot area rotation (°2/s) defined as the area composed by the phase-plot of rotation left to right angular motion versus velocity. Phase-plot area was calculated based on cross-product calculations between vectors drawn from neutral position to each coordinate point.
Jerk index rotation defined as maximum rotation left to right as the mean spectral frequency of the first derivative of the angular acceleration signal multiplied by movement duration.
The statistical analysis was performed using the statistical package Stata software (StataCorp, College Station, TX, USA) version 13 on a personal computer. Taxonomy, terminology, and definitions related to reliability and measurement error are based on Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) .
Based on the study design each target was rated by a different set of the nine examiners (considered to be randomly selected from a larger population of examiners) and because we aim to generalize to individual ratings the Intraclass Correlation Coefficients (ICC1,1) were calculated to assess reliability . The intraclass correlation coefficient (ICC(1,1))  and Bland-Altman limits of agreement (LOAs)  with a 95 % confidence interval (CI) were calculated to assess test-retest reliability and to evaluate measurement error. Paired t-tests were used to detect systematic bias between tests sessions using the trial means.
We used Bland-Altman plots  and correlation analysis between absolute differences and mean values to test the assumption of normally distributed and homoscedastic data. No heteroscedastic relationships were found.
We stratified into subgroups based on pain distribution, (back and leg pain versus back pain only) by collapsing Quebec diagnostic groups 2, 3, and 4 versus Quebec diagnostic group 1 . The BMI cutoff point was based on the World Health Organization for the classification of overweight (i.e., BMI ≥ 30)  and the unstable pain subgroup was defined as patients with a change in score (the numerical rating scale) between test and retest of ±2 points or more .
Six hundred thirty individuals were considered for inclusion in the study, of these 329 were not included because they did not meet the inclusion criteria specified in the primary study . Of the 301 included, 22 did not complete both assessments and 59 were excluded due to technical problems during the testing (defects in the measuring device (N = 6) and a database storing error (N = 53)). Reasons for dropout were recorded as follows: refused to participate (N = 9), personal conflict (N = 3), increase in musculoskeletal pain (N = 3), insufficient time (N = 2), unknown reasons (N = 2), competing co-morbidity (N = 1) and change of address (N = 1)), leaving 220 complete datasets of which one was excluded because the participant had performed the side-bending movements in reverse order and thus a total of 219 datasets were available for analysis. The clinical characteristics of the study population are showed in (Table 1).
There were no differences in baseline characteristics between the final sample of 219 individuals and the 82 individuals not available for analysis with respect to BMI, gender, duration of pain, or depression score (data not shown). The individuals not available for analysis were however slightly younger (median age of 43 versus 47 years).
A statistically significant difference between session 1 and 2 was found in 3 out of 4 of the motion parameters for rotation: ROM (7.6 % higher at session 2, p = 0.009), Rotation mean velocity (13.6 % higher at session 2, p < 0.0001), Phase-plot area (15.3 % higher at session 2, p = 0.0002). For lateral flexion, a statistical difference between the two sessions was found in 2 out of the 4 motion parameters: Lateral flexion mean velocity (4.6 % higher at session 2, p = 0.043) and phase plot area (4.8 % higher at session 2, p = 0.045) (Table 2).
The reliability analysis based on the whole study sample showed ICC(1,1) coefficients varying between 0.68 and 0.73 for the frontal plane and 0.33 and 0.49 for the horizontal plane. Furthermore relatively wide LOA values (e.g. ROM ranged from −15.4 to 15.2° in lateral flexion and −25.3 to 20.1° in rotation) were found for all motion parameters in both frontal and horizontal plane movements (Table 3).
Reliability data from the subgroup analyses ICC(1,1) ranged from 0.28 to 0.69 for horizontal plane and 0.55 to 0.81 for frontal plane movements. For all parameters frontal plane movements showed higher reliability scores than movements in the horizontal plane (Table 4).
Participants with higher BMI (BMI > 30) had higher ICC(1,1) values and lower LOA scores between the two sessions in all parameters except the jerk index. Participants examined by the same examiner showed higher ICC(1,1) coefficients and smaller LOA values between the two sessions in all motion parameters except the Jerk index which showed identical ICC(1,1) coefficients in the inter and intra examiner analysis.
Participants with unstable pain showed a trend towards lower ICC(1,1) coefficients and higher LOA scores between the sessions for the frontal plane movements, whereas the horizontal plane movements showed mixed results – with ICC(1,1) coefficients being slightly lower for ROM, mean velocity and jerk index and higher for Phase-plot area.
Finally, participants with LBP and leg pain had less variation in ROM, mean velocity and Phase-plot area between the sessions, but a lower ICC (1,1) coefficient for the Jerk index when compared to participants with LBP only.
We found systematic differences between the test and retest session for three of the four motion parameters in the horizontal plane and in two of the four motion parameters in the frontal plane with one further parameter showing borderline significant differences between the two sessions. These differences most likely indicate the presence of a learning effect caused by patients’ habituation to the instrument and the testing situation.
Our hypotheses were confirmed as we found that frontal plane movements yield higher ICC(1,1) coefficients on all measured parameters and across all subgroups when compared to the horizontal plane. Frontal plane motions, exhibit moderate to good reliability with ICC(1,1) values, ranging between 0.55 and 0.8 . Therefore, frontal plane movement data obtained using the CA6000 Spine Motion Analyzer can be used for group comparisons such as those used in research but not for individual comparisons in the clinical setting. All calculated ICC(1,1) values for horizontal motion parameters range from poor to moderate, and no single parameter in the horizontal plane was found with an ICC(1,1) value above 0.69. Finally, LOA where found to be relatively wide. Although frontal plane motion parameters have slightly smaller LOA, we deem the LOA of both planes to be too wide for the CA6000 Spine Motion Analyzer to be used in clinical practice. Therefore, we cannot recommend the use of horizontal movement parameters obtained with this device for neither group nor individual comparisons, and subgroup patterns for horizontal motion should be interpreted with extra care [26, 27]. We believe, like Dvorak et al., that the lower ICC(1,1) values obtained in the horizontal plane using the CA6000 Spine Motion Analyzer may be caused by slipping of the mounting plates across the skin during rotation of the trunk. It should be noted that other types of kinematic devices have been recommended for all planes of trunk movement except extension by other authors [28, 29].
We further hypothesized that in general greater ICC(1,1) coefficients and smaller LOA would be found when patients were examined by the same examiner, had a BMI below 30, had a stable pain level, were men and could be classified in the Quebec Task Force classifications Group 1. We found that some of the patterns were as we had hypothesized in that patients, who were examined by the same examiners, had a stable pain level, and were men showed less variation between the two test sessions and had in general smaller LOA. This pattern is consistent across all three planes of motion, and it is therefore a general finding that intraexaminer measurements and measurements made on men and pain stable patients are more reliable than interexaminer measurements, and measurements made on women and patients who have unstable pain.
Among patients with a BMI above 30 and patients with both LBP and leg pain, we unexpectedly found less variation, and smaller LOA between the sessions compared to findings from patients with a BMI below 30, and among patients who had LBP without leg pain. We therefore rejected our second hypothesis as a whole because only some of the subgroup comparisons showed the expected patterns.
We observed greater ICC(1,1) coefficients, and smaller LOA in ROM for all three planes of motion among patients with a BMI above 30. We speculate that this may be because the larger body mass generally limits motion and thus these measurements likely reflect body size rather than spine function. A secondary comparative analysis on mean ROM in the frontal plane comparing patients with a BMI above 30 to patients with a BMI below 30 did indeed show that patients with higher BMI had lower ROM 44.5(9.5) (mean (SD)) versus 50.4(8.0), p < 0.0001 (paired t-test)). Another secondary analysis showed that patients who reported different pain scores between session 1 and 2, also had more changes in ROM between the two sessions if their BMI was below 30 (ICC(1,1) value 0.43), whereas patients with unstable pain and a high BMI had more similar ROM values between the two sessions (ICC(1,1) value 0.84).
On average people with LBP have reduced lumbar ROM . Our secondary analysis suggests that patients with a BMI above 30 represents a subgroup of LBP patients with even further reduced ROM. We suggest that a ROM limiting factor specific to this subgroup could be excess intraabdominal fat tissue reducing the ROM through compression. This would explain why ROM measurements on patients with BMIs above 30 appear to be quite stable even though their pain level has changed in between sessions. Another possible explanation, could be that the findings are caused by a flaw in the measurement device related to measuring ROM on patients with BMI´s above 30, i.e. increased slipping of the mounting plates caused by extra subcutaneous fat, causing the device to yield wrong but consistent results. More research investigating lumbar ROM among subgroups of LBP patients using other types of devices than the CA6000 Spine Motion Analyzer is needed to clarify this further.
Unexpectedly, we found less intersession variation among patients with both low back and leg pain. For these patients ICC(1,1) coefficients were between 0.05 to 0.28 higher than those found for patients with LBP only. A possible explanation for this phenomenon could be that patients with leg pain represent a more homogeneous population with regard to what is causing their pain.
A further comparison with our previous findings  revealed nearly identical ICC(1,1) values for the sagittal and frontal plane ROM, mean velocity and the phase-plot, when looking at patients with LBP only. However, the same comparison made among patients with LBP and leg pain revealed ICC(1,1) values to differ substantially more between the two planes of motion, but always with the frontal plane having the highest ICC(1,1) values. Together these findings indicate that when measuring patients using the CA6000 Spine Motion Analyzer, results will be equally reliable for the frontal and sagittal plane if the patients suffer from back pain without leg pain, but if the patients suffer from LBP and leg pain, the results will be more reliable for the frontal plane.
The jerk index is a particularly noteworthy parameter because it captures the quality and smoothness of the movements and not only the range. Among several observations, we have chosen three to be of particular interest. Firstly, with identical or very similar intra and interexaminer ICC(1,1) coefficients the jerk index appears to be almost unaffected by interexaminer bias. This is a consistent finding across all three motion planes . Secondly, while Jerk index ICC(1,1) values in the horizontal plane ranged from poor to low-end moderate, values in the frontal plane ranged from high-end moderate to good. Furthermore all of the ICC(1,1) values in the frontal plane were also notably higher than the previously published results from the sagittal plane  – with the lowest difference being in the males (0.80 in the frontal plane and 0.70 in the sagittal plane), and the highest difference being in the BMI > 30 group (frontal plane 0.69 and sagittal plane 0.41). This indicates that when using the Jerk Index parameter as a base-line measurement, an outcome indicator or both, frontal plane measurements will be more reliable. Thirdly, the jerk index is the only motion parameter that showed the same subgroup pattern across all three planes of motion. We therefore speculate that while ROM, Phase plot and Mean velocity may be closely related to biomechanical factors, which change in subgroups depending on the plane examined, the jerk index may instead reflect a component of locomotion that is less dependent on biomechanical factors. Such a component could be biological, i.e. a neuromuscular control mechanism or it could reflect a psychological mechanism such as fear avoidance. Adding a dynamical systems approach to study movement control and coordination as proposed by B. Spinelli et al.  may contribute to a deeper understanding of this component of locomotion.
Previous research has shown the jerk index to change significantly and differently depending on whether patients receive spinal manipulation or exercise . Possibly the jerk index reflects an underlying principle which is affected differently by these two commonly used treatment interventions. Previous Jerk index measurements in clinical trials have however been made in the sagittal plane , and results from our current analysis show Jerk index measurements to be notably more reliable when made in the frontal plane.
The CA6000 Spine Motion Analyzer has previously been described in detail and verified for precision and accuracy [15, 33–37]. A majority of these studies have found the device to have high to excellent accuracy and precision in both horizontal and frontal plane motion. A single exception to these findings is however made by Christensen, who found the device to have very high precision but less than acceptable accuracy. Christensen found the accuracy for horizontal and frontal plane signals such as those obtained in the current study to be ranging from 6.0 to 11.5 % for frontal plane signals and from 7.0 to 10.3 % for horizontal plane signals .
To reduce complexity and data abundance, the recorded 3D spinal motion data were reduced into a number of separate motion parameters. The selected parameters could be considered as reductionist models to achieve descriptive measures of complex spinal movement patterns in patients with LBP at the functional level. Obviously, selecting some parameters and certain ways to analyze means that other types of important kinematic information may remain uncovered in the data set.
This study has focused on single-plane analysis of the lumbar spine; a combined plane movement analysis may yield different results, which could be of clinical relevance .
Use of over the counter pain medication and changes in physical activity may have changed between the two sessions, but were not considered.
This study reports inter-session reliability, with the two sessions 7–14 days apart. Intra session reliability was not considered.
In addition, these results cannot be extrapolated to other technologies.
Using the CA6000 Spine Motion Analyzer, frontal plane measurements are sufficiently reliable to be used for group comparisons but not individual comparisons. Measurements in the horizontal plane can be used neither for group nor individual comparisons.
Greater ICC(1,1) coefficients and smaller LOA were observed when patients were examined by the same examiner, had a stable pain level between tests, and were male.
We found that ROM measurements were more reliable in patients with a BMI higher than 30, and measurements on patients with LBP and leg pain showed higher reliability and smaller measurement error in all parameters except for the jerk index.
The jerk index appears to be almost unaffected by interexaminer bias regardless of the examined motion plane, and it is more reliable when it is measured in the frontal plane. The jerk index is the only motion parameter to have a consistent subgroup pattern across all three planes of motion.
O'Sullivan P. Diagnosis and classification of chronic low back pain disorders: maladaptive movement and motor control impairments as underlying mechanism. Man Ther. 2005;10:242–55.
Adams MA. Biomechanics of back pain. Acupunct Med. 2004;22:178–88.
Bishop JB, Szpalski M, Ananthraman SK, McIntyre DR, Pope MH. Classification of low back pain from dynamic motion characteristics using an artificial neural network. Spine (Phila Pa 1976). 1997;22:2991–8.
Kaigle AM, Wessberg P, Hansson TH. Muscular and kinematic behavior of the lumbar spine during flexion-extension. J Spinal Disord. 1998;11:163–74.
Lehman GJ. Biomechanical assessments of lumbar spinal function. How low back pain sufferers differ from normals. Implications for outcome measures research. Part I: kinematic assessments of lumbar function. J Manipulative Physiol Ther. 2004;27:57–62.
Hidalgo B, Pitance L, Hall T, Detrembleur C, Nielens H. Short-term effects of Mulligan mobilization with movement on pain, disability, and kinematic spinal movements in patients with nonspecific low back pain: a randomized placebo-controlled trial. J Manipulative Physiol Ther. 2015;38:365–74.
Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.
de Vet HC, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59:1033–9.
Mieritz RM, Bronfort G, Kawchuk G, Breen A, Hartvigsen J. Reliability and measurement error of 3-dimensional regional lumbar motion measures: a systematic review. J Manipulative Physiol Ther. 2012;35:645–56.
Mieritz RM, Bronfort G, Jakobsen MD, Aagaard P, Hartvigsen J. Reliability and measurement error of sagittal spinal motion parameters in 220 patients with chronic low back pain using a three-dimensional measurement device. Spine J. 2013.
Dopf CA, Mandel SS, Geiger DF, Mayer PJ. Analysis of spine motion variability using a computerized goniometer compared to physical examination. A prospective clinical study. Spine (Phila Pa 1976). 1994;19:586–95.
Dvorak J, Vajda EG, Grob D, Panjabi MM. Normal motion of the lumbar spine as related to age and gender. Eur Spine J. 1995;4:18–23.
Gill KP, Callaghan MJ. Intratester and intertester reproducibility of the lumbar motion monitor as a measure of range, velocity and acceleration of the thoracolumbar spine. Clin Biomech (Bristol, Avon). 1996;11:418–21.
Lee RY, Laprade J, Fung EH. A real-time gyroscopic system for three-dimensional measurement of lumbar spine motion. Med Eng Phys. 2003;25:817–24.
McGregor AH, McCarthy ID, Hughes SP. Motion characteristics of the lumbar spine in the normal population. Spine (Phila Pa 1976). 1995;20:2421–8.
Troke M, Moore AP, Cheek E. Intra-operator and inter-operator reliability of the OSI CA 6000 Spine Motion Analyzer with a new skin fixation system. Man Ther. 1996;1:92–8.
Bronfort G, Maiers MJ, Evans RL, Schulz CA, Bracha Y, Svendsen KH, Grimm RH, Jr., Owens EF, Jr., Garvey TA, Transfeldt EE. Supervised exercise, spinal manipulation, and home exercise for chronic low back pain: a randomized clinical trial. Spine J. 2011;11:585–98.
Atlas SJ, Deyo RA, Patrick DL, Convery K, Keller RB, Singer DE. The Quebec Task Force classification for Spinal Disorders and the severity, treatment, and outcomes of sciatica and lumbar spinal stenosis. Spine (Phila Pa 1976). 1996;21:2885–92.
Jordan K, Dziedzic K, Mullis R, Dawes PT, Jones PW. The development of three-dimensional range of motion measurement systems for clinical practice. Rheumatology (Oxford). 2001;40:1081–4.
Sjolander P, Michaelson P, Jaric S, Djupsjobacka M. Sensorimotor disturbances in chronic neck pain--range of motion, peak velocity, smoothness of movement, and repositioning acuity. Man Ther. 2008;13:122–31.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–45.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.
Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.
Physical status: the use and interpretation of anthropometry. Report of a WHO Expert Committee. World Health Organ Tech Rep Ser. 1995;854:1–452.
Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, Haythornthwaite JA, Jensen MP, Kerns RD, Ader DN,. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain. 2008;9:105–21.
Portney LG, Watkins MP. Foundations of clinical research: applications to practice. 3rd ed. Upper Saddle River, N.J: Pearson/Prentice Hall; 2009.
Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, Stein RE. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11:193–205.
Hidalgo B, Hall T, Nielens H, Detrembleur C. Intertester agreement and validity of identifying lumbar pain provocative movement patterns using active and passive accessory movement tests. J Manipulative Physiol Ther. 2014;37:105–15.
Hidalgo B, Gilliaux M, Poncin W, Detrembleur C. Reliability and validity of a kinematic spine model during active trunk movement in healthy subjects and patients with chronic non-specific low back pain. J Rehabil Med. 2012;44:756–63.
Laird RA, Gilbert J, Kent P, Keating JL. Comparing lumbo-pelvic kinematics in people with and without back pain: a systematic review and meta-analysis. BMC Musculoskelet Disord. 2014;15:229.
Spinelli BA, Wattananon P, Silfies S, Talaty M, Ebaugh D. Using kinematics and a dynamical systems approach to enhance understanding of clinically observed aberrant movement patterns. Man Ther. 2015;20:221–6.
Mieritz RM, Hartvigsen J, Boyle E, Jakobsen MD, Aagaard P, Bronfort G. Lumbar motion changes in chronic low back pain patients: a secondary analysis of data from a randomized clinical trial. Spine J. 2014;14:2618–27.
Christensen HW. Precision and accuracy of an electrogoniometer. J Manipulative Physiol Ther. 1999;22:10–4.
Schuit D, Petersen C, Johnson R, Levine P, Knecht H, Goldberg D. Validity and reliability of measures obtained from the OSI CA-6000 Spine Motion Analyzer for lumbar spinal motion. Man Ther. 1997;2:206–15.
Petersen CM, Johnson RD, Schuit D, Hayes KW. Intraobserver and interobserver reliability of asymptomatic subjects' thoracolumbar range of motion using the OSI CA 6000 Spine Motion Analyzer. J Orthop Sports Phys Ther. 1994;20:207–12.
Feipel V, Rondelet B, Le Pallec J, Rooze M. Normal global motion of the cervical spine: an electrogoniometric study. Clin Biomech (Bristol, Avon). 1999;14:462–70.
Dvorak J, Antinnes JA, Panjabi M, Loustalot D, Bonomo M. Age and gender related normal motion of the cervical spine. Spine (Phila Pa 1976). 1992;17:S393–398.
Monie AP, Barrett CJ, Price RI, Lind CR, Singer KP. Computer-aided combined movement examination of the lumbar spine and manual therapy implications: Case report. Man Ther. 2015.
The first author received funding from the Nordic Institute of Chiropractic and Clinical Biomechanics.
The authors declare that they have no competing interests.
GB has acquired the data. SH, RM and JH have made the analysis and interpretation of data. SH, RM and JH have been involved in drafting the manuscript, and all authors have been active in revising the manuscript critically for important intellectual content. All authors have given final approval of the version to be published. All authors agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.