- Study protocol
- Open Access
Cost-effectiveness of spinal manipulation, exercise, and self-management for spinal pain using an individual participant data meta-analysis approach: a study protocol
Chiropractic & Manual Therapiesvolume 26, Article number: 46 (2018)
Spinal pain is a common and disabling condition with considerable socioeconomic burden. Spine pain management in the United States has gathered increased scrutiny amidst concerns of overutilization of costly and potentially harmful interventions and diagnostic tests. Conservative interventions such as spinal manipulation, exercise and self-management may provide value for the care of spinal pain, but little is known regarding the cost-effectiveness of these interventions in the U.S. Our primary objective for this project is to estimate the incremental cost-effectiveness of spinal manipulation, exercise therapy, and self-management for spinal pain using an individual patient data meta-analysis approach.
We will estimate the incremental cost-effectiveness of spinal manipulation, exercise therapy, and self-management using cost and clinical outcome data collected in eight randomized clinical trials performed in the U.S. Cost-effectiveness will be assessed from both societal and healthcare perspectives using QALYs, pain intensity, and disability as effectiveness measures. The eight randomized clinical trials used similar methods and included different combinations of spinal manipulation, exercise therapy, or self-management for spinal pain. They also collected similar clinical outcome, healthcare utilization, and work productivity data. A two-stage approach to individual patient data meta-analysis will be conducted.
This project capitalizes on a unique opportunity to combine clinical and economic data collected in a several clinical trials that used similar methods. The findings will provide important information on the value of spinal manipulation, exercise therapy, and self-management for spinal pain management in the U.S.
Chronic pain is a major public health problem, affecting more adults in the United States than heart disease, diabetes, and cancer combined . Low back and neck pain are the first and third most common chronic pain conditions in U.S. adults  with nearly one of three Americans experiencing chronic neck or low back pain in their lifetime . While the prevalence of spinal pain has been stable over the past two decades, the global burden (measured by disability adjusted life years) has increased 42% due to aging and population growth [4, 5]. Roughly 25% of U.S. adults with spine pain report limitations with physical function, 11% report limitations with social function, and 19% report limitations with work, school or household activities . With low back pain ranked first and neck pain fourth in disability worldwide, spine pain has become a burdensome health condition with considerable public health consequences [4, 5].
The economic impact of spinal pain and associated comorbidities is also substantial. An estimated $88.1 billion in healthcare expenditures (~ 4% of total healthcare spending) was directed towards low back and neck pain within the U.S. in 2013 . Diabetes and ischemic heart disease are the only conditions in the U.S. with higher levels of healthcare spending . While direct expenditures for spinal pain are large, total healthcare expenditures are even greater due to comorbidities (such as depression) . When total healthcare costs are considered, for example care of spinal pain plus associated comorbid conditions, expenditures increase to 9% of total U.S. healthcare costs (2005 data) . In addition, reduced work productivity accounts for a large proportion of the financial burden in individuals with back or neck pain. Lost productivity costs for back pain were estimated at $19.8 billion per year in 2002, with reduced productivity while still at work (i.e. presenteeism) accounting for nearly 70% of total lost productivity costs .
Spine pain management has gathered increased scrutiny amidst concerns about overutilization of costly and potentially harmful interventions and diagnostic tests. Over the past decade the number of epidural injections, opioid prescriptions, and spinal surgeries for back pain has more than doubled with little positive impact on patient outcomes [9,10,11,12,13]. Annual healthcare expenditures for individuals with spinal pain increased by 95% from 1999 to 2008 largely due to increases in medical specialist expenditures . From 1996 to 2013, the U.S. spent an additional $57.2 billion dollars per year on the management of spinal pain, which represents one of the larger increases in healthcare spending for any condition . While more conservative and potentially less costly alternatives are available to treat spinal pain, including spinal manipulation therapy (SMT), exercise therapy, and self-management, they are often underutilized. An analysis of administrative data from across the U.S. found low back pain patients are more likely to receive opioids (41%) than visit a chiropractor (39%) or physical therapist (34%) .
Complementary and integrative interventions may reduce the clinical and cost burden of spine pain. Recent data from the U.S. Medical Expenditures Panel Survey suggests complementary and integrative therapies, including SMT, reduce healthcare expenditures for spinal pain conditions; however, the cost-effectiveness of SMT within U.S. healthcare settings has not received much attention [16,17,18]. Given the increasing financial and societal burden of spinal pain, and concerns surrounding current management strategies, robust cost-effectiveness analyses (CEA) of SMT and other complementary and integrative treatments for spine pain are much needed [18,19,20,21].
Our primary objective is to estimate the incremental cost-effectiveness of spinal manipulation, exercise therapy, and self-management for spinal pain from both societal and healthcare perspectives using quality-adjusted life years (QALYs), pain intensity, and disability as effectiveness measures. We will analyze cost and clinical outcome data collected as part of eight randomized clinical trials performed in the U.S. using an individual patient data meta-analysis (IPDMA) approach. The eight randomized clinical trials used similar methods, collected similar clinical outcome, healthcare utilization, and work productivity data, and included different combinations of SMT, exercise therapy, or self-management for spinal pain.
We will use an IPDMA approach to evaluate costs and effects of spinal manipulation, exercise therapy, and self-management (i.e. home exercise & advice) for spinal pain using data from eight randomized clinical trials including a total of 1891 participants (Table 1). Each of the included trials obtained written consent from participants who were 18 years of age or older, and written patient assent and parent consent from participants 12–17 years of age. Six of the clinical trials were funded by the U.S. Department of Health and Human Services Health Resources and Services Administration [22,23,24,25,26,27] and one was funded by the National Institute of Health’s National Center for Complementary and Integrative Health . Seven of the trials are registered on clinicaltrials.gov (one trial  was initiated prior to its existence).
Settings and participants
All of the clinical trials were performed within a university-affiliated research clinic in the Minneapolis, MN metropolitan region. Six of the clinical trials were performed exclusively in MN [22,23,24,25, 28, 29] and two were multi-center studies with additional sites in Portland, OR  or Davenport, IA . Participants had commonly recognized sub-groups of spinal pain including acute or chronic neck pain, chronic low back pain, and back-related leg pain (Table 1). Five of the clinical trials included adults (18–65 years), two trials included older adults (65 years and older), and one trial focused on adolescents (12–18 years). All eight trials recruited participants from the general population primarily through mass mailings. Other recruitment strategies included advertisement in newspapers, social media, television, radio, and community posters.
In all 8 of the clinical trials, participants were required to have self-reported severity of spinal pain ≥3/10 for inclusion. Other inclusion criteria common to the 8 clinical trials included a stable medication plan and no ongoing spinal treatment prior to enrollment. Common exclusion criteria included current or pending litigation, inability to read and comprehend English, substance abuse, history of surgical spinal fusion, progressive neurological deficits, or contraindications to study treatments.
Spinal manipulation was included as an intervention in all eight trials. Supervised exercise therapy was provided in six trials and a self-management intervention focusing on home exercises and advice was also provided in six of the trials.
Spinal manipulation therapy (SMT) was delivered by licensed chiropractors over an 11–12 week intervention period in all eight trials. The treating chiropractor determined the frequency of SMT visits in six of the eight studies. The mean frequency of SMT visits ranged from 10 to 20 across the eight trials with most trials reporting a mean visit frequency between 15 and 20. SMT consisted of high velocity, low amplitude manipulation, with an option to use low velocity, variable amplitude mobilization as indicated. Brief soft tissue work (up to 5 minutes) and heat therapy were allowed to facilitate the manual treatment, if necessary, which is typical in clinical practice.
Supervised exercise therapy was delivered by licensed chiropractors, physical therapists or exercise therapists over an 11–12 week period in six trials. Five studies [22,23,24,25, 29] included 20 one-hour visits and one trial  included 8 to16, 45-min visits of one-on-one supervised exercise therapy [25, 29]. Participants completed a combination of stretching and strengthening exercises emphasizing a high number of repetitions with progressions in challenge and/or resistance over time. Exercises were tailored for each participant’s abilities and could include the use of labile surfaces in addition to balance and coordination exercises. Participants also completed a light aerobic warm-up (up to 10 min) in all of the clinical trials.
Self-management was delivered by licensed chiropractors or exercise therapists in six trials [22,23,24,25,26, 28]. Participants attended two to four one-hour visits where they were given information on basic spinal anatomy and physiology, their prognosis, self-care advice (such as heat or icing instructions), postural and ergonomic advice, and home exercise instruction. Home exercises typically included a combination of self-mobilization, stretching and strengthening exercises specific to the individual’s condition and ability.
Perspective, Time Horizon & Discount Rate
We will adopt a societal perspective for the primary analysis including all healthcare costs regardless of payer (third-party insurers, patient out-of-pocket costs) in addition to time and transportation costs associated with healthcare use and lost productivity costs for both paid and unpaid labor related to spinal pain. We will exclude future earnings and consumption costs since interventions for spinal pain are not expected to impact mortality. In addition to the societal perspective, we will adopt a healthcare perspective including only healthcare costs . A summary of resources included in the healthcare and societal perspectives are provided in Table 2. We will not adopt a patient perspective as a secondary analysis, as patient level costs (copays, co-insurance) vary considerably by health insurance plan in the U.S. and we do not have access to this data for trial participants. All eight clinical trials collected clinical outcome and healthcare utilization data for 1 year following randomization, which will therefore be the time horizon for the cost-effectiveness evaluation. No discounting (diminishing future costs and health effects to represent present value) will be applied.
In all trials, clinical and cost outcomes were collected by self-report at multiple time points over a 1 year period with similar timing (4, 12, 26, and 52 weeks). All eight trials collected clinical outcomes including pain, disability, quality of life, and work absenteeism (Table 3).
QALYs (a metric combining quality and quantity of life) will be constructed for all eight trials, using the SF6D, which was collected in seven trials, and the EQ5D-3 L, which was collected in six trials. The SF6D is derived from 11 items within the Medical Outcomes Study Short Form 36-item Health Survey (SF-36) and includes six dimensions of health, each with 4–6 different levels . We will use U.S. preferences for individual SF6D health states obtained via discrete choice experimentation, which are similar to UK values elicited with standard gamble methods . In addition, QALYs will be estimated using the EuroQol 5D-3 L (EQ5D-3 L) as a sensitivity analysis. The EQ5D-3 L measures health across five dimensions, each with three possible levels. Preferences for EQ5D-3 L health states will be determined using published values from a representative sample of the U.S. population elicited by time trade-off methods . Finally, one study of adolescents  assessed health related quality of life using the pediatric quality of life inventory (PedsQL) which has recently been mapped to the EQ5D in a UK adolescent population .
Self-reported pain intensity was measured using the 11-box numerical rating scale (NRS) and was the primary outcome in each of the eight trials. The NRS is a reliable and valid outcome measure for individuals with spinal pain and is recommended as a core outcome domain by both the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials group and the NIH task force on research standards for chronic low back pain [35, 36].
Disability was measured with reliable and valid measures commonly used in spine pain research: the Neck Disability Index (four trials) [37, 38] and Roland-Morris Disability Questionnaire (four trials) . The CEA using disability as the effectiveness outcome will use standardized mean differences due to the variation in disability measures. Standardized mean differences provide a uniform scale for meta-analysis of outcomes measured with different psychometric scales. The standardized mean difference reports the size of the treatment effect relative to the amount of variability between participants in the same treatment group within each study . A standardized mean difference of one equates to a treatment effect that is the size of one standard deviation across studies.
Direct healthcare costs
Healthcare utilization outcomes collected include the number of provider visits by specialty, types of services provided, and medication use. The number of provider visits and medication use were collected using standardized self-report questionnaires in all eight trials, and more detailed information regarding the types of services provided (e.g. MRI, injections) was collected by phone interviews in five of the trials. A list of procedures and corresponding Current Procedural Terminology (CPT)/ Healthcare Common Procedure Coding System (HCPCS) codes will be compiled and unit costs for each procedure will be determined using Medicare’s national allowable payment. Unit costs for non-covered services under Medicare (such as acupuncture) will be determined using Medicare’s published relative value unit for the corresponding CPT code. Unit costs for medication will be determined using the average cost per prescription day from Medicare’s prescription drug profiles public use file. All unit cost estimates will be converted to a recent common price year in U.S. dollars using the Centers for Medicare and Medicaid Services Personal Health Care Expenditure deflator to account for inflation .
A human capital approach including lost productivity costs for both paid and unpaid labor (such as retirees or homemakers) will be used . Lost work productivity due to absenteeism was collected using a modified question from the U.S. National Health Interview Survey (seven trials) . Participants reported the number of days in the past month they were unable to carry out their daily work (in or away from home) due to spine pain. We will value each day as 8 hours of reduced productivity using age specific U.S. national pre-tax median hourly wage rates plus fringe benefits . We will report productivity costs for paid labor, unpaid labor and their combined total.
Time & Transportation Costs
Time and transportation costs associated with healthcare utilization will be included using an opportunity cost approach (valuing resources according to their best alternative use). A standardized time unit for each procedure will be multiplied by the age specific U.S. national post-tax median wage rate plus fringe benefits for each participant. Healthcare related transportation costs will be estimated using average distance and transportation time estimates for medical care in the U.S. as reported in the National Household Travel Survey . Transportation time will be valued using age-specific national post-tax median wage rates plus fringe benefits . The U.S. Internal Revenue Service’s standard mileage deduction rate for operating an automobile will be used to value transportation costs.
Clinical outcomes will be analyzed using hierarchical linear mixed models to account for correlation within subjects due to repeated measures. Time weighted averages using linear interpolation will be used to determine mean clinical outcomes over the 1 year time horizon. Baseline clinical outcomes (QALYs, pain, and disability) will be included as covariates.
Cost outcomes analyses
Cost data for healthcare and medication use, time and transportation, and lost productivity will be analyzed using generalized estimating equations specifying an appropriate distribution (such as Poisson, negative binomial, or gamma) and link to model mean costs over the 1 year time horizon . Cost distributions are frequently skewed with a heavy tail as a small number of participants are responsible for a large proportion of cost. We will account for this by bootstrapping cost and outcome data using 5000 bootstrap samples taken with replacement with the trial participant as the unit of observation.
We will rank treatments by mean outcome and determine the incremental cost-effectiveness ratio (ICER) by dividing incremental costs by incremental effects. We will not calculate ICERs for treatments which are dominated (more expensive, less effective); however, we will report uncertainty of cost and effect differences for dominated interventions . Bias-corrected bootstrap confidence intervals will be calculated and the bootstrapped cost-effect pairs will be plotted on the cost-effectiveness plane to graphically display uncertainty surrounding the ICER . We will use cost-effectiveness acceptability curves (graphical display of uncertainty that an intervention is cost-effective at different willingness to pay thresholds for 1 year of perfect health) to determine the probability each treatment is cost-effective based on a range of recommended willingness to pay thresholds for a QALY within the U.S . Additionally, we will use net monetary benefit analyses to present confidence intervals over a large range of willingness to pay thresholds (the amount of money a decision maker would be willing to pay for 1 year of full health given a fixed budget) .
Missing data analyses
The pattern of missing clinical outcome and cost data will be assessed to determine the appropriate imputation strategy and sensitivity analysis. If data are missing at random (differences between missing and observed data are related only to other observed data), multiple imputation and likelihood based estimation techniques such as linear mixed models will be used [49, 50]. If there is suspicion that data are not missing at random, sensitivity analyses will be performed by imputing data accounting for missingness explanations (such as refusal of assigned treatment or dropout due to poor treatment response).
Individual participant data meta-analysis (IPDMA)
Stage One: First, for each perspective (societal, healthcare) and comparison (e.g. SMT vs self-management), we will identify trials for possible meta-analysis. Next, we will determine individual trial estimates for differences in effectiveness, costs, and incremental cost-effectiveness.
Stage Two: We will combine studies using random effects models  to produce pooled cost-effectiveness estimates. Prior to pooling, we will visually inspect individual trial estimates of effectiveness and costs using forest plots and determine the amount of statistical heterogeneity using the I2 statistic. If no more than minimal heterogeneity is detected for both estimates of effectiveness and costs (I2 < 50%, with consistent direction and magnitude of estimates), we will report the pooled estimates. It is possible we will encounter more than minimal heterogeneity when attempting to combine data from multiple spinal pain trials. If heterogeneity prevents statistical pooling and cannot be explained by a priori defined sub-group analyses, we will report the individual trial cost-effectiveness results.
Regardless of our ability to pool, we will perform a limited number of a priori determined subgroup analyses, which are especially relevant for decisions in clinical practice [53, 55]. This may explain heterogeneity (if it exists) identified in stage two of the IPDMA. We will determine if differences in cost-effectiveness exist due to 1) age; 2) pain location (neck, back, and leg pain); 3) duration of pain (acute vs chronic); and 4) type of comparison (head to head vs add-on comparison; e.g. SMT+ supervised exercise vs supervised exercise alone).
Combined analyses of economic data are rarely possible due to differences in resource utilization outcomes, costs and healthcare settings [56, 57]. Additionally, individual clinical trials rarely include a sufficient number of participants to detect important differences in economic outcomes. This project represents a unique opportunity to potentially combine clinical and economic data collected in eight randomized clinical trials using an IPDMA approach. This will provide more precise estimates of the cost-effectiveness of spinal manipulation, exercise therapy, and self-management compared to analysis of the individual trials. Further, an IPDMA approach has many advantages over traditional meta-analysis including the ability to conduct standardized within-study analyses, account for missing data at the individual level, and investigate potential sub-group effects at the participant level which may account for heterogeneity in estimates across studies .
While systematic reviews have found promising evidence of the cost-effectiveness of SMT for spinal pain, particularly when productivity costs are considered, [58,59,60,61,62] the original studies have limitations that draw attention to the need for further high quality CEAs [18, 20]. Few existing CEAs have adopted both societal (including lost productivity costs) and healthcare perspectives [59, 61, 62] to facilitate the applicability of findings to multiple audiences (including policy makers and health-care systems) . Additionally, high rates of missing cost and QALY data are common among the existing studies. This project will address these issues by using an IPDMA approach to combine data from multiple, comparable RCTs with high follow up rates, and will report cost-effectiveness estimates from both societal and healthcare perspectives. Limitations of our approach include relying on participant self-report for non-study related healthcare use, the absence of costs for informal caregiver time due to spinal pain within the societal perspective, and the potential that interventions within the trials were protocolized relative to real world application.
The generalizability of existing cost-effectiveness studies to the U.S. healthcare system is also a concern [18, 20, 21]. A limited number of studies have been conducted in the U.S [62, 63]. Further, few studies have assessed SMT delivered by chiropractors [62, 64], the profession responsible for providing the majority of SMT services in the U.S . Cost-effectiveness research on SMT from European healthcare settings does not readily transfer to the U.S. where healthcare costs are much higher [66, 67]. For this project, all of the trials were performed within the U.S. and assessed SMT delivered by chiropractors. This project will fill an important gap in providing new information regarding the value SMT, exercise therapy, and self-management for managing spinal pain within the U.S. healthcare system. Comparisons to U.S. based cost-effectiveness estimates for other common spinal pain treatments will be made when possible to provide context regarding the relative value of these treatments.
Current Procedural Terminology
Healthcare Common Procedure Coding System
Individual participant data meta-analysis
Numerical rating scale
Pediatric quality of life inventory
Quality-adjusted life year
Randomized clinical trial
Spinal manipulation therapy
Institute of Medicine. Relieving pain in America: a blueprint for transforming prevention, care, education, and research. Washington, DC: The National Academies Press; 2011.
Johannes CB, Le TK, Zhou X, Johnston JA, Dworkin RH. The prevalence of chronic pain in United States adults: results of an internet-based survey. J Pain. 2010;11(11):1230–9.
Von Korff M, Crane P, Lane M, Miglioretti DL, Simon G, Saunders K, Stang P, Brandenburg N, Kessler R. Chronic spinal pain and physical-mental comorbidity in the United States: results from the national comorbidity survey replication. Pain. 2005;113(3):331–9.
Hoy D, March L, Brooks P, Blyth F, Woolf A, Bain C, Williams G, Smith E, Vos T, Barendregt J, et al. The global burden of low back pain: estimates from the global burden of disease 2010 study. Ann Rheum Dis. 2014;73(6):968–74.
Hoy D, March L, Woolf A, Blyth F, Brooks P, Smith E, Vos T, Barendregt J, Blore J, Murray C, et al. The global burden of neck pain: estimates from the global burden of disease 2010 study. Ann Rheum Dis. 2014;73(7):1309–15.
Martin BI, Deyo RA, Mirza SK, Turner JA, Comstock BA, Hollingworth W, Sullivan SD. Expenditures and health status among adults with back and neck problems. JAMA. 2008;299(6):656–64.
Dieleman JL, Baral R, Birger M, Bui AL, Bulchis A, Chapin A, Hamavid H, Horst C, Johnson EK, Joseph J, et al. US spending on personal health care and public health, 1996-2013. JAMA. 2016;316(24):2627–46.
Stewart WF, Ricci JA, Chee E, Morganstein D, Lipton R. Lost productive time and cost due to common pain conditions in the US workforce. JAMA. 2003;290(18):2443–54.
Deyo RA, Mirza SK, Turner JA, Martin BI. Overtreating chronic back pain: time to back off? J Am Board Fam Med. 2009;22(1):62–8.
Pinto RZ, Maher CG, Ferreira ML, Hancock M, Oliveira VC, McLachlan AJ, Koes B, Ferreira PH. Epidural corticosteroid injections in the management of sciatica: a systematic review and meta-analysis. Ann Intern Med. 2012;157(12):865–77.
Deshpande A, Furlan A, Mailis-Gagnon A, Atlas S, Turk D. Opioids for chronic low-back pain. Cochrane Database Syst Rev. 2007;3:CD004959.
Staal JB, de Bie R, de Vet HC, Hildebrandt J, Nelemans P. Injection therapy for subacute and chronic low-back pain. Cochrane Database Syst Rev. 2008;3:CD001824.
Deyo RA, Von Korff M, Duhrkoop D. Opioids for low back pain. BMJ. 2015;350:g6380.
Davis MA, Onega T, Weeks WB, Lurie JD. Where the United States spends its spine dollars: expenditures on different ambulatory services for the management of back and neck conditions. Spine. 2012;37(19):1693–701.
Ivanova JI, Birnbaum HG, Schiller M, Kantor E, Johnstone BM, Swindle RW. Real-world practice patterns, health-care utilization, and costs in patients with low back pain: the long road to guideline-concordant care. Spine J. 2011;11(7):622–32.
Martin BI, Gerkovich MM, Deyo RA, Sherman KJ, Cherkin DC, Lind BK, Goertz CM, Lafferty WE. The association of complementary and alternative medicine use and health care expenditures for back and neck problems. Med Care. 2012;50(12):1029–36.
Andronis L, Kinghorn P, Qiao S, Whitehurst DG, Durrell S, McLeod H. Cost-effectiveness of non-invasive and non-pharmacological interventions for low back pain: a systematic literature review. Appl Health Econ Health Policy. 2017;15(2):173–201.
Tsertsvadze A, Clar C, Court R, Clarke A, Mistry H, Sutcliffe P. Cost-effectiveness of manual therapy for the management of musculoskeletal conditions: a systematic review and narrative synthesis of evidence from randomized controlled trials. J Manip Physiol Ther. 2014;37(6):343–62.
Rubinstein SM, van Middelkoop M, Assendelft WJ, de Boer MR, van Tulder MW. Spinal manipulative therapy for chronic low-back pain. Cochrane Database Syst Rev. 2011;2:CD008112.
Michaleff ZA, Lin CW, Maher CG, van Tulder MW. Spinal manipulation epidemiology: systematic review of cost effectiveness studies. J Electromyogr Kinesiol. 2012;22(5):655–62.
Herman PM, Poindexter BL, Witt CM, Eisenberg DM. Are complementary therapies and integrative care cost-effective? A systematic review of economic evaluations. BMJ Open. 2012;2:5.
Evans R, Bronfort G, Schulz C, Maiers M, Bracha Y, Svendsen K, Grimm R, Garvey T, Transfeldt E. Supervised exercise with and without spinal manipulation performs similarly and better than home exercise for chronic neck pain: a randomized controlled trial. Spine. 2012;37(11):903–14.
Maiers M, Bronfort G, Evans R, Hartvigsen J, Svendsen K, Bracha Y, Schulz C, Schulz K, Grimm R. Spinal manipulative therapy and exercise for seniors with chronic neck pain. Spine J. 2014;14(9):1879–89.
Bronfort G, Maiers MJ, Evans RL, Schulz CA, Bracha Y, Svendsen KH, Grimm RH, Jr., Owens EF, Jr., Garvey TA, Transfeldt EE: Supervised exercise, spinal manipulation, and home exercise for chronic low back pain: a randomized clinical trial. Spine J 2011, 11(7):585–598.
Maiers MJ, Hartvigsen J, Schulz C, Schulz K, Evans RL, Bronfort G. Chiropractic and exercise for seniors with low back pain or neck pain: the design of two randomized clinical trials. BMC Musculoskelet Disord. 2007;8(1):94.
Bronfort G, Hondras MA, Schulz CA, Evans RL, Long CR, Grimm R. Spinal manipulation and home exercise with advice for subacute and chronic back-related leg pain: a trial with adaptive allocation. Ann Intern Med. 2014;161(6):381–91.
Schulz C, Leininger B, Evans R, Vavrek D, Peterson D, Haas M, Bronfort G. Spinal manipulation and exercise for low back pain in adolescents: study protocol for a randomized controlled trial. Chiropr Man Therap. 2014;22:21.
Bronfort G, Evans R, Anderson AV, Svendsen KH, Bracha Y, Grimm RH. Spinal manipulation, medication, or home exercise with advice for acute and subacute neck pain: a randomized trial. Ann Intern Med. 2012;156(1.1):1–10.
Bronfort G, Evans R, Nelson B, Aker PD, Goldsmith CH, Vernon H. A randomized clinical trial of exercise and spinal manipulation for patients with chronic neck pain. Spine. 2001;26(7):788–97. discussion 798-789
Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine. New York: Oxford University Press; 2016.
Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.
Craig BM, Pickard AS, Stolk E, Brazier JE. US valuation of the SF-6D. Med Decis Mak. 2013;33(6):793–803.
Shaw JW, Johnson JA, Coons SJ. US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care. 2005;43(3):203–20.
Khan KA, Petrou S, Rivero-Arias O, Walters SJ, Boyle SE. Mapping EQ-5D utility scores from the PedsQL generic core scales. PharmacoEconomics. 2014;32(7):693–706.
Dworkin RH, Turk DC, Farrar JT, Haythornthwaite JA, Jensen MP, Katz NP, Kerns RD, Stucki G, Allen RR, Bellamy N, et al. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005;113(1–2):9–19.
Deyo RA, Dworkin SF, Amtmann D, Andersson G, Borenstein D, Carragee E, Carrino J, Chou R, Cook K, DeLitto A, et al. Report of the NIH task force on research standards for chronic low back pain. J Pain. 2014;15(6):569–85.
Vernon H, Mior S. The neck disability index: a study of reliability and validity. J Manip Physiol Ther. 1991;14(7):409–15.
van der Velde G, Beaton D, Hogg-Johnston S, Hurwitz E, Tennant A. Rasch analysis provides new insights into the measurement properties of the neck disability index. Arthritis Rheum. 2009;61(4):544–51.
Roland M, Fairbank J: The Roland-Morris disability questionnaire and the Oswestry disability questionnaire. Spine 2000, 25(24):3115–3124.
Higgins JPT, Green S: Cochrane handbook for systematic reviews of interventions Version 5.1.0 [updated March 2011]. In: The Cochrane Collaboration. 2011: Available from www.cochrane-Available from handbook.org.
Krol M, Brouwer W, Rutten F. Productivity costs in economic evaluations: past, present, future. PharmacoEconomics. 2013;31(7):537–49.
Adams PF, Hendershot GE, Marano MA, Centers for Disease C, Prevention/National Center for Health S. Current estimates from the National Health Interview Survey, 1996. Vital Health Stat 10. 1999;200:1–203.
Probst JC, Laditka SB, Wang JY, Johnson AO. Effects of residence and race on burden of travel for care: cross sectional analysis of the 2001 US National Household Travel Survey. BMC Health Serv Res. 2007;7:40.
Mihaylova B, Briggs A, O'Hagan A, Thompson SG. Review of statistical methods for analysing healthcare resources and costs. Health Econ. 2011;20(8):897–916.
Hunink M, Weinstein M, Wittenberg E, Drummond M, Pliskin J, Wong J, Glasziou P. Decision making in health and medicine: integrating evidence and values. Cambridge: Cambridge University Press; 2014.
Briggs AH, O'Brien BJ, Blackhouse G. Thinking outside the box: recent advances in the analysis and presentation of uncertainty in cost-effectiveness studies. Annu Rev Public Health. 2002;23:377–401.
Fenwick E, O'Brien BJ, Briggs A. Cost-effectiveness acceptability curves--facts, fallacies and frequently asked questions. Health Econ. 2004;13(5):405–15.
Groot Koerkamp B, Hunink MG, Stijnen T, Hammitt JK, Kuntz KM, Weinstein MC. Limitations of acceptability curves for presenting uncertainty in cost-effectiveness analysis. Med Decis Mak. 2007;27(2):101–11.
Briggs A, Clark T, Wolstenholme J, Clarke P. Missing... Presumed at random: cost-analysis of incomplete data. Health Econ. 2003;12(5):377–92.
Diggle P, Heagerty P, Liang K, Zeger S. Analysis of longitudinal data. Oxford: Oxford University press; 2002.
Stewart GB, Altman DG, Askie LM, Duley L, Simmonds MC, Stewart LA. Statistical analysis of individual participant data meta-analyses: a comparison of methods and recommendations for practice. PLoS One. 2012;7(10):e46042.
Riley RD, Lambert PC, Abo-Zaid G. Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ. 2010;340:c221.
Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Glasziou P, Jaeschke R, Akl EA, et al. GRADE guidelines: 7. Rating the quality of evidence--inconsistency. J Clin Epidemiol. 2011;64(12):1294–302.
AHRQ Methods for Effective Health Care. In: Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Edn. Rockville (MD): Agency for Healthcare Research and Quality (US); 2014.
Espinoza MA, Manca A, Claxton K, Sculpher MJ. The value of heterogeneity for cost-effectiveness subgroup analysis: conceptual framework and application. Med Decis Mak. 2014;34(8):951–64.
Shemilt I, McDaid D, Marsh K, Henderson C, Bertranou E, Mallander J, Drummond M, Mugford M, Vale L, Campbell and Cochrane Economics Methods Group, et al. Issues in the incorporation of economic perspectives and evidence into Cochrane reviews. Syst Rev. 2013;2:83.
Brunetti M, Shemilt I, Pregno S, Vale L, Oxman AD, Lord J, Sisk J, Ruiz F, Hill S, Guyatt GH, et al. GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence. J Clin Epidemiol. 2013;66(2):140–50.
Korthals-de Bos IB, Hoving JL, van Tulder MW, Rutten-van Molken MP, Ader HJ, de Vet HC, Koes BW, Vondeling H, Bouter LM: Cost effectiveness of physiotherapy, manual therapy, and general practitioner care for neck pain: economic evaluation alongside a randomised controlled trial. BMJ 2003, 326(7395):911.
Lewis M, James M, Stokes E, Hill J, Sim J, Hay E, Dziedzic K. An economic evaluation of three physiotherapy treatments for non-specific neck disorders alongside a randomized trial. Rheumatology (Oxford). 2007;46(11):1701–8.
Bosmans JE, Pool JJ, de Vet HC, van Tulder MW, Ostelo RW. Is behavioral graded activity cost-effective in comparison with manual therapy for patients with subacute neck pain? An economic evaluation alongside a randomized clinical trial. Spine. 2011;36(18):E1179–86.
Rivero-Arias O, Gray A, Frost H, Lamb SE, Stewart-Brown S. Cost-utility analysis of physiotherapy treatment compared with physiotherapy advice in low back pain. Spine (Phila Pa 1976). 2006;31(12):1381–7.
Leininger B, McDonough C, Evans R, Tosteson T, Tosteson AN, Bronfort G. Cost-effectiveness of spinal manipulative therapy, supervised exercise, and home exercise for older adults with chronic neck pain. Spine J. 2016;16(11):1292–304.
Fritz JM, Kim M, Magel JS, Asche CV. Cost-effectiveness of primary care management with or without early physical therapy for acute low back pain: economic evaluation of a randomized clinical trial. Spine. 2017;42(5):285–90.
UK BEAM Trial Team. United Kingdom back pain exercise and manipulation (UK BEAM) randomised trial: cost effectiveness of physical treatments for back pain in primary care. BMJ. 2004;329(7479):1381.
Hurwitz EL. Epidemiology: spinal manipulation utilization. J Electromyogr Kinesiol. 2012;22(5):648–54.
Papanicolas I, Woskie LR, Jha AK. Health care spending in the United States and other high-income countries. JAMA. 2018;319(10):1024–39.
Anderson GF, Reinhardt UE, Hussey PS, Petrosyan V. It’s the prices, stupid: why the United States is so different from other countries. Health affairs (Project Hope). 2003;22(3):89–105.
Research reported in this publication was supported by the National Center For Complementary & Integrative Health of the National Institutes of Health under Award Number K01AT008965. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Ethics approval and consent to participate
Ethical approval for the proposed study was provided by the Institutional Review Board at the University of Minnesota, Minneapolis, MN, USA. (#1508E77089).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.