Review conclusions by Ernst and Canter regarding spinal manipulation refuted
© Bronfort et al; licensee BioMed Central Ltd. 2006
Received: 17 July 2006
Accepted: 03 August 2006
Published: 03 August 2006
In the April 2006 issue of the Journal of Royal Society of Medicine, Ernst and Canter authored a review of the most recent systematic reviews on the effectiveness of spinal manipulation for any condition. The authors concluded that, except for back pain, spinal manipulation is not an effective intervention for any condition and, because of potential side effects, cannot be recommended for use at all in clinical practice. Based on a critical appraisal of their review, the authors of this commentary seriously challenge the conclusions by Ernst and Canter, who did not adhere to standard systematic review methodology, thus threatening the validity of their conclusions. There was no systematic assessment of the literature pertaining to the hazards of manipulation, including comparison to other therapies. Hence, their claim that the risks of manipulation outweigh the benefits, and thus spinal manipulation cannot be recommended as treatment for any condition, was not supported by the data analyzed. Their conclusions are misleading and not based on evidence that allow discrediting of a large body of professionals using spinal manipulation.
In the April 2006 issue of the Journal of Royal Society of Medicine, Ernst and Canter authored a review of the most recent published systematic reviews on the effectiveness of spinal manipulation for any condition, including back pain, neck pain, and headache . The authors concluded that data from the systematic reviews did not demonstrate spinal manipulation to be an effective intervention for any condition with the exception of back pain, where it was superior to sham manipulation but not better than conventional treatments. They also stated that manipulation cannot be recommended for use in clinical practice because of the potential side effects. The purpose of this commentary is to provide a critical appraisal of their review based on standard systematic review methodology .
The Ernst and Canter review is an example of some of the pitfalls associated with conducting reviews that do not adhere to standard systematic review methodology, thus threatening the validity of the conclusions. The authors used a broad sweeping approach to conduct their review that appears to have resulted in misinterpretation of some of the evidence. This led to misleading conclusions regarding the value of spinal manipulation.
First, the authors chose to only summarize reviews published after 2000 without providing a rationale or assessing the impact of this censored, truncated approach. Based on the inclusion and exclusion criteria, the review excluded at least three eligible reviews [3–5] and included at least one review that we do not consider systematic . The review did not reference the eight excluded studies to enable readers to verify the judgments made.
Second, the authors elected to assess the quality of included reviews quite loosely even though more robust and clinimetrically sound approaches are available and have been widely used by others . The authors only made casual comments about certain reviews being more important than others. Such an approach is prone to bias and unnecessary subjectivity .
Third, the authors did not report on any pre-specified rules to evaluate the evidence in aggregate and did not perform any sensitivity analysis to test the robustness of their conclusions. Inference about the overall evidence supporting or refuting spinal manipulation was solely based on extraction of text from the conclusions of the individual reviews. The methodological quality and validity of the included reviews apparently were not assessed. There was at least one example of the extracted information from one of their own review abstracts which was in conflict with their reported results .
Fourth, there was no attempt made to analyze the nature of discordance between the selected reviews' conclusions for each clinical condition. In our view, this should have included consideration of the study question, methodology and quality of the reviews, as well as the number of randomized trials included in each review. The authors claim that they authored or coauthored 3 of the 16 included reviews and that these all were unbiased and of high quality. From their own table and reference list it is evident that 5 of the 16 reviews (all negative conclusions) were authored or coauthored by Ernst [9–13]. As to the methodological quality of these reviews, we leave it to the scientific community to judge.
Ernst and Canter referred to a study by them which concluded that there was a strong association between positive findings and authorship by chiropractors . However, this study did not include any systematic review assessed in their current review of reviews. Furthermore, the assertion that the overly positive reviews were authored by the same chiropractor is somewhat misleading, as these reviews [15, 16] had multi-disciplinary authorship. We wonder why Ernst and Canter, in the interest of being unbiased, did not entertain the possibility that reviews which had no authors with expertise in spinal manipulation were biased. It is very well possible that having content expertise onboard is needed for drawing clinically sensible conclusions.
Additionally, we challenge the implicit assumption used by Ernst and Canter to reach the conclusion that certain systematic reviews show that spinal manipulation is not effective. This assumes that manipulation must outperform other treatments to be considered effective or appropriate care. An example of this is their interpretation, "no proof of effectiveness of spinal manipulation," of the most recent Cochrane review by Assendelft et al , which concluded that manipulation was superior to sham/placebo but not better than other types of therapy for low back pain. However, not being superior to other types of therapy does not mean that manipulation is not effective, a fact acknowledged by Assendelft et al in their review . Consistent with that, a very recent systematic review of Cochrane reviews concluded that spinal manipulation is an effective treatment option for low back pain .
Ernst and Canter did not conduct or cite a systematic review of the hazards of manipulation including comparison to other therapies. Hence, the claim that the risks of manipulation outweigh the benefits, and thus spinal manipulation cannot be recommended as treatment for any condition, was not supported by the data analyzed.
The conclusions by Ernst and Canter were definitely not based on an acceptable quality review of systematic reviews and should be interpreted very critically by the scientific community, clinicians, patients, and health policy makers. Their conclusions are certainly not valid enough to discredit the large body of professionals utilizing spinal manipulation.
- Ernst E, Canter PH: A systematic review of systematic reviews of spinal manipulation. JR Soc Med. 2006, 99: 192-196. 10.1258/jrsm.99.4.192.View Article
- Oxman AD, Cook DJ, Guyatt GH: Users' guides to the medical literature. VI. How to use an overview. Evidence-Based Medicine Working Group. JAMA. 1994, 272: 1367-1371. 10.1001/jama.272.17.1367.View ArticlePubMed
- Bronfort G, Nilsson N, Haas M, Evans R, Goldsmith CH, Assendelft WJ, Bouter LM: Non-invasive physical treatments for chronic/recurrent headache. Cochrane Database Syst Rev. 2004, 3: CD001878-ReviewPubMed
- Ferreira ML, Ferreira PH, Latimer J, Herbert R, Maher CG: Efficacy of spinal manipulative therapy for low back pain of less than three months' duration. J Manipulative Physiol Ther. 2003, 26 (9): 593-601. 10.1016/j.jmpt.2003.08.010.View ArticlePubMed
- Glazener CM, Evans JH, Cheuk DK: Complementary and miscellaneous interventions for nocturnal enuresis in children. Cochrane Database Syst Rev. 2005, 2: CD005230-2005, Apr18PubMed
- Balon JW, Mior SA: Chiropractic care in asthma and allergy. Ann Allergy Asthma Immunol. 2004, 93: S55-60.View ArticlePubMed
- Hunt DL, McKibbon KA: Locating and Appraising Systematic Reviews. Ann Intern Med. 1997, 126 (7): 532-538. 1997, Apr 1View ArticlePubMed
- Kaptchuk TJ: Effect of interpretive bias on research evidence. BMJ. 2003, 326 (7404): 1453-5. 10.1136/bmj.326.7404.1453. 2003, Jun 28PubMed CentralView ArticlePubMed
- Astin JA, Ernst E: The effectiveness of spinal manipulation for the treatment of headache disorders: a systematic review of randomized clinical trials. Cephalalgia. 2002, 22 (8): 617-23. 10.1046/j.1468-2982.2002.00423.x. ReviewView ArticlePubMed
- Ernst E: Chiropractic spinal manipulation for neck pain: a systematic review. J Pain. 2003, 4: 417-42. 10.1067/S1526-5900(03)00735-1.View ArticlePubMed
- Ernst E, Canter PH: Chiropractic spinal manipulation treatment for back pain? A systematic review of randomised clinical trials. Phys Ther Rev. 2003, 8 (2): 85-91. 10.1179/108331903225002425.View Article
- Ernst E: Chiropractic manipulation for non-spinal pain: a systematic review. NZ Med J. 2003, 116: 1-9.
- Ernst E, Harkness EF: Spinal manipulation: a systematic review of sham-controlled, double-blind, randomized clinical trials. J Pain Sympt Man. 2001, 22 (4): 879-89. 10.1016/S0885-3924(01)00337-2.View Article
- Canter PH, Ernst E: Sources of bias in reviews of spinal manipulation for back pain. Wien Klin Wochenschr. 2005, 117 (9-10): 333-41. 10.1007/s00508-005-0355-6.View ArticlePubMed
- Bronfort G, Assendelft WJ, Evans R, Haas M, Bouter L: Efficacy of spinal manipulation for chronic headache: a systematic review. J Manipulative Physiol Ther. 2001, 24 (7): 457-66. 10.1067/mmt.2001.117090.View ArticlePubMed
- Bronfort G, Haas M, Evans RL, Bouter LM: Efficacy of spinal manipulation and mobilization for low back pain and neck pain: a systematic review and best evidence synthesis. Spine J. 2004, 4 (3): 335-56. 10.1016/j.spinee.2003.06.002.View ArticlePubMed
- Assendelft WJ, Morton SC, Yu EI, Suttorp MJ, Shekelle PG: Spinal manipulative therapy for low back pain. Cochrane Database Syst Rev. 2004, 1: CD000447-ReviewPubMed
- van Tulder MW, Koes B, Malmivaara A: Outcome of non-invasive treatment modalities on back pain: an evidence-based review. Eur Spine J. 2006, 15 (Suppl 1): S64-81. 10.1007/s00586-005-1048-6. Epub 2005 Dec 1PubMed CentralView ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.