- Open Access
Guideline implementation in the Canadian chiropractic setting: a pilot cluster randomized controlled trial and parallel study
Chiropractic & Manual Therapiesvolume 27, Article number: 31 (2019)
Feasibility and pilot studies are recommended prior to embarking on large-scale costly confirmatory trials. The objectives were to determine the feasibility of conducting a cluster randomized controlled trial (C-RCT) to evaluate a complex knowledge translation (KT) intervention to improve the management of people with neck pain, and to identify challenges and potential solutions to conducting a fully powered C-RCT in the chiropractic setting.
Pilot C-RCT involving a nationally representative sample of chiropractors and patients. We invited 400 chiropractors and 150 patients to participate. Clinicians were randomized to receive either an online theory-based KT educational and brief action plan (BAP) intervention (intervention group) or a copy of a clinical practice guideline (control group). Study-related challenges were ascertained via mid-study phone interviews and end-of-study feedback questionnaires. Analyses focused on descriptive estimates of likely recruitment, retention, and adherence rates, and documentation of potential barriers.
In total, 47 chiropractors (12%) agreed to participate and were randomized after resampling. Fifteen withdrew from the study, leaving a total of 32 (8%) participants. Eleven chiropractors in the intervention group completed the webinars and e-learning modules, two partially completed them and three did not register. Participating chiropractors recruited a total of 29 patients. Sixty-three percent (n = 7) of intervention and 56% (n = 10) of control group patients completed all outcome measures at both baseline and 3-months follow-up, attended follow-up visits and performed home exercises. Patients in the intervention group reported significant reductions in pain (mean 1.6, 95% CI 0.26–2.94, P = 0.027) and disability scores (9.8, 95% CI 3.68–15.91, P = 0.033) from baseline to 3-month follow-up. Key barriers to participation reported by chiropractors included lack of time, difficulties in recruiting patients, problems with the administration of study questionnaires, concern that the clinician-patient relationship might be jeopardized, and lack of assistance from office staff. Over half (55%) of the respondents in the intervention group encountered some difficulty registering or completing the educational modules.
Recruitment of clinicians and patients for a trial of a complex intervention can be challenging, and retention of participants after enrolment may be low. Future trials of this nature likely require multiple recruitment strategies to achieve desired sample sizes. Moreover, time-constraint issues are perceived particularly by clinicians as a major barrier to both study enrolment before, and protocol adherence during, their actual participation in a trial.
The study was registered at, NCT02483091, on 17th June 2015.
The fields of knowledge translation (KT) and implementation research aim to reduce knowledge-to-practice gaps . Implementing complex interventions to improve clinical decision-making and patient’s health outcomes poses particular challenges within randomized clinical trials as sample size estimates have to account for expected dropouts attributed partly to the high burden of commitment imposed on participants .
Recruitment, retention and adherence to study interventions are challenging, with more than 80% of randomized clinical trials struggling with recruitment and retention issues . Several barriers to participating in clinical trials have been reported . For clinicians, these may include time constraints, inadequate staffing and training, concerns over the quality of the doctor-patient relationship, side effects of new treatment, loss of professional autonomy, difficulty with the consent procedure, lack of remuneration or recognition, and low interest in research. For patients, barriers may include concerns about the uncertainty of the experimental treatment or information provided in the consent forms, additional procedures, appointments for the study and related expenses, and unwillingness to be involved in research studies .
A C-RCT is an appropriate study design for evaluating the impact of interventions administered at the group level, including public health, healthcare quality improvement, KT and educational interventions . Thus, C-RCT provides an option to study system effects of KT not pertaining to the individual patient. Although individually randomized trials are statistically more straightforward, C-RCTs are generally preferred for reducing the potential risk of contamination between different comparison groups whose patients may arise from the same clinic .
The primary objective of a pilot RCT is to assess whether the planned components and processes of a study can work together prior to conducting a full-scale RCT . It is argued that conducting pilot studies that are well-conceived with clear aims and objectives will lead to higher-quality RCTs . Pilot studies (as well as their deconstructed counterparts, feasibility studies) can be invaluable to the success of future larger-scale studies by testing recruitment procedures, establishing costs of recruitment, estimating variability of outcomes, obtaining baseline data on study measures and demographic data, and assessing adherence to the timeline established for the study [7, 9]. Publishing pilot studies benefit the researcher by: 1) avoiding duplication of efforts/resources in assessing feasibility; 2) efficiently updating other researchers and potential funders about feasibility issues through electronic indexing and dissemination of relevant information; and 3) providing accountability by ensuring the best possible use of research results .
Over the past two decades, the chiropractic profession in Canada has been proactive in developing clinical practice guidelines (CPGs) in general [11,12,13] and informing clinical decision-making on the management of neck and back pain disorders in particular (www.chiroguidlines.org). The CPG on the management of people with acute and chronic non-specific neck pain (NSNP) was recently updated . This guideline recommended offering multimodal care, including advice about self-management, physical activity including exercise, along with manual therapy for acute and chronic neck pain. Very few guideline implementation studies have been conducted in the chiropractic profession to date [15, 16]. Thus, it was deemed timely to explore the feasibility of doing so in the Canadian setting.
The primary objective of this pilot study was to determine the feasibility of conducting a C-RCT to evaluate a complex KT intervention to improve the management of people with non-specific neck pain. Feasibility was evaluated in terms of rates of recruitment, retention, and adherence to the study protocol. We also estimated the potential effectiveness of the complex KT intervention, and solicited feedback from participants about the overall usefulness of the content and format of the KT intervention and challenges encountered with respect to recruitment, retention and adherence.
We conducted a pilot cluster-randomized, two-arm, parallel groups controlled trial with a 1:1 allocation ratio. Details of the protocol can be found elsewhere . Briefly, the study tested the feasibility and impact on protocol adherence and patient outcomes of two methods of delivering an educational intervention: (1) a complex KT intervention plus dissemination of practice guidelines for the intervention group; and (2) passive dissemination of a practice guideline alone for the control group. Development of the KT complex intervention was informed by the results of a related qualitative study based on the Theoretical Domains Framework (TDF) published earlier . The final theory-based educational intervention consisted of a series of three webinars, a self-management online video on Brief Action Planning (BAP), two online case scenarios and a printed copy of the practice guideline [18, 19]. We also conducted clinician mid-study interviews and end-of study surveys to ascertain barriers to recruitment, retention and adherence (details below).
Population and procedures
Chiropractors in private practice in Canada were first informed of the study purpose and encouraged to participate via newsletters and emails from the Canadian Chiropractic Association (CCA) and provincial chiropractic associations. Invitation letters were sent to 200 randomly selected chiropractors from a sampling frame of 8200 chiropractic practices within 10 provinces in Canada, which was obtained from the membership list of the CCA. Chiropractors were eligible to participate based on the following criteria: 1) graduated at least 1 year ago; 2) were practicing chiropractic in Canada; 3) saw more than two adults (age 18–65) with neck pain per week; and 4) spoke fluent English or French. Chiropractors who agreed to participate were then randomized to receive either the theory-based educational intervention in the experimental group or simply a printed copy of the guideline in the control group. Each chiropractor was asked to recruit up to five neck pain patients into the study. Incentives to participate included a chance to win one of four $250 gift cards for participants who completed the study, and four hours of pre-approved continuing education (CE) credits for experimental participants who completed the educational intervention .
Data collection and management
We conducted mid-study semi-structured interviews and end of study surveys of clinicians to explore potential barriers encountered regarding recruitment, retention and adherence to the protocol. Telephone interviews lasted between 15 and 20 min, during which clinicians were asked about major challenges encountered at any stage of the procedures, including: patient recruitment, logging on the Canadian Memorial Chiropractic College (CMCC) e-learning platform, completing all components of the KT intervention (if applicable), and returning completed study forms and questionnaires. The clinician interviewee was then invited to consider possible ways to address major issues. Where appropriate, the interviewer provided examples of strategies other participants found helpful or shown to be effective in prior research. At study completion, all participating chiropractors received a letter inviting them to complete a feedback form to describe any additional challenges experienced during the study. For this purpose, four different exit questionnaires were administered depending on whether participants enrolled and then subsequently either: 1) did not register to complete the online educational intervention; 2) were lost to follow-up; 3) did not recruit any patients after allocation to the intervention arm; or, 4) did not recruit patients after allocation to the control arm. Each questionnaire consisted of 25 items covering six domains found to be relevant in studies exploring physicians barriers to recruiting patients in implementation trials [20, 21]: 1) complexity of the guideline itself (4 items); 2) ease of implementation of the recommendations (5 items); 3) ease of recruitment of patients (7 items); 4) burden of paper work/questionnaires (3 items); 5) effect on the clinic environment (2 items); and 6) ease of completion of the online intervention (4 items). For each item, respondents were instructed to indicate their level of agreement on a 5-item Likert scale, anchored by the terms “strongly agree” to “strongly disagree”.
Randomization was done using a computer-generated random allocation sequence. A sample of 200 chiropractors was chosen with the expectation that 20% of eligible chiropractors would agree to participate (recruitment rate) within 6 weeks, and from these, 80% would complete the study at three months (retention rate).
Concealment of the allocation sequence
An independent research assistant withheld the allocation sequence from the study recruitment personnel. Thus, the code sequence was strictly concealed from the study coordination recruitment team.
Investigators, patients, and the study statistician were blinded to group allocation until the statistical analysis had been completed. Participating chiropractors were clearly aware of the KT interventions they were receiving, but were kept blind to all study hypotheses and were instructed not to tell their patients about their KT interventions in order to maintain a degree of patient blinding.
Primary feasibility outcomes for both chiropractors and patients were rates of: 1) recruitment; 2) retention; and, 3) adherence to the KT interventions. Additional file 1 summarizes the feasibility outcomes, sources of measurement, and timing of administration. Additional file 2 provides the criteria for defining successful feasibility. Thresholds for “success” for the recruitment and retention rates are described above. For adherence rate, we expected that over 80% of participants would complete all components of the intervention (three webinars, self- management online learning module, and two vignettes). To assess chiropractors’ compliance with prescribing guideline recommendations (e.g., exercise and self-care prescriptions), we embedded within patient encounter forms an 18-item checklist of proxy measures highlighting treatment approaches commonly used by chiropractors. Secondary outcomes at the clinician-level consisted of scores on two behavioural constructs for recommended multimodal care: 1) level of knowledge, and 2) self-efficacy. Single indicator statements to evaluate knowledge (I am following the recommendations regarding the use of CPG and multimodal care approach for management of neck pain patients) and self-efficacy (I am confident about implementing the recommended care on BAP and CPG) were each rated on a five-point Likert scale ranging from ‘1 = strongly disagree to 5 = strongly agree.’ Clinical outcomes consisted of pain intensity as assessed using a 10 cm Visual Analogue Scale (VAS) [22, 23], and neck pain-specific disability using the Neck Disability Index (NDI) [24, 25]. Satisfaction with care was measured at baseline and at three months of follow-up using the short version of the Patient Satisfaction Questionnaire , which uses a 5-point Likert scale anchored by 1 = “very satisfied” and 5 = “very dissatisfied.” Patients were also asked how likely they would be to choose chiropractic care again in the event that they had another episode of neck pain. Such responses were rated on a 4-point Likert scale ranging from 1 = “Definitely would” to 4 = “Not likely.”
The main analysis focused on descriptive statistics relating to feasibility outcomes and, therefore, estimated rates of recruitment, study retention, and adherence of chiropractors to the KT intervention (i.e. completing training and applying recommendations). We also estimated the potential efficacy of the KT intervention on a patient’s adherence to the recommended multimodal care, and on pain and disability outcomes. For pain and disability outcomes, we used minimal clinically important differences of 10% for the VAS [27, 28] and 20% for the NDI  to recode the data and categorize patients according to whether they had responded (i.e. improved), deteriorated, or not responded at all (Table 1). We distinguished the proportions of individuals in each group who responded for treatment received and compared proportions between the experimental and control groups.
To estimate the potential effectiveness of the KT intervention, we calculated the proportion of chiropractors who endorsed, post-intervention, a higher level of knowledge (awareness about the guideline and the BAP) and self-efficacy (extent or strength of one’s belief in one’s own ability to complete tasks and reach goals)  in the control group, and then used this as the basis for calculating the probability of achieving a more extreme response in the intervention group, using the normal approximation to the binomial distribution. Given the pilot nature of this trial, a per-protocol, rather than intention-to-treat, analysis was performed.
Data from telephone interviews were anonymized and transcribed. Major barriers and potential solutions reported by clinicians were considered by the research team. Changes that could be implemented during the trial were favoured when perceived as likely to facilitate participation, if they did not alter the main study objectives, and remained within our limited budget. Exit survey responses were tabulated and analyzed descriptively. To ease interpretation, we combined response categories of “Strongly agree” and “Agree”, and “Strongly disagree” and “Disagree”, leaving three possible categories (Agree, Neutral, Disagree). Team members reviewed the key findings, and considered possible strategies to overcome recruitment, protocol adherence, and retention barriers to clinicians’ and patients’ participation in a full trial.
There were no major differences in most baseline characteristics between the intervention and control groups, for both chiropractors (Table 2) and patients (Tables 3). The majority of chiropractors were male (68.6%), in their mid-forties, in practice for greater than 16 years, full-time practitioners (87.5%), working in an urban setting (over 81%) in either a group or multidisciplinary practice (75%), and reported seeing an average caseload of 21–50 neck pain patients each week (68.8%). The majority of patients were female (77%), with a mean age of 45.8 ± 14.6 years old. The duration of neck pain of more than three months was higher in the intervention group (73% vs. 44.4%).
Invitation letters were sent to 200 randomly selected chiropractors in June 2015 with two follow-up reminders. As recruitment was slow, an additional random sample of 200 chiropractors were invited to participate in August 2015. From a total of 400 selected chiropractors after resampling, only 47 (12%) initially agreed to participate and were randomized to the intervention or the control group. Fifteen clinicians later withdrew from the study for reasons highlighted in Fig. 1, leaving a total of 32 chiropractor-participants (8%) who completed the study.
Out of 47 chiropractors who had initially consented to participate (including the withdrawals), 35% (7/20) of chiropractors in the control group and 41% (11/27) in the intervention group completed and returned end-of-study questionnaires.
Adherence rate to the KT intervention
Of the 16 chiropractors in the intervention group, 11 (69%) completed all webinars and e-learning modules, two partially completed them and three did not register for the online educational intervention.
Potential effectiveness for chiropractors’ knowledge and self-efficacy
Potential effectiveness for chiropractors’ knowledge and self-efficacy was computed for chiropractors who returned completed end-of-study questionnaires. Out of 47 chiropractors who had initially consented to participate (including the withdrawals), 35% (7/20) in the control group and 41% (11/27) in the intervention group completed and returned end-of-study questionnaires. Among chiropractors returning completed end-of-study questionnaires, 5/7 chiropractors in the control group (expected “success” probability of 0.71) endorsed a higher level of knowledge compared to 7/11 in the intervention group (observed probability of 0.63), in which case, the probability of observing 7 or less successes by chance alone was 0.40. Further, 4/7 participants in the control group (expected “success” probability of 0.57) endorsed a higher self-efficacy level compared to 3/11 in the intervention group (observed probability of 0.27), in which case, the probability of observing 3 or less successes by chance was 0.046.
Nine chiropractors recruited a total of 29 patients (11 in the intervention group, 18 in the control group). Only 4 chiropractors (2 in the intervention group and 2 in the control group) successfully recruited all 5 neck pain patients (Fig. 1).
Three participants in the control group withdrew before the study onset because of disability compensation (n = 2) and potential side effects from care (n = 1). Of patients who completed the trial, 17 (intervention group = 7; controls =10) returned completed outcome measures at baseline and at 3-months’ follow-up (Fig. 1).
Patient adherence rate to the intervention
All 17 patients attended all follow-up visits and reported performing the prescribed home exercises at 3 months. In the control group, 10 out of 18 respondents completed multimodal care, yielding an expected success proportion of 0.55. In the intervention group, 7 out of 11 respondents completed multimodal care (observed success probability of 0.63), in which case, the probability of observing 7 or more successes by chance alone was 0.072 (Table 4).
Patients in the intervention group reported significant reductions in baseline pain (mean difference of 1.6, 95% CI 0.26–2.94, P = 0.027) and disability scores (9.8, 95% CI 3.68–15.91, P = 0.033) at 3-months’ follow-up, while those in the control group showed no statistically significant difference (Table 4).
Satisfaction with care
All patients returning completed questionnaires (n = 17) reported being satisfied (n = 1) or very satisfied (n = 16) with their care, and the level of satisfaction did not appear to change between the baseline and the end of the study. Most patients (71%) said that they would return to see the same chiropractor should they have another episode of neck pain in future (Table 4).
Mid-study telephone interviews
Thirteen chiropractors in the intervention group and nine in the control group (69% response rate) agreed to take part in the mid-study telephone interview. Several practitioners found recruiting patients to the study very challenging despite regular correspondence with all chiropractors and the provision of advice, summary sheets and other tools to make the recruitment process as easy as possible. The main barriers reported by chiropractors included: 1) lack of time; 2) concern that the clinician-patient relationship might be jeopardized or that recruitment might be perceived as ‘hounding’; 3) unwillingness of patients to be involved in a research study; 4) lack of assistance from office staff; 5) low numbers of neck pain patients seeking care: 6) problems with follow up of the study procedures with the participants; 7) lack of clear information about the estimated time required to complete the project; 8) too much information in the study package; and 9) not wanting to return the follow-up questionnaires. Selected quotes from chiropractors are provided in Additional file 3.
In contrast, some participants reported that their adherence was encouraged by: 1) ease of access to the internet and online modules for all practitioners; 2) perceived acceptability and clarity of study objectives and instructions by both practitioners and patients; 3) ease with which CPG recommendations could be followed; 4) keen interest of practitioners in recruiting patients; and 5) the offer of a gift card as an incentive for completing all modules of the study. Additionally, some clinicians and patients were encouraged by being informed that the study protocol was registered at clinicaltrials.gov (to provide information publicly to other potential clinicians and patient participants), and by the study research assistant’s concerted efforts to follow-up on the progress of all participants.
End of study survey
About half of chiropractors returning completed end-of-study questionnaires in both groups indicated they experienced some difficulty in recruiting patients (Table 5). Over a quarter found that the paperwork administered to their patients was problematic, and about 40% were hindered by lack of support/cooperation from their staff to help with recruitment. Importantly, 6/11 (55%) respondents in the intervention group indicated they had difficulty with registering or completing the online modules, while 4/11 (37%) indicated that the webinars were too time consuming. Only one respondent agreed that the webinars needed improvement, suggesting that the content and design of webinars was generally acceptable.
This pilot trial encountered several challenges in recruitment, retention and adherence to the protocol worthy of consideration prior to embarking on a costly, fully powered, confirmatory study. Of the 47 chiropractors (after resampling) and 29 patients recruited for this pilot study, only 32 and 17 participants, respectively, completed all study steps at 3 months. Additionally, only 18 chiropractors from both the groups completed and returned end-of-study questionnaires. Although confidence in implementing BAP was lower in the intervention group, patients in this group reported significant reduction in pain and disability at 3-month. We used both mid-study interviews and end-of-study surveys of clinicians to help identify possible strategies for maximizing clinician and patient participation in future studies. Given that not all clinicians returned completed end-of-study questionnaires and that we were not able to interview patients, we also reviewed the literature to identify additional potential solutions to barriers to study participation. These are described below and further summarized in Additional file 4.
As is reported in other clinical trials [31, 32], our study suffered from slow recruitment with an additional 200 chiropractors needing to be contacted with an invitation to participate in order to reach our study sample size. Despite our attempts to advertise our study in national CCA monthly newsletter and follow-up emails, our low response and recruitment rates were possibly affected by the lack of details provided in our advertisement on the study duration and number of hours participants would be expected to volunteer . Further, not all licenced chiropractors are members of the CCA, and the email invitation was limited to those who did not previously opt-out from receiving these. Interviews revealed that messages from the research team were not routinely transferred by the receptionist or shared with the treating chiropractor. As with other studies [34, 35], time constraints and lack of motivation were important barriers for clinicians to participate . An additional end of study questionnaire for chiropractors who declined to participate to explore the reasons for non-participation may have been helpful.
The number of patients recruited within the given time frame was insufficient, with only two chiropractors in the intervention group and control group recruiting all 5 neck pain patients. Some chiropractors indicated that they rarely treated patients with neck pain or provided low frequency of care. As in other studies , lack of support from the clinic staff was also a challenge, particularly for chiropractors in solo practice.
What does the literature say about overcoming recruitment, retention and adherence barriers?
Strategies to overcome recruitment barriers
We followed the widely-used Dillman method  for postal invitation of chiropractors, with follow-up invitations and reminder letters at three week intervals, and confirmation with interested participants via telephone or email. At mid-point, participants received a revised version of the study protocol and a flowchart for the recruitment of patients aiming to clarify certain steps. However, these revised instructions may have created confusion, particularly for recently recruited practitioners, possibly affecting the confidence of participants in the management of the study. Recruitment tends to be more successful when it is conducted face-to-face in conjunction with a site-based research facilitator [38,39,40]. However, our study involved nine out of the ten Canadian provinces, making such strategies impractical and resource-intensive . Future considerations for reaching the desired sample size may include relaxing our selection criteria, replacing poor recruitment sites and extending the study period to allow more time for recruitment and completion of all study procedures [42, 43]. However, trial prolongation can result in a delay in rolling-out a potentially effective intervention, as well as increase the total workload and related costs of the trial . Alternative promising strategies to enhance clinician recruitment rates include the use of a clearer summary of the research protocol (to eliminate any misconceptions about the projects objectives and tasks), telephone reminders to non-responders (contingent on institutional review board approval), and having the principal investigator, rather than the research coordinator, correspond with the participants directly [44,45,46]. Other important factors to consider are organizing weekly or monthly teleconferences to discuss recruitment success rates, asking sites if they need additional support from sponsors for efficient and effective recruitment, and creating a short survey for participants who offered enrollment initially but later declined .
Incentives to patients in the form of reimbursements for transportation, time given for their participation in the study or a gift coupon may be considered when designing trials . Social media (e.g., Pain Society of Canada, Facebook, Arthritis Society of Canada) , and the use of peer opinion leaders or knowledge brokers to support practitioners in the recruitment of patients have also been recommended [50, 51]. In our study, not using these strategies may well have contributed to the poor response.
Pre-determined goal-setting  may enhance patient engagement , a particularly relevant strategy when the intervention aims to increase self-management support as in the current study. Other strategies include the use of newspaper articles, mail-outs – including those from primary care services – and patient incentives . Providing clear, easy-to-understand eligibility criteria and proper training for staff members within participating clinics also appears to be important.
Key barriers to study retention or the continued involvement of participating clinicians over the projected study duration  included lack of time; competing demands that were originally unforeseen at the time of enrollment; lack of resources; concerns that patients may ask questions outside the participating clinician’s scope of knowledge; and worries over the impact on the doctor-patient relationship. In other studies in the literature, additional barriers have been identified, which include: lack of knowledge about the trial design; geographical relocation away from the area originally recruited in; loss of professional autonomy; difficulty with the consent procedure; insufficiently interesting research questions; being randomized into a control group; and lack of confidence to implement the newly designed strategy [4, 54,55,56].
Retention barriers in patients include personal economic stress, job stress, and insufficient caregiving resources; lack of family and social support; and not readily seeing any personal benefits to participating in the study [57, 58].
Strategies to overcome retention barriers
High retention rate starts with developing and maintaining a strong study design and protocol, with careful consideration of the sample frame and sample size, and continuous monitoring and improvement of the survey and interview instruments . Participants must be well-informed about their role in the study and the value of their contribution to the study. Transparency regarding the time commitment and the length of the intervention can help . Establishing a relationship both with practitioners who agreed to participate and with their reception staff is crucial by providing clear instructions and maintaining frequent contact with support staff . Weekly or monthly progress reports and monthly follow-up by a research team member to update participants on the study progress and address potential concerns or questions is recommended . Additionally, retention may be increased by delegating practitioners’ tasks to the clinic staff (e.g., the completion of patient’s follow-up questionnaires), monetary compensation as well as non-monetary incentives (like gift cards, tokens of appreciation) to staff members for this additional work [57, 61].
Maintaining frequent contact, encouraging patients to remain in the study for the full duration and providing clear information regarding the benefits of the research study may increase the retention of patients .
Adherence to the protocol
Adherence is an important factor for gathering knowledge about the adequacy and appropriateness of an intervention’s effectiveness and the outcomes of trials [34, 62,63,64]. Adherence can be defined as the degree to which research subjects or patients act in accordance with the advice or instructions of researchers or of their healthcare provider . Some chiropractors indicated that they were not able to complete the proposed intervention because of the length of the educational intervention (4 h duration). Further, the additional time required to deliver the BAP to patients or to prescribe or demonstrate home exercises may have conflicted with their current practice schedules and/or philosophy. Practitioner’s guarded views toward evidence-informed practice (EIP) and the importance of research may have contributed to low adherence to the protocol and completion of the study . Others reported lack of clarity in our instructions (e.g., sequence of questionnaires to be completed at different time points).
In addition, the low adherence and retention rates, the number of active intervention components, the possible need for a reminder at mid-point, and the types of outcome measures used may partly explain the higher knowledge and self-efficacy reported in the control group than the intervention group [67,68,69]. Nonetheless, this pilot trial did not aim to prove superiority of the intervention but to test trial procedures and estimate parameters for the main trial sample size calculation .
Despite adhering to the recommended number of treatment sessions provided by practitioners over the study period, a significant proportion of neck pain patients in both groups achieved only partial or no significant clinical improvement. This may indicate that practitioners failed to adhere to intervention strategies and CPG recommendations for the management of neck pain, patients did not adhere to recommended home exercises, or the treatment was ineffective in this group of patients.
Strategies to overcome adherence barriers
The timeline of the study should be properly followed by both the research team members and study participants. To this end, the study coordinator should periodically contact participants regarding the progress of the study and follow-ups. Since practitioners are busy and may not respond to calls, or listen to voicemails, alternative communication technologies may be more successful. Texting is a cost-saving innovative solution that can be easily read and responded to rapidly . Pre- and post-randomization procedures such as screening (to directly inquire about and confirm each participants likelihood of cooperating and adhering), monitoring (number of treatment sessions, logs, assays, and completion of self-report questionnaires), behavioural screening (for anxiety, depression, motivation, and other facilitators/barriers to participation) and educational interventions (e.g., educational videos, seminars, group discussions) can increase the likelihood of participants adhering to the entire study protocol .
Effective practitioner-patient communication may be improved by ensuring that patients are knowledgeable and informed about the study objectives and its importance . Practitioners should be self-motivated enough to encourage their patients to maintain adherence to the intervention protocol . Support can also come from study investigators, encouraging personal interaction among participants within respective treatment arms as well as between family members and the patients, caregivers and to some extent community support . Online educational training can be effective to promote intimate, meaningful, human-to-human interactions to foster hope and build a trusting relationship among participants . In a RCT, setting up the control group is an important aspect and should be exposed to similar duration and intensity of contact time as the intervention group, meeting the needs for education, attention, and socialization .
While we successfully recruited the number of clinicians needed for this pilot study, it is expected that the number of participants for a large trial would prove difficult to recruit. In addition, the number of patients recruited was insufficient which should be of significant concern for a larger trial. Chiropractors from the intervention group who had completed the webinars and e-learning modules indicated that the intervention components were very useful and that by implementing these, they had successfully changed practice behaviour. Similarly, patients in the intervention group also found the BAP may be a useful approach to improve their health. However, because of small sample size, the results prevent us from making any firm conclusions about clinical outcomes and behavioural change. Implementing KT interventions among clinicians and their patients requires a well thought-out research protocol and dedicated practitioners and clinical staff to ease the recruitment process of patients. The challenges associated with conducting nationwide pilot RCTs in the chiropractic setting are profound. Greater attention must be given to potential barriers to recruitment, adherence and retention which may arise and effective ways of addressing these to ensure satisfactory completion of the trial. Knowledge-based information should be conveyed to both practitioners and patients to maximize their interest in and knowledge about the trial.
Overall, these results reinforce that low recruitment and retention of participants, and low adherence to proposed knowledge translation interventions can lead to reduced statistical power, misinterpretation of results, increased duration and cost, and premature termination of a study [76, 77]. Pilot testing implementation trials using feasibility measures is recommended prior to undertaking confirmatory trials. Future research may wish to consider strategies we have highlighted in this paper prior to conducting pilot RCTs.
Brief action plan
Canadian Chiropractic Association
Clinical practice guideline
Cluster randomized controlled trial
Neck Disability Index
Visual analogue scale
Bussieres A, Patey A, Francis J, Sales A, Grimshaw J. Identifying factors likely to influence compliance with diagnostic imaging guideline recommendations for spine disorders among chiropractors in north america: a focus group study using the theoretical domains framework. Implement Sci. 2012;7:82.
Loh SY, Lee SY, Quek KF, Murray L. Barriers to participation in a randomized controlled trial of qigong exercises amongst cancer survivors: lessons learnt. Asian Pac J Cancer Prev. 2012;13(12):6337–42.
Ulrich CM, James JL, Walker EM, Stine SH, Gore E, Prestidge B, et al. Rtog physician and research associate attitudes, beliefs and practices regarding clinical trials: implications for improving patient recruitment. Contemp Clin Trials. 2010;31(3):221–8.
Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: A systematic review. J Clin Epidemiol. 1999;52(12):1143–56.
McRae AD, Taljaard M, Weijer C. Cluster-randomized trials: a closer look. Clin Trials. 2016;13(3):294-300.
Cook AJ, Delong E, Murray DM, Vollmer WM, Heagerty PJ. Statistical lessons learned for designing cluster randomized pragmatic clinical trials from the nih health care systems collaboratory biostatistics and design core. Clin Trials. 2016;13(5):504-12.
Angeles RN, Guenter D, McCarthy L, Bauer M, Wolfson M, Chacon M, et al. Group interprofessional chronic pain management in the primary care setting: a pilot study of feasibility and effectiveness in a family health team in Ontario. Pain Res Manag. 2013;18(5):237–42.
Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004;10(2):307–12.
Logsdon MC, Gohmann S. Challenges and costs related to recruitment of female adolescents for clinical research. J Pediatr Nurs. 2008;23(5):331–6.
Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10:1.
Henderson D, Association CC. Clinical guidelines for chiropractic practice in Canada: proceedings of a consensus conference commissioned by the Canadian chiropractic association, held at the glenerin inn, Mississauga, Ontario, Canada, april 3–7, 1993. Canadian Chiropractic Association; 1994.
Triano JJ. Literature syntheses for the council on chiropractic guidelines and practice parameters: methodology. J Manip Physiol Ther. 2008;31(9):645–50.
Bussieres AE, Al Zoubi F, Stuber K, French SD, Boruff J, Corrigan J, et al. Evidence-based practice, research utilization, and knowledge translation in chiropractic: a scoping review. BMC Complement Altern Med. 2016;16:216. https://doi.org/10.1186/s12906-016-1175-0.
Bussieres AE, Stewart G, Al-Zoubi F, Decina P, Descarreaux M, Hayden J, et al. The treatment of neck pain-associated disorders and whiplash-associated disorders: a clinical practice guideline. J Manip Physiol Ther. 2016;39(8):523–64.e27. https://doi.org/10.1016/j.jmpt.2016.08.007.
Bishop A, Thomas E, Foster N. Health care practitioners’ attitudes and beliefs about low back pain: a systematic search and critical review of available measurement tools. Pain. 2007;132:91–101.
McKenzie J, O’Connor D, Page M, Mortimer D, French S, Walker B. Improving the care for people with acute low-back pain by allied health professionals (the align trial): a cluster randomised trial protocol. Implement Sci. 2010;5. https://doi.org/10.1186/1748-5908-5-86.
Abbade LPF, Abbade JF, Thabane L. Introducing the consort extension to pilot trials: enhancing the design, conduct and reporting of pilot or feasibility trials. J Venomous Anim Toxins Incl Trop Dis. 2018;24:4. https://doi.org/10.1186/s40409-018-0142-2.
Dhopte P, Ahmed S, Mayo N, French S, Quon JA, Bussières A. Testing the feasibility of a knowledge translation intervention designed to improve chiropractic care for adults with neck pain disorders: study protocol for a pilot cluster-randomized controlled trial. Pilot and Feasibility Studies. 2016;2(1):1–11. https://doi.org/10.1186/s40814-016-0076-9.
Bussieres A, Al Zoubi F, Quon J, Ahmed S, Thomas A, Stuber K, et al. Fast tracking the design of theory-based kt interventions through a consensus process. Implement Sci. 2015;10(1):18.
Foster JM, Sawyer SM, Smith L, Reddel HK, Usherwood T. Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials. BMC Med Res Methodol. 2015;15:18. https://doi.org/10.1186/s12874-015-0012-3.
Page MJ, French SD, McKenzie JE, O'Connor DA, Green SE. Recruitment difficulties in a primary care cluster randomised trial: investigating factors contributing to general practitioners’ recruitment of patients. BMC Med Res Methodol. 2011;11:35. https://doi.org/10.1186/1471-2288-11-35.
Downie WW, Leatham PA, Rhind VM, Wright V, Branco JA, Anderson JA. Studies with pain rating scales. Ann Rheum Dis. 1978;37(4):378–81.
Huskisson EC. Measurement of pain. J Rheumatol. 1982;9(5):768–9.
Ackelman BH, Lindgren U. Validity and reliability of a modified version of the neck disability index. J Rehabil Med. 2002;34(6):284–7.
Sterling M, Rebbeck T. The neck disability index (ndi). Aust J Physiother. 2005;51(4):271.
Thayaparan AJ, Mahdi E. The patient satisfaction questionnaire short form (psq-18) as an adaptable, reliable, and validated tool for use in various settings. Med Educ Online. 2013;18:21747. https://doi.org/10.3402/meo.v18i0.21747.
Stauffer ME, Taylor SD, Watson DJ, Peloso PM, Morrison A. Definition of nonresponse to analgesic treatment of arthritic pain: an analytical literature review of the smallest detectable difference, the minimal detectable change, and the minimal clinically important difference on the pain visual analog scale. Int J Inflam. 2011;2011:231926. https://doi.org/10.4061/2011/231926.
Hawker GA, Mian S, Kendzerska T, French M. Measures of adult pain: visual analog scale for pain (vas pain), numeric rating scale for pain (nrs pain), mcgill pain questionnaire (mpq), short-form mcgill pain questionnaire (sf-mpq), chronic pain grade scale (cpgs), short form-36 bodily pain scale (sf-36 bps), and measure of intermittent and constant osteoarthritis pain (icoap). Arthritis Care Res (Hoboken). 2011;63(Suppl 11):S240–52. https://doi.org/10.1002/acr.20543.
McCarthy MJ, Grevitt MP, Silcocks P, Hobbs G. The reliability of the Vernon and mior neck disability index, and its validity compared with the short form-36 health survey questionnaire. Eur Spine J. 2007;16(12):2111–7. https://doi.org/10.1007/s00586-007-0503-y.
Ormrod J. Human learning 3rd ed. Upper Saddle River: Merrill; 1999.
Asch S, Connor SE, Hamilton EG, Fox SA. Problems in recruiting community-based physicians for health services research. J Gen Intern Med. 2000;15(8):591–9.
Herber OR, Schnepp W, Rieger MA. Recruitment rates and reasons for community physicians’ non-participation in an interdisciplinary intervention study on leg ulceration. BMC Med Res Methodol. 2009;9:61.
Walker BF, Stomski NJ, Hebert JJ, French SD. A survey of australian chiropractors’ attitudes and beliefs about evidence-based practice and their use of research literature and clinical practice guidelines. Chiropr Man Therap. 2013;21(1):44.
Lovato LC, Hill K, Hertert S, Hunninghake DB, Probstfield JL. Recruitment for controlled clinical trials: literature summary and annotated bibliography. Control Clin Trials. 1997;18(4):328–52.
Blekken LE, Nakrem S, Gjeilo KH, Norton C, Morkved S, Vinsnes AG. Feasibility, acceptability, and adherence of two educational programs for care staff concerning nursing home patients’ fecal incontinence: a pilot study preceding a cluster-randomized controlled trial. Implement Sci. 2015;10:72.
Mahmud A, Zalay O, Springer A, Arts K, Eisenhauer E. Barriers to participation in clinical trials: a physician survey. Curr Oncol. 2018;25(2):119–25. https://doi.org/10.3747/co.25.3857.
Dillman DA. A summary: mail and telephone surveys: the total design method. J Contin High Educ. 1982;30(2):14–5.
Cave A, Ahmadi E, Makarowski C. Recruiting issues in community-based studies: some advice from lessons learned. Can Fam Physician. 2009;55(5):557–8.
Butterfield PG, Yates SM, Rogers B, Healow JM. Overcoming subject recruitment challenges: strategies for successful collaboration with novice research agencies. Appl Nurs Res. 2003;16(1):46–52.
Borgiel AE, Dunn EV, Lamont CT, MacDonald PJ, Evensen MK, Bass MJ, et al. Recruiting family physicians as participants in research. Fam Pract. 1989;6(3):168–72.
Copeland RJ, Horspool K, Humphreys L, Scott E. Recruiting to a large-scale physical activity randomised controlled trial - experiences with the gift of hindsight. Trials. 2016;17(1):104. https://doi.org/10.1186/s13063-016-1229-0.
Leach MJ. Barriers to conducting randomised controlled trials: lessons learnt from the horsechestnut & venous leg ulcer trial (havlut). Contemp Nurse. 2003;15(1–2):37–47.
Hadidi N, Buckwalter K, Lindquist R, Rangen C. Lessons learned in recruitment and retention of stroke survivors. J Neurosci Nurs. 2012;44(2):105–10. https://doi.org/10.1097/JNN.0b013e3182478c96.
Treweek S, Lockhart P, Pitkethly M, Cook JA, Kjeldstrom M, Johansen M, et al. Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and metaanalysis. BMJ Open 2013;3(2):e002360.
Bornbaum CC, Kornas K, Peirson L, Rosella LC. Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: a systematic review and thematic analysis. Implement Sci. 2015;10:162.
Goodyear-Smith F, York D, Petousis-Harris H, Turner N, Copp J, Kerse N, et al. Recruitment of practices in primary care research: the long and the short of it. Fam Pract. 2009;26(2):128–36.
Huang GD, Bull J, Johnston McKee K, Mahon E, Harper B, Roberts JN. Clinical trials recruitment planning: a proposed framework from the clinical trials transformation initiative. Contemp Clin Trials. 2018;66:74–9. https://doi.org/10.1016/j.cct.2018.01.003.
Gul RB, Ali PA. Clinical trials: the challenge of recruitment and retention of participants. J Clin Nurs. 2010;19(1–2):227–33.
Edwards P. Questionnaires in clinical trials: guidelines for optimal design and administration. Trials. 2010;11:2.
Institute of Medicine Committee on Advancing Pain Research C, Education. The national academies collection: Reports funded by national institutes of health. In: Relieving pain in america: A blueprint for transforming prevention, care, education, and research. Washington (DC): National Academies Press (US) National Academy of Sciences; 2011.
Ngune I, Jiwa M, Dadich A, Lotriet J, Sriram D. Effective recruitment strategies in primary care research: a systematic review. Qual Prim Care. 2012;20(2):115–23.
Maclean N, Pound P, Wolfe C, Rudd A. Qualitative analysis of stroke patients' motivation for rehabilitation. BMJ. 2000;321(7268):1051–4.
Davis LL, Broome ME, Cox RP. Maximizing retention in community-based clinical trials. J Nurs Scholarsh. 2002;34(1):47–53.
Campbell MK, Snowdon C, Francis D, Elbourne D, McDonald AM, Knight R, et al. Recruitment to randomised trials: strategies for trial enrollment and participation study. The steps study. Health Technol Assess. 2007;11(48):iii, ix–105.
Frayne SM, Mancuso M, Prout MN, Freund KM. Attitudes of primary care physicians toward cancer-prevention trials: a focus group analysis. J Natl Med Assoc. 2001;93(11):450–7.
Williamson MK, Pirkis J, Pfaff JJ, Tyson O, Sim M, Kerse N, et al. Recruiting and retaining gps and patients in intervention studies: the deps-gp project as a case study. BMC Med Res Methodol. 2007;7:42. https://doi.org/10.1186/1471-2288-7-42.
Adams M, Caffrey L, McKevitt C. Barriers and opportunities for enhancing patient recruitment and retention in clinical research: findings from an interview study in an nhs academic health science Centre. Health Res Policy Syst. 2015;13:8. https://doi.org/10.1186/1478-4505-13-8.
Palinkas LA, Ell K, Wells AA. Understanding barriers to retention after a clinical treatment trial drop out: translating qualitative research and theory to practice. J Clin Trials. 2014;2014.
Colditz GA, Coakley E. Weight, weight gain, activity, and major illnesses: the nurses’ health study. Int J Sports Med. 1997;18(Suppl 3):S162–70.
Dal-Re R, Moher D, Gluud C, Treweek S, Demotes-Mainard J, Carne X. Disclosure of investigators’ recruitment performance in multicenter clinical trials: a further step for research transparency. PLoS Med. 2011;8(12):e1001149. https://doi.org/10.1371/journal.pmed.1001149.
Bower P, Brueton V, Gamble C, Treweek S, Smith CT, Young B, et al. Interventions to improve recruitment and retention in clinical trials: a survey and workshop to assess current practice and future priorities. Trials. 2014;15:399. https://doi.org/10.1186/1745-6215-15-399.
Martin KA, Bowen DJ, Dunbar-Jacob J, Perri MG. Who will adhere? Key issues in the study and prediction of adherence in randomized controlled trials. Control Clin Trials. 2000;21(5 Suppl):195s–9s.
Cyarto EV, Brown WJ, Marshall AL. Retention, adherence and compliance: important considerations for home- and group-based resistance training programs for older adults. J Sci Med Sport. 2006;9(5):402–12.
Munoz EB, Dorado MF, Guerrero JE, Martinez FM. The effect of an educational intervention to improve patient antibiotic adherence during dispensing in a community pharmacy. Aten Primaria. 2014;46(7):367–75.
Robiner WN. Enhancing adherence in clinical research. Contemp Clin Trials. 2005;26(1):59–77. https://doi.org/10.1016/j.cct.2004.11.015.
Slater H, Briggs AM, Smith AJ, Bunzli S, Davies SJ, Quintner JL. Implementing evidence-informed policy into practice for health care professionals managing people with low back pain in australian rural settings: a preliminary prospective single-cohort study. Pain Med. 2014;15(10):1657–68. https://doi.org/10.1111/pme.12351.
Johnson MJ, May CR. Promoting professional behaviour change in healthcare: what interventions work, and why? A theory-led overview of systematic reviews. BMJ Open. 2015;5(9):e008592. https://doi.org/10.1136/bmjopen-2015-008592.
Whitehead AL, Julious SA, Cooper CL, Campbell MJ. Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res. 2016;25(3):1057–73. https://doi.org/10.1177/0962280215588241.
Bussières AE, Laurencelle L, Peterson C. Diagnostic imaging guidelines implementation study for spinal disorders: a randomized trial with postal follow-ups. J Chiropr Educ. 2010;24(1):2–18.
Finch SA, Wasserman R, Nabi-Burza E, Hipple B, Oldendick R, Winickoff JP. Overcoming challenges in the changing environment of practice-based research. Ann Fam Med. 2015;13(5):475–9.
Derksen F, Bensing J, Lagro-Janssen A. Effectiveness of empathy in general practice: a systematic review. Br J Gen Pract. 2013;63(606):e76–84. https://doi.org/10.3399/bjgp13X660814.
Corbett M, Foster N, Ong BN. Gp attitudes and self-reported behaviour in primary care consultations for low back pain. Fam Pract. 2009;26(5):359–64. https://doi.org/10.1093/fampra/cmp042.
Levkoff S, Sanchez H. Lessons learned about minority recruitment and retention from the centers on minority aging and health promotion. Gerontologist. 2003;43(1):18–26.
Cantrell MA, Conte T. Enhancing hope among early female survivors of childhood cancer via the internet: a feasibility study. Cancer Nurs. 2008;31(5):370–9.
McGinley JL, Martin C, Huxham FE, Menz HB, Danoudis M, Murphy AT, et al. Feasibility, safety, and compliance in a randomized controlled trial of physical therapy for parkinson's disease. Parkinsons Dis. 2012;2012:795294.
Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. Spirit 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Kennedy CC, Thabane L, Ioannidis G, Adachi JD, Papaioannou A, Investigators V. Implementing a knowledge translation intervention in long-term care: feasibility results from the vitamin d and osteoporosis study (vidos). J Am Med Dir Assoc. 2014;15(12):943–5.
The authors wish to thank the participating chiropractors and patients for their time and assistance with the study. We are grateful for the support of the Canadian Chiropractic Guideline Initiative (CCGI). The CCGI’s mission is to develop evidence-based clinical practice guidelines and best practice recommendations, and facilitate their dissemination and implementation within the chiropractic profession.
This project was funded by the Edith Strauss Rehabilitation Research Projects in Knowledge Translation from the School of Physical and Occupational Therapy at McGill University.
Availability of data and materials
Data has been made available [see Additional file 3].
Ethics approval and consent to participate
Ethics approval was granted by the Faculty of Medicine, McGill University Institutional Review Board (A04-B09-15B). The study was registered at https://clinicaltrials.gov/, NCT02483091, on 17th June 2015. All chiropractors and patients provided informed written consent. All participation was voluntary and participants could withdraw at any time from the project or from any part thereof.
Consent for publication
The authors of this publication have each given consent for publication. Written informed consent was obtained from the participants for publication of their individual details and accompanying images in this manuscript. The consent form is held by the authors’ institution clinical notes and is available for review by the Editor-in-Chief.
AEB, JQ, and SDF received research funding from Canadian national and provincial chiropractic organizations, either as salary support or for research project funding. SDF is Deputy Editor-in-Chief for Chiropractic and Manual Therapies; however, he did not have any involvement in the editorial process for this manuscript and was blinded from the editorial system for this paper from submission to decision.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Knowledge translation
- Randomized controlled trial
- Pilot projects
- Feasibility studies
- Multifaceted intervention