Adherence to and uptake of clinical practice guidelines: lessons learned from a clinical practice guideline on chemotherapy concomitant with radiotherapy in head-and-neck cancer

Original Article

Oncology Education

Adherence to and uptake of clinical practice guidelines: lessons learned from a clinical practice guideline on chemotherapy concomitant with radiotherapy in head-and-neck cancer

S.F. Hall , MSc MD , * , J.C. Irish , MSc MD * , R.W. Gregg , MD § , P.A. Groome , PhD , S. Rohland
* Department of Otolaryngology, Queen’s University, Kingston, ON., Division of Cancer Care and Epidemiology, Queen’s University, Kingston, ON., Department of Surgical Oncology, Princess Margaret Cancer Centre, University of Toronto, Toronto, ON., § Department of Oncology, Queen’s University, Kingston, ON., Division of Cancer Care and Epidemiology, Queen’s University, Kingston, ON..




Clinical practice guidelines ( cpg s) are systematically developed statements designed to assist practitioners and patients in making decisions about appropriate heath care interventions. Clinical practice guidelines are expensive and time-consuming to create. A cpg on concurrent chemotherapy with radiation therapy ( ccrt ) was developed in Ontario at a time when treatment approaches for head-and-neck cancer were changing significantly.


An assessment of treatments and outcomes based on electronic and chart data obtained from a population-based study of 571 patients with oropharynx cancer treated in Ontario (2003–2004) was combined with a review of relevant knowledge transfer (publications and presentations at major meetings) to understand variation in adherence to a cpg .


In 9 Ontario cancer treatment centres, ccrt was used for 55% of all patients with oropharyngeal cancer; however, at the centres individually, that proportion ranged from 82% to 39%. Furthermore, there was no agreement on the chemotherapy regimen: 2–4 years later (a period during which newer regimens were emerging), only 4 of 9 centres were following the guideline for most patients. When outcomes of treated patients were compared for centres with “higher” and “lower” use of ccrt , no difference in survival was observed ( p = 0.64).


At a time of treatment evolution, the new guideline was controversial, and there are many reasons for the mixed adherence. An estimation of adherence should be included during both development and review of guidelines.

KEYWORDS: Clinical practice guidelines , uptake , variation , head-and-neck cancer , chemoradiotherapy


Clinical practice guidelines ( cpg s) are systematically developed statements designed to assist practitioners and patients in making decisions about appropriate heath care interventions for specific clinical circumstances1. Evidence demonstrates that cpg s can influence the processes and outcomes of care24.

To inform their recommendations, high-quality cpg s use evidence that is typically selected, appraised, and synthesized using systematic review methods5. In trying to craft recommendations for important clinical questions, the cpg process can be challenged when the quality of the evidence is poor or its quantity is scant3. Such was the case with a cpg produced by the Head and Neck Cancer Disease Site Group of the Program in Evidence-Based Care, the cancer guidelines program of the provincial cancer agency Cancer Care Ontario ( cco ). One cpg published in 2000 addressed the question of the effectiveness of the addition of chemotherapy to radiotherapy for head-and-neck cancer6,7 based on a systematic review of the evidence between 1970 and 2000.

The cpg recommended that concomitant chemo-therapy with conventional radiotherapy ( ccrt ) be the treatment of choice for patients with locally advanced squamous cell carcinoma, noted that the ideal agent had yet to be identified, and proposed two regimens as reasonable options outside the setting of a clinical trial. However, from the outset, considerable concern was raised concerning the lack of quality data8,9 about the incidence of major late toxicity1013, with a modest-at-best survival advantage of 8%14 against a backdrop of years of unsuccessful trials investigating the use of chemotherapeutic agents in patients with cancers of the head and neck. Despite those limitations, 60% of practitioners responding during the external review step of the guideline development process15 indicated that the guideline should be approved, and 75% indicated that they were likely or very likely to use it7.

The objective of the present study was to document adherence to the cpg recommendations by the cancer centres across Ontario that approved it and to examine changes in the evidence that were occurring at the time. The manuscript is divided into sections about the clinical story and the educational events near the time of the guideline. The first part uses a population-based study of patients from 2003–2004 to examine patients, treatments, and outcomes. The second part reviews the frequency and content of ccrt presentations at major conferences and in publications between 1997 and 2003. With respect to the clinical study, the years 2003 and 2004 were chosen specifically because uptake was known to vary, thus creating natural experiments that would allow for an assessment of outcomes despite selection bias1618.


The cpg 7 was published in 2000 based on survival evidence from 20 randomized comparisons (1970 into 2000) of patients with locally advanced stage iii or iv squamous cell head-and-neck cancer identified in literature searches ( medline , cancerlit , Health star , and Cochrane Library) and concluded that survival improved with ccrt compared with conventional radiotherapy alone. These were some of the key recommendations:

  • Concomitant chemotherapy with conventional fractionated radiotherapy should be the treatment of choice for patients with advanced squamous cell head-and-neck cancer,

  • At this time, the data are insufficient to recommend the use of concomitant chemotherapy with altered fractionation schedules.

  • The choice of concomitant therapy should take into account the toxicity produced by various regimens and the convenience of treatment administration. An examination of individual trial results and toxicity profiles with the use of concomitant cisplatin-based treatment suggests that, given the circumstances, reasonable options outside a clinical trial include either single-agent daily cisplatin or carboplatin with conventional radiotherapy, or alternating split-course radiotherapy with cisplatin plus infusional 5-fluorouracil.


3.1   Part 1: The Clinical Study

The methods and results of a population-based study of all patients with squamous cell cancer of the oropharynx treated in Ontario during 2003–2004 have previously been published19. The study used information from the population-based Ontario Cancer Registry located at the Division of Cancer Care and Epidemiology (formerly the Radiation Oncology Research Unit) of the Queen’s Cancer Research Institute. All potential patients were identified based on International Classification of Diseases codes with a date of diagnosis between January 1, 2003, and December 31, 2004. The outpatient charts, with treatment records, were reviewed by experienced abstractors at the Queen’s Cancer Research Institute for data on patient characteristics, extent of disease, investigations, treatments, and outcomes. After exclusions, 571 cases of oropharyngeal carcinoma were retained.

Patient variables included the Adult Comorbidity Evaluation20 and staging according to the TNM classification (6th edition)21. Patient status with respect to the human papilloma virus ( hpv ) was not available. We defined four initial treatment options of radiotherapy ( rt ), chemoradiotherapy ( ccrt ), surgery, or palliation, including treatment of residual disease (because that would be assumed to be part of the initially planned treatment). The surgery cohort included patients who received planned postoperative rt . The palliation cohort was identified based on a statement of intent in the chart for palliative or no treatment, regardless of the actual treatment administered. We recorded the cancer treatment centre at which the initial treatment was performed, and all centres were anonymized for analysis. Using the percentage of patients receiving ccrt at each centre, we compared outcomes at cancer treatment centres with similar protocols and stratified the centres based on a cut-point of 50% into those with “higher” and “lower” use of ccrt . Survival outcomes for the two groups were compared by the Kaplan–Meier method and Cox proportional hazards regression, controlling for age, sex, comorbidity, sub-site, T stage, and N stage.

Table i describes the patient population. Treatment selection was evident in the data: overall, the patients receiving ccrt were younger and healthier, with more advanced disease and a higher rate of base-of-tongue cancers. In comparing patients managed at the 9 treatment centres, we observed no statistically significant difference in age ( p = 0.87), comorbidities ( p = 0.39), sub-site ( p = 0.65), N stage ( p = 0.19), or TNM group ( p = 0.22).

TABLE I  Patient and tumour characteristicsa


Table ii presents the initial treatments. More than 85% of the patients were treated with either rt or ccrt , but there was little agreement or consensus about treatment among the 9 centres ( p < 0.0001). Although approximately 10% of patients at all centres received palliative treatment, the rate of ccrt varied from 78.26% to 30.14% ( p < 0.0001). When patients receiving palliation and surgery were excluded, variation in the use of ccrt ranged from 82% to 39% (Figure 1).

TABLE II  Initial treatments delivered at the nine centresa




FIGURE 1 Patients treated with radiotherapy (rt) or concurrent chemotherapy and radiotherapy (ccrt), by treatment centre (anonymized). Excludes palliative and primary surgery cohorts. Adapted from Hall et al.19 with permission from Wiley–Blackwell.

Table iii presents the six chemotherapy regimens used in the study population. In the centre comparison presented in Figure 2, the regimens are grouped into 4 classes of therapy (low-dose daily cisplatin or carboplatin, mid-dose weekly, high-dose every 3 weeks, and any combination with 5-fluorouracil). In 5 centres, one regimen (that aligned with the cpg ) was used almost exclusively. In 2 centres, two primary regimens (one of which did not align with the cpg ) were used. In 1 centre, all four chemotherapy options were tried during the 2 years of interest.

TABLE III  Chemotherapy regimens used at the nine centresa




FIGURE 2 Chemotherapy regimens used, by treatment centre (anonymized). 5fu = 5-fluorouracil; q3 = every three.

In comparing the outcomes of all patients and of those treated at the centres with “higher” and “lower” use of ccrt , we observed no difference in 3-year overall survival (66.8% vs. 66%), 5-year overall survival (58.8% vs. 57.5%), 3-year disease-specific survival (72.3% vs. 72.5%), and 5-year disease-specific survival (68.9% vs. 67.7%) (Figure 3). The hazard ratio in the Cox model was 1.028 (95% confidence interval: 0.775 to 1.363; p = 0.85).



FIGURE 3 Disease-specific survival of patients treated at centres with higher and lower use of concurrent chemotherapy and radiotherapy.

3.2  Part 2: Knowledge Transfer

The cpg process and the guideline itself provided information about randomized trials and meta-analyses about ccrt regimens up to 2000 for oncologists in Ontario, but other sources of information such as journal articles and presentations at major meetings were available to clinicians. A medline search spanning 1950 to the present combined the key word “head and neck neoplasms” with “combined modality therapy” ( m e sh ) and each of the following phrases as text words: “concomitant or combined,” “radiotherapy,” “chemotherapy,” “radiochemotherapy,” and “chemoradiotherapy.” The reference lists of relevant studies were used to identify additional publications. To address the emergence of high-dose regimens, the foregoing terms were then combined with the search term “high dose.” We tabulated the number of publications describing only high-dose concomitant ccrt schedules between January 1997 and December 2003, because those publications might have influenced oncologists in Ontario.

Presentations at major meetings are another source of information for clinicians, especially if the presentations are given by opinion leaders. The American Society of Clinical Oncology Web site ( and the American Society for Radiation Oncology Web site ( were searched for relevant conference proceedings from meetings during 1997–2003 of head-and-neck poster or oral presentations describing high- and low-dose ccrt administered for head-and-neck cancer. Unfortunately, programs and abstracts for the annual meetings of the Canadian Association of Medical Oncologists and the Canadian Association of Radiation Oncology during the same period were not available online. For the present review, only podium presentations of high-dose ccrt regimens for head-and-neck cancer were included. However, we classified posters (American Society of Clinical Oncology head-and-neck and central nervous system group, 1998–1999; and head-and-neck cancer group, 2000–2003) as high-dose, low- or medium-dose, or any ccrt schedule.

Table iv shows the numbers of manuscripts, presentations, and posters that were located during the search. Over time, the number of published manuscripts about high-dose regimens remained constant. The number of posters on ccrt presented each year increased, and the number of posters on high-dose and low- or mid-dose regimens held steady. However, between 2000 and 2002, 14 podium presentations about high-dose regimens were delivered; few such presentations were delivered before 2000, and one was delivered in 2003.

TABLE IV   Publications, podium presentations, and posters about chemoradiotherapy, high-dose chemoradiotherapy, and lower-dose chemotherapy for head-and-neck cancer, 1997 to 2003



Given the resources and time required to follow the cpg development cycle and to create a cpg 15, adherence ought to be high. Typically, adherence in Ontario to the cgp s created by cco is high22. However, the present study demonstrates that 2–4 years after approval of a guideline, adherence was mixed and much lower. The 9 Ontario cancer treatment centres used ccrt for 55% of oropharynx cancer patients overall (range: 30%–80%), and although not all patients would have been eligible for ccrt , we observed little difference in patient characteristics between centres. Furthermore, no agreement on the drug regimen was evident: 4 centres were following the guideline for most patients, 2 centres were following the guideline for some patients, and 3 centres were using regimens not supported by the guideline.

Cabana et al. 23 cited 7 reasons why physicians do not follow guidelines, including lack of awareness, lack of familiarity, lack of agreement with the evidence, lack of outcome expectancy, lack of self-efficacy, inertia of previous practice, and external barriers. The reason for the varied uptake of ccrt in Ontario might have been lack of agreement with the evidence (despite the practitioner feedback process), external barriers, or the inertia of previous practice. However, why were 3 centres exclusively using a high-dose regimen that was not recommended in the cpg ? In Table iv , the data show continued interest in ccrt whether high- or low-dose, but the number of podium presentations on the new high-dose regimens at major meetings was increasing. It could be that some Ontario centres were influenced by those presentations more than by the cpg (noting that there had not been—and never has been—a clinical trial comparing the high- and low-dose regimens).

The development of the 5-6a cpg carefully followed the steps of the guideline development cycle15 used in 2000 and almost certainly would have satisfied all the criteria of the newer agree tools for creating or assessing guidelines ( Why, then, did adherence vary?

First, for a new guideline to be accepted by groups and organizations, the process ought to address the culture and receptivity of the physicians and organizations the guideline is intended to influence. The new cgp , together with the momentum of the ccrt revolution of that time, was led by medical oncologists at a time when the head-and-neck teams, site groups, tumour boards, and management care conferences were traditionally staffed by radiation oncologists and surgeons. The role of medical oncology in head-and-neck cancer was limited to palliative care or research within approved clinical trials—because, aside from a U.S. Veterans Affairs trial25, chemotherapy had not been showing much progress or promise. Although the medical oncology community was no doubt enthusiastic, acceptance by the radiation oncologists and head-and-neck surgeons almost certainly varied depending on institutional practices.

At the institution level, the political landscape can also be a factor in adherence to any new guideline, and interestingly, in 2000, cco had approved divestment of the provision of cancer care services at Ontario cancer treatment centres to the hospitals hosting the regional centres, a process that was completed in 2002. That change coincided with production of the guideline, and it is possible that the head-and-neck site groups at the host hospitals did not feel as responsible to cco -created cpg s once the line of responsibility had changed.

A second potential reason for varied adherence is acceptance of the opinions of the guideline development committee. The committee members ought to be representative of the potential target physicians and familiar with the process. The committee at that time (2000) consisted of volunteer members from some specialties at each cancer treatment centre whose opinions might or might not have reflected the opinions of other members of the local head-and-neck treatment team. The chair at the time was very knowledgeable about the cpg development cycle, but many members of the Head and Neck Cancer Disease Site Group were experiencing their first encounter with the complex and prolonged evidence-based guideline process. The newness of the process almost certainly slowed the process in a clinical environment that was continuing to evolve.

A third reason for varied adherence is the need to address major concerns or potential concerns. In 2000, ccrt was a very controversial treatment, and very real concern was being expressed by most head-and-neck teams about the validity of the data on late toxicity8,9, especially permanent dysphagia1013. Based on a review of the clinical trials, one author9 had even stated that “no data were collected on the critical items of swallowing and airway function. These gaps, inconsistencies and variations in reporting practices indicate that published toxicity reports are not only frequently lacking key information, but also suggest that they likely contain significant underreporting, bias and errors.” It is not surprising that the enthusiasm of physicians and centres varied. Addressing concerns might also require the inclusion of competing evidence and, in this case, evidence about other non-chemotherapy options. Published trials had reported that, compared with conventional rt , hyperfractionated rt without chemotherapy was associated with better outcomes26, and some rt departments in Ontario were particularly interested in that treatment option. The cpg meta-analysis had included two studies on hyperfractionation, but did not directly compare hyperfractionated regimens with ccrt regimens; and although the statement “the data for concomitant chemoradiotherapy are at least as good as the data for accelerated fractionation the body of evidence is higher” appears in the discussion, it does not appear in the recommendations. The use of hyperfractionated rt with an increased total dose was subsequently shown to provide an effect (8% difference with a 22% reduction in the hazard of death) identical to that achieved with ccrt 27,28.

A fourth potential reason for varying adherence is that a guideline might be an inappropriate approach for controversial topics with an evidence base that is rapidly expanding and evolving. By the time this particular cpg was published, the recommendations were clearly considered historical by some centres. A looser or more fluid statement—with some combination of evidence updates, ongoing review, or reassessment of the recommendations—would perhaps have provided more and better information to the head-and-neck oncologists of Ontario.

A final reason for varied uptake is the lack of a mechanism for feedback (Smith and Hillner29). Given the controversy concerning the guideline, a built-in mechanism for direct feedback to or an audit on uptake after 1–2 years might have proved useful for the Head and Neck Cancer Disease Site Group, the Program in Evidence-Based Care, the guideline, and physicians.

To summarize, the observed variation in adherence was likely attributable to receptivity, the process, new evidence with new treatments, a lack of feedback, and concern over incomplete data.

Figure 3 further complicates the story: Our results suggest that the addition of chemotherapy to rt had a minimal effect on survival for oropharyngeal cancer patients in 2003–2004. The complete analysis has already been reported19. In our study, the univariable and multivariable analyses might be confounded by hpv status (although the effect of hpv status was not known at the time of the guideline); however, it is unlikely that the rate of hpv -positive cases varied in the populations of the “higher-use” and “lower-use” centres in our study. Our findings have two possible explanations: either the evidence about ccrt for oropharyngeal cancer was not, outside the biases of the clinical trials, generalizable to the real world of community practice in the 9 Ontario cancer treatment centres30, or the evidentiary base concerning the addition of chemotherapy to rt for head-and-neck cancer was confounded by the evolving causative role of hpv . Clinical trials and population-based studies are under way to answer that fundamental question.

A review of the extensive literature on compliance with or adherence to cpg s is beyond the scope of this report; review articles by Smith and Hillner29, Francke et al. 31, Grimshaw and various colleagues2,3,32, and Tan33 are recommended. Three previous studies on compliance with cpg s specifically in head-and-neck oncology (including thyroid cancer) have been published.

Van Agthoven et al. 34 compared practice based on chart reviews before and after a guideline on the diagnosis, treatment, and follow-up of patients with laryngeal cancer in the Netherlands. Those authors reported that “in general, the guideline recommendations were properly complied with” and that compliance was related to the quality of the evidence. They noted that a plan for direct feedback on performance to clinicians and some form of accountability as proposed by Smith and Hillner29 might have improved their results and, subsequently, the quality of the guideline. The cco 5-6a guideline would have been improved by some form of built-in feedback, especially given that treatments were evolving.

Another relevant adherence study was reported by Lewis et al. 35, based on a chart review of 107 new patients referred with recurrent or residual head-and-neck cancer to the MD Anderson Cancer Center. Using the U.S. National Comprehensive Cancer Network head-and-neck guidelines as a comparator, those authors found that 58.7% of the patients had received inadequate surgery; 10.9%, inadequate adjuvant therapy; and 4.4%, inadequate rt .

Panigrahi et al. 36 compared prior clinical practice with a guideline on the treatment of medullary thyroid cancer that had undergone many iterations over time. Based on data for 2033 patients from the U.S. Surveillance, Epidemiology and End Results database, those authors found that the extent of surgery was inappropriate in 41% of cases. They identified differences by geographic region, year of treatment, tumour size, age, and sex as contributing factors. Our study found regional differences in adherence, and the guideline might not have improved survival outcomes.


By 3 years after publication, the recommendation of the cco cpg on the use of ccrt over rt alone for patients with advanced squamous cell cancers of the head-and-neck was adopted for 55% of patients with oropharyngeal cancer across Ontario; however, the uptake by centre varied from 82% to 39%, possibly because of concerns about evidence quality, medical culture, delay in process, and evolving treatment options not addressed in the guideline. The drug regimen recommendation was modified by many centres (possibly on the basis of presentations by opinion leaders) in the period immediately after publication of the cpg , despite no comparative evidence being available. Clinical practice guidelines ought to include a more precise estimate of adherence, performance ought to be frequently monitored when the guideline is controversial, and a more fluid guideline format might be more appropriate in situations in which the evidence is evolving rapidly.


The research proposal titled “The impact of the Ontario Clinical Practice Guideline #5-6a on physicians, patients and practice” was funded (no. 19174) by the ncic (now the Canadian Cancer Society Research Institute). The project was approved by the Research Ethics Board of Queen’s University (OTL-028-06) and also by all Ontario cancer treatment centre host hospitals. Use of the data was approved by both the Ontario Cancer Registry and cco . The joint study coordinators at the Division of Cancer Care and Epidemiology were Tina Dyer and SR, with assistant Sarah Pickett. The statistician/analysts were Rebecca Griffiths and Diana Martins. SFH was responsible for grant application, data collection, data analysis, and manuscript preparation. Dr. Melissa Brouwers kindly assisted with early versions of the manuscript.

Portions of this work (“Should guideline review include assessment of adherence?”) were presented at the 4th Guidelines International Network Conference; Toronto, Ontario; August 22–25, 2007.


We have read and understood Current Oncology ’s policy on disclosing conflicts of interest, and we declare that we have none.


1. Field MJ, Lohr KN, eds. Clinical Practice Guidelines: Directions for a New Program. Washington, DC: The National Academies Press; 1990.

2. Grimshaw J, Eccles M, Tetroe J. Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof 2004;24(suppl 1):S31–7.

3. Grimshaw JM, Thomas RE, MacClennan G. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004;8:iii-iv,1–72.
cross-ref  pubmed  

4. Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care 2009;18:385–92.
cross-ref  pubmed  

5. Brouwers M, Stacey D, O’Connor A. Knowledge creation: synthesis, tools and products. CMAJ 2010;182:E68–72.
cross-ref  pmc  

6. Browman GP, Hodson DI, Mackenzie RJ, Bestic N, Zuraw L on behalf of the Cancer Care Ontario Practice Guideline Initiative Head and Neck Cancer Disease Site Group. Choosing a concomitant chemotherapy and radiotherapy regimen for squamous cell head and neck cancer: a systematic review of the published literature with subgroup analysis. Head Neck 2001;23:579–89.
cross-ref  pubmed  

7. Cancer Care Ontario (cco), Program in Evidence-Based Care. Concomitant Chemotherapy and Radiotherapy in Squamous Cell Head and Neck Cancer (Excluding Nasopharynx). Practice guideline 5-6a. Toronto, ON: cco; 2000.

8. Trotti A. Toxicity in head and neck cancer: a review of trends and issues. Int J Radiat Oncol Biol Phys 2000;47:1–12.
cross-ref  pubmed  

9. Trotti A, Bentzen SM. The need for adverse effects reporting standards in oncology clinical trials. J Clin Oncol 2004;22:19–22.

10. Eisbruch A, Schwartz M, Rasch C, et al. Dysphagia and aspiration after chemoradiotherapy for head and neck cancer: which anatomic structures are affected and can they be spared by imrt? Int J Radiat Oncol Biol Phys 2004;60:1425–39.
cross-ref  pubmed  

11. Newman L, Vieira F, Schweizer V, et al. Eating and weight changes following chemoradiation for advanced head and neck cancer. Arch Otolaryngol Head Neck Surg 1998;124:589–92.
cross-ref  pubmed  

12. Nguyen NP, Moltz CC, Frank C, et al. Dysphagia following chemoradiotherapy for locally advanced head and neck cancer. Ann Oncol 2004;15:383–8.
cross-ref  pubmed  

13. Smith RV, Kotz T, Beitler JJ, Wadler S. Long term swallowing problems after organ preservation therapy with concomitant radiation therapy with intravenous hydroxyurea. Arch Otolaryngol Head Neck Surg 2000;126:384–9.
cross-ref  pubmed  

14. Pignon JP, Bourhis J, Domenenge C, Designe L. Chemo-therapy added to locoregional treatment for head and neck squamous cell carcinoma: three meta-analyses of updated individual data. Lancet 2000;355:949–55.
cross-ref  pubmed  

15. Browman GP, Levine MN, Mohide EA, et al. The practice guidelines development cycle: a conceptual tool for practice guidelines development and implementation. J Clin Oncol 1995;13:502–12.

16. Goodwin PJ, Ballman KV, Small EJ, Cannistra SA. Evaluation of treatment benefit in Journal of Clinical Oncology. J Clin Oncol 2013;31:1123–4.
cross-ref  pubmed  

17. Hall SF, Groome PA, Irish J, O’Sullivan B. Radiotherapy or surgery for head and neck squamous cell cancer: establishing the baseline for hypopharyngeal carcinoma? Cancer 2009;115:5711–22.
cross-ref  pubmed  

18. Newhouse JP, McClellan M. Econometrics in outcomes research: the use of instrumental variables. Annu Rev Public Health 1998;19:17–34.
cross-ref  pubmed  

19. Hall SF, O’Sullivan B, Irish JC, Meyer RM, Gregg R, Groome P. Impact of the addition of chemotherapy to radiotherapy for oropharyngeal cancer in 2003–2004: population-based study from the province of Ontario, Canada. Head Neck 2014;:[Epub ahead of print].

20. Piccirillo JF, Tierney RM, Costas I, Grove L, Spitznagel EL Jr. Prognostic importance of comorbidity in a hospital based cancer registry. JAMA 2004;291:2441–7.
cross-ref  pubmed  

21. Sobin LH, Wittekind C, eds. TNM Classification of Malignant Tumours. 6th ed. New York, NY: John Wiley and Sons; 2002.

22. Cancer Care Ontario (cco). Number of evidence-based reports for cancer care and control [Web article]. Toronto, ON; cco: 2009. [Available at:; cited February 11, 2015]

23. Cabana M, Rand C, Powe N, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA 1999;282:1458–65.
cross-ref  pubmed  

24. agree Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the agree project. Qual Saf Health Care 2003;12:18–23.

25. Induction chemotherapy plus radiation compared with surgery plus radiation in patients with advanced laryngeal cancer. The Department of Veterans Affairs Laryngeal Cancer Study Group. N Engl J Med 1991;324:1685–90.
cross-ref  pubmed  

26. Fu KK, Pajak TF, Trotti A, et al. A Radiation Therapy Oncology Group (rtog) phase iii randomized study to compare hyperfractionation and two variants of accelerated fractionation to standard fractionation radiotherapy for head and neck squamous cell carcinomas: first report of rtog 9003. Int J Radiat Oncol Biol Phys 2000;48:7–16.
cross-ref  pubmed  

27. Bourhis J, Overgaard J, Audry H, et al. Hyperfractionated or accelerated radiotherapy in head and neck cancer: a meta-analysis. Lancet 2006;368:843–54.
cross-ref  pubmed  

28. Budach W, Hehr T, Budach V, Belka C, Dietz K. A meta-analysis of hyperfractionated and accelerated radiotherapy and combined chemotherapy and radiotherapy regimes in unresected locally advanced squamous cell carcinoma of the head and neck. BMC Cancer 2006;6:28.

29. Smith TJ, Hillner BE. Ensuring quality cancer care by the use of clinical practice guidelines and critical pathways. J Clin Oncol 2001;19:2886–97.

30. Booth CM, Tannock IF. Evaluation of treatment benefit: randomized controlled trials and population-based observational research. J Clin Oncol 2013;31:3298–9.
cross-ref  pubmed  

31. Francke AL, Smit MC, de Veer AJ, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak 2008;8:38.
cross-ref  pubmed  pmc  

32. Grimshaw J, Eccles M, Thomas R, et al. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med 2006;21(suppl 2):S14–20.

33. Tan KB. Clinical practice guidelines: a critical review. Int J Health Care Qual Assur Inc Leadersh Health Serv 2006;19:195–220.
cross-ref  pubmed  

34. van Agthoven M, Heule–Dieleman HA, de Boer MF, et al. Evaluating adherence to the Dutch guideline for diagnosis, treatment and follow-up of laryngeal carcinomas. Radiother Oncol 2005;74:337–44.
cross-ref  pubmed  

35. Lewis CM, Hessel AC, Roberts DB, et al. Prereferral head and neck cancer treatment: compliance with national comprehensive cancer network treatment guidelines. Arch Otolaryngol Head Neck Surg 2010;136:1205–11.
cross-ref  pubmed  

36. Panigrahi B, Roman SA, Sosa JA. Medullary thyroid cancer: are practice patterns in the United States discordant from American Thyroid Association guidelines? Ann Surg Oncol 2010;17:1490–8.
cross-ref  pubmed  

Correspondence to: Stephen F. Hall, Division of Cancer Care and Epidemiology, 10 Stuart Street, Kingston, Ontario K7L 3N6. E-mail:

(Return to Top)

Current Oncology , VOLUME 22 , NUMBER 2 , April 2015

Copyright © 2017 Multimed Inc.
ISSN: 1198-0052 (Print) ISSN: 1718-7729 (Online)