SkadePortalen / WhiplashInfo
Nedanst?nde artikel publiceras med tillst?d av f?fattarna genom Michael D Freeman, DC, PhD, MPH. Den publicerades ursprungligen i Spine den 12 september 1997
F? de som vill kunna l?a artikel i sin eget ordbehandlingsprogram eller skriva ut den, s??erfinner ni den h?. Dubbeklicka p?den s??pnas den i Din ordbehandlare. Den ? virusfri."Whiplash Associated Disorders (WAD) - Redefining Whiplash and its Management" by the Quebec Task Force: A Critical Evaluation
Michael D. Freeman
Submittted to Spine, December 1996
"Whiplash Associated Disorders (WAD) - Redefining Whiplash and its Management" by the Quebec Task Force: A Critical Evaluation
In January 1995, the Societe de l?assurance Automobile du Quebec (SAAQ) published a text entitled, Whiplash Associated Disorders (WAD)--Redefining Whiplash and its Management (referred to, henceforth, as the "text"). The text was authored by the Quebec Task Force on Whiplash-Associated Disorders, which was chaired by Walter O. Spitzer, M.D., M.P.H., F.R.C.P.C., and consisted of an eminent panel of experts in medicine, epidemiology and biostatistics, chiropractic, and other disciplines. The reported mandate of the Task Force was to address a variety of issues concerning whiplash injuries, including:
The Task Force set out to comprehensively review the literature on the subject in order to respond to the issues of the mandate. In addition, a retrospective cohort study was performed on SAAQ data of whiplash-diagnosed individuals in Quebec who collected compensation for their injuries in 1987.
The strategy of the Task Force was to use the "preeminence of evidence" for developing the guidelines, and that, no matter how eminent the panel members were in their respective fields of specialty, their opinions were "always subordinate to evidence" (section 1, page 3).
The Task Force first set about this task by instructing its members on the anatomy, pathophysiology, and biomechanics of whiplash injuries. Then, they examined the existing literature on the subject, using a technique called "the best synthesis of evidence," to determine which literature was scientifically suitable for inclusion in the study. The Task Force then studied its cohort and analyzed the resulting data. Lastly, based upon the results of the literature search and the cohort study, conclusions and recommendations were made regarding the research questions that had been asked. In addition to the text, which was several hundred pages long and available from the SAAQ (it is self-referred to as the "Official Report"), the Task Force published a 73-page pull-out supplement in the April 15, 1995 issue of the journal Spine () (referred to, henceforth, as the "supplement"). When the text and supplement were published, synopsized versions of the conclusions and recommendations were published widely in the popular press, under headlines such as Whiplash Treatments Found to be Ineffective, and Much Whiplash Aid is Rated Worthless (, , ).
It is our contention that some of the most critical conclusions and recommendations, as well as the methodology used by the Task Force in reaching those conclusions, are flawed to the point that the validity of the document must be questioned. The purpose of this paper is to describe our findings of the examination of the text and supplement and to present an analysis of potential sources of bias and other weaknesses.
Materials and Methods
Initially, we reviewed both the primary text and the supplement published by the Quebec Task Force. After examining both publications it was determined that only the primary text would be critiqued because it contained a more complete discussion of the study, and because the supplement contained no unique information.
Initially, only the Task Force?s methodology was examined, particularly for sources of bias which might have threatened either the internal or external validity of the study. Internal validity is defined as the lack of bias in the study, and is threatened by comparison and information biases. External validity refers to the generalizability of the results of the study; in the case of this study, how the results and conclusion from the cohort study apply to the general population.
After a review of the methodology, it became evident that there were other problems with the document that posed an equally large threat to the accuracy of the study?s conclusions as did the study?s lack of validity. These problems consisted of the confusing use of terminology, and conclusions and recommendations that were neither supported by the literature review nor by the results of the cohort study. They were, in some cases, contrary to findings reported in the literature cited by the Task Force.
Results and Discussion
We found five separate categories of methodologic flaws within the text. These categories were:
Selection Bias in Article Selection
The first area in which bias was noted was the manner of selection of articles considered eligible for inclusion in the study. In section 1 of the text, page 6, the statement was made that an a priori "criteria of quality when accepting or rejecting studies" could not be used because it would have resulted in the rejection of "virtually all articles considered" for inclusion in the formal literature review. In spite of this declaration, nearly all of the articles considered were rejected. Specifically, of the 10,382 articles reviewed, 62 were deemed acceptable (section 1, page 4), yielding an acceptance rate of 0.6%, and a rejection rate of 99.4%. Wholesale rejection of existing literature is not a source of bias per se if it does not result in an unrepresentative selection of the literature. However, the variability of all of the literature is difficult to assess and, with such a small sample of the literature, the degree to which the accepted literature is representative of the whole pool of relevant literature cannot be determined.
The literature that was considered for review included searches of the computerized databases beginning in 1980 and continuing to April of 1994. Sources included computerized databases such as MEDLINE, TRIS, and NTIS. Also searched were reports by government agencies, and the Task Force members were asked to supply studies of which they were aware (chapter 5.1, page 3). Literature from before 1980 was included if it was considered either "seminal" or "important" by members of the Task Force. The criteria for gauging these characteristics was not provided. The seemingly arbitrary and nebulous nature of article selection for the period prior to 1980 contrasts greatly with the pan-inclusive search of the subsequent literature. There is no explanation for the discrepancy in search methodology for the periods before and after 1980. However, the use of noncomparable criteria for article selection may have seriously undermined the accuracy of the literature review.
Selection Bias in the Cohort Study
With the SAAQ whiplash-associated disorder cohort, the Task Force study set out to estimate the incidence of "compensated [emphasis added] whiplash injury" in Quebec and describe its variation by age, gender, and geographical region (section 6, page 2). The study subjects were identified from the SAAQ?s database of individuals with ICD-9 diagnostic code 847.0 (cervical sprains and strains, including whiplash injury) and included only individuals who had received compensation for their injuries in 1987 in Quebec. Information for each individual receiving compensation was gathered from the computer database of the SAAQ. The following variables were considered:
No information was gathered about treatment rendered, symptoms, or the extent of functional impairment of the individuals receiving compensation. Several types of compensation were available from the SAAQ (section 6, page 17):
Not included as compensation was most of the cost of treatment for whiplash injuries because Quebec has universal health care insurance and private plans that provide for treatment of whiplash injuries. The text mentions that the SAAQ would reimburse for treatment when it was not provided by any other insurance, but the amount of reimbursement for treatment not otherwise covered was reported to be $0.00 for 1987 (section 6, page 4), whereas in the supplement, Table 6 enumerated numerous categories of expenditure not mentioned in the "Official Report." The reason for this disparity is unclear. Notwithstanding this inconsistency, it is apparent from the text that only
individuals who sought compensation, regardless of treatment history, were included in the cohort.
Also not included in the cohort were individuals who suffered whiplash injuries during the course of their employment because, in Quebec, industrial injuries are the responsibility of another insurer. The selection criteria for subject eligibility for the cohort eliminated an unknown number of the following whiplash-injured individuals:
Had the Task Force used the data generated by their study to estimate the incidence of "compensated whiplash injury" in Quebec and describe its variation by age, gender, and geographical region, as they had originally set forth, selection bias would have been a much less significant issue. However, in the results section (section 6, pages 5-12) the authors did not confine themselves to inferences regarding 847.0-diagnosed individuals receiving compensation. The data were extrapolated to all whiplash-injured individuals in Quebec in 1987, not just those receiving compensation.
Another substantial source of selection bias resulted from the elimination of large portions of the cohort. For example, of the original 4766 subjects, 1743 (36.6%) were excluded because their computer file contained no police report. In accidents where property damage exceeds CAN$500, or accidents in which occupants are injured and require immediate medical attention, or accidents involving animals larger than 50 kg, police may be summoned to the scene (). This usually results in the generation of a police report of the accident. Thus, police reports are not randomly associated with accidents.
Eliminating all individuals from the cohort study who had no police report associated with their compensation history would exclude whiplash-injured individuals who had a delay in onset of symptoms requiring medical care and/or who had less than CAN$500 property damage to their vehicle. Determination of whether this exclusion might be a source of selection bias requires examination of the literature regarding delayed symptom onset and the rate of whiplash injury at sub-vehicular damage velocities.
Several authors have reported delay of onset symptoms in whiplash-injured individuals (, , , ). For example, Hildingsson and Toolanen, in one of the 11 studies the Task Force accepted for their prognosis section, reported the following onset of symptoms in their cohort of 93 whiplash-injured patients (): 65 patients were symptomatic within one hour; 77 patients were symptomatic within 5 hours; and 85 patients were symptomatic within 15 hours. Thus, 30% of these patients would not have been symptomatic immediately after the accident, and would not have met one of the response criteria of the Quebec Police Department. This figure is comparable to the 36.6% of the cohort that did not have police reports in their compensation claim file.
Several studies have examined damage thresholds for various vehicles. For example, Szabo et al. found that 1981-83 Ford Escorts could withstand multiple impacts at 10 mph without sustaining damage (). Bailey et al. reported the damage thresholds for a 1980 Toyota Tercel, a 1977 Honda Civic, a 1980 Chevrolet Citation, and a 1981 Ford Escort as 8.1 mph, 8.2 mph, 8.4 mph, and 10.2 mph, respectively ().
Wooley et al. tested a 1979 Pontiac Grand Prix, a 1979 Ford E-150 van, a 1978 Honda Accord, a 1979 Ford F-250 pick-up, a 1983 Ford Thunderbird, and a 1989 Chevrolet Citation and reported damage thresholds at 9.9 mph, 9.9 mph, 11.0 mph, 11.7 mph, 12.1 mph, and 12.7 mph, respectively ().
Concerning the rate of occupant injury, Foret-Bruno et al. () reported that, at velocity changes below 9.3 mph, the injury rate was 36%, while at velocity changes greater than 9.3 mph, the injury rate was only 20%, pointing to an inverse relationship between vehicle damage and occupant injury. Olsson et al. () found that 18% of these injuries occurred at crashes of less than 6.2 mph, and that 60% of injuries occurred between 6.2 and 12.4 mph. These findings nullify another of the Quebec police department response criteria because the majority of whiplash injuries occur at speeds that are unlikely to result in significant vehicle damage.
It is reasonable to conclude that a substantial subpopulation of whiplash-injured individuals were eliminated from the Task Force?s cohort study by the police report selection criteria. These persons may have had a different history of compensation and recurrence than the group that was studied, resulting in study results that are difficult to interpret and that lack external validity. Moreover, the subpopulation of the cohort that was studied for recurrences did not include an additional 1,348 (28.3%) subjects who were given other diagnoses in addition to the ICD-9 diagnostic code 847.0. Accordingly, some of the most seriously injured individuals probably were excluded from the study by this selection criteria, further undermining the interpretability and external validity of the study findings.
Information bias threatens the validity of the cohort study as a result of the use of ICD-9 diagnostic code 847.0 as the criteria for whiplash injury. In section 7, page 2, the Task Force remarked that diagnosis in whiplash was "confusing and non-standard," thereby suggesting that misdiagnosis may be common. We agree with this assessment. Therefore, it is probable that some whiplash cases were overlooked due to misclassification or the use of codes other than 847.0.
The Results and Discussion section of the cohort study (section 6, pages 5-15) contains numerous references to the portion of the study population that had "recovered" at the time of cessation of compensation. However, without any data gathered concerning the symptoms, level of treatment, or functional impairment at the time of cessation of compensation, it would not be possible to infer anything beyond the fact that the individual no longer was receiving compensation.
Although it is not unreasonable to assume that an unknown percentage of the cohort stopped receiving compensation because they had indeed "recovered" in the conventional sense of the word, alternative explanations for time loss cessation are also likely:
In the section following the description of the cohort study (section 6, page 2), recovery is defined as the "end of disability compensation." However, there is no reference cited for this unusual use of the word; the use of "recovery" in this manner is inconsistent with its usual meaning and is, at best, confusing and, at worst, misleading.
Other words or phrases used to describe findings from the cohort study, which cannot be inferred from the data that were collected, are:
Table 3.1 enumerates the locations in the text where the above listed and similar phrases were found.
Table 3.1: Questionable use of Terminology in the Text
The Self-limited and Short-lived Nature of Whiplash Injuries
In several places in the text, the Task Force reports that whiplash injuries are relatively benign. In section 7, page 2, they note: "Whiplash-associated disorders are usually self-limited." In section 7, page 3, they note: "Patients should be reassured that Whiplash-associated disorders are almost always self-limited." Again in section 7, page 10, they note: "The clinical management of WAD patients should recognize that most WAD...is self-limited." In chapter 8.1, page 3, they note: "Patients should be reassured that most WAD are benign and self-limiting."
There were no references cited in the section on prognosis of whiplash injuries to support these statements. Indeed, Table 184.108.40.206, "Prevalence of symptoms at follow-up," lists the four studies on prognosis which were accepted for review along with the findings of those authors. Norris and Watt found that 66% of their cohort had neck pain at an average of two years post injury (); Radanov et al. found that 27% of their cohort were symptomatic six months post-accident (), and in a study published two years later, reported that 27% of their cohort continued to have headaches six months post-accident (). Hildingsson and Toolanen found that 44% of their cohort were symptomatic an average of two years post-accident ().
Even based upon the only literature accepted by the Task Force in this study which addressed long-term symptomatology, it appears that whiplash-associated disorders are frequently not self-limited and that a substantial number of injured individuals have long-term, chronic symptoms as a result of their injuries.
Additionally, there were no data collected on the physical status of the compensated whiplash injured subjects in the Quebec whiplash-associated disorder cohort study that would have allowed for an inference regarding recovery rates.
In section 7, page 2, the authors note: "All interventions?should be accompanied by reassurance about the favorable prognosis?"
A "favorable prognosis" is usually forecast in conditions that are known to spontaneously resolve without any residual symptoms or disability. Relying only on the literature cited by the Quebec Task Force, whiplash is a disorder that leaves 27% to 66% of the injured population symptomatic at six months to two years post-injury. They cited no studies in their text that would lend support to this statement about favorable prognosis.
Pain is not Harmful
In section 7, page 3, the Task Force recommended: "The key message to the WAD patient is that the pain is not harmful, [and] is usually short-lived? ." The Task Force did not study the nature or severity of pain experienced by the subjects of their cohort study, and none of the prognosis studies accepted for inclusion support the statement that WAD pain is not harmful or that it is short-lived. To the contrary, the pain apparently is long-lived in a substantial proportion of cases. The degree of harm caused by pain from whiplash injuries is a complex subject that was not investigated by the Task Force.
Whiplash Results in Temporary Discomfort
In section 7, page 3, the Task Force reports: "?most incidents of WAD are self-limited, involving temporary discomfort, and rarely resulting in permanent harm.
The studies cited in Table 220.127.116.11 of the text do not support the statement that the "discomfort" is temporary for a substantial percentage of injured individuals. Additionally, using the term "discomfort" in lieu of "pain" may be misleading, because it may suggest to some that the pain experienced by whiplash-injured individuals is minimal or trivial. The degree of pain experienced by the average whiplash-injured individual was not studied by the QTF, in either its cohort study or its review of the literature.
A literature search was conducted to determine if there were other studies that contradicted the Task Force?s conclusions that whiplash injuries short-lived, self limited, and temporary in nature. In addition to the four studies cited by the Task Force, 27 additional studies were found which reported on follow-up of acutely whiplash-injured individuals more than six months post-injury. A minimum quality criteria was established for these studies, which was as follows:
Table 3.2 lists the 11 studies that fit the preceding criteria by author, year of study, cohort size, length of follow-up, and proportion of cohort with neck pain at final follow-up, with respect to those who initially presented with neck pain. The results of this literature search clearly contradict the Task Force?s conclusions regarding the permanency of whiplash injuries.
Prognosis studies that fit the minimum quality criteria for inclusion
In section 6, page 15, the annual incidence rate of compensated insurance claims for whiplash injury in Quebec in 1987 was reported as 70/100,000, based upon the results of the cohort study. This rate is compared with that "of other countries," and Saskatchewan, where the rate was stated to be as "high as 700 per 100,000." However, due to the aforementioned substantial problems with subject selection criteria, the composition of the cohort, with regard to actual whiplash injury, is not clear. Moreover, there is no mention in the text of whether the selection criteria for these other cohorts were comparable. Thus, direct comparison of whiplash injury rates may not be comparable between these groups.
The validity of the conclusions and recommendations of the Quebec Task Force regarding the natural course of whiplash injuries is questionable. This stems from the presence of bias and unconventional terminology used in both the literature search and the cohort study. Although the Quebec Task Force set out to "redefine whiplash and its management," striving for the desirable goal of clarification of the numerous contentious issues surrounding the injury, its publications have instead further confused the subject. Fundamental issues concerning the disorder continue to be debated in the literature, as evidenced by a recent publication by Schrader et al. who hypothesized that chronic symptoms as a result of whiplash were not real and were primarily the result of avarice (). This study was later criticized for, among other faults, having "severe and fatal" selection bias (, , ).
We are in agreement with the Quebec Task Force concerning the need for high quality research concerning the true epidemiologic characteristics of whiplash injuries. Although the whiplash literature is extensive, no definitive studies have established widely accepted standards for either acute or chronic whiplash regarding effective treatment, prognosis, and risk factors for progression from the acute to the chronic stage.
Perhaps the unintended result of the publication of the Task Force findings will be to stimulate discussion in the literature and improve the quality of research on whiplash injuries.
Send mail to email@example.com
with questions or comments about this web site.
Copyright © 2001-2011 Tomas Alsbro, Whiplash Info. All rights reserved.