[Previous]

1 Introduction


1.1 Definition of Alcoholism

      Alcoholism is a very heterogeneous illness and its definition is still in progress. ICD-10 classifies two different types of alcoholism: Dependence and harmful drinking (1).

Alcohol Dependence (ICD-10)

Harmful Alcohol Use (ICD-10)

      DSM-IV (2) criteria are similar. However for 'Harmful use' the expression of 'Alcohol abuse' is preferred.

      A third widely accepted problem is hazardous drinking (3-7) which classifies people without alcohol-related problems but an amount of alcohol intake that is likely to lead to problems in the future. Unfortunately its definition is quite difficult because health risks related to alcohol consumption increase gradually with the amount of alcohol intake and a cut-point is therefore artificial. A limit of 1 drink/day for women and 2 drinks/day for men above which consumption is considered hazardous, is suggested by the U.S. Dep. of Health (6). These are the levels of consumption at which the demonstrated risk for alcohol-associated diseases such as hypertension (7) and breast cancer (7) exceed the potential benefits derived. Similar limits were put by the Health Education Authority in U.K. and the Royal College of Psychiatrists (8,9).


1.2 The impact of Alcoholism on Public Health

      Alcohol consumption and alcohol related medical and psychosocial morbidity remain a major concern in Public health. In the USA incidence and prevalence of alcoholism ( diagnosed by DSM-IV criteria) in the general population is estimated 4.4% and 13.3% respectively (10). In Switzerland there is an estimated average consumption of 13 liters of pure alcohol per year and person (age 15 and older) as calculated from the overall alcohol sold in the country (9.6 liters for the U.S.A.) (11). There are an estimated 2.5% of alcoholics (4), a number probably highly optimistic. Apart of the immense amount of personal suffering, the socioeconomic impact is considerable. In Canada the economic cost of alcohol abuse was estimated at more than $7.5 billion per year, representing 40.8% of the total cost of substance abuse (12). In Switzerland 20% of all hospital admissions are related to alcohol, ranging up to 50% in the group of 40-50 years old (4).


1.3 Prevention

      There is no doubt about the necessity of effective prevention to fight this major health problem. Whereas primary prevention tries to inform and support people before they get into any alcohol related troubles, the aim of secondary prevention is to help people already experiencing any kind of negative consequences due to their alcohol intake. This is done with the goal to decrease or even stop their harmful alcohol consumption and to minimize further social or physical health damage.

      Secondary prevention is a widely used practice in clinical medicine, but primary prevention is often neglected . The reasons therefore are manyfold. Apart from lack of time and focus, difficulty to prove effectiveness seems a major constraint (1,2,4,26). Therefore screening general population to follow the impact of primary prevention is fundamental. However the utility of screening instruments such as the CAGE questionnaire for primary prevention has only recently become part of investigation. The requirement for a screening tool in primary prevention differ from secondary. Most often the general population has to be screended and there is a need to detect a population at risk rather than people already suffering from illness. Moreover, even if a test is not very specific, it may be useful as a parameter to detetect time trends as long as reliability is accurate.


1.4 Alcohol screening tests

      Alcoholism is difficult to diagnose. There are no objective biologic tests that are reliable indicators of alcohol problems. Mean cell volume of red blood cells, g-GT of the liver and a few others are often altered in excessive drinking but their sensitivity and specificity are insufficient (3). Therefore, in most of the cases diagnosis requires subjective information of the patient or his surrounding. Unfortunately, alcohol problems are associated with social stigma and patients are not eager to have the condition discovered at any stage. For this reason patients may not be truthful with themselves or others regarding the extent of consumption or negative consequences resulting from its use. The combination of subjective diagnostic criteria and denial creates a major barrier for physicians in the screening and diagnosis of alcohol problems. To overcome this problem, multiple alcohol screening questionnaires have been developed. Their common goal is to provide physicians and health care workers with a good tool to diagnose alcoholism. Therefore they needed to be short, easy to use, and overcome denial, which was achieved by using questions that are answered positively by alcoholics even though they denied any excessive drinking.

      The following is a short overview of the most used and well established alcohol screening questionnaires:

  1. CAGE-Test
    One of the oldest and best investigated screening tests (4,13)
  2. MAST (Michigan alcoholism screening test)
    25 Questions, wide variety. Slightly better performance than the CAGE but much longer (14)
  3. B-MAST
    Reduction of the MAST to 10 Questions (15), shows a high correlation with the full MAST (r=0.95). It's performance is comparable to the CAGE (16).
  4. S-MAST
    Reduction of the MAST to 13 questions with high correlation to the MAST (17).
  5. AUDIT
    10 Questions, including questions similar to the CAGE and questions about alcohol consumption. It was developed to identify problem drinkers in primary care settings. It seems to detect a broad range of alcohol related problems, including hazardous drinking (5).
  6. TWEAK
    5 Questions, including some questions of the CAGE, others from the MAST, and a question about the quantity of alcohol consumed. It was initially designed to detect 'at risk" drinkers. There is some evidence that it performs better in detecting heavy drinking than the CAGE (18).

      Findings from studies that compared all or some of the tests are heterogeneous (5,14,16,18,19,20) and probably due to methodological differences. In summary, apart from the MAST that is much longer than the others, the tests seem to perform equally well in detecting alcoholism with some minor individual advantages in different populations (sexe, age) (21).

      There are some other, less known questionnaires, such as the VAST, SWAG, NET, T-ACE(14,21,22).


1.5 The CAGE Questionnaire

      The CAGE Questionnaire is a widely used tool to screen for alcoholism. It was developed by Ewing and Rouse in 1970 (13) to detect alcoholics in general hospitals. A patient sample, including clinically diagnosed alcoholics, answered a large number of alcohol related questions. Next, researchers looked for the minimum number of questions that would usefully divide the responders into alcoholics and non-alcoholics. Four questions performed well and were placed in a new order to permit the use of the mnemonic CAGE. In 1974 Mayfield et al. published the first validation study (23). Since then, reliability and validity have been well documented in hospital (13,16,18,24,25,) and general practice (10,14,21,26-30) settings. The CAGE has gained remarkable popularity because it is short, simple to use, and allows to detect more alcoholics than blunt questions on drinking habits (13,23). Two ore more positive answers on this 4-question-test is the common cut-off for detecting alcoholism (13,23). The sensitivity and specificity of this test by DSM-IIIR criteria for alcohol dependence as a goldstandard are 75-85% and 85-95% respectively (21).


1.6 The CAGE and gender differences

      In every evaluation of alcohol related disorders it seems useful to investigate men and women separately. The CAGE performance seems to be worse in women than in men(12,16,20,22). Not only are women three times less likely to have a positive test result, which may reflect the fact that alcoholism is less common in the female population but some studies show less sensitivity in women (16,31). The increased stigma associated with heavy drinking in women (32) might lead women to underreport alcohol consumption and alcohol related problems more often than men. Also, in many social groups women are less likely than men to experience overt social consequences of heavy drinking such as employment, economic, or legal difficulties (33,34). On the other hand, women suffer from adverse consequences of drinking at lower levels of consumption than men (6-9,35).


1.7 The CAGE in General Populations

      The validity of the CAGE questionnaire in general population samples was subject of recent investigations (12,16,18,31,36-39). The general population differs in many ways from hospital and general practice settings:

  1. Usually the prevalence of alcoholism (pre-test probability) is lower than in general practice or hospital settings. Mainly because alcoholics are more likely to experience health problems and contact the medical system than the average population (3,16).
  2. Alcoholics in the general population have less severe symptoms than alcoholics seeking medical care(3,16). It seems that alcoholics are much more likely to contact health care providers once they are seriously ill, which is usually in a later and more severe stage of their alcohol disease (3,16).
  3. In the general population the risk for denial is higher than in hospital and general practice settings (3,16). People who are seeking a physicians help are often aware of their problem and more likely to talk about their alcohol consumption. And even people initially denying any relation between their medical problem and alcohol consumption often start accepting the facts after continuous conversations and treatment (3,16).

      Changes in pre-test probability should not affect the sensibility and specificity of a test. However the positive predictive value is lower in samples with low pre-test probabilities such as the general population.

      The other two points represent new conditions that may alter the CAGE's performance (sensitivity and specificity). For example, if denial is more common, then sensitivity is expected to be lower.

      The different characteristics of general populations compared to hospital and general practice samples explain the need to test the performance of the CAGE under these conditions. A task that is complicated by the fact that proper goldstandards are more difficult to obtain in general populations. It is often very difficult to get access to preexisting clinical records and the time healthy individuals are ready to invest in surveys is often limited. This makes it difficult to obtain further information to validate and administer the CAGE questionnaire, especially longtime psychiatric interviews and clinical tests. Only two American studies compared the CAGE to DSM-IIIR criteria in a general population, reporting sensitivity of 0.56/0.77 and specificity of 0.95/0.85 (16,39). In all the other applications of the CAGE to the general population proper gold standards are missing.

      Finally, most of the mentioned studies used the English version of the CAGE in Anglo-Saxon cultures. However, for the use in general populations proper validation of the French version and its use in European cultures is still lacking (36).


1.8 The CAGE in Public Health

      Especially in public health the CAGE is often administered in a different way (phone interviews or posted questionnaires) and for different reasons (population surveys and prevention rather than treatment). That is why further validation of the CAGE under these special conditions could be valuable.

      Whereas the CAGE's ability to detect alcohol dependence are well documented there are still some doubts about its ability to detect harmful and especially hazardous drinking (3,12). The CAGE was not initially designed to detect lower symptomatic alcoholism (13). However, as the definition of alcoholism progressed (16) and the importance of hazardous drinking started to be recognized (3) the question raised whether the CAGE would be able to detect these conditions(3,16).

      One could argue that in public health screening for harmful and hazardous drinking is more important than screening for dependence because it seems often an earlier stage in alcohol disease, is more effective to treat and covers the greatest part of alcohol related suffering and costs due to its high prevalence (3,4).


1.9 Goals of the study

      Paying attention to these aspects this study addresses to the following questions:

  1. Utility of the CAGE as a screening tool in population surveys
  2. Ability of the CAGE in detecting low symptomatic alcoholism
  3. Analysis of the validity of the CAGE in general population samples
  4. Performance of different cut-offs
  5. Gender differences in the CAGE performance
  6. Analysis of the validity of the French version of the CAGE
  7. Characteristics of the CAGE administered to the Swiss-French culture

2 Methods


2.1 Setting and population

      In February 1996, J.-F. Etter et al. mailed a questionnaire to a representative sample of the population living in the canton of Geneva aged from 18 to 70. The sample is a random selection of 1000 persons based on the official file of Geneva residents (400'000 inhabitants). Four reminders were sent to the non-responders, and a response-rate of 68.4% (675 / 987) was obtained after exclution of 13 ineligible persons.

      This dissertation is a secondary analysis of these previously published datas (46).


2.2 Content of the Questionnaire

      The Questionnaire was in French and contained a section on personality, smoking and on alcohol. The alcohol section consisted of the CAGE-Questionnaire and questions about drinking habits, alcohol-related problems and other questions related to alcohol and personal health.

      The part of the Questionnaire used for this study (translated from its French version)

      
1. How frequently have you been drinking alcohol in the past twelve months..... -  6-7 days / week
-  3-5 days / week
-  1-2 days / week
-  1-3 days / month
-  Less than once a month
-  Never
2. How many drinks on average did you take on the days you've been drinking alcohol? ___drinks / day
3. How many times in the last twelve months have you driven a car with the impression of having drunk too much? ___times
4. Have you met any of the following problems related to alcohol abuse? -  Drivers license suspension
-  Difficulties in the family
-  Difficulties in the job
-  Difficulties with friends, neighbors, etc.
5. Have you ever tried to get help for a problem related to alcohol use ? -  from a doctor (exept psychiatrists)
-  from a psychiatrist or psychologist
-  from social workers
6. In general, do you consider that your health is..... -  Excellent
-  Very good
-  Good
-  fair
-  poor


2.3 Measures

      The CAGE is an acronym of the four questions:

      The original CAGE was designed to detect current alcoholics (13). However, because people who had only experienced alcoholism far in the past could also answer positively to the questions it was suspected that the CAGE may detect lifetime prevalence of alcoholism rather then only current alcoholics. That is why the past-year CAGE was developed to detect only the actual alcoholics (prevalence) . In this study we used a French translation of the questionnaire in the version that screens for life long prevalence of alcoholism.

      Validation Criteria

      Cronbach a was used to assess reliability. For criterion validation we used the following hypothesis: If the four CAGE questions are good tools to detect people who have a problem with their alcohol intake, the following hypothesis should be true for the individuals giving an affirmative answer to one of the four question compared to the ones that responded negatively :

  1. People with one or more positive answers to the CAGE questions have a higher average alcohol intake than participants with no positive answers.
  2. People with one or more positive answers to the CAGE questions are more likely to be hazardous and heavy drinkers.
    As mentioned, hazardous alcohol intake is difficult to define. We set the limit at an average daily alcohol intake of 1 drink/day for women and 2 drinks/day for men on above which consumption is considered hazardous, as suggested by the U.S. Dep. of Health (6). These are the levels of consumption at which the demonstrated risk for alcohol-associated diseases such as hypertension (7) and alcohol related cancer (7,40) exceed the potential benefits derived. Similar limits were set by the Health Education Authority in U.K. and the Royal College of Psychiatrists (8,9).
    The chosen limits are the lower end of all suggestions found in the literature and are therefore subject to criticism. So we added the criteria "heavy drinking" for an average daily alcohol intake of more than 3 drinks for women and more than 4 drinks for men. These levels are slightly above to most optimistic estimation of harmful alcohol consumption in the literature (40g pure alcohol per day for women and 60g for men at a standard drink of 12g of pure alcohol)(11) and therefore above this limit there are hardly any doubts about the serious risks for physical and psychosocial health.
  3. People with one or more positive answers to the CAGE questions are more likely to have experienced problems related to their alcohol intake.
    "Harmful drinking" was defined as reporting problems related to alcohol intake in at least one of the different areas. This doesn't completely correlate with the ICD-10 diagnosis for harmful drinking that suggests that the pattern of alcohol use leading to problems must persist for at least one month ore has to be present repeatedly.
  4. People with one or more positive answers to the CAGE questions are more likely to report repeated driving while intoxicated .
    Individuals who answered the question "How many times have you been driving a car with the impression of having had too much alcohol" were considered positive for "Driving while intoxicated" if they reported five or more such episodes. The repetitiveness of a behavior that exposes the person to a serious risk regarding its health and conflicts with law (41) is a good sign for the abuse of alcohol (DSM IV) and an increased risk for dependence (3). Unfortunately, DSM does not specify the meaning of repetitive but a cut at five times a year seems reasonable.
  5. People with one or more positive answers to the CAGE questions are more likely to report having sought professional help for their drinking.
    This includes all people having ever contacted a doctor, psychiatrist or social assistance to face a problem related to their alcohol intake.
  6. People with one or more positive answers to the CAGE questions have a worse health status than those with negative answers.
    Alcohol dependence and hazardous drinking is related to an alcohol consumption that harms the individuals health if persistent. CAGE positive individuals should therefore report an overall poorer health state then the CAGE negative. To get a dichotomic variable we separated the individuals who considered their health being excellent, very good or good from the ones reporting fair or poor health.

      Each of the four CAGE questions was tested against those criteria. In addition we compared the population with two or more positive answers, the recommended threshold for the CAGE 2 to detect alcoholism (13,23), to the population with one ore no positive answers.

      In some studies a cut-off of one is discussed (16,18,29,42), especially for screening tests in which sensitivity is supposed to be high. The aim is to keep negative predictive value as low as possible. Therefore a high sensitivity is needed. This can only be achieved with a low threshold. The consequence is often a decrease in specificity and positive predictive value. But this is secondary for a screening test who aims not a final diagnosis but rather detecting a population at risk. The definitive diagnosis can then be evaluated with further tests.

      Moreover, in general population samples where symptoms are often mild, too many false negative are said to be lost with a threshold of two(16). That is why we compared the performance of the CAGE at the different thresholds.

      As mentioned, hazardous, harmful and heavy drinking should be detected by a screening test, especially in public health. We measured the performance of the CAGE in detecting these individuals. Again we compared thresholds of two and one.

      The clinician who is confronted with a patient, however, is more interested in the meaning of the individual score rather than a threshold. That's why we added the probability of having one of those conditions for the different CAGE scores.

      For the statistical calculations we used the SPSS8.0 program (SPSS Inc., Chicago). We did group comparison accompanied with p-values calculated with chi-squares for categorical variables. Differences associated with a p-value <= 0.05 were considered statistically significant. To validate the different CAGE questions we further used Pearson chi square, relative values (bench marking of Pearson chi squares of the four CAGE questions) and odds ratios.


3 Results


3.1 CAGE results at the threshold of 2

      The total sample was 675, 322 men (48%), 350 women (52%). Of those 9.7 % were non-drinkers. This low number is characteristic for the Swiss-French population (43,11).

      The results of the CAGE at the common used cut-off point of two are shown in table 1.

      
Table 1 : CAGE-Test (In %, n=675=100%)
  All men female
Have you ever felt you need to Cut down on you drinking? 17.3 23.9* 11.2*
Have you ever felt Annoyed by criticism of your drinking? 9.0 14.5* 4.3*
Have you ever felt Guilty about your drinking? 13.7 18.9* 8.6*
Have you ever felt you needed a drink first thing in the morning? (Eye-opener) 2.3 4.4* 0.3*
"CAGE" Positive (2 or more positive answers with "eye-opener excluded) 11.0 16.6 6.1
CAGE Positive (2 or more positive answers) 11.3 17.0* 6.1*
* Difference between men and women p< ;0.05

      11.3% of the population has a positive CAGE result. Men are 2.8 times more likely to have a positive test result than women (17.0 vs 6.1) are. Almost one out of five people or 17.3% of the population have already felt that they need to cut down their drinking. On the other hand, only 2.3% respond affirmatively to the 'eye-opener'. The exclusion of this question would hardly change the number of positive CAGE results.

      The shown percentages are based on the total sample, including the non-drinkers. Even though in many other studies CAGE results are calculated excluding the non-drinkers, including non-drinkers seems more appropriate. It gives a better estimation of the number of problem-drinkers in the general population and allows comparing the results in different populations. Moreover to validate the CAGE, including self-reported non-drinkers seems important because this group may contain an important percentage of alcoholics in denial. They may be detected in the process of validation.


3.2 Alcohol and alcohol related problems

      The average alcohol consumption was 6.4 glasses/week (table 2) that is 77 g of pure alcohol (one standard drink =12g pure alcohol (11)). Men consume almost three times more then women. 8.6% of the population are hazardous and 3.8% heavy drinkers. These data are quite similar to the ones obtained by Gmel (11) who used similar cut-offs in the Swiss-French population (9.1% and 3.9% respectively).

      
Table 2 : Alcohol consumption and Alcohol related problems. (n=100%=675)
  Total Male Female
Hazardous drinking 8.6% 11.9%* 5.5%*
Heavy drinking 3.8% 6.7%* 1.2%*
Harmful drinking 10% 10.9% 9.1%
 - Confiscated driving license 3.8% 6.0% 1.5%
 - Family problems 6.0% 6.0% 6.1%
 - Professional problems 2.9% 3.1% 2.6%
 - other social problems 4.2% 3.1% 5.2%
Intoxicated while driving (> ;= 5 times in last twelve months) 4.3% 8.1%* 0.9%*
Tried to get help for alcohol-related problems 2.5% 3.2% 1.8%
Fair or poor health status 6.8% 6.7% 7%
drinks/week 6.4 9.5* 3.6*
* Difference between male and female p< ;0.05

      10% of the population reports having experienced problems related to alcohol consumption in at least one of the screened areas and are therefore classified harmful drinkers. Interestingly there is no significant difference between man and women, as one would expect if the hypothesis of lower consumption and higher denial in females were true. This could be due to women reporting problems related to the alcohol consumption of close ones rather than their own. Whereas the number of men reporting five or more times intoxicated driving in the last twelve month is alarmingly high (8.1%), the number of people seeking professional help for their drinking is deceptively low. In the latter , there is no difference between sexes.


3.3 Reliability

      Cronbach-alpha was 0.70 (table 3), a result also found in other studies of the French and English version of the CAGE (36), suggesting good internal consistency.

      Additionally, we tested Cronbach-alpha for the CAGE excluding questions one by one. By excluding the 'eye-opener' question Cronbach-alpha raised to 0.73. All other exclusions decreased internal consistency of the CAGE.

      
Table 3 : Cronbach alpha for the total CAGE and partial, excluding each of the four questions
CAGE AGE CGE CAE CAG
0.70 0.61 0.61 0.55 0.73


3.4 Validation of content

      As shown in table 4 , the CAGE does not cover all of the criterias indicating alcohol dependency as suggested by ICD-10. Especially the criterion "giving up other activities" seems not to be covered by any of the four CAGE questions.

      
Table 4 : Content validation of the CAGE regarding ICD-10 criteria
ICD-10 Cut down Annoyed Guilty Eye-opener
Compulsion        
Lack of control        
Withdrawal        
Tolerance        
Other activities        
Use despite        


3.5 Characteristics of the different CAGE questions

      To test the properties of the CAGE we compared its four questions to the different indicators for alcohol problems (table 5a). Every single question shows good discrimination power in tests. A positive answer in any of the four questions is associated with a four to five times higher probability for being a hazardous or harmful drinker. A positive answer increases the alcohol consumption 2.6 to 3 times.

      
Table 5a : Prevalence of each validation criterion in the different CAGE groups in %
CAGE question Cut-down* Annoyed* guilty* eye-opener*
answer
n=
Yes
116
no
517
Yes
61
No
573
yes91 No534 yes15 No625
Hazardous drinking 25.7 5.5 33.9 6.4 27.3 6.1 30.8 8.5
Heavy drinking 11.7 2.3 16.7 2.7 11.2 2.8 14.3 3.7
Harmful drinking 24.3 7.0 40.0 7.0 27.8 7.3 53.3 9.1
Intoxicated while driving 9.4 3.4 18.5 3.1 16.5 2.5 23.1 3.9
Professional Help 12.3 0.4 16.7 1.0 9.0 1.5 28.6 1.9
Fair or poor health status 13.2 5.7 20.3 5.7 16.9 5.3 15.4 6.8
drinks/week 13.4 5.2 16.3 5.7 13.8 5.6 18.6 6.3
*All p< ;0.05

      By far the best discrimination is obtained for the group seeking professional help. People with a positive answer in any of the questions are 6 to 30 times more likely to have contacted professional help than the ones with negative answers. This group is considered the one with the highest probability of alcohol dependence and the high discrimination power of the CAGE questions is therefore of great significance. Finally the groups answering affirmatively report a poorer health status than the negative, as one would expect.

      The calculated chi-squares and relative validity (table 5b) show that the "Annoyed"-question performs best in all criterions except in "driving while intoxicated". "Cut-down" and "Guilty" are of equal value with some differences. Whereas the first does excellent in "Professional Help" the second performs better in "Driving while intoxicated". Again the 'eye-opener' has a somewhat special position. Its discrimination power is pretty poor compared to other items.

      
Table 5b : Pearson Chi-Squares and Relative Validity
CAGE Question cut-down Annoyed Guilty eye-opener
  chi rv Chi rv Chi rv chi rv
Hazardous drinking 44.5 0.91 49 1.00 40.5 0.83 7.8 0.16
Heavy drinking 20.9 0.75 27.8 1.00 13.8 0.5 4.0 0.14*
Harmful drinking 31 0.48 65.2 1.00 35.1 0.54 31.3 0.48
Driving w. intox. 7.4 0.27 27.4 0.84 32.6 1.00 11.5 0.35
Professional help 53.2 0.99 53.8 1.00 17.1 0.32 39.7 0.74
Poor health 7.9 0.49 17.6 1.00 15.6 0.89 1.4 0.09*
* p> ;0.05


3.6 Validation of the CAGE at a threshold of 2

      The Characteristics of the CAGE positive population at a CAGE threshold of 2 are shown in table 6a. All tested factors that indicate problems with alcohol consumption are far more common in the CAGE positive group of the sample. Alcohol consumption in the positive group is three times higher than in the negative. One third are hazardous (33.3%) or harmful drinkers (33.8%) compared to 5.7% and 7.1% respectively. A previous study (12) supports the good discrimination factor for harmful drinking (4.8 and 7 respectively). Heavy drinkers are six times more common (15.1 vs 2.5). However, it is surprising that heavy drinking is not better separated than hazardous drinking (6 vs 5.8).

      
Table 6a : Characteristics of the CAGE positive (>=2) vs CAGE negative population in %
  Total* male* female*
CAGE score > ;=2 < ;2 > ;=2 < ;2 > ;=2 < ;2
Hazardous drinking 33.3 5.7 29.4 8.9 42.9 3.2
Heavy drinking 15.1 2.5 15.4 5.2 14.3 0.3
Harmful drinking 33.8 7.1 34.0 6.3 33.3 7.7
Driving w. intox. 14.5 3.1 18.4 6.3 5.0+ 0.7+
Professional Help 14.9 0.9 16.7 0.4 10.0 1.3
Health status 19.2 5.3 13.2 5.6 35.0 5.1
drinks/week 15.7 5.4 17.1 8.2 12.2 3.2
* all p< ;0.05
+ not significant

      The most impressive performance is detected in the people seeking professional help for their alcohol consumption. They are 15 times more common in the positive group (14.9 vs 0.9). It is interesting to see that the CAGE has in all areas an equal or higher distinction power in women.

      To highlight the discrimination power in the different criterions we additionally calculated the odds ratios (table 6b).

      
Table 6b : Odds ratios with 95%confidence interval for an individual with a CAGE score >=2
  Total Male Female
  odds ratio Interval odds ratio Interval odds ratio interval
Hazardous drinking 8.2 4.5/15.1 4.2 2.0/9.0 22.6 7.8-66
Heavy drinking 7 3.0/16.0 3.3 1.3/8.5 52.0 5.1/525
Harmful drinking 6.7 3.7/12.0 7.7 3.6/16.4 6.0 2.2/16.3
Driving w. intox. 5.3 2.3/12.0 3.8 1.4/8.3 8.0 0.7/92*
Professional help 19.6 6.6/58.2 50.4 6.2/407 8.5 1.5/50
Poor health status 4.2 2.1/8.4 2.6 1.0/6.7 9.9 3.4/28
*not significant

      In this view, the outstanding performance of the CAGE in detecting people who got professional help for their alcohol use is even more evident, especially in men. In women hazardous and heavy drinking is best detected.


3.7 Threshold at 1

      With a CAGE at a threshold of one 24.1% of the sample have a positive CAGE (34.5% of men, 16.3 % of women). In this case the CAGE positive group shows slightly lower frequencies for all factors (table 7). On the other hand, the CAGE negative group shows only little decrease of the criterion frequencies. Especially in 'Professional help' the CAGE performance is still outstanding, and in female even better than at a threshold of two.

      
Table 7a : Characteristics of the CAGE positive (>=1) vs CAGE negative population in %
  Total* male* female*
CAGE > ;=1 pos neg pos neg pos neg
Hazardous drinking 20.9 5.0 21.2 8.0 20.4 2.9
Heavy drinking 9.6 2.1 11.8 4.5 5.5 0.4
Harmful drinking 21.1 6.5 21.7 5.5 20.0 7.2
Driving w. intox. 11.4 2.1 15.5 4.7 3.8+ 0.4+
Professional help 8.8 0.4 9.4 0.0 7.5 0.7
Poor health status 10.6 5.7 8.5 6.1 14.8 5.4
Drinks/week 12.3 4.8 14.5 7.4 8.2 2.9
* all p< ;0.05
+ not significant

      
Table 7b : Odds ratios with 95%confidence interval for an individual with a CAGE score >=2
  Total Male Female
  odds ratio Interval odds ratio Interval odds ratio interval
Hazardous drinking 5 2.8/8.8 3.1 1.5/6.2 8.7 3.3/22.8
Heavy drinking 5 2.2/8.8 2.8 1.1/7 16 1.6/157
Harmful drinking 3.9 2.5/6.6 4.8 2.2/10.3 3.3 1.4/7.2
Driving w. intox. 5.9 2.6/13.1 3.7 1.5/8.8 11* 0.9/122
Professional help 23.1 5/103 n/a   11.4 2/63
Poor health status 2 1.1/3.7 1.*4 0.6/3.5 3 1.2/7.6
* not significant


3.8 CAGE performance in detecting low symptomatic alcoholism

      Of the 56 individuals who were positive for hazardous drinking 42.9% had a positive CAGE (table6), of the harmful drinkers only 38.5%.

      
Table 8 : Performance of the CAGE in detecting hazardous or harmful drinking at different thresholds
CAGEthres-hold
N=
Hazardous drinking Heavy drinking Harmful drinking
total
56
male
37
female
19
total25 male21 female4 total65 male34 female31
> ;=1 Sens
Spec
0.57
0.79
0.57
0.70
0.58
0.86
0.600.77 0.570.68 0.750.84 0.520.78 0.680.70 0.360.86
> ;=2 Sens
Spec
0.43
0.92
0.41
0.86
0.47
0.96
0.440.90 0.380.84 0.750.95 0.390.92 0.530.87 0.230.96

      Of the heavy drinkers 54% have a negative CAGE. At the lower the threshold of one, sensibility in detecting hazardous and harmful drinking raises to 0.57 and 0.60 respectively. If it comes to compare sexes, hazardous or heavy drinking is better detected in female, sensibility and specificity being higher. Not so in harmful drinking. Only 23% of the females reporting problems related to their alcohol intake have a positive CAGE at a threshold of two (vs 53% in men). With a cut-off at one, sensitivity raises to 36%. As mentioned there is the same number of female harmful drinker as male. However 75% of them are CAGE negative.

      The following ROC curves help to visualize the effect of different CAGE cut-offs on hazardous -, harmful drinking and some others of the used criterions.

      

Table 9a : ROC Curves for hazardous drinking

      

Table 9b : ROC Curves for harmfull drinking

      

Table 9c : ROC Curves for professional help

      

Table 9d : ROC Curves for heavy drinking

      

Table 9e : ROC Curves for driving while intoxicated

      The only satisfying curve is obtained in 'Professional help' All other curves are less impressive. Even by sacrifying specificity, sensitivity is only slowly increasing.

      The ability of the CAGE in detecting individuals with harmful or hazardous drinking or both is shown in table 10.

      
Table 10 : Performance of the CAGE in detecting individuals with hazardous and/ or harmful drinking at different thresholds
CAGE
Threshold
hazardous and/or harmful drinking n=108
  Sensibility specificity
  total Male Female total male female
> ;=1 0.51 0.60 0.39 0.81 0.74 0.87
> ;=2 0.36 0.44 0.25 0.94 0.90 0.97
  pos pred value neg pred value
  total Male Female total male female
> ;=1 0.36 0.38 0.32 0.11 0.13 0.10
> ;=2 0.54 0.55 0.53 0.12 0.15 0.11

      At a cut-off at two the positive predictive value is 0.54. That means a person with a positive test has a 54% chance of having at least one of the two conditions. However sensibility is very poor (36.1%). 2/3 of the harmful and/ or hazardous drinkers has a negative CAGE and is therefore not detected. Even at a threshold of 1 that lowers the specificity from 93.7 to 81%, sensibility is not much more than 50% and the positive predictive value falls to 0.36.

      Whereas there is a higher sensibility in men, specificity is better in women. The higher the specificity, the higher is the positive predictive value. The similar results for both sexes are a result of the deeper prevalence (pre-test probability) in women.


3.9 Characteristics of the individual CAGE scores

      Alcohol consumption and related problems increase continuously with CAGE scores (table 11) and any threshold seems therefore artificial. That's why it is often proposed to judge after individual scores rather then by cut-points (29). One third of the persons with a CAGE score of two has either hazardous or/and harmful drinking. With a score of three this probability is 0.65, raising to a 100% for a score of 4.

      
Table 11 : Hazardous and harmful drinking in different CAGE scores in %
CAGE-Score
n=
0
478
1
81
2
38
3
24
4
10
Hazardous drinking 5.0 9.9 21.1 50.0 40.0
Harmful drinking 6.5 10.3 17.9 40.0 80.0
Hazardous and/or Harmful drinking 11.2 19.5 35.9 65.2 100.0
Drinks/week 4.8 9.2 12.4 17.7 23.1

      


4 Discussion


4.1 Validation of a the CAGE in a French version administered to a general population sample

      The percentage of positive answers for the different CAGE-questions is similar to other studies in the Swiss-French (43) and even other European populations with the same prevalence of a positive CAGE (38,43). These findings suggest good reproducibility for the CAGE in the studied population. Internal consistency is reported being around 0.7 in different studies (36).

      The content validation of the CAGE is not complete regarding ICD-10. This is not surprising considering that the CAGE is more than 25 years old and the ICD classification changed significantlly over the years. However since only 3 out of the 6 criterions of ICD-10 are necessary for the diagnosis of alcohol dependency and the CAGE covers five of them, content validation may be regarded as satisfying.

      The discrimination power of the different CAGE questions and of the common threshold of two for all tested criterions shows good construct validity, for men as well as for women. This supports its reputation of being a valid tool for detecting problem drinking, also in its French version and administered to the Swiss-French population.

      It seems worthy to emphasize the good performance of the CAGE in people having sought professional help for their alcohol use. This group probably contains a high number of alcoholics. And it is a good sign to see that the CAGE is able to detect this group. However, people seeking help are more likely to confess their alcohol problems and therefore the good CAGE result in this group does not permit to comment on its performance towards denial.

      The association between a positive CAGE and reported problems due to alcohol consumption supports the findings in other studies (12,36). Unfortunately again, individuals in denial may respond negatively to both, the CAGE and the questions about alcohol related problems.

      The low number of positive "eye-openers" compared to results found in American studies is a common finding in the Swiss (43) and other European cultures (31,37). This question seems too blunt for a culture where drinking in the morning is socially unaccepted. People admitting it are considered alcoholics in the public opinion and this seems the reason that denial to this question is high. It is therefore not surprising that this question shows a very poor sensibility throughout all the performed tests. Cronbach-alpha increased by suppressing the 'eye-opener' which further raises the question of its use in the studied population.


4.2 Performance of different cut-offs

      At a threshold of one the CAGE's discrimination power for the studied criterions hardly changes. In this case the CAGE positive group shows slightly lower frequencies for all factors and specificity of the test could therefore be lower (table 5). On the other hand, the CAGE negative group shows only little decrease of the criterion frequencies. This suggests that a threshold of one does not remarkably improve negative predictive value. This questions a threshold of one in samples where a high sensitivity is needed.

      The different ROC curves support the hypothesis that a threshold of one lowers specificity without remarkable improving of sensibility. However we must admit that this statement bases on our criterions and not on diagnosed alcoholism.


4.3 Ability of the CAGE in detecting low symptomatic alcoholism

      The CAGEs performance in detecting hazardous or harmful drinking is pretty poorly (table 7). Of the 56 individuals who were positive for hazardous drinking 42.9% had a positive CAGE (>=2), of the harmful drinkers only 38.5%. For hazardous drinking, an average of more than one glass for women and more than two for men was set. This this low levels of alcohol consumption may not be considered low symptomatic alcoholism by anyone because they are very close to the suggested daily alcohol intake of 1 to 2 glasses to decrease cardiovascular risks.

      The modest performance of the CAGE in detecting harmful drinking raises more concerns and correlates with results of other studies where sensitivity was 0.38 and 0.48 (44). Because we used lower criteria for harmful drinking than the DSM-IIIR, sensitivity may be higher if DSM-IIIR is used. Even of the heavy drinkers 54% are missed. It is surprising that the CAGE does not perform better in heavy than in hazardous drinkers. This is somehow in contrast to reported correlation of CAGE scores to alcohol consumption, saying the higher the alcohol consumption, the higher the average CAGE score (12,31,37). Being confronted with the poor CAGE performance in detecting lower symptomatic alcoholism one is tempted to lower the threshold to one. By this sensibility in detecting hazardous and harmful drinking raises by factor 1.3 and 1.6 to 57% and 60% respectively, still quite modest. If it comes to compare sexes, it is surprising to see that the CAGE performs better in women than in men in detecting hazardous or heavy drinking. Even though definitions in these categories are not the same for men and women, this finding suggests that the CAGE detects unhealthy alcohol consumption better in women than in men. Not so in harmful drinking, where the performance in women is disastrous. Only 23% of the females reporting problems related to alcohol intake have a positive CAGE at a threshold of two. Even with the cut-off at one no satisfying sensitivity is obtained (36%). As mentioned there is the same number of female harmful drinker as male. However 75% of them are CAGE negative. One explanation for this findings is the possibility that many women reported having problems because of alcohol abuse of their husbands or other close ones rather than because of own drinking.

      The CAGE seems to be a weak tool to screen for low symptomatic or early stages of alcoholism, such as hazardous and harmful drinking. Here, lowering the cut-off to one does not remarkably increase its performance. It seems as if the CAGE is not able to differentiate between occasional harmless drinking and low symptom alcoholism.


4.4 Gender differences

      Men have three times more often a positive CAGE result than women. This is a common finding (27,30,38,43) and reflects to a certain degree the fact that alcoholism is more common in men. However it is suspected that the CAGE performance is worse in women, sensitivity being poorer (20). But a recent study (12) showed the same probability for a positive CAGE results in both groups if they have the same drinking amount and pattern. Unfortunately, an important reason for reported lower alcohol consumption in women is the higher rate of overall denial, explained by the fact that drinking in women is socially less accepted (34).

      Women report about the same amount of alcohol related problems as men. This is surprising because women are said to have less alcohol-related problems than men at the same drinking pattern (33,34). The reason therefore seems to be that they are often socially less exposed, especially housewives (34). Our findings suggest that either alcohol consumption in women are underestimated or women are more likely to admit problems caused by their alcohol intake. However, as mentioned the underlying assumption is that the reported problems are related to their own alcohol intake and not to the consumption of significant others.

      Even in people who sought professional help for problems related to their alcohol consumption there is no difference in sexes even though a recent study shows that women with alcohol-related problems are only half as likely to have received any alcohol-related treatment (45). Again one could argue that alcoholism in females might be higher than indicated by the CAGE results.

      Overall this data shows a possibility that alcoholism may be higher in women as shown by the CAGE. This would be compatible with findings in other studies that report lower sensitivity for the CAGE in women than in men (20).


4.5 Utility of the CAGE as a screening tool in Public health

      The advantages of the CAGE, its shortness, ease of use and to evaluate, would make it an interesting tool for the use in preventive medicine, especially in health questionnaires, and routine screening procedures. However its poor performance in detecting low symptomatic alcoholism raises some doubts. 54% of all the people reporting an alcohol intake higher than 4 drinks for men and 3 drinks for women every day are not detected. And of the individuals who admit having problems due to alcohol consumption, more than 60% are CAGE negative. The CAGE's utility in Preventive Medicine seems therefore questionable because the population that is most appropriate for preventive intervention is not properly detected. This supports the similar findings in other studies (16,22).

      For better detection of low symptomatic alcoholism, especially hazardous drinking, questioning about drinking amounts seems to be justified (3). The AUDIT test that contains questions about drinking habits may be a better tool for alcohol screening in preventive medicine. However its reputation of being able to detect lower symptomatic alcoholism is weak (and still needs further validation (5).


5 Conclusion

      Different applications to the Swiss French population show similar CAGE results.The investigated criterion validation indicates that the CAGE test is a good parameter to measure the extend of alcoholism in a general population, but it does not allow to detect low symptomatic alcoholics accurately. Further investigations are needed to strengthen its validity in the European and French-speaking culture. A literature review showed that there is no study validating the CAGE against ICD or DSM criteria in a European or French-speaking setting.

      How many of the 11% with a CAGE score >=2 in our study are true alcoholics can not be answered. Therefore a goldstandard such as DSM criteria would have been necessary. In the U.S.A., in a recent study 15.6% of the general population met DSM-III-R lifetime criteria for alcoholism (16). The administered CAGE showed sensitivity of 56% and specificity of 95% at a cut-point of two. Another study in the American general population reports lifetime prevalence for alcoholism of 38% as diagnosed by the CAGE (39). It is very unlikely that alcoholism was twice as common in this group, both representing the average American people. Nevertheless the administered CAGE showed even better sensitivity and specificity compared to DSM-III-R than in the other study. Finally, in a recent study in the Canadian general population, where drinking habits are comparable to the American, only 4.3% had a positive CAGE score (12). This shows that CAGE results in general populations are highly variable and difficult to compare. Even though they seem to reflect the degree of alcoholism present, the influence of the characteristics of the studied population and the study itself are considerable.

      To add to the confusion, only 60% of DSM-III-R alcoholics meet the new DSM- IV criteria for the same disorder (16). This shows that the definition of alcoholism is still in progress and it seems therefore that the question, whether the CAGE detects true alcoholics or not, is quite artificial.

      Under these aspects one should not diagnose alcoholism by the CAGE result but rather take it as an indicator for a possible problem. The Clinician should evaluate patients considering their individual CAGE score rather than a threshold. Whereas a CAGE score of 3 or 4 justifies intensive further investigation, a score of 1 or 2 should be seen in the patients overall context. Every second person with a CAGE result of two reports either unhealthy alcohol consumption or problems related to alcohol intake and this is therefore an alarming sign. If suspicion for alcoholism is present, a CAGE score of one should be an indication for further investigation.

      That seems even more justified considering the fact that reported problems and drinking are certainly lower than reality. The mean alcohol intake in this study (6.4 drinks/week) represents less than 40% of the expected amount calculated from alcohol sold to the population (11). Moreover only 4 of 321 women report an alcohol intake greater than three drinks/week, suggesting that heavy drinking female hardly ever admit their drinking.

      As mentioned 32% of the primary chosen sample were non-respondents. This group may contain a higher number of alcoholics because they are less likely to fill out a questionnaire. Therefore we can not exclude a "selection-bias" and again alcoholism and related problems could be higher than reported by the questionnaire.

      All these limitations further raise fears that alcoholism is a very common illness, often and largely underestimated.


[Previous] [Next]