The Permanente Journal

Search the Journal 
  Site Index
TPJ Home pageBrowse The JournalSubscribe to TPJInstructions for AuthorsContinuing Medical EducationAnnouncementsLinksJournal StaffEmail Us



••Spring
1998 / Vol 2, No 2

Comments from the Journal EditorsAbstracts from articles published in other journals
Clinical articles on the practice of Permanente medicinePermenente Medical History
Poetry, Art, Musings from Permanente clinicians
Nonclinical articles on external issuesOriginal ResearchArticles from a Systems perspective
Book Reviews lighter side of medicineLetters to the editor

 

 

 

 

 

 

 

 

 

 

 

Written Instruction and Compliance with Return Visits for Reading Mantoux (PPD) Skin Tests in a Large General Pediatric Practice | to pdf >>
by Harold J. Farber, MD



Background: Effectiveness of tuberculosis screening may be impaired by noncompliance with Mantoux test reading. We wished to determine whether a written instruction sheet improves compliance with return visits to have Mantoux skin tests read.
Methods: In Step 1 of a 2-step study, we distributed a written instruction sheet on randomly assigned days; in Step 2, we compared compliance with return visits before and after use of a written instruction sheet as routine practice.
Results: During Step 1, a 5% increase in compliance (n = 619, p = .10) was associated with use of the instruction sheet. In Step 2, a 7% increase was seen (n = 991, p = .015). When data from Steps 1 and 2 were pooled, the 5% improvement was statistically significant (p = .02).
Conclusion: Use of the written instruction sheet is associated with a small improvement, which may not be clinically relevant, in return visits for Mantoux test reading. Further research is needed to identify cost-effective methods to improve compliance with Mantoux test reading.

Introduction
The Mantoux (also known as PPD) skin test is the preferred test for detecting tuberculosis.1-3 Proper reading of the test requires skilled examination of the skin test site within a limited number of days after skin test placement.4 Readings taken by patients or by their parents are unreliable.5,6 Therefore, the value of the Mantoux text is limited by patients' failure to return for interpretation of the skin test result.

Compliance with return visits for Mantoux test reading has historically been problematic at our medical center, part of a large prepaid health maintenance organization serving an ethnically diverse, predominantly working-class population. Previous reports in the literature suggest that compliance with return visits for skin test reading is problematic in many settings, and compliance rates range from 34% in a poor urban population in Seattle, Washington7 to 85% in a university-sponsored screening program.8

Although written instruction may improve adherence to medical recommendations,9 Roberts et al8 in a university-sponsored screening drive, found no difference between patients given written and verbal instruction and verbal instruction only.

This study was designed to test whether providing a written instruction sheet improves compliance with instruction to return for Mantoux test reading in the setting of a large general pediatric practice.

Methods
As the first step in a 2-step procedure, all pediatric outpatients at our medical center who had a Mantoux skin test ordered by a pediatrician during the study periods were either given a preprinted instruction sheet (Appendix) and verbal instruction to return in two to three days to have the skin test read (intervention group) or were given the verbal instruction alone (control group). The intervention group (267 patients) received written instruction on randomly assigned weekdays; the control group (352 patients) received verbal instruction alone on other days.

Although a small portion of the study population was Hispanic, the instruction sheet was provided in English only. Parents' literacy level was not assessed. To reflect clinical practice, wording of the verbal instruction was not standardized. The verbal instruction was given by nursing staff administering the Mantoux test, and the written instruction sheet was given by clerks registering patients for the test. Nurses and clerks were not blinded as to intervention group assignment; physicians ordering the Mantoux tests were blinded as to group assignment.

Patients who returned within two to five days to have the Mantoux test read were defined as compliant. Patients who did not return within this period were defined as noncompliant. No attempt was made to contact families of noncompliant patients.

Compliance rates for control and intervention groups during Step 1 were higher than the clinic's historical baseline rate; therefore, after Step 1 concluded, we undertook Step 2 by collecting compliance data for another 499 consecutive patients given verbal instruction alone. This group had lower compliance than either the intervention or control groups during Step 1, so we gave the preprinted instruction sheet and verbal instructions to another 492 consecutive patients and determined compliance rates for both groups.

Data were analyzed via 1-tailed z-score to test for improved compliance in the intervention compared with the control groups. For data pooled from Steps 1 and 2, we used the chi-squared test to determine whether day of the week influenced compliance with Mantoux test reading. Statistical significance was accepted if p <.05. Patients aged >18 years who received a Mantoux test during the study period were deleted from the data analysis.

Patients receiving the preprinted instruction sheet were informed that it was being given as part of a research study. The study protocol was approved by the Kaiser Permanente Medical Care Program, Northern California Institutional Review Board.

Preprinted instruction sheet given to pediatric patients at Kaiser Permanente Medical Center, Hayward, California who had pediatrician-ordered Mantoux skin test during the study periods.

Results
Mean (SD) age of the intervention group in Step 1 was 5.1 (4.4) years; mean (SD) age of the control group was 5.7 (4.7) years. Median age for both groups combined was 4 years.

Mean (SD) age of the control group in Step 2 was 6.9 (4.9) years; median age was 5.0 years. Mean (SD) age of the intervention group was 5.8 (5.4) years; median age was 4 years.

Of the 267 patients given written and verbal instruction in Step 1, 187 (70%) returned for skin test reading as did 230 (65%) of the 352 patients given verbal instruction only (p = .10).

During Step 2, 261 (52%) of the 499 patients given only verbal instruction returned for skin test reading as did 291 (59%) of the 492 patients given the preprinted instruction sheet and verbal instruction (p = .02).

Data pooled from Steps 1 and 2 showed no significant difference in compliance (p = .37) for the different days of the week.

Of 969 skin tests read in Steps 1 and 2 combined, six (.6%) were interpreted as positive. The size of the reaction was not recorded for one patient, was 13 mm for another patient, and was >15 mm (17-40 mm) for the remaining four patients.

When the written instruction sheet was given on random days (Step 1), improvement in compliance with Mantoux test reading was small (5%) and not statistically significant (p = .10). In contrast, during Step 2, when data were collected for the 499 patients in the control group and for the 492 patients in the intervention group, the improvement in compliance was statistically significant (p = .02) although small (7%).

Discussion
Step 2 included 991 subjects and therefore had greater power to detect a small improvement than Step 1, which included 619 subjects. If, to achieve greater power, we were to combine data from Steps 1 and 2, 478 (63%) of the 759 patients in the intervention group would have been found compliant vs 491 (58%) of the 851 patients in the control group (p = .02). This finding suggests that the preprinted instruction sheet increased compliance by 5% to 7%. This small improvement may not be clinically significant.

An unexpected finding was that compliance was higher for the control group during Step 1 (intervention given on random days) than for the control group after Step 1 concluded (but before the intervention portion of Step 2). The magnitude of this difference was greater than that attributed to the intervention. Possible explanations for this finding include a time effect (ie, different compliance rates at different times of the year) and the Hawthorne effect, which refers to the independent tendency of group productivity to increase because of social aspects of the research environment (attention, excitement, prestige).10 The enthusiasm generated by the study may have improved the quality and energy of verbal instruction given to patients by our staff.

Even with use of the preprinted instruction sheet, noncompliance with return visits for Mantoux skin test reading in a general pediatric practice remains high. This population had a low rate of tuberculin reactivity; however, diagnoses might be missed in populations having higher prevalence of tuberculosis infection. Improved, cost-effective, methods of increasing compliance rates are needed.

Cheng et al11 in an urban children's hospital, compared different methods to improve compliance with tuberculin skin test reading and found that the negative reinforcement of withholding school forms until the test was read increased adherence by 26%. Tanke et al,12 in a study at a public health clinic, found that an automated telephone reminder system (TeleMinder®) led to a small (5%) improvement in compliance with tuberculin test reading. In both of these studies, all subjects were given both written and verbal instructions.

In Cheng's study,11 a 13% improvement in compliance was observed between baseline and study periods without any other intervention. The Hawthorne effect observed in both our study and that of Cheng suggest that the energy, interest, enthusiasm, and commitment of the person giving the instruction can influence compliance rates.

These results suggest that improving compliance with tuberculin skin test reading will be challenging. The combination of written and verbal instructions may provide a small improvement. The work of Cheng11 suggests a large improvement in the rate of return visits for skin test reading can be achieved if there is an adverse consequence (withholding school forms) to noncompliance; however, this strategy does not apply in situations other than school-mandated screenings.

Presented in part at the 1995 International Conference of the American Thoracic Society, Seattle, Washington, May 20-24, 1995, and published in abstract form.

Acknowledgments: I am indebted to Lana Benson, who collected the data, and to Martha Ruiz, who distributed the written instruction sheets. Tracy Lieu, MD, MPH, and Steven Black, MD, reviewed the manuscript.

The Medical Editing Department, Kaiser Foundation Research Institute, provided editorial assistance.


References

  1. Starke JR, Jacobs RF, Jereb J. Resurgence of tuberculosis in children. J Pediatr 1992;120:839-55.
  2. American Thoracic Society. Diagnostic standards and classification of tuberculosis. Am Rev Respir Dis 1990; 142:725-35. [published erratum appears in Am Rev Respir Dis 1990 Dec;142(6 pt 1):1470]
  3. American Academy of Pediatrics. Committee on Infectious Diseases. Screening for tuberculosis in infants and children. Pediatrics 1994;93:131-4.
  4. Division of Tuberculosis Elimination, Centers for Disease Control, and American Thoracic Society. Core curriculum on tuberculosis. 2nd ed. Atlanta GA: Centers for Disease Control, U.S. Department of Health and Human Services, 1991.
  5. Cheng TL, Ottolini M, Getson P, Wolf MD, Scheidt PC. Poor validity of parent reading of skin test induration in a high risk population. Pediatr Infect Dis J 1996;15:90 2.
  6. Howard TP, Solomon DA. Reading the tuberculin skin test, who when and how. Arch Intern Med 1988;148:2457-9.
  7. Kemper K. Follow-up of tuberculin skin tests [letter]. J Health Care Poor Underserved 1994;5(1):1-4.
  8. Roberts MC, Wurtele SK, Leeper JD. Experiments to increase return in a medical screening drive: two futile attempts to apply theory to practice. Soc Sci Med 1983;17:741-6.
  9. Meichenbaum D, Turk DC. Facilitating treatment adherence: a practitioners guidebook. New York: Plenum Press; 1987.
  10. French JRP. Experiments in field settings. In: Festinger L, Katz D, editors. Research methods in the behavioral sciences. New York: Dryden Press; 1953. p. 98 135.
  11. Cheng TL, Ottolini MC, Baumhaft K, Brasseux C, Wolf MD, Scheidt PC. Strategies to increase adherence with

 

 

 

 

 

 

 

To Spring 1998 Table of Contents >>

 



The Permanente Journal

500 NE Multnomah St., Suite 100,
Portland, OR 97232
503-813-4387 / fax: 503-813-2348


Copyright The Permanente Journal, Kaiser Permanente. All rights reserved