Canadian Medical Association Journal Home

Table of Contents
Free eCMAJ TOC

Back issues
Supplements
Selected series

eLetters
About this journal
Info for authors

PubMed

Validity of utilization review tools
CMAJ 2000;163(10):1238[Letters in PDF]


See response from: N. Kalant, et al
Norman Kalant and colleagues conclude that utilization review tools are not valid to assess appropriateness of setting [Research].1 We argue that this conclusion is not supported for several reasons. First, and most importantly, acute care review tools assume that subacute care and acute care are separate, discrete levels. With only minor exceptions, in Canada subacute care is normally and appropriately delivered within the acute care setting. One report referred to by the authors specifically makes this point in terms of the structure of the Ontario health system.2 This oversight alone is likely to account for a significant proportion of the mismatch between the review tools for acute care (without including subacute care) and the opinion of a panel of experts.

The authors base their conclusions on a simple kappa statistic. However, they have not adjusted for the nonindependent nature of the days of stay of the 75 patients reviewed. Our work has demonstrated a 30% correlation between the appropriateness of 1 day of stay and appropriateness of the subsequent day (unpublished data). Nonindependence of observations may amplify disagreement as measured by the kappa statistic.

Finally, the authors claim that no previous studies have validated these tools by comparison with implicit review by a panel of physicians. In fact 2 published studies used physician panels to demonstrate validity.3,4

Peter Dodek
Physician Leader
Intensive Care Unit
St. Paul's Hospital
Barbara Trerise
Leader
Utilization Management & Evaluation Services
St. Paul's Hospital
C. Brian Warriner
Vice-President, Medicine
Providence Health Care
Vancouver, BC


References
  1. Kalant N, Berlinguet M, Diodati JG, Dragatakis L, Marcotte F. How valid are utilization review tools in assessing appropriate use of acute care beds? CMAJ 2000;162(13):1809-13.
  2. Utilization Steering Committee, Joint Policy and Planning Committee. Non-acute hospitalization project — final report. Toronto: Ontario Ministry of Health; 1997. Reference document RD6-3.
  3. Strumwasser I, Paranjpe NV, Ronis DL, Share D, Sell LJ. Reliability and validity of utilization review criteria. Med Care 1990;28:95-109.
  4. Inglis AL, Coast J, Gray SF, Peters TJ, Frankel S. Appropriateness of hospital utilization. Med Care 1995;9:952-7.

 

 

Copyright 2000 Canadian Medical Association or its licensors