User interaction models for knowledge-based clinical decision support systems

Informaticians have been developing knowledge-based clinical decision support systems for over 30 years with many notable successes [Reisman, 1996]. Once the arduous tasks of collecting the medical knowledge required and developing an accurate computer understandable representation scheme are complete, the informatician must determine the appropriate user interaction model. Several different interaction models have been developed over the years.  The following sections briefly describe each of the five main user interaction models and provide examples of successful systems that have been developed using each of them.

Interpretation

Interpretation systems present information to clinicians passively.  These systems can create relatively simple, yet nicely formatted clinical laboratory reports and graphs, or sophisticated interpretations of such things as electrocardiograms (EKGs) [Klingeman, 1967]. Interpretation systems work best when interfaced directly to the data generated by laboratory instruments that produce numeric data. In addition, there should be a well understood physiologic model in existence which unambiguously interprets the data. These systems have found their greatest clinical utility in areas such as arterial blood gas interpretation [Gardner, 1975], spirometry [Ostler, 1984], and automated PAP smear analysis [Wilbur, 1998], to name just a few.

Consultation

Consultation systems carry on an interactive dialogue with clinicians in an attempt to help them arrive at a correct diagnoses or therapeutic decisions. These systems can be used by physicians to determine the test or procedure that will be most likely to help them confirm or rule out a specific diagnosis. One of the earliest consultation systems, MYCIN, was developed by Shortliffe in the early 1970s [Shortliffe, 1975]. Clinicians interacted with MYCIN through a long series of questions designed to elicit the patient's clinical state and then help the clinician select the appropriate antibiotic.   More recently informaticians have utilized the consultation model for the implementation of clinical practice guidelines. Very few of these systems have met with extensive or even continued use in real-life clinical situations.

Monitoring

Monitoring systems "watch" the clinical database for the storage of particular data items or the passage of a predetermined amount of time. Once such an item is stored in the database, a program is called which "decides" whether the particular data value (or combination of data values) warrants notifying a clinician. Monitoring systems work best on problem areas in which the medical knowledge can be represented in one or more if-then-else type constructs. These systems have met with considerable success in areas as simple as the detection of abnormal laboratory results [Bradshaw, 1989] and adverse drug events [Classen, 1992] or as complicated as ventilator monitoring in ICU patients [Sittig, 1989]. Most clinicians find the "safety net" effect of such systems reassuring and  more often than not are happy to comply with the computer's suggestion.

Critiquing

Critiquing systems require that all the patient's clinical data, as well as the clinician's anticipated action be available in the computer. The critiquing system then generates a review of this decision based on its "understanding" of the patient's underlying patho-physiological condition and the risks associated with the planned therapeutic alternative chosen. Such systems have met with their greatest success when incorporated into physician order entry systems. In such cases they can inform physicians of potential drug-drug, drug-lab, or drug-allergy interactions, as well as suggest less expensive alternatives [Teich, 1997]. Given the diagnosis the physician is attempting to confirm or rule-out, a critiquing system might mention a more appropriate radiological exam [Harpole, 1997].

Teaching

Any of the above mentioned interaction models can be enhanced by offering a "teaching mode" to the user. Such a mode would allow the system to "explain" its reasoning to the clinician. In a landmark article, Teach and Shortliffe stated that the ability of a system to "explain" its reasoning was one of the key factors in clinician acceptance of decision support systems [Teach, 1981]. Since that time many systems have been successfully deployed without this capability, although system developers are still encouraged to provide it when possible. Many developers skirt this issue by citing a scientific journal article or displaying the actual rules (along with the patient's data values) the system used to reach the conclusion.

Choosing the appropriate user interaction model is one of the most difficult and important decisions the informatician must make. The key item that must be considered is the nature of the medical decision being made. Many medical decisions are based on numerous simple and widely agreed upon, rules that all clinicians know but have difficulty bringing to bear with 100% accuracy.  Examples of such decisions might include: Does this infant need an MMR vaccination today? Do these particular arterial blood gas values represent a metabolic or respiratory acidosis? Has the patient's sodium value fallen more than 25% over the last 12 hours? These determinations are best implemented as interpretation or monitoring systems. Other decisions are fraught with complicated risk assessments and competing alternatives; they have no clear-cut "best" solutions. Such decisions are best implemented as critiquing systems. The management of a patient's hypertension [Miller, 1984] or the selection of the anesthetic technique to be employed during surgery [Miller, 1983] are two excellent examples of medical decisions which beg for a critiquing system.  The consultation mode, on the other hand, has not met with much success in the clinical realm for the simple reason that clinicians are reluctant to spend extended periods of time entering data into a computer in order to receive advice.

Building knowledge-based clinical decision support systems that are intended for routine use in the clinical setting is a difficult, but rewarding challenge. Finding the appropriate user interaction model is one of the most important, but often overlooked, tasks.

References:

  1. Bleich HL. Computer evaluation of acid-base disorders. J Clin Invest 1969 Sep;48(9):1689-1696
  2. Bradshaw KE, Gardner RM, Pryor TA. Development of a computerized laboratory alerting system.Comput Biomed Res 1989 Dec;22(6):575-87
  3. Classen DC, Pestotnik SL, Evans RS, Burke JP. Computerized surveillance of adverse drug events in hospital patients. JAMA 1991 Nov 27;266(20):2847-51  Published erratum appears in JAMA 1992 Apr 8;267(14):1922
  4. Gardner RM, Cannon GH, Morris AH, Olsen KR, Price WG: Computerized blood gas interpretation and reporting system. IEEE Computer 1975; 8:39-45.
  5. Harpole LH, Khorasani R, Fiskio J, Kuperman GJ, Bates DW. Automated evidence-based critiquing of orders for abdominal radiographs: impact on utilization and appropriateness. J Am Med Inform Assoc 1997 Nov-Dec;4(6):511-21
  6. Klingeman J, Pipberger HV. Computer classifications of electrocardiograms. Comput Biomed Res 1967 Mar;1(1):1-17
  7. Miller PL. Critiquing anesthetic management: the "ATTENDING" computer system. Anesthesiology 1983 Apr;58(4):362-9
  8. Miller PL, Black HR. Medical plan-analysis by computer: critiquing the pharmacologic management of
    essential hypertension. Comput Biomed Res 1984 Feb;17(1):38-54
  9. Ostler DV, Gardner RM, Crapo ROA computer system for analysis and transmission of spirometry waveforms using volume sampling.Comput Biomed Res 1984 Jun;17(3):229-40
  10. Reisman Y. Computer-based clinical decision aids. A review of methods and assessment of
    systems. Med Inf (Lond) 1996 Jul-Sep;21(3):179-97
  11. Shortliffe EH, Davis R, Axline SG, Buchanan BG, Green CC, Cohen SN. Computer-based consultations in clinical therapeutics: explanation and rule acquisition capabilities of the MYCIN system.Comput Biomed Res 1975 Aug;8(4):303-20
  12. Sittig DF, Pace NL, Gardner RM, Beck E, Morris AH. Implementation of a computerized patient advice system using the HELP clinical information system. Comput Biomed Res 1989 Oct;22(5):474-87
  13. Teach RL, Shortliffe EH. An analysis of physician attitudes regarding computer-based clinical consultation systems. Comput Biomed Res 1981 Dec;14(6):542-58
  14. Teich JM, Kuperman GJ, Bates DW. Clinical decision support: making the transition from the hospital to the community network. Healthcare Information Management 1997;11(4):27-37.
  15. Wilbur DC, Prey MU, Miller WM, Pawlick GF, Colgan TJ. The AutoPap system for primary screening in cervical cytology. Comparing the results of a prospective, intended-use study with routine manual practice. Acta Cytol 1998 Jan-Feb;42(1):214-20

Ó 1998 Dean F. Sittig