Process Knowledge-Infused AI: Toward User-Level Explainability, Interpretability, and Safety

Thumbnail Image

Files

1162.pdf (1.14 MB)

Links to Files

https://ieeexplore.ieee.org/document/9889132

Permanent Link

https://doi.org/10.1109/MIC.2022.3182349
 http://hdl.handle.net/11603/29561

Collections

UMBC Computer Science and Electrical Engineering Department
UMBC Faculty Collection

Author/Creator

Author/Creator ORCID

https://orcid.org/0000-0002-5411-2230

Date

2022-09-13

Type of Work

journal articles
preprints
Text

Department

Program

Citation of Original Publication

A. Sheth, M. Gaur, K. Roy, R. Venkataraman and V. Khandelwal, "Process Knowledge-Infused AI: Toward User-Level Explainability, Interpretability, and Safety," in IEEE Internet Computing, vol. 26, no. 5, pp. 76-84, 1 Sept.-Oct. 2022, doi: 10.1109/MIC.2022.3182349.

Rights

© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Subjects

Abstract

AI has seen wide adoption for automating tasks in several domains. However, AI's use in high-value, sensitive, or safety-critical applications such as self-management for personalized health or personalized nutrition has been challenging. These require that the AI system follows guidelines or well-defined processes set by experts, community, or standards. We characterize these as process knowledge (PK). For example, to diagnose the severity of depression, the AI system should incorporate PK that is part of the clinical decision-making process, such as the Patient Health Questionnaire (PHQ-9). Likewise, a nutritionist's knowledge and dietary guidelines are needed to create food plans for diabetic patients. Furthermore, the BlackBox nature of purely data-reliant statistical AI systems falls short in providing user-understandable explanations, such as what a clinician would need to ensure and document compliance with medical guidelines before relying on a recommendation. Using the examples of mental health and cooking recipes for diabetic patients, we show why, what, and how to incorporate PK along with domain knowledge in machine learning. We discuss methods for infusing PK and present performance evaluation metrics. Support for safety and user-level explainability of the PK-infused learning improves confidence and trust in the AI system.