A survey on artificial intelligence assurance

Journal of Big Data

Chih-Hao Huang¹  Laura Freeman²  Feras A. Batarseh³ 

[1] College of Science, George Mason University, 22030, Fairfax, USA;Department of Statistics, Virginia Polytechnic Institute and State University (Virginia Tech), 22203, Arlington, VA, USA;The Bradley Department of Electrical and Computer Engineering, Virginia Polytechnic Institute and State University (Virginia Tech), 22203, Arlington, VA, USA;

关键词: AI assurance;    Data Engineering;    Explainable AI (XAI);    Validation and verification;   

DOI  :  10.1186/s40537-021-00445-7

来源: Springer

【 摘 要 】

Artificial Intelligence (AI) algorithms are increasingly providing decision making and operational support across multiple domains. AI includes a wide (and growing) library of algorithms that could be applied for different problems. One important notion for the adoption of AI algorithms into operational decision processes is the concept of assurance. The literature on assurance, unfortunately, conceals its outcomes within a tangled landscape of conflicting approaches, driven by contradicting motivations, assumptions, and intuitions. Accordingly, albeit a rising and novel area, this manuscript provides a systematic review of research works that are relevant to AI assurance, between years 1985 and 2021, and aims to provide a structured alternative to the landscape. A new AI assurance definition is adopted and presented, and assurance methods are contrasted and tabulated. Additionally, a ten-metric scoring system is developed and introduced to evaluate and compare existing methods. Lastly, in this manuscript, we provide foundational insights, discussions, future directions, a roadmap, and applicable recommendations for the development and deployment of AI assurance.

【 授权许可】

CC BY