Preferences in AI algorithms: The need for relevant risk attitudes in automated decisions under uncertainties

This article briefly describes the sometimes-serious problem of that discrepancy between the preferences of the risk managers who use an AI output, and the risk attitude embedded in the AI system. The recommendation is to make these AI factors as accessible and transparent as possible and to allow for preference adjustments in the model if needed. The formulation of two simplified examples is described, that of a medical doctor and his/her patient when using an AI system to decide of a treatment option, and that of a skipper in a sailing race such as the America's Cup, receiving AI-processed sensor signals about the sailing conditions on different possible courses.
Source: Risk Analysis - Category: International Medicine & Public Health Authors: Tags: PERSPECTIVE Source Type: research