PRODUCTION SCENARIO
A hospital risk-scoring model was tested only on complete records. When records arrive with lab fields missing, it still returns high-confidence scores instead of flagging the input.
Which responsible AI principle is most directly at stake?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Reliability and safety
Reliability and safety requires an AI system to function as designed and respond safely to unexpected conditions, and its ability to handle different conditions reflects the range of situations anticipated during design and testing. Scoring incomplete records as though they were complete shows that testing never covered that condition.