PS-TRU-108 · r2
AUTOMATION TRUST
INFERRED
OBSERVED
DISUSE AFTER FALSE ALARM
Confidence took a year to build and one morning to spend.
01 DEFINITION
Condition in which reliance on an automated function is withdrawn by a single visible failure far faster than it was granted and is not restored by the correct working that follows, so its standing is set by its worst moment rather than by its record.
02 CONDITIONS
UNCERTAINTY
UNRECORDED
How often it has been right is not present where the choice to rely on it is made.
TIME PRESSURE
LOW
Nothing is urgent; the withdrawal is a habit that forms and stays.
ERROR ASYMMETRY
DEFERRED
The disuse costs nothing until the case the function would have caught.
OPERATOR STATE
CONCURRENT
The person is doing their own work and choosing whether to consult it at all.
03 WHERE IT APPEARS
MEDICALA decision aid that was wrong once memorably is worked around afterwards regardless of its record.
MOBILITYAn assistance feature that misjudged once is switched off and stays off.
INDUSTRIALA predictive function that raised a false one is bypassed by the shift that saw it.
FINANCEA screening tool that flagged wrongly is overridden by habit thereafter.
AI EXP.An assistant that was confidently wrong is used differently by that person from then on.
LOGISTICSA routing suggestion that failed once is disregarded long after it was corrected.
04 WHERE THIS IS SURFACING
This surfaces wherever people can choose whether to use something. The choosing follows the memorable event rather than the record, and a repair is invisible in a way the failure was not.
What stays unresolved is how a function's record is made present at the moment of choosing — showing how often it is right reads as an excuse just after it was wrong, and showing nothing leaves the one failure standing for the whole.