AEON Communications
CLOSE ×
PS-TRU-108 · r2 AUTOMATION TRUST INFERRED OBSERVED

DISUSE AFTER FALSE ALARM

Confidence took a year to build and one morning to spend.

01   DEFINITION

Condition in which reliance on an automated function is withdrawn by a single visible failure far faster than it was granted and is not restored by the correct working that follows, so its standing is set by its worst moment rather than by its record.

02   CONDITIONS

UNCERTAINTY UNRECORDED How often it has been right is not present where the choice to rely on it is made.
TIME PRESSURE LOW Nothing is urgent; the withdrawal is a habit that forms and stays.
ERROR ASYMMETRY DEFERRED The disuse costs nothing until the case the function would have caught.
OPERATOR STATE CONCURRENT The person is doing their own work and choosing whether to consult it at all.

03   WHERE IT APPEARS

MEDICALA decision aid that was wrong once memorably is worked around afterwards regardless of its record.
MOBILITYAn assistance feature that misjudged once is switched off and stays off.
INDUSTRIALA predictive function that raised a false one is bypassed by the shift that saw it.
FINANCEA screening tool that flagged wrongly is overridden by habit thereafter.
AI EXP.An assistant that was confidently wrong is used differently by that person from then on.
LOGISTICSA routing suggestion that failed once is disregarded long after it was corrected.

04   WHERE THIS IS SURFACING

This surfaces wherever people can choose whether to use something. The choosing follows the memorable event rather than the record, and a repair is invisible in a way the failure was not.

What stays unresolved is how a function's record is made present at the moment of choosing — showing how often it is right reads as an excuse just after it was wrong, and showing nothing leaves the one failure standing for the whole.