Confidence bands: act, confirm, hand to a person
Pick two thresholds on the machine's confidence, tuned on your own data:
| Band | Example | Do |
|---|---|---|
| High | 0.90 and up | Act. |
| Middle | 0.8 to 0.90 | Act, and ask the person to confirm afterwards. |
| Low | under 0.8 | Hand to a person before acting. |
Also hand to a person regardless of confidence when the action cannot be undone, or when the question is about a person.
Pin a version (ap-1.0.0) after tuning thresholds, so the human side does not change under you.