What we do
English
The 5-Step Pilot Framework
01
Hypothesis
One sentence: metric + deadline + behavior + why.
02
Cohort design
Pick the segment where it should work best. Add a contrast/control group if possible.
03
Success metrics
Adoption, task completion, satisfaction, time saved, error rate, escalation rate.
04
Feedback loops
Weekly reviews + early-warning triggers (day 7, week 1).
05
Decision tree
Pre-commit to outcomes: GO / REFINED / KILL at day 90.
Non-negotiables
  • Decide kill criteria BEFORE launch (avoid sunk-cost pilots).
  • Measure replacement vs. additive usage (does it reduce dashboard logins?).
  • Treat operations as high-risk: log every action, enable rollback, audit errors.
Success Metrics & Kill Criteria
Primary success targets
Adoption
80% of pilot users send at least 1 command/day by day 30
Task completion
90% of commands executed without human escalation
Satisfaction
90% rate the experience 4/5 or higher
Kill / pause triggers
Adoption
<50% by day 30
Errors
>5% incorrect actions
Satisfaction
<80%
Escalations
>30% needs humans
90-Day Pilot Timeline
1
Day 0
Launch pilot to defined cohort
2
Day 7
Early-warning check (adoption + error spikes)
3
Day 30
Checkpoint (targets + kill criteria)
4
Day 90
Decision: GO / REFINED / KILL
Use This Blueprint
Want this framework adapted to your portfolio and team? I help operators design pilots that produce a decision in 90 days.