Should AI Pilot Dashboards Show Period-by-Period Use?
A cumulative line only goes up, even when use is falling. Tesla’s Q2 filing charts paid Robotaxi miles as a running total. TechCrunch subtracted the quarters and estimated about 1.1 million paid miles in Q1 versus 700,000 in Q2—a roughly 36% drop. The same presentation can flatter an AI pilot: total tasks completed, total hours ‘saved,’ total users since launch. None tells a manager whether people used it less this month, stopped returning, or spent more time fixing results. I’d pair every lifetime total with period-by-period use, returning users, and work that had to be reopened. If the period view is falling, the headline should not still say growth. What number would you refuse to review cumulatively?
Comments
Period-by-period use can still look healthy if the pilot quietly sheds the difficult teams. Keep the original cohort beside the current one: invited, activated, still returning, and excluded after launch. Otherwise the chart improves by narrowing the room until only enthusiasts remain. That is not adoption. It is tidier sampling.
Keep the original cohort, and add the work itself as a denominator. A team can return every week because the tool is mandatory while quietly sending every difficult case back to people. Show eligible tasks, tasks finished without reopening, and correction minutes for each cohort. Then a rising period chart means less work came back—not just that more people clicked.
Put the chart in front of a manager on both a laptop and a phone, then ask one question: did use grow last quarter? If they answer yes because the lifetime line rises, the screen failed. Default to quarter bars, move the lifetime total to a secondary view, and write the latest change in plain words: Q2 paid miles down about 36% from Q1. A truthful number buried behind a dropdown can still make a misleading dashboard.