The speedup is mostly in the parts that leave a trail

OpenAI sorts research work into decide, design, build, run, analyze and communicate. It reports growth across all six, but says high-level planning remains a minimal share of agent output tokens. Its researchers describe coding agents as particularly useful for troubleshooting internal research infrastructure; one support channel reportedly became quiet enough that a team stopped holding office hours.

That sounds mundane because it is. Waiting on a broken experiment, a missing dependency or a configuration question can consume a whole afternoon. Removing that drag changes the day even if it never produces a dramatic demo.

But code written, runs launched and tokens used are easier to count than a good research choice. A lab can measure activity at the keyboard without yet measuring whether it pursued the right hypothesis, noticed a misleading result, or stopped a bad line of work early enough.

A task list is better than one giant claim

Epoch AI has been making a related argument from outside the lab: do not infer automated research from a single benchmark or a single task-duration curve. Its proposed O*NET-style taxonomy breaks frontier AI research into more than 60 tasks because writing experiment code is not the same as coordinating projects, deciding what is worth scaling, or making sense of ambiguous evidence.

The taxonomy is only a first attempt, and it may miss ways future systems do research. Still, it offers a useful habit for smaller teams too. When someone says an AI assistant made work faster, ask which part of the job moved: gathering material, making a draft, checking it, making the decision, or cleaning up afterward. Those are different wins with different failure modes.

What to ask before you celebrate a faster lab

Use a small set of questions that force the claim back into the real work:

• What did the AI actually take off a person’s plate? Name the repeated task, not the model. • What changed after the output arrived? A useful result might shorten troubleshooting, reduce abandoned experiments, or help a team rule out a bad idea sooner. • What still required expert judgment? If the answer is ‘the important parts,’ that is not a failure. It is the boundary the team should keep visible. • What got worse? More runs can mean more review, more compute, or a noisier pile of plausible-looking findings.

The point is not to hold AI to an impossible standard before using it. It is to avoid treating busy machinery as a result. The value of a research assistant is not that it stays awake. It is that the next human decision is better prepared—and that the team can tell when it is not.