Cheap technology is not a cheap task
Model fees are one component. Preparation, review, permissions and downstream correction may remain human work. Without changes there, tool efficiency may not become an operating result.
Cheaper inference makes more tasks feasible to try. Feasible and worthwhile remain different. We believe the enterprise must compare the value of the whole job: whether saved time can be used, how errors affect operations and whether the new method moves a workflow bottleneck.
reduction in inference cost at a specified capability level1
2025 · Nov 2022–Oct 2024 · GPT-3.5-level performanceFalling inference prices repeatedly redraw the economic boundary of tasks. They do not remove the costs of process integration, human review or error handling at the same pace. We believe AI investment should move from a fixed tool list to a revisable task portfolio, reassessing automation and human control as capability, prices and consequences change.
EXAMINING AI THROUGH THE TASK
Model fees are one component. Preparation, review, permissions and downstream correction may remain human work. Without changes there, tool efficiency may not become an operating result.
Faster drafting does not necessarily shorten approval; better prediction does not necessarily improve trading. The connection between a task and subsequent action determines whether an improvement is usable.
Related tasks can reuse knowledge, evaluations and interfaces. Selecting isolated demonstrations can miss clusters that accumulate enduring capability.
Examine preparation, processing, review and execution together. Identify where time is consumed and outcomes constrained before assigning work to AI.
Consider frequency, consequences of error, assessability and value together. Valuable but hard-to-verify tasks require a different investment rhythm.
Update priorities as models, prices and constraints change. Previously uneconomic tasks may become attractive; deployed tasks may warrant narrower scope.
Where the binding constraint is regulation, physical capacity or an immovable approval policy, AI may not be the next best investment. Establish what technology can actually change.
What action will the organisation take differently after this task becomes faster, and which outcome should improve?
Demos and departmental requests can dominate use-case lists without establishing volumes, rework, expert review or failure consequences. Faster drafting may create more downstream review. Value needs to be estimated across the complete task chain.
Select tasks such as maintenance knowledge support, contract checking or operating analysis. Record triggers, inputs, steps, review and exceptions, and verify effort using samples.
Compare rules-based automation, AI assistance and controlled execution, considering acceptable errors, data permissions and learning costs rather than assuming model involvement everywhere.
Select pilots by value, feasibility and risk. Specify baselines, full costs, evaluation periods and continuation conditions; identify missing capabilities for deferred use cases.
Task-chain and workload baseline
Use-case value, readiness and risk portfolio
Pilot charter and continue/stop criteria
Initial value estimates are investment hypotheses and require representative-task validation before becoming business targets.
Comparison of inference cost at GPT-3.5-level MMLU performance; not a reduction in total enterprise AI or project costs.
Stanford 2025 · Nov 2022–Oct 2024 · GPT-3.5-level performanceOSWorld is a structured computer-use benchmark; the result is not an energy-production success rate or a deployment threshold.
Stanford AI Index 2026 · OSWorld benchmarkSelf-reported status in a cross-industry, cross-geography survey, not a measured maturity score for energy enterprises.
IBM 2025 · 1,700 senior data and analytics leaders globally