Boeing’s differences training for the 737 MAX ran as an iPad course, roughly an hour long, for pilots already type-rated on the 737 NG. The FAA approved it as Level B. It made no mention of MCAS, the new flight-control law that pitched the nose down when it read a single angle-of-attack sensor. Two crews, two crashes, 346 people. The training was completed. The capability to recover from an MCAS runaway was not there.
The Department of Transportation Inspector General laid out the sequence in plain language: pilot response to automated MCAS activation was not included in the required training, and references to MCAS were removed from the flight crew operations manual and the differences tables in March 2016. Every pilot who flew the aircraft had a completion record. The airline had an attendance sheet. What the airline did not have was a crew that could execute the recovery on the morning it was needed.
This is the pattern underneath most training programs bolted onto transformations, implementations, and operational changes. Completion rates are cheap to produce and defensible in a board pack. Capability — can the person run the redesigned process on Monday morning, without a coach at their shoulder — is harder to measure and slower to build, and it is the only thing the business actually needed.
What Capability Looks Like on Monday Morning
Capability is a person doing the work at the target quality, at the target pace, without a coach standing behind them. A billing clerk closes a claim in the new system in the time the redesigned process assumed. A refinery operator responds to the alarm the way the new procedure requires. A nurse enters a medication order in the new EPR, catches the interaction warning, and resolves it in the workflow the trust designed. None of those are training outcomes. They are operating outcomes, and they show up in the numbers the business already tracks — cycle time, first-pass yield, error rates, incident counts.
Attendance is a different thing. Attendance is a name on a roster. Completion is a click at the end of a module. A completion certificate confirms that a person sat through material. It does not confirm that the person can do the work. Programs that report on completion rates as evidence of readiness are answering a question no operator asked. The operator’s question is whether the redesigned process will run at the outcome that mattered on the first Monday after go-live and every Monday after.
The gap between the two shows up quickly. Completion rates in the high nineties sit next to first-week error rates that force the old process back into use as a workaround. Trainers report on hours delivered while supervisors quietly staff a second shift to catch the mistakes coming out of the first. The tool did not fail. The training did not fail on its own terms. The capability was never built.
Why Programs Default to Attendance
Completion metrics are cheap to produce and hard to argue with. A learning management system will report a number to two decimal places, on demand, in every region and shift. It can be dashboarded, benchmarked against last quarter, and put in front of a steering committee that has ninety minutes and eleven agenda items. It is a defensible number produced by a defensible system. It happens to be the wrong number.
Capability, by contrast, has to be assessed by a human being watching another human being do the work. It cannot be batch-processed. It runs at the pace a supervisor can spend twenty minutes with an operator on the floor, not the pace a server can issue certificates. It resists the reporting cadence that transformation programs are governed by, which is one reason so many programs quietly settle for the metric that fits the cadence and abandon the metric that would tell them the truth.
There is also a procurement gravity to it. When training is scoped as a deliverable from a vendor — a course, a module library, a portal — the contract is easiest to write against attendance and completion. Those are the things a vendor can guarantee. Capability is a property of the workforce, not of the course, and it is not something a course provider can be held to on its own. The result is a program specified in a way that a vendor can deliver, rather than a program specified in a way the business can use.
How To Measure the Thing That Matters
There are four instruments that actually measure capability, and none of them look like a quiz at the end of a module. Task-based verification asks the person to complete a real unit of work end to end, at the target quality, in a controlled setting — not answer questions about how they would do it. Live simulation puts them into a scenario that includes the exceptions the new process is meant to handle, including the ugly ones the vendor script does not cover. Apprentice-model handoff pairs the person with a qualified operator for a defined number of reps and only signs them off when the qualified operator says they are ready. Over-the-shoulder assessment sends a competent observer to the workstation during real operation and grades the work as it happens.
These are older instruments than most training organizations remember. Apprenticeships in the trades have used them for a century. Aviation uses them under the label of Line Oriented Flight Training and check rides — which is why the fix, after the MAX grounding, ended at Level D simulator training on the actual failure modes, not another iPad course. Nuclear operations uses them under the label of qualification cards. Manufacturing uses them under the label of job instruction training. In every setting where the cost of an unready operator is high enough to be seen, the industry evolved past attendance and toward verification.
The instruments share a common shape. A named qualified person signs a named unqualified person off against a specific task. The signature carries authority. The person doing the sign-off can be found afterward and asked what they saw. That is what separates capability assessment from completion tracking: someone who is accountable for the operator’s readiness, in writing, on the record.
What Real Capability Programs Look Like
A capability program is longer than a training program and staffed differently. It runs weeks or months past go-live, not up to the day of it. It uses embedded coaches drawn from the operating population — supervisors, senior operators, super-users pulled off the line for a defined tour — because a coach who has done the work is worth more than a coach who has documented it. It builds task lists that map to the actual jobs the redesigned process creates and signs each person off against those tasks, not against a curriculum.
The floor presence is the part that most programs cut first and regret later. In the first eight to twelve weeks after go-live, the ratio of coaches to operators on the shift is what determines whether the redesigned process holds. NHS England’s 2024 EPR usability survey found that 44% of clinical staff reported receiving no ongoing training after initial rollout, and only 34% said their EPR made them more efficient. The Health Services Safety Investigations Body’s 2025 thematic review put a sharper point on it: training often did not reflect how the system would be used in the real world, and it was not delivered by people with experience of using the system in clinical practice. The trusts that recovered did so by moving experienced clinicians into the coaching role during rollout, not by rerunning the module.
A capability program also treats sign-off as a gate, not a formality. A person is not qualified because they finished the course; they are qualified because a named assessor watched them do the task and put their name to it. Programs that write this into the go-live plan produce a different Monday morning than programs that write in a completion target. The completion target arrives on time and looks green. The capability gate arrives when it arrives, and the process runs when it opens.
Designing Capability In From Day One
The most consequential decision about training in a transformation is not what the training looks like. It is when the training program gets designed. When capability is added at the end — after the process is designed, the technology is configured, the roles are drafted, and the go-live date is set — the training program inherits whatever time and budget the earlier workstreams left behind. It becomes a residual, and residuals produce completion rates.
Designing capability in from day one changes several things at once. The redesigned process is written with a task list that the assessment plan can be built against. The role descriptions are specific enough that a supervisor can tell whether a person is doing the job. Configuration decisions get made with an eye on how the operator will learn them, not only on how the vendor prefers to ship them. Sponsors budget for the coaches and the floor time before the go-live date is locked, rather than discovering the need in month two and staffing it out of overtime.
Program governance changes with it. The steering committee reviews qualification rates against the task list, not completion rates against a curriculum. Go-live readiness is judged by how many operators have been signed off on which tasks, with which assessors, at which quality, and how many exceptions the shift is currently handling without help. The gate to production is a capability gate. The dashboard that mattered on the technology plan — environments stood up, integrations passing tests, cutover rehearsed — still matters. It is joined by a capability dashboard that says who can actually run the process on the day it goes live.
The Decision That Belongs to the Operator
Completion is easier to report than capability. It always will be. A capability program is more work at the front of the transformation, more coaching cost through go-live, more supervisor time in the first two months. It also produces a workforce that can run the redesigned process at the outcome the business case promised, which is the only reason the transformation was funded.
The 737 MAX training was legal, approved, and complete. The pilots did what the regulator required. The gap that produced two accidents was not a compliance gap. It was a capability gap that a compliance regime had misclassified as a training decision. NHS trusts that recovered EPR rollouts did not do it by rerunning the vendor course. They did it by putting experienced people at the elbow of new users for as long as it took, and by measuring readiness against the work, not against the roster.
The operator running the business is the one who has to decide which metric governs go-live. A completion rate protects the schedule and produces a workforce that looks trained on paper. A capability gate protects the outcome and produces a workforce that can run the process the business set out to redesign. The two are not the same. Choosing between them is what makes the difference between a transformation the earnings call can point to and a transformation the operations team is quietly working around by month four.