The Manager Training That Scored 4.8 and Changed Nothing on the Floor

The CEO of a mid-size manufacturing company kept the feedback forms in a folder on his desktop. Every session of the new shift-supervisor training had scored above 4.7 out of 5. One session hit a 4.8. He mentioned it at the next board meeting as proof the culture investment was working.

Six months later, his plant's floor turnover was exactly where it had been before the training started. Two supervisors who had scored the training highest on their own feedback forms had each lost a third of their crew in that window.

He asked his HR director to pull the exit interviews. The pattern was consistent and it had nothing to do with pay. Workers described supervisors who "talk over you the second you push back" and "don't actually listen, they just wait for their turn."

These were the same supervisors who had rated the training a near-perfect score.

What a 4.8 rating actually measures

A feedback form measures whether the room enjoyed the two days. It measures whether the facilitator was engaging, whether the content felt relevant, whether the supervisor walked out feeling like his time had been well spent. None of that requires the supervisor's actual on-floor behavior to have moved by a single degree.

A supervisor can sit through two excellent days of training, agree with everything said, genuinely enjoy the experience, and return to the floor the next morning running the exact same conversational pattern he ran the day before. Enjoying a description of a better way to talk to people is a different mental event from being able to do it under the specific pressure of a floor running behind schedule.

The pressure moment is where the gap lives. In a classroom, nobody is behind on a shipment. Nobody's shift is short two people. When a supervisor's prefrontal cortex is under load from an actual production problem, the reflexive pattern takes over, and the two days of training, however well received, has no mechanism installed to interrupt it.

How much is one unresolved conflict really costing your company?

What the HR director changed about the measurement

She stopped using the feedback form as the primary metric. She started measuring one specific thing on the floor itself: how often a supervisor paused and repeated back what a worker said before responding, observed directly during a real shift, not a training simulation.

The first round of floor observations were rough. Supervisors who had scored the classroom training a 4.8 were pausing before responding in real conversations less than ten percent of the time. The gap between the survey and the floor was not subtle. It was close to total.

She built a much smaller program around that single gap. Not a two-day event. A weekly fifteen-minute walk with each supervisor where she watched one real interaction and gave one piece of specific feedback about what happened in that exact exchange. No slides. No feedback form at the end.

Doug Noll's new book Empathy Leadership: The Powerful Skill That Drives Winning Results lays out why a classroom rating and a floor behavior are two different things measured by two different instruments. See it here.

What the floor looks like a year later

Turnover on the two worst-performing crews dropped by nearly a third within two quarters of starting the weekly walks. Neither supervisor could describe what had changed in training language. Both described it as "I just started actually hearing what they were telling me before I answered."

The CEO no longer asks for a feedback score after a training. He asks what changed on the floor within thirty days. It is a harder number to produce and a much harder one to fake.

‍