As AI takes on more tasks, what happens when people have to jump in to clean up after it?

Having a human “in the loop” overseeing when an AI makes a decision is important, but what happens to that responsible human over time when the AI gets it right over and over again?