Strong piece. But “human in the loop” is often a transitional phrase, not a destination. Once models improve, many firms will quietly move from humans in the loop to humans on the loop - and eventually humans blamed by the loop.
The real task is not inserting people at checkpoints. It is designing organisations where human judgment actually retains authority, skill, and learning value. Otherwise oversight becomes theatre. 
Human-in-the-loop isn’t a feature request—it’s the governance layer that makes deployment safe, reliable, and socially acceptable. Great synthesis of real experiments.
This is an extremely timely post, touching as it does on an issue much noticed among those beginning potentially significant use of AI. Altho much noticed, this concern seems far less often brought up as a topic for conversation or as a potentially troubling omen. No doubt the reasons vary, but silence in the face of the incredible speed this technology is advancing strikes this observer as a fraught choice. Thank you for an illuminating piece.
Interesting! Under accountability, I wonder if you can mention how humans need to be aware of when the AI is using context that can subtly shape thinking. Organizations can put flaws in to keep their employees on their toes, and employees can put in flaws to keep the AI on its toes.
I might add something like - In addition to factual accuracy, humans should also evaluate the context surrounding the facts to determine if there are cultural assumptions that might be shaping the way the information is interpreted. Great Job, important work!
The tension between "minimise drudgery" and "promote learning" is the whole paper compressed into two bullet points that quietly contradict each other.
Junior lawyers learn contract law by reviewing hundreds of contracts. Junior analysts learn financial modelling by building models that a senior partner could produce in a quarter of the time. The drudgery isnt a bug in the training pipeline. It is the training pipeline. Remove it and you solve the productivity problem in year one while creating a competence crisis in year five.
The airline pilot analogy buried in the paper is more revealing than the authors maybe intended. Pilots who spend most of their time supervising automation are measurably worse at manual flying when the automation fails. Thats not a hypothetical. Thats an FAA finding with decades of incident data behind it. "Human in the loop" only works if the human has independently acquired the skills the loop requires. And thats the part that gets quietly defunded once the AI handles the routine work.
The paper asks the right question. But the honest answer might be that you cant have both.
I created a post related to this. I fear that the Human Augmentation Loop (HAL) will eventually close simply because there is no theoretical limit to AI capability. The only question I have is how long it will take.
You are defining a "Manufacturing" process with huge gaps. Do you engage with MIT INM (JH BB SB) et al. ? Your "Factory" is your "Product" this is the cutting edge.. But How? Hopefully this is isn't a "Zombie" substack page and MIT team members actually engage.
What makes a little bit more optimistic then 2 years ago:
Schools adapt, pupils are learning *with* that technologies…
But still companies often refuse to improve their employees capabilities by good training. Very rarely I see gamification or other options to make people just curious enough to reflect deeper and go on with deeper learning about how to use AI in their own field.
And- openly said - not a small number of people simply don’t want to hear about „AI and IT the whole day while working“…😅
Strong piece. But “human in the loop” is often a transitional phrase, not a destination. Once models improve, many firms will quietly move from humans in the loop to humans on the loop - and eventually humans blamed by the loop.
The real task is not inserting people at checkpoints. It is designing organisations where human judgment actually retains authority, skill, and learning value. Otherwise oversight becomes theatre. 
Human-in-the-loop isn’t a feature request—it’s the governance layer that makes deployment safe, reliable, and socially acceptable. Great synthesis of real experiments.
This is an extremely timely post, touching as it does on an issue much noticed among those beginning potentially significant use of AI. Altho much noticed, this concern seems far less often brought up as a topic for conversation or as a potentially troubling omen. No doubt the reasons vary, but silence in the face of the incredible speed this technology is advancing strikes this observer as a fraught choice. Thank you for an illuminating piece.
This topic of human-in-the-loop is incredibly relevant right now as everyone is challenged to apply AI tools to their work. Oersonall
Interesting! Under accountability, I wonder if you can mention how humans need to be aware of when the AI is using context that can subtly shape thinking. Organizations can put flaws in to keep their employees on their toes, and employees can put in flaws to keep the AI on its toes.
I might add something like - In addition to factual accuracy, humans should also evaluate the context surrounding the facts to determine if there are cultural assumptions that might be shaping the way the information is interpreted. Great Job, important work!
The tension between "minimise drudgery" and "promote learning" is the whole paper compressed into two bullet points that quietly contradict each other.
Junior lawyers learn contract law by reviewing hundreds of contracts. Junior analysts learn financial modelling by building models that a senior partner could produce in a quarter of the time. The drudgery isnt a bug in the training pipeline. It is the training pipeline. Remove it and you solve the productivity problem in year one while creating a competence crisis in year five.
The airline pilot analogy buried in the paper is more revealing than the authors maybe intended. Pilots who spend most of their time supervising automation are measurably worse at manual flying when the automation fails. Thats not a hypothetical. Thats an FAA finding with decades of incident data behind it. "Human in the loop" only works if the human has independently acquired the skills the loop requires. And thats the part that gets quietly defunded once the AI handles the routine work.
The paper asks the right question. But the honest answer might be that you cant have both.
I created a post related to this. I fear that the Human Augmentation Loop (HAL) will eventually close simply because there is no theoretical limit to AI capability. The only question I have is how long it will take.
do people know they are being researched…?
Every automation I build has the human in the loop. Don’t see it working without it.
You are defining a "Manufacturing" process with huge gaps. Do you engage with MIT INM (JH BB SB) et al. ? Your "Factory" is your "Product" this is the cutting edge.. But How? Hopefully this is isn't a "Zombie" substack page and MIT team members actually engage.
HAL - open the hatch HAL- HAL?
What makes a little bit more optimistic then 2 years ago:
Schools adapt, pupils are learning *with* that technologies…
But still companies often refuse to improve their employees capabilities by good training. Very rarely I see gamification or other options to make people just curious enough to reflect deeper and go on with deeper learning about how to use AI in their own field.
And- openly said - not a small number of people simply don’t want to hear about „AI and IT the whole day while working“…😅