About this episode
Today on the podcast, I interview AI researcher Tony Zhang about some of his recent findings about the effects that fully automated AI has on user decision-making. Tony shares lessons from his recent research study comparing typical recommendation AIs with a “forward-reasoning” approach that nudges users to contribute their own reasoning with process-oriented support that may lead to better outcomes. We’ll look at his two study examples where they provided an AI-enabled interface for pilots tasked with deciding mid-flight the next-best alternate airport to land at, and another scenario asking investors to rebalance an ETF portfolio. The takeaway, taken right from Tony’s research, is that “going forward, we suggest that process-oriented support can be an effective framework to inform the design of both 'traditional' AI-assisted decision-making tools but also GenAI-based tools for thought.”
Highlights/ Skip to:
Tony Zhang’s background (0:46)
Context for the study (4:12)
Zhang’s metrics for measuring over-reliance on AI (5:06)
Understanding the differences between the two design options that study participants were given (15:39)
How AI-enabled hints appeared for pilots in each version of the UI (17:49)
Using AI to help pilots make good decisions faster (20:15)
We look at the ETF portfolio rebalancing use case in the study (27:46)
Strategic and tactical findings that Tony took away from his study (30:47)
The possibility of commercially viable recommendations based on Tony’s findings (35:40)
Closing thoughts (39:04)
Quotes from Today’s Episode
“I wanted to keep the difference between the [recommendation & forward reasoning versions] very minimal to isolate the effect of the recommendation coming in. So, if I showed you screenshots of those two versions, they would look very, very similar. The only difference that you would immediately see is that the recommendation version is showing numbers 1, 2, and 3 for the recommended airports. These [rankings] are not present in the forward-reasoning one [airports are default sorted nearest to furthest]. This actually is a pretty profound difference in terms of the interaction or the decision-making impact that the AI has. There is this normal flight mode and forward reasoning, so that pilots are already immersed in the system and thinking with the system during normal flight. It changes the process that they are going through while they are working with the AI.” Tony (18:50 - 19:42)
“You would imagine that giving the recommendation makes your decision fast
