Fabrizio Dell'Acqua
Digital Data Design Institute, Harvard Business School
Titles as the sources gave them. In 1 entry, with 3 checked quotations.
What they said
Newest first. Each quotation was found word for word in the source.
“For each one of a set of 18 realistic knowledge tasks within the frontier of AI capabilities ranging from creative to analytical tasks, subjects using AI outperformed those not using AI, completing 12.2% more tasks and completing them 25.1% more quickly on average while also delivering solutions of significantly improved quality.”
“However, for a complex managerial task selected to be outside the frontier, subjects using AI were 19% less likely to produce correct solutions compared with those without AI, pointing to potential limitations of AI supporting knowledge workers.”
“We introduce and study the concept of a “jagged technology frontier” to describe the uneven impact of artificial intelligence (AI) capabilities, where AI assistance improves performance for some tasks but worsens it for others, even within the same knowledge workflow and with a seemingly similar level of difficulty.”
In the Base
Every entry they appear in.
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality
In its abstract, Dell'Acqua and colleagues describe a preregistered experiment with Boston Consulting Group in which 758 knowledge workers were randomly given no AI, GPT-4, or GPT-4 plus prompting guidance. On 18 tasks inside the AI's capabilities, AI users did more, faster and better; on one task outside them, they were 19% less likely to be correct.