AI & skill formation
2026-01-30 17:52:11.428831+01 by Dan Lyke 0 comments
How AI Impacts Skill Formation Judy Hanwen Shen, Alex Tamkin
Figure 6 shows that while using AI to complete our coding task did not significantly improve task completion time, the level of skill formation gained by completing the task, measured by our quiz, is significantly reduced (Cohen d=0.738, p=0.01). There is a 4.15 point difference between the means of the treatment and control groups. For a 27-point quiz, this translates into a 17% score difference or 2 grade points. Controlling for warm-up task time as a covariate, the treatment effect remains significant (Cohen’s d=0.725, p=0.016).