The Impact of AI Usage and Informativeness on Skill Development in Logical Reasoning

Shang Wu, Hongyu Yao, Catarina Belem, Shuyuan Fu, Mark Steyvers, Padhraic Smyth

arXiv:2605.21695 · 2026-05-23 공개 · arXiv · PDF

problem-solving logical-reasoning ai-assistance human-ai-interaction informativeness ai-usage learning-outcomes skill-development

Abstract

Artificial intelligence (AI) is being increasingly integrated into human problem-solving, yet its effects on individual skill development remain unclear. We examine how both AI usage and informativeness can shape learning in the context of a controlled logical reasoning task with on-demand access to AI assistance. We find that greater AI usage is associated with weaker skill development: heavy AI users underperform relative to comparable peers, whereas light AI users perform similarly to matched users who do not use AI. We also find in our study that these patterns are mediated by AI informativeness. Low-information AI neither improves immediate performance nor preserves performance after AI assistance is removed, and is linked to weaker learning overall. On the other hand, high-information AI was found to improve short-run performance without reducing post-AI outcomes on average in our experiments, but with heterogeneous effects. Our findings in general suggest that AI can, depending on context, either complement human skill development by amplifying independent reasoning or can act as a substitute that undermines such reasoning, with the implication that regulating AI access and usage will be important for promoting skill development in the presence of AI assistance.

한국어 요약

📋 한 줄 요약

**[AI와 학습 효과 / 논리 추론]** 통제된 논리 추론 실험에서 heavy AI 사용자가 같은 조건 peer 대비 underperform, light 사용자는 미사용 매칭과 유사 — low-info AI는 즉각·잔여 성능 모두 약화, high-info AI는 단기 성능 향상하면서 평균적 post-AI 성능 보존.

🎯 핵심 기여도

💡 핵심 아이디어

AI 보조의 학습 효과는 사용량·informativeness 두 축에 의해 결정되며, low-info·heavy 사용은 인간 추론을 대체해 skill development를 undermine, high-info·light 사용은 보완 가능 — AI 접근·사용 규제가 skill development 촉진의 핵심 정책 lever다.

🔬 기술적 접근법

📊 주요 결과

💭 의의 및 한계

**의의**: AI 사용과 학습 효과의 정량 실험 evidence, 교육·정책에 함의 — informativeness·사용량의 동시 규제 필요, 인간 추론 자율성 보전을 위한 design 가이드. **한계**: 단일 논리 추론 task로 일반화 한계, 단기 실험으로 장기 학습 영향 불명, AI usage의 자기선택 편향 통제 가능성.

🚀 실용적 활용