Quick Fixes for novice programmers: effective but under-utilised

TY - CHAP

T1 - Quick Fixes for novice programmers

T2 - The United Kingdom and Ireland Computing Education Research conference

AU - Brown, Neil C. C.

AU - Weill-Tessier, Pierre

AU - Ford, Jamie

AU - Kölling, Michael

N1 - Funding Information: We are grateful for the King’s Undergraduate Research Fellowship (KURF) scheme which supported this project. We thank Brett Becker and Andreas Stefik for their advice on related work. Publisher Copyright: © 2023 ACM.

PY - 2023/9/7

Y1 - 2023/9/7

N2 - Professional software development environments typically provide "quick fixes" for common program errors: a common solution to an error that can be enacted with a single click. For example, an "unknown type" error can be fixed by adding an import for the type, or an "unknown variable" error can be fixed by changing a misspelt identifier to match the name of an already-declared variable. The BlueJ environment recently added some support for quick fixes, and in this paper we use the associated Blackbox dataset to investigate how they are used by novice programmers. We use a combination of automatic filtering of over 100 000 quick fixes, and manual categorisation of 900 programming session fragments. We find that acceptance of suggestions ranges from 1-17% for different quick fix types, usually within 3-5 seconds, and many manually performed alternatives are similar to the actions of unselected quick fixes. Furthermore, we find that users are faster and are more able to make productive progress when quick fix support is available, especially for fixing imports. This data can be used to inform design of future quick fix systems. There are pedagogical arguments for and against providing such a feature to novice programmers and we provide some initial discussion on the matter.

AB - Professional software development environments typically provide "quick fixes" for common program errors: a common solution to an error that can be enacted with a single click. For example, an "unknown type" error can be fixed by adding an import for the type, or an "unknown variable" error can be fixed by changing a misspelt identifier to match the name of an already-declared variable. The BlueJ environment recently added some support for quick fixes, and in this paper we use the associated Blackbox dataset to investigate how they are used by novice programmers. We use a combination of automatic filtering of over 100 000 quick fixes, and manual categorisation of 900 programming session fragments. We find that acceptance of suggestions ranges from 1-17% for different quick fix types, usually within 3-5 seconds, and many manually performed alternatives are similar to the actions of unselected quick fixes. Furthermore, we find that users are faster and are more able to make productive progress when quick fix support is available, especially for fixing imports. This data can be used to inform design of future quick fix systems. There are pedagogical arguments for and against providing such a feature to novice programmers and we provide some initial discussion on the matter.

KW - Quick fixes

KW - Blackbox

KW - Programming education

UR - http://www.scopus.com/inward/record.url?scp=85174483299&partnerID=8YFLogxK

U2 - 10.1145/3610969.3611117

DO - 10.1145/3610969.3611117

M3 - Conference paper

T3 - ACM International Conference Proceeding Series

BT - UKICER 2023 - Proceedings of the 2023 Conference on United Kingdom and Ireland Computing Education Research

PB - Association for Computing Machinery

Y2 - 7 September 2023 through 8 September 2023

ER -