King's College London

Research portal

Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project

Research output: Chapter in Book/Report/Conference proceedingConference paper

Standard

Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project. / Brown, Neil Christopher Charles; Altadmri, Amjad; Sentance, Sue; Kölling, Michael.

ACM International Computing Education Research Conference. 2018. ed. ACM, 2018.

Research output: Chapter in Book/Report/Conference proceedingConference paper

Harvard

Brown, NCC, Altadmri, A, Sentance, S & Kölling, M 2018, Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project. in ACM International Computing Education Research Conference. 2018 edn, ACM.

APA

Brown, N. C. C., Altadmri, A., Sentance, S., & Kölling, M. (2018). Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project. In ACM International Computing Education Research Conference (2018 ed.). ACM.

Vancouver

Brown NCC, Altadmri A, Sentance S, Kölling M. Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project. In ACM International Computing Education Research Conference. 2018 ed. ACM. 2018.

Author

Brown, Neil Christopher Charles ; Altadmri, Amjad ; Sentance, Sue ; Kölling, Michael. / Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project. ACM International Computing Education Research Conference. 2018. ed. ACM, 2018.

Bibtex Download

@inbook{47404cdd367b4adfafeb96f915a761e7,
title = "Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project",
abstract = "The Blackbox project has been collecting programming activity data from users of BlueJ (a novice-targeted Java development environment) for nearly five years. The resulting dataset of more than two terabytes of data has been made available to interested researchers from the outset. In this paper, we assess the impact of the Blackbox project: we perform a mapping study to assess eighteen publications which have made use of the Blackbox data, and we report on the advantages and difficulties experienced by researchers working with this data, collected via a survey. We find that Blackbox has enabled pieces of research which otherwise would not have been possible, but there remain technical challenges in the analysis. Some of these -- but not all -- relate to the scale of the data. We provide suggestions for the future use of Blackbox, and reflections on the role of such data collection projects in programming research.",
author = "Brown, {Neil Christopher Charles} and Amjad Altadmri and Sue Sentance and Michael K{\"o}lling",
year = "2018",
month = "8",
day = "13",
language = "English",
booktitle = "ACM International Computing Education Research Conference",
publisher = "ACM",
edition = "2018",

}

RIS (suitable for import to EndNote) Download

TY - CHAP

T1 - Blackbox, Five Years On: An Evaluation of a Large-scale Programming Data Collection Project

AU - Brown,Neil Christopher Charles

AU - Altadmri,Amjad

AU - Sentance,Sue

AU - Kölling,Michael

PY - 2018/8/13

Y1 - 2018/8/13

N2 - The Blackbox project has been collecting programming activity data from users of BlueJ (a novice-targeted Java development environment) for nearly five years. The resulting dataset of more than two terabytes of data has been made available to interested researchers from the outset. In this paper, we assess the impact of the Blackbox project: we perform a mapping study to assess eighteen publications which have made use of the Blackbox data, and we report on the advantages and difficulties experienced by researchers working with this data, collected via a survey. We find that Blackbox has enabled pieces of research which otherwise would not have been possible, but there remain technical challenges in the analysis. Some of these -- but not all -- relate to the scale of the data. We provide suggestions for the future use of Blackbox, and reflections on the role of such data collection projects in programming research.

AB - The Blackbox project has been collecting programming activity data from users of BlueJ (a novice-targeted Java development environment) for nearly five years. The resulting dataset of more than two terabytes of data has been made available to interested researchers from the outset. In this paper, we assess the impact of the Blackbox project: we perform a mapping study to assess eighteen publications which have made use of the Blackbox data, and we report on the advantages and difficulties experienced by researchers working with this data, collected via a survey. We find that Blackbox has enabled pieces of research which otherwise would not have been possible, but there remain technical challenges in the analysis. Some of these -- but not all -- relate to the scale of the data. We provide suggestions for the future use of Blackbox, and reflections on the role of such data collection projects in programming research.

M3 - Conference paper

BT - ACM International Computing Education Research Conference

PB - ACM

ER -

View graph of relations

© 2018 King's College London | Strand | London WC2R 2LS | England | United Kingdom | Tel +44 (0)20 7836 5454