{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T19:11:09Z","timestamp":1732043469298,"version":"3.28.0"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,5,11]]},"DOI":"10.1145\/3613904.3642773","type":"proceedings-article","created":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T08:38:06Z","timestamp":1715416686000},"page":"1-20","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs"],"prefix":"10.1145","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-6118-7938","authenticated-orcid":false,"given":"Majeed","family":"Kazemitabaar","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Toronto, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1064-2333","authenticated-orcid":false,"given":"Runlong","family":"Ye","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Toronto, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0009-0000-0303-057X","authenticated-orcid":false,"given":"Xiaoning","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Toronto, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1069-2795","authenticated-orcid":false,"given":"Austin Zachary","family":"Henley","sequence":"additional","affiliation":[{"name":"Microsoft Research, United States"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5150-9806","authenticated-orcid":false,"given":"Paul","family":"Denny","sequence":"additional","affiliation":[{"name":"School of Computer Science, The University of Auckland, New Zealand"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-8283-0072","authenticated-orcid":false,"given":"Michelle","family":"Craig","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Toronto, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-0494-5373","authenticated-orcid":false,"given":"Tovi","family":"Grossman","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Toronto, Canada"}]}],"member":"320","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"e_1_3_3_2_1_1","doi-asserted-by":"publisher","DOI":"10.18260\/1-2--33084"},{"key":"e_1_3_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_3_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569759"},{"volume-title":"Deductive and inductive approaches to qualitative data analysis. Analyzing and interpreting qualitative data: After the interview","year":"2021","author":"Bingham J","key":"e_1_3_3_2_4_1","unstructured":"Andrea\u00a0J Bingham and Patricia Witkowsky. 2021. Deductive and inductive approaches to qualitative data analysis. Analyzing and interpreting qualitative data: After the interview (2021), 133\u2013146."},{"key":"e_1_3_3_2_5_1","doi-asserted-by":"publisher","unstructured":"Rishi Bommasani Drew\u00a0A. Hudson Ehsan Adeli Russ Altman Simran Arora Sydney von Arx Michael\u00a0S. Bernstein Jeannette Bohg Antoine Bosselut Emma Brunskill Erik Brynjolfsson Shyamal Buch Dallas Card Rodrigo Castellon Niladri Chatterji Annie Chen Kathleen Creel Jared\u00a0Quincy Davis Dora Demszky Chris Donahue Moussa Doumbouya Esin Durmus Stefano Ermon John Etchemendy Kawin Ethayarajh Li Fei-Fei Chelsea Finn Trevor Gale Lauren Gillespie Karan Goel Noah Goodman Shelby Grossman Neel Guha Tatsunori Hashimoto Peter Henderson John Hewitt Daniel\u00a0E. Ho Jenny Hong Kyle Hsu Jing Huang Thomas Icard Saahil Jain Dan Jurafsky Pratyusha Kalluri Siddharth Karamcheti Geoff Keeling Fereshte Khani Omar Khattab Pang\u00a0Wei Koh Mark Krass Ranjay Krishna Rohith Kuditipudi Ananya Kumar Faisal Ladhak Mina Lee Tony Lee Jure Leskovec Isabelle Levent Xiang\u00a0Lisa Li Xuechen Li Tengyu Ma Ali Malik Christopher\u00a0D. Manning Suvir Mirchandani Eric Mitchell Zanele Munyikwa Suraj Nair Avanika Narayan Deepak Narayanan Ben Newman Allen Nie Juan\u00a0Carlos Niebles Hamed Nilforoshan Julian Nyarko Giray Ogut Laurel Orr Isabel Papadimitriou Joon\u00a0Sung Park Chris Piech Eva Portelance Christopher Potts Aditi Raghunathan Rob Reich Hongyu Ren Frieda Rong Yusuf Roohani Camilo Ruiz Jack Ryan Christopher R\u00e9 Dorsa Sadigh Shiori Sagawa Keshav Santhanam Andy Shih Krishnan Srinivasan Alex Tamkin Rohan Taori Armin\u00a0W. Thomas Florian Tram\u00e8r Rose\u00a0E. Wang William Wang Bohan Wu Jiajun Wu Yuhuai Wu Sang\u00a0Michael Xie Michihiro Yasunaga Jiaxuan You Matei Zaharia Michael Zhang Tianyi Zhang Xikun Zhang Yuhui Zhang Lucia Zheng Kaitlyn Zhou and Percy Liang. 2021. On the Opportunities and Risks of Foundation Models. https:\/\/doi.org\/10.48550\/ARXIV.2108.07258","DOI":"10.48550\/ARXIV.2108.07258"},{"key":"e_1_3_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518944"},{"key":"e_1_3_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478431.3499352"},{"volume-title":"Language Models are Few-shot Learners. Advances in neural information processing systems 33","year":"2020","author":"Brown Tom","key":"e_1_3_3_2_8_1","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared\u00a0D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, 2020. Language Models are Few-shot Learners. Advances in neural information processing systems 33 (2020), 1877\u20131901."},{"key":"e_1_3_3_2_9_1","unstructured":"Peter Brusilovsky Barbara\u00a0J Ericson Cay\u00a0S Horstmann and Christian Servin. 2023. The Future of Computing Education Materials. (2023)."},{"volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda","year":"2021","author":"Chen Mark","key":"e_1_3_3_2_10_1","unstructured":"Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de\u00a0Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021)."},{"key":"e_1_3_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/00317217231168266"},{"key":"e_1_3_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569823"},{"key":"e_1_3_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953299"},{"volume-title":"Computing Education in the Era of Generative AI. arXiv preprint arXiv:2306.02608","year":"2023","author":"Denny Paul","key":"e_1_3_3_2_14_1","unstructured":"Paul Denny, James Prather, Brett\u00a0A Becker, James Finnie-Ansley, Arto Hellas, Juho Leinonen, Andrew Luxton-Reilly, Brent\u00a0N Reeves, Eddie\u00a0Antonio Santos, and Sami Sarsa. 2023. Computing Education in the Era of Generative AI. arXiv preprint arXiv:2306.02608 (2023)."},{"key":"e_1_3_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3488042.3488052"},{"key":"e_1_3_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511861.3511863"},{"key":"e_1_3_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576123.3576134"},{"key":"e_1_3_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478431.3499334"},{"volume-title":"Proceeding of the 44th ACM technical symposium on Computer science education. 579\u2013584.","author":"Guo J","key":"e_1_3_3_2_19_1","unstructured":"Philip\u00a0J Guo. 2013. Online python tutor: embeddable web-based program visualization for cs education. In Proceeding of the 44th ACM technical symposium on Computer science education. 579\u2013584."},{"key":"e_1_3_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3587103.3594157"},{"key":"e_1_3_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753478"},{"key":"e_1_3_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3051467"},{"volume-title":"Hotjar: Website Heatmaps & Behavior Analytics Tools. https:\/\/www.hotjar.com\/. Accessed on: 30-July-2023.","year":"2023","key":"e_1_3_3_2_23_1","unstructured":"Hotjar. 2023. Hotjar: Website Heatmaps & Behavior Analytics Tools. https:\/\/www.hotjar.com\/. Accessed on: 30-July-2023."},{"key":"e_1_3_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0262-4079(23)00099-4"},{"key":"e_1_3_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2015.7357199"},{"key":"e_1_3_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lindif.2023.102274"},{"key":"e_1_3_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580919"},{"key":"e_1_3_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3631802.3631806"},{"volume-title":"Learning Analytics and Knowledge Conference 2023 (LAK\u201923)","year":"2023","author":"Kumar Harsh","key":"e_1_3_3_2_29_1","unstructured":"Harsh Kumar, Ilya Musabirov, Joseph\u00a0Jay Williams, and Michael Liut. 2023. QuickTA: Exploring the Design Space of Using Large Language Models to Provide Support to Students. Learning Analytics and Knowledge Conference 2023 (LAK\u201923)."},{"key":"e_1_3_3_2_30_1","doi-asserted-by":"crossref","unstructured":"Sam Lau and Philip\u00a0J Guo. 2023. From\" Ban It Till We Understand It\" to\" Resistance is Futile\": How University Programming Instructors Plan to Adapt as More Students Use AI Code Generation and Explanation Tools such as ChatGPT and GitHub Copilot. In Proceedings of the 2023 ACM Conference on International Computing Education Research-Volume 1.","DOI":"10.1145\/3568813.3600138"},{"key":"e_1_3_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2014.6883051"},{"key":"e_1_3_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787709"},{"key":"e_1_3_3_2_33_1","doi-asserted-by":"crossref","unstructured":"Juho Leinonen Paul Denny Stephen MacNeil Sami Sarsa Seth Bernstein Joanne Kim Andrew Tran and Arto Hellas. 2023. Comparing Code Explanations Created by Students and Large Language Models. arxiv:2304.03938\u00a0[cs.CY]","DOI":"10.1145\/3587102.3588785"},{"key":"e_1_3_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569770"},{"key":"e_1_3_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/3495724.3496517"},{"key":"e_1_3_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3286960.3286970"},{"key":"e_1_3_3_2_37_1","doi-asserted-by":"crossref","unstructured":"Mark Liffiton Brad Sheese Jaromir Savelka and Paul Denny. 2023. CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classes. arxiv:2308.06921\u00a0[cs.CY]","DOI":"10.1145\/3631802.3631830"},{"key":"e_1_3_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960334"},{"key":"e_1_3_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569785"},{"key":"e_1_3_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2361276.2361291"},{"key":"e_1_3_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400802114581"},{"key":"e_1_3_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3361721.3361724"},{"key":"e_1_3_3_2_43_1","unstructured":"Matthew\u00a0B Miles and A\u00a0Michael Huberman. 1994. Qualitative data analysis: An expanded sourcebook. sage."},{"key":"e_1_3_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339422"},{"key":"e_1_3_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2361276.2361299"},{"volume-title":"Assessing and responding to the growth of computer science undergraduate enrollments","author":"Engineering National Academies\u00a0of Sciences, Medicine, 2018.","key":"e_1_3_3_2_46_1","unstructured":"Engineering National Academies\u00a0of Sciences, Medicine, 2018. Assessing and responding to the growth of computer science undergraduate enrollments. National Academies Press."},{"key":"e_1_3_3_2_47_1","doi-asserted-by":"crossref","unstructured":"Kimberly\u00a0A Neuendorf. 2017. The content analysis guidebook. sage.","DOI":"10.4135\/9781071802878"},{"key":"e_1_3_3_2_48_1","unstructured":"OpenAI. 2022. Introducing ChatGPT. https:\/\/openai.com\/blog\/chatgpt. Accessed on: 30-July-2023."},{"volume-title":"Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models. arXiv preprint arXiv:2302.04662","year":"2023","author":"Phung Tung","key":"e_1_3_3_2_49_1","unstructured":"Tung Phung, Jos\u00e9 Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, and Gustavo Soares. 2023. Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models. arXiv preprint arXiv:2302.04662 (2023)."},{"key":"e_1_3_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372782.3406263"},{"key":"e_1_3_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3617367"},{"key":"e_1_3_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3587102.3588805"},{"key":"e_1_3_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501385.3543957"},{"key":"e_1_3_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3568813.3600142"},{"key":"e_1_3_3_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017800"},{"key":"e_1_3_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.46504\/12201701sm"},{"key":"e_1_3_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432423"},{"key":"e_1_3_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519665"},{"key":"e_1_3_3_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676723.2677260"},{"volume-title":"Mind in society: Development of higher psychological processes","author":"Vygotsky Lev\u00a0Semenovich","key":"e_1_3_3_2_60_1","unstructured":"Lev\u00a0Semenovich Vygotsky and Michael Cole. 1978. Mind in society: Development of higher psychological processes. Harvard university press."},{"key":"e_1_3_3_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445645"},{"key":"e_1_3_3_2_62_1","volume-title":"Proc. of the 8th Australasian Conf. on Computing Education -","volume":"52","author":"Whalley L.","year":"2006","unstructured":"Jacqueline\u00a0L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P.\u00a0K.\u00a0Ajith Kumar, and Christine Prasad. 2006. An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies. In Proc. of the 8th Australasian Conf. on Computing Education - Volume 52. Australian Computer Society, Inc., AUS, 243\u2013252."},{"key":"e_1_3_3_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3520312.3534862"}],"event":{"name":"CHI '24: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGACCESS ACM Special Interest Group on Accessible Computing"],"location":"Honolulu HI USA","acronym":"CHI '24"},"container-title":["Proceedings of the CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3613904.3642773","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T12:26:33Z","timestamp":1726748793000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642773"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":63,"alternative-id":["10.1145\/3613904.3642773","10.1145\/3613904"],"URL":"https:\/\/doi.org\/10.1145\/3613904.3642773","relation":{},"subject":[],"published":{"date-parts":[[2024,5,11]]},"assertion":[{"value":"2024-05-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}
