Abstract
The use of Conversational Agents (CAs) in computer-supported collaborative learning (CSCL) has shown promising results regarding students’ productive dialogue and learning. Yet, limited work has explored the connection between the configuration of the CA behavior, the nature of the learning task, and the student behavior in authentic educational settings. In this work, we describe a pedagogical design space of CAs for collaborative learning composed of three dimensions: task design, domain model, and agent intervention strategies. We conduct an initial field study in a university classroom comparing two types of agent intervention strategies based on student participation, dialogue, and satisfaction. 54 university students worked in pairs in the same collaborative brainstorming task with a CA tool and were randomly assigned in two CA conditions with a) knowledge-based prompts to connect two domain concepts, b) social prompts to link their partners’ contributions. The results show that students who received knowledge-based prompts significantly exchanged more messages with evidence of explicit reasoning and were more satisfied with the agent and their discussion during the task. Students from both conditions reported problems like the lack of context-awareness and timely interventions by the agent. We discuss the relation between the agent intervention strategies and the task design towards seeking design recommendations for CAs in CSCL.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adamson, D., Dyke, G., Jang, H., Rosé, C.P.: Towards an agile approach to adapting dynamic collaboration support to student needs. Int. J. Artif. Intell. Educ. 24(1), 92–124 (2014)
Amarasinghe, I., Hernández Leo, D., Manathunga, K., Jonsson, A.: Sustaining continuous collaborative learning flows in MOOCs: orchestration agent approach. J. Univ. Comput. Sci. 24(8), 1034–1051 (2018)
Bittner, E., Oeste-Reiß, S., Leimeister, J.M.: Where is the bot in our team? toward a taxonomy of design option combinations for conversational agents in collaborative work. In: Proceedings of the 52nd Hawaii International Conference on System Sciences, pp. 284–293 (2019)
Bittner, E.A., Küstermann, G.C., Tratzky, C.: The facilitator is a Bot: towards a converstational agent for facilitating idea elaboration on idea platforms. In: Proceedings of the 27th European Conference on Information Systems (ECIS) (2019)
Colace, F., De Santo, M., Lombardi, M., Pascale, F., Pietrosanto, A., Lemma, S.: Chatbot for e-learning: a case of study. Int. J. Mech. Eng. Robot. Res. 7(5), 528–533 (2018)
Dyke, G., Adamson, D., Howley, I., Rosé, C.P.: Enhancing scientific reasoning and discussion with conversational agents. IEEE Trans. Learn. Technol. 6(3), 240–247 (2013)
Goodyear, P., Carvalho, L.: The Architecture of Productive Learning Networks. Routledge, Abingdon (2014)
Hayashi, Y.: Multiple pedagogical conversational agents to support learner-learner collaborative learning: Effects of splitting suggestion types. Cogn. Syst. Res. 54, 246–257 (2019)
Huang, J.X., Lee, K.S., Kwon, O.W., Kim, Y.K.: A chatbot for a dialogue-based second language learning system. In: CALL In a Climate of Change: Adapting to Turbulent Global Conditions, Short Papers from EUROCALL, vol. 2017, pp. 151–157 (2017)
Kirschner, P.A., Sweller, J., Kirschner, F., Zambrano, J.: From cognitive load theory to collaborative cognitive load theory. Int. J. Comput. Support. Collab. Learn. 13(2), 213–233 (2018)
Kobbe, L., et al.: Specifying computer-supported collaboration scripts. Int. J. Comput. Support. Collab. Learn. 2(2–3), 211–224 (2007)
Kumar, R., Rosé, C.P., Wang, Y.C., Joshi, M., Robinson, A.: Tutorial dialogue as adaptive collaborative learning support. Front. Artif. Intell. Appl. 158, 383 (2007)
Michaels, S., O’Connor, C., Resnick, L.B.: Deliberative discourse idealized and realized: accountable talk in the classroom and in civic life. Stud. Philos. Educ. 27(4), 283–297 (2008)
Murray, T.: An overview of intelligent tutoring system authoring tools: Updated analysis of the state of the art. In: Murray, T., Blessing, S.B., Ainsworth, S. (eds.) Authoring Tools for Advanced Technology Learning Environments, pp. 491–544. Springer, Dordrecht (2003). https://doi.org/10.1007/978-94-017-0819-7_17d
OECD: Draft collaborative problem solving framework (2015). http://www.oecd.org/pisa/pisaproducts/Draft. PISA 2015 Collaborative Problem Solving Framework.pdf
Saldaña, J.: Thinking Qualitatively: Methods of Mind. Sage Publications, Thousand Oaks (2014)
Tegos, S., Demetriadis, S., Karakostas, A.: Promoting academically productive talk with conversational agent interventions in collaborative learning settings. Comput. Educ. 87, 309–325 (2015)
VanLehn, K., Graesser, A., Jackson, G., Jordan, P., Olney, A., Rosé, C.: Natural language tutoring: a comparison of human tutors, computer tutors, and text. Cogn. Sci. 31(1), 3–13 (2007)
Veletsianos, G., Russell, G.S.: Pedagogical agents. In: Spector, J., Merrill, M., Elen, J., Bishop, M. (eds.) Handbook of Research on Educational Communications and Technology, pp. 759–769. Springer, New York (2014). https://doi.org/10.1007/978-1-4614-3185-5_61
Winkler, R., Söllner, M.: Unleashing the potential of chatbots in education: a state-of-the-art analysis. In: Academy of Management Annual Meeting (AOM) (2018)
Acknowledgements
Authors would like to thank Alejandra Martínez-Monés who assisted in the study and Stavros Demetriadis, Tasos Karakostas, and Stathis Nikolaidis who provided the CA technology, in the context of project grant 588438-EPP-1-2017-1-EL-EPPKA2-KA funded by the European Commission, which supported this research. Further support was provided by project grant TIN2017-85179-C3-2-R funded by the Spanish State Research Agency (AEI) and the European Regional Development Fund and project grant VA257P18 funded by the Regional Government of Castilla y León and the European Regional Development Fund.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Michos, K. et al. (2020). Design of Conversational Agents for CSCL: Comparing Two Types of Agent Intervention Strategies in a University Classroom. In: Alario-Hoyos, C., Rodríguez-Triana, M.J., Scheffel, M., Arnedillo-Sánchez, I., Dennerlein, S.M. (eds) Addressing Global Challenges and Quality Education. EC-TEL 2020. Lecture Notes in Computer Science(), vol 12315. Springer, Cham. https://doi.org/10.1007/978-3-030-57717-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-57717-9_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-57716-2
Online ISBN: 978-3-030-57717-9
eBook Packages: Computer ScienceComputer Science (R0)