iBet uBet web content aggregator. Adding the entire web to your favor.

Link to original content: https://doi.org/10.1145/1345443.1345438

Developing a computer science-specific learning taxonomy | Working group reports on ITiCSE on Innovation and technology in computer science education

research-article

Developing a computer science-specific learning taxonomy

Authors:

Colin G. Johnson,

Tuukka Ahoniemi,

Diana Cukierman,

Isidoro Hernán-Losada,

Tracy L. Lewis,

Donna McGee Thompson,

Charles Riedesel,

Errol ThompsonAuthors Info & Claims

ITiCSE-WGR '07: Working group reports on ITiCSE on Innovation and technology in computer science education

Pages 152 - 170

https://doi.org/10.1145/1345443.1345438

Published: 01 December 2007 Publication History

Abstract

Bloom's taxonomy of the cognitive domain and the SOLO taxonomy are being increasingly widely used in the design and assessment of courses, but there are some drawbacks to their use in computer science. This paper reviews the literature on educational taxonomies and their use in computer science education, identifies some of the problems that arise, proposes a new taxonomy and discusses how this can be used in application-oriented courses such as programming.

References

[1]

Agencia Nacional de Evaluación de la Calidad y Acreditación. 2005. Título de Grado en Ingeniería Informática.

[2]

Ala-Mutka, K. M. A survey of automated assessment approaches for programming assignments. Computer Science Education 15, 83--102, 2005.

[3]

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J. and Wittrock, M. C., Eds. 2001. A taxonomy for learning and teaching and assessing: A revision of Bloom's taxonomy of educational objectives. Addison Wesley Longman, Inc.

[4]

Azuma, M., Coallier, F. and Garbajosa, J. How to apply the Bloom taxonomy to software engineering. Software Technology and Engineering Practice: Eleventh Annual International Workshop on, 19--21 Sept. 2003, 117--122.

Digital Library

[5]

Biggs, J. B. and Collis, K. F. 1982. Evaluating the quality of learning: The SOLO taxonomy (Structure of the Observed Learning Outcome). Academic Press, New York.

[6]

Biggs, J. B. Teaching for quality learning at university. Open University Press, Buckingham, 1999.

[7]

Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H. and Krathwohl, D. R. 1956. Taxonomy of Educational Objectives: Handbook 1 Cognitive Domain. Longmans, Green and Co Ltd, London.

[8]

Bologna Secretariat. Framework of qualifications for the European Higher Education Area, 2005.

[9]

Box, I. Assessing the assessment: an empirical study of an information systems development subject. Proceedings of the fifth Australasian conference on Computing education - Volume 20, Adelaide, Australia, Australian Computer Society, Inc., 2003.

Digital Library

[10]

Buck, D. and Stucki, D. J. Design Early Considered Harmful: Graduated Exposure to Complexity and Structure Based on Levels of Cognitive Development. 31st SIGCSE Technical Symposium on Computer Science Education, 2000, 75--79.

Digital Library

[11]

Buck, D. and Stucki, D. J. JKarelRobot: A case study in supporting levels of cognitive development in the computer science curriculum. Proceedings of the 32^nd SIGCSE Symposium on Computer Science Education, ACM Press, New York, NY, 2001, 16--20.

Digital Library

[12]

Buckley, J. and Exton, C. A framework for assessing programmers' knowledge of software systems. Proc. 11^th IEEE International Workshop on Program Comprehension, IWPC, 2003.

Digital Library

[13]

Burgess, G. A. Introduction to programming: blooming in America. J. Comput. Small Coll. 21, 19--28. 2005.

Digital Library

[14]

Computing Accreditation Commission. Criteria for Accrediting Computing Programs: Effective for Evaluations During the 2006--2007 Accreditation Cycle. ABET Inc, Baltimore, MD, 2005.

[15]

Cooper, S., Cassel, L., Moskal, B., and Cunningham, S. Outcomes-based computer science education Proceedings of the 36th SIGCSE technical symposium on Computer science education, ACM Press, St. Louis, Missouri, USA, 2005.

Digital Library

[16]

Cukierman, D. and McGee Thompson, D. Learning Strategies Sessions within the Classroom in Computing Science University Courses Proceedings of WCCCE 2007, 12th Western Canadian Conference on Computing Education, May 2007.

[17]

Doran, Michael V. and Langan, David D. A cognitive-based approach to introductory computer science courses: lesson learned. Proceedings of the twenty-sixth SIGCSE technical symposium on Computer science education, Nashville, Tennessee, United States, ACM Press, 1995.

Digital Library

[18]

Facione, P. A. Critical thinking; A statement of expert consensus for purposes of educational assessment and instruction, research findings and recommendations, 1990, Fullerton ERIC Reports, ED315.423.

[19]

Farthing, D. W., Jones, D. M. and McPhee, D. Permutational multiple-choice questions: an objective and efficient alternative to essay-type examination questions. Proceedings of the 3^rd Conference on Innovation and Technology for Computer Science Education, ITiCSE, 1998, ACM Press, New York, NY, 1998, 81--85.

Digital Library

[20]

Gronlund, N. F. Measurement and evaluation in teaching. MacMillan, New York, 1981.

[21]

Hernán-Losada, I., Lázaro-Carrascosa, C. and Velázquez-Iturbide, J. Á. On the use of Bloom's taxonomy as a basis to design educational software on programming. Proceedings of World Conference on Engineering and Technology Education, WCETE 2004, COPEC, Brazil, 2004, 351--355.

[22]

Hernán-Losada, I., Velázquez-Iturbide, J. Á and y Lázaro-Carrascosa, C. A. Programming learning tools based on Bloom's taxonomy: proposal and accomplishments. Proc. VIII International Symposium of Computers in Education (SIIE 2006), León, España, Octubre 2006, 2006, 325--334.

[23]

Howard, Richard A., Carver, Curtis A. and Lane, William D. Felder's learning styles, Bloom's taxonomy, and the Kolb learning cycle: tying it all together in the CS2 course. Proceedings of the twenty-seventh SIGCSE technical symposium on Computer science education, Philadelphia, Pennsylvania, United States, ACM Press, 1996.

Digital Library

[24]

Huitt, W. and Hummel, J. 2003. Piaget's theory of cognitive development. Educational Psychology Interactive

[25]

Ihantola, P., Karavirta, V., Korhonen, A. and Nikander, J. Taxonomy of effortless creation of algorithm visualizations. Proceedings of the 2005 International Workshop on Computing Education Research, ICER '05, Seattle, WA, October 01--02, 2005, ACM Press, New York, NY, 2005, 123--133.

Digital Library

[26]

Illinois Online Network: Educational Resources, http://www.ion.illinois.edu/resources/tutorials/assessment/bloomtest.asp, Accessed on 19/07/2007, 2007.

[27]

Johnson, C. G. and Fuller, U. D. Is Bloom's taxonomy appropriate for computer science? 6th Baltic Sea Conference on Computing Education Koli Calling 2006, Koli Calling, November 2006, Berglund, A. and Wiggberg, M., Eds. Department of Information Technology, University of Uppsala, Stockholm, 2007, 120--123.

Digital Library

[28]

Joint IEEE Computer Society/ACM Task Force on Computing Curricula. 2005. The Overview Report. http://www.computer.org/portal/cms_docs_ieeecs/ieeecs/education/cc2001/CC2005-March06Final.pdf, 2005, visited September 2007.

[29]

King, O. M. and Kitchener, K. S. 1994. Developing reflective judgement: understanding and promoting intellectual growth and critical thinking in adolescents and adults. Jossy-Bass Inc, San Francisco.

[30]

Kolb, D. Experiential Learning: Experience as the Source of Learning and Development. Prentice-Hall, New York, NY, 1984.

[31]

Kramer, J. Is abstraction the key to computing? Communications of the ACM 50, 37--42, 2007.

Digital Library

[32]

Krathwohl, D. R., Bloom, B. S. and Masia, B. B. 1964. Taxonomy of educational objectives: the classification of educational goals. Handbook Volume 2: Affective domain. McKay, New York.

[33]

Krathwohl, D. R. A revision of Bloom's taxonomy: an overview. Theory into Practice 41, 212--218, 2002.

[34]

Kumar, A. N. Learning programming by solving problems. In Informatics Curricula and Teaching Methods, L. Cassel and R. A. REIS, Eds. Kluwer Academic, 29--39, 2003.

[35]

Kundratova, M., Turek, I. Chapters from engineering pedagogy. Educational Objectives (in Slovak). STU Bratislava, 2001.

[36]

Lahtinen, E. and Ahoniemi, T. Visualizations to Support Programming on Different Levels of Cognitive Development. Proceedings of The Fifth Koli Calling Conference on Computer Science Education, 2005, 87--94.

[37]

Lahtinen, E. A Categorization of Novice Programmers: A Cluster Analysis Study. Proceedings of the 19th annual Workshop of the Psychology of Programming Interest Group, Joensuu, Finland, July 2--6, 2007, Sajaniemi, J. and Tukiainen, M., Eds. University of Joensuu Department of Computer Science and Statistics, Joensuu, Finland, 2007, 32--41.

[38]

Lister, R. On Blooming First Year Programming, and its Blooming Assessment. Proceedings of the Australasian Conference on Computing EducationACM Press, New York, NY, 2000, 158--162.

Digital Library

[39]

Lister, R., and Leaney, J. Introductory programming, criterion-referencing, and Bloom. Proceedings of the 34th SIGCSE technical symposium on Computer science education, Reno, Nevada, USA, ACM Press, 2003.

Digital Library

[40]

Lister, R., and Leaney, J. First year programming: Let all the flowers bloom. 5^th Australasian Computer Education Conference, Adelaide, SA, Australia, 2003.

Digital Library

[41]

Lister, R., Adams, E. S., Fitzgerald, S., Fone, W., Hamer, J, Lindholm, M., McCartney, R., Moström, J. E., Sanders, K., Seppälä, O., Simon, B., and Thomas, L. A multi-national study of reading and tracing skills in novice programmers. Working group reports from ITiCSE on Innovation and technology in computer science education, Leeds, United Kingdom, ACM Press, 2004, 119--150.

Digital Library

[42]

Lister, R., Simon, B., Thompson, E., and Whalley, J. L. Not seeing the forest for the trees: novice programmers and the SOLO taxonomy. Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education, Bologna, Italy, ACM Press, New York, NY, 2006, 118--122.

Digital Library

[43]

Machanick, P. Experience of applying Bloom's Taxonomy in three courses. Proc. Southern African Computer Lecturers' Association Conference, Strand, South Africa, June 2000, 2000, 135--144.

[44]

Manaris, B. and McCauley, R. Incorporating HCI into the undergraduate curriculum: Bloom's taxonomy meets the CC'01 curricular guidelines. Frontiers in Education, 2004. FIE 34th Annual Meeting, 2004, T2H/10-T2H/15.

[45]

Merrill, M. D. Lesson segments based on component display theory. In Instructional design theory, M. D. Merrill, Ed. Educational Technology Publications, Englewood Cliffs, NJ, 177--212, 1994.

[46]

Merrill, M. D. The prescriptive component display theory. In Instructional design theory, M. D. Merrill, Ed. Educational Technology Publications, Englewood Cliffs, NJ, 159--176, 1994.

[47]

Merrill, M. D. The descriptive component display theory. In Instructional design theory, M. D. Merrill, Ed. Educational Technology Publications, Englewood Cliffs, NJ, 111--157, 1004

[48]

Moon, J. How to use level descriptors. Southern England Consortium for Credit Accumulation and Transfer, 2002.

[49]

Naps, T., Cooper, S., Koldehofe, B., Roessling, G., Dann, W., Korhonen, A., Malmi, L., Rantakokko, J., Ross, R. J., Anderson, J., Fleischer, R., Kuittinen, M. and McNally, M. 2003. Evaluating the educational impact of visualization. ACM SIGCSE Bulletin 35, 124--136.

Digital Library

[50]

Niemierko, B. Pomiar sprawdzajacy w dydaktyce. Teoria i zastosowania (in Polish). Panstwowe Wydawnictwo Naukowe, Warszawa, 1990.

[51]

Oliver, D., Dobele, T., Greber, M., and Roberts, T. This course has a Bloom Rating of 3.9. Proceedings of the sixth conference on Australasian computing education - Volume 30, Dunedin, New Zealand, Australian Computer Society, Inc., 2004.

Digital Library

[52]

Perry, W. G. J. Forms of intellectual and ethical development in the college years: a scheme. Harcourt Brace Jovanovich College Publishers, Forth Worth, 1968.

[53]

Perry, W. G. J. Different worlds in the same classroom. In Improving learning: new perspectives, P. Ramsden, Ed. Kogan Page; Nichols Pub. Co, London, New York NY, 145--161, 1988.

[54]

Piaget, J. and Inhelder, B. The Psychology of the Child. Routledge & Kegan Paul, 1969.

[55]

Polanyi, M. 1958. Personal knowledge: towards a post-critical philosophy. Routledge and Kegan Paul, Chicago.

[56]

Rademacher, R. Applying Bloom's taxonomy of cognition to knowledge management systems. 1999 ACM SIGCPR conference on Computer Personnel Research, New Orleans, LA, April 8--10, 1999, ACM Press, New York, NY, 1999, 276--278.

Digital Library

[57]

Rapaport, W. J. William Perry's scheme of intellectual and ethical development, http://www.cse.buffalo.edu/~rapaport/perry.positions.html.

[58]

Reeves, M. F. An Application of Bloom's Taxonomy to the Teaching of Business Ethics. Journal of Business Ethics 9, 609--616, 1990.

[59]

Reigeluth, C. M. and Stein, F. S. 1983. The elaboration theory of instruction. In Instructional-design theories and models: an overview of their current status, C. M. Reigeluth, Ed. Lawrence Erlbaum Associates, Hillsdale, NJ, 338--381.

[60]

Reigeluth, C. M., Merrill, M. D. and Bunderson, C. V. 1994. The structure of subject matter content and its instructional design implications. In Instructional design theory, M. D. Merrill, Ed. Educational Technology Publications, Englewood Cliffs, NJ, 59--77.

[61]

Reigeluth, C. M., Merrill, M. D., Wilson, B. G. and Spiller, R. T. 1994. The elaboration theory and instruction: a model for sequencing and synthesizing instruction. In Instructional design theory, M. D. Merrill, Ed. Educational Technology Publications, Englewood Cliffs, NJ, 79--102.

[62]

Reynolds, C. and Fox, C. 1996. Requirements for a computer science curriculum emphasizing information technology: subject area curriculum issues. ACM SIGCSE Bulletin 28, 247--251.

Digital Library

[63]

Robins, A., Rountree, J. and Rountree, N. 2003. Learning and Teaching Programming: a Review and Discussion. Computer Science Education 13, 137--172.

[64]

Sanders, I. and Mueller, C. A fundamentals-Based Curriculum for First Year Computer Science. 31st SIGCSE Technical Symposium on Computer Science Education, ACM Press, 2000, 227--231.

Digital Library

[65]

Scott, T. Bloom's taxonomy applied to testing in computer science classes. J. Comput. Small Coll. 19, 267--274, 2003.

Digital Library

[66]

Simpson, B. J. The classification of educational objectives: psychomotor domain. Illinois Journal of Home Economics 10, 110--114, 1966.

[67]

Svec, S. Taxonomy for Teaching: A System for Teaching Objectives, Learning Activities and Assessment Tasks (Revision of Bloom's Taxonomy of the Cognitive Domain). In Pedagogicka revue (in Slovak) 57, 453--476, 2005.

[68]

Swedish Ministry of Higher Education and Research, Higher Education Ordinance, http://www.sweden.gov.se/sb/d/574/a/21541, Accessed on 19/07/2007, 2007.

[69]

Thompson, E. Does the sum of the parts equal the whole? Proceedings of the seventeenth annual conference of the National Advisory Committee on Computing Qualifications, Mann, S. and Clear, T., Eds. National Advisory Committee on Computing Qualifications, 2004, 440--445.

[70]

Thompson, E. Holistic assessment criteria - applying SOLO to programming projects. Proceedings of the Ninth Australasian Computing Education Conference (ACE 2007), Ballarat, Victoria, Australia, Mann, S. and Simon, Eds. Australian Computer Society Inc, 2007, 155--162.

Digital Library

[71]

University of Victoria. Learning Skills Program - Bloom's Taxonomy, http://www.coun.uvic.ca/learn/program/hndouts/bloom.html, Accessed on 19/07/2007, 2007.

[72]

Whalley, J. L., Lister, R., Thompson, E., Clear, T., Robbins, P., Kumar, P. K. A., and Prasad, C. An Australasian study of reading and comprehension skills in novice programmers, using the bloom and SOLO taxonomies. Proceedings of the 8^th Australasian Conference on Computing Education - Volume 52, Hobart, Australia, Australian Computer Society, Inc, 2006, 243--252.

Digital Library

[73]

Winslow, L. E. 1996. Programming Pedagogy - a Psychological Overview. SIGCSE Bull. 28, 17--22.

Digital Library

Cited By

Deutsch M(2023)Applying the Mathematical Task Framework to K-8 ComputingProceedings of the 18th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3605468.3609753(1-2)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3605468.3609753
Pequeno JFonseca BLopes J(2023)The technological physical laboratory to achieve improvements in the quality of learning in epistemic termsInternational Journal of Technology and Design Education10.1007/s10798-023-09866-234:4(1513-1541)Online publication date: 16-Dec-2023
https://doi.org/10.1007/s10798-023-09866-2
Murtazin KShvets OMeeter MPiho G(2022)Characteristics of Learning Outcomes for Integrating Work-Based Learning into the Business Information Technology Study Program2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO)10.23919/MIPRO55190.2022.9803677(1307-1312)Online publication date: 23-May-2022
https://doi.org/10.23919/MIPRO55190.2022.9803677
Show More Cited By

Index Terms

Developing a computer science-specific learning taxonomy
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Computer science education
        Information science education

Recommendations

A Systematic Review of the Use of Bloom's Taxonomy in Computer Science Education
SIGCSE '18: Proceedings of the 49th ACM Technical Symposium on Computer Science Education

Bloom's taxonomy is a model that allows characterizing students' learning achievements. It is frequently used in computer science education (CSE), but its use is not straightforward. We present a systematic review conducted to know actual use of the ...
Developing a computer science-specific learning taxonomy

Bloom's taxonomy of the cognitive domain and the SOLO taxonomy are being increasingly widely used in the design and assessment of courses, but there are some drawbacks to their use in computer science. This paper reviews the literature on educational ...
Analyzing CS competencies using the SOLO taxonomy
ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education

We have used the SOLO Taxonomy to analyze 5,608 competencies stemming from 734 courses from the faculties of science at Aarhus University and University of Southern Denmark. Both faculties have formulated learning outcomes using this taxonomy. This has ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ITiCSE-WGR '07: Working group reports on ITiCSE on Innovation and technology in computer science education

December 2007

255 pages

ISBN:9781450378420

DOI:10.1145/1345443

Editors:
Janet Carter
University of Kent, Canterbury, UK
,
June Amillo
Universidad Politécnica de Madrid

ACM SIGCSE Bulletin Volume 39, Issue 4
December 2007
236 pages
ISSN:0097-8418
DOI:10.1145/1345375
Issue’s Table of Contents

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

FGU

Conference

ITiCSE07

ITiCSE07: 12th Annual Conference on Innovation and Technology in Computer Science Education

December 1, 2007

Dundee, Scotland

Acceptance Rates

Overall Acceptance Rate 552 of 1,613 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

189
Total Citations
View Citations
3,910
Total Downloads

Downloads (Last 12 months)192
Downloads (Last 6 weeks)25

Reflects downloads up to 07 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Deutsch M(2023)Applying the Mathematical Task Framework to K-8 ComputingProceedings of the 18th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3605468.3609753(1-2)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3605468.3609753
Pequeno JFonseca BLopes J(2023)The technological physical laboratory to achieve improvements in the quality of learning in epistemic termsInternational Journal of Technology and Design Education10.1007/s10798-023-09866-234:4(1513-1541)Online publication date: 16-Dec-2023
https://doi.org/10.1007/s10798-023-09866-2
Murtazin KShvets OMeeter MPiho G(2022)Characteristics of Learning Outcomes for Integrating Work-Based Learning into the Business Information Technology Study Program2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO)10.23919/MIPRO55190.2022.9803677(1307-1312)Online publication date: 23-May-2022
https://doi.org/10.23919/MIPRO55190.2022.9803677
Shah BPareek J(2022)Automated Evaluation of SQL Queries: Eval_SQLEvolution in Computational Intelligence10.1007/978-981-16-6616-2_9(89-104)Online publication date: 24-Apr-2022
https://doi.org/10.1007/978-981-16-6616-2_9
Skalka JDrlik MBenko LKapusta JRodríguez del Pino JSmyrnova-Trybulska EStolinska ASvec PTurcinek P(2021)Conceptual Framework for Programming Skills Development Based on Microlearning and Automated Source Code Evaluation in Virtual Learning EnvironmentSustainability10.3390/su1306329313:6(3293)Online publication date: 17-Mar-2021
https://doi.org/10.3390/su13063293
Velázquez-Iturbide J(2021)An Analysis of the Formal Properties of Bloom's Taxonomy and Its Implications for Computing EducationProceedings of the 21st Koli Calling International Conference on Computing Education Research10.1145/3488042.3488069(1-7)Online publication date: 17-Nov-2021
https://dl.acm.org/doi/10.1145/3488042.3488069
Gruenewald AGiesser CBuechner SGibas CBrueck R(2021)Going Virtual: Teaching Practical Skills of Circuit Design and Programming for Heterogeneous Groups Online2021 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON46332.2021.9454125(404-412)Online publication date: 21-Apr-2021
https://doi.org/10.1109/EDUCON46332.2021.9454125
Smuts HJordaan MSmuts C(2021)Towards a Knowledge Operationalisation Model for Service Learning in Community Projects in Higher EducationKnowledge Management in Organizations10.1007/978-3-030-81635-3_4(41-53)Online publication date: 17-Jul-2021
https://doi.org/10.1007/978-3-030-81635-3_4
Barkmin MBrinda T(2020)Analysis of Programming Assessments — Building an Open Repository for Measuring CompetenciesProceedings of the 20th Koli Calling International Conference on Computing Education Research10.1145/3428029.3428039(1-10)Online publication date: 19-Nov-2020
https://dl.acm.org/doi/10.1145/3428029.3428039
Zhou NCao YJacob SRichardson D(2020)Teacher Perceptions of Equity in High School Computer Science ClassroomsACM Transactions on Computing Education10.1145/341063320:3(1-27)Online publication date: 28-Sep-2020
https://doi.org/10.1145/3410633
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents