Usability Evaluation of Metacognitive Support System for Novice Programmers (MSSNP) using SUMI
Keywords:MSSNP, usability, novice programmers, human-machine system
To build effective e-learning is the new challenge faced by software designers and human-computer interaction (HCI) researchers. In computer science, usability is part of the human-computer interaction aspect that relates to the clarity and elegance with which the interaction with software is designed. SUMI (Software Usability Measurement Inventory) is a comprehensive solution, and is a well-tested and validated method for determining whether software has achieved its predetermined goals efficiently and effectively, as evaluated by the end users. This paper presents an empirical study by employing the SUMI (Software Usability Measurement Inventory) to evaluate the MSSNP in terms of the affect, efficiency, control, helpfulness and learnability. The results indicate that MSSNP is an ideal system to support the metacognitve activities for learning Introductory Computer Programming.
Davids, M.R., Chikte, U., Grimmerâ€Somers, K., and Halperin, M.L.: â€˜Usability testing of a multimedia eâ€learning resource for electrolyte and acidâ€base disordersâ€™, British Journal of Educational Technology, 2014, 45, (2), pp. 367-381
Davis, F.D., Bagozzi, R.P., and Warshaw, P.R.: â€˜User acceptance of computer technology: a comparison of two theoretical modelsâ€™, Management science, 1989, 35, (8), pp. 982-1003
Davis, F.D.: â€˜User acceptance of information technology: system characteristics, user perceptions and behavioral impactsâ€™, International journal of man-machine studies, 1993, 38, (3), pp. 475-487
Dumas, J.S., and Redish, J.: â€˜A practical guide to usability testingâ€™ (Intellect Books, 1999. 1999)
FDIS, I.: â€˜9241-11. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs), Part 11: Guidance on Usability Specification and Measuresâ€™, in Editor (Ed.)^(Eds.): â€˜Book 9241-11. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs), Part 11: Guidance on Usability Specification and Measuresâ€™ (Technical report, 1997, edn.), pp.
Johnson, R., and Hegarty, J.R.: â€˜Websites as educational motivators for adults with learning disabilityâ€™, British Journal of Educational Technology, 2003, 34, (4), pp. 479-486
Kirakowski, J., and Corbett, M.: â€˜Measuring user satisfactionâ€™, in Editor (Ed.)^(Eds.): â€˜Book Measuring user satisfactionâ€™ (Cambridge University Press, 1988, edn.), pp. 329-338
Kirakowski, J., and Corbett, M.: â€˜SUMI: The software usability measurement inventoryâ€™, British journal of educational technology, 1993, 24, (3), pp. 210-212
Kirakowski, J.: â€˜The use of questionnaire methods for usability assessmentâ€™, Unpublished manuscript. Retreived from http://sumi. ucc. ie/sumipapp. html, 1994
Maheshwari, P.: â€˜Teaching programming paradigms and languages for qualitative learningâ€™, in Editor (Ed.)^(Eds.): â€˜Book Teaching programming paradigms and languages for qualitative learningâ€™ (ACM, 1997, edn.), pp. 32-39
Means, B., Toyama, Y., Murphy, R., Bakia, M., and Jones, K.: â€˜Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studiesâ€™, US Department of Education, 2009
Mohd Rum, S.N and Ismail,M.A (2013), Promoting Metacognitive Learning Environment in Supporting Novice Programmer Using Semantic Web, International Conference on Emerging Trends in Computer Science & Information Technology, Kuala Lumpur ,pp45-48 , 2013
Mohd Rum, S.N and Ismail,M.A Development of a Metacognitive Support System for Novice Programmers (MSSNP) Using the Semantic Web, 3rd International Conference on Computer Science and Computational Mathematics (ICCSCM), 8th 9th May 2014, Langkawi, Malaysia, pp 24 28, 2014
Pearl, J.: â€˜Heuristics: intelligent search strategies for computer problem solvingâ€™, 1984
Riley, D.D.: â€˜Teaching problem solving in an introductory computer science classâ€™, ACM SIGCSE Bulletin, 1981, 13, (1), pp. 244-251
Schraw, G., and Sperling Dennison, R.: â€˜Assessing metacognitive awarenessâ€™, Contemporary educational psychology, 1994, 19, pp. 460-460
Siti Nurulain Mohd Rum and Ismail M.A Ontology Development of Metacognitive Support System for Novice Programmers (MSSNP),International Symposium on Technology Management and Emerging Technologies (ISTMET), 27th - 29th May 2014, Bandung, Indonesia,IEEE, 2014
Tobias, S., Everson, H.T., and Laitusis, V.: â€˜Towards a Performance Based Measure of Metacognitive Knowledge Monitoring: Relationships with Self-Reports and Behavior Ratingsâ€™, 1999
How to Cite
- Papers must be submitted on the understanding that they have not been published elsewhere (except in the form of an abstract or as part of a published lecture, review, or thesis) and are not currently under consideration by another journal published by any other publisher.
- It is also the authors responsibility to ensure that the articles emanating from a particular source are submitted with the necessary approval.
- The authors warrant that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required.
- The authors ensure that all the references carefully and they are accurate in the text as well as in the list of references (and vice versa).
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Attribution-NonCommercial 4.0 International that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
- The journal/publisher is not responsible for subsequent uses of the work. It is the author's responsibility to bring an infringement action if so desired by the author.