An Improvement of Computer Based Test System Based on TCExam for Usage with A Large Number of Concurrent Users
Abstract
Computer-based test or assessment has been used widely, especially in the current COVID-19 pandemic, where many schools are conducting distance learning as well as distance examination. The need for a computer or software system to support education is inevitable. A range of solutions, from the free/open source software systems to the paid/proprietary ones have been publicly available. Still, an organization with limited resources prefers to find free or low-budget, while yet demanding reliable solutions. We have reported the use of the computer-based test in a new student recruitment test which is held country-wide. We developed the system based on TCExam, a free and open source computer-based test software, and successfully fulfilled the requirements, but with some tweaks. We found that the TCExam has a performance degradation when used by a large number of examinees concurrently, especially during specific phases during the test. This paper reports the result of our investigation to address the problem and suggests some modifications to the base codes as well as a recommendation of the hardware configuration. We evaluated the modified system in a simulated environment. We successfully achieved up to 56% performance gain using the modified system.
Downloads
References
Carole J. Gallagher, Reconciling a Tradition of Testing with a New Learning Paradigm, Educational Psychology Review, Vol. 15, No. 1, pp. 83-99, 2003. DOI: https://doi.org/10.1023/A:1021323509290
Cynthia G. Parshall, Judith A. Spray, John C. Kalohn, and Tim Davey, Practical Considerations in Computer-Based Testing, Practical Considerations in Computer-Based Testing, 2002. DOI: https://doi.org/10.1007/978-1-4613-0083-0
Y. Anang, Takdir, F. Ridho, I. Santoso, L. R. Maghfiroh, S. Mariyah, M. Takahashi, and Y. Watanabe, Implementation of Computer-Based Test in a Countrywide New Student Recruitment Process, Proceedings of the 4th International Conference on Information Technology (InCIT), Bangkok, pp. 268-273, 2019. DOI: https://doi.org/10.1109/INCIT.2019.8912026
Nicola Asuni, Quality Features of TCExam, an Open-Source Computer-Based Assessment Software, JRC Scientific and Technical Reports EUR 23306 EN, Institute for the Protection and Security of the Citizen, Joint Research Centre, European Commission, Ispra (VA), Italy, 2008.
ISO/IEC, ISO/IEC 9126: Software Engineering – Product Quality. ISO/IEC, 2001.
ISO/IEC, ISO/IEC 25010:2011: Systems and Software Engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) — System and Software Quality Models. ISO/IEC, 2011.
Michael Russell, Amie Goldberg, and Kathleen O’connor, Computer-based Testing and Validity: a look back into the future, Assessment in Education: Principles, Policy & Practice, Vol. 10 No. 3, pp. 279–293, 2003. DOI: https://doi.org/10.1080/0969594032000148145
Chua Yan Piaw, Replacing Paper-based Testing with Computer-based Testing in Assessment: Are We Doing Wrong?, Procedia - Social and Behavioral Sciences, Proceedings of the 12 th International Educational Technology Conference - IETC, pp. 655–664, 2012. DOI: https://doi.org/10.1016/j.sbspro.2012.11.077
Maria M. Llabre, Nancy E. Clements, Katharine B. Fitzhugh, Gary Lancelotta, Roy D. Mazzagatti, and Nancy Quinones, The Effect of Computer-Administered Testing on Test Anxiety and Performance, Journal of Educational Computing Research, Vol. 3 No. 4, pp. 429–433, 1987. DOI: https://doi.org/10.2190/GMX4-AV22-FD4R-A06P
Jr. Thomas J. Ward, Simon R. Hooper, and Kathleen M. Hannafin, The Effect of Computerized Tests on the Performance and Attitudes of College Students, Journal of Educational Computing Research, Vol. 5 No. 3, pp. 327–333, 1989. DOI: https://doi.org/10.2190/4U1D-VQRM-J70D-JEQF
Joseph Hardcastle, Cari F. Herrmann-Abell, DeBoer, and E. George, Comparing Student Performance on Paper-and-Pencil and Computer-Based-Tests, In Annual Meeting of the American Educational Research Association, April 2017.
Dave Bartram, The International Test Commission Guidelines on Computer-Based and Internet-Delivered Testing, Industrial and Organizational Psychology, Vol, 2 No. 1, pp. 11–13, 2009. DOI: https://doi.org/10.1111/j.1754-9434.2008.01098.x
Martha Thurlow, Sheryl S. Lazarus, Debra Albus, and Jennifer Hodgson, Computer-based Testing: Practices and Considerations. Synthesis report, National Center on Educational Outcomes, 2010.
Pierre Bourque, EÉcole de Technologie Supeérieure (EÉTS), Richard E. (Dick) Fairley, and Software and Systems Engineering Associates (S2EA), Guide to the Software Engineering Body of Knowledge (SWEBOK®): Version 3.0, IEEE Computer Society Press, 2014.
IEEE Computer Society, Software and Systems Engineering Vocabulary (SEVOCAB), http://www.computer.org/sevocab/, 2021. Accessed: Feb 12, 2021.
Qingping He and Peter Tymms, A computer-assisted test design and diagnosis system for use by classroom teachers, Journal of Computer Assisted Learning, Vol. 21 No. 6, pp. 419–429, 2005. DOI: https://doi.org/10.1111/j.1365-2729.2005.00148.x
Jatin Shah, Dimple Rajgor, Meenakshi Vaghasia, Amruta Phadtare, Shreyasee Pradhan, Elias Carvalho, and Ricardo Pietrobon, WriteSim TCExam - An open source text simulation environment for training novice researchers in scientific writing, BMC Medical Education 2010, 10:39, pp. 1-14, 2010. DOI: https://doi.org/10.1186/1472-6920-10-39
M. Ismail, W. Z. A. Mokhtar, N. N. M. Nasir, N. R. L. Rashid, and A. K. Ariffin. The development of a web-based homework system (wbh) via tcexam, Mediterranean Journal of Social Sciences, Vol. 5 No. 15, 2014. DOI: https://doi.org/10.5901/mjss.2014.v5n15p249
Ambiyar, Muhammad Luthfi Hamzah, Astri Ayu Purwati, and Eki Saputra, Computer Based Test Using Tcexam as An Instrument Learning Evaluation, International Journal of Scientific & Technology Research, Vol. 8, pp. 1066–1069, 2019.
James Shaw, Web Application Performance Testing—a Case Study of an On-line Learning Application, BT Technology Journal, Vol. 18 No. 2, pp. 79–86, 2000. DOI: https://doi.org/10.1023/A:1026732502654
Eljona Proko and Ilia Ninka, Analyzing and Testing Web Application Performance, International Journal of Engineering and Science, Vol. 3 No. 10, pp. 47–50, 2013.
Rijwan Khan and Mohd Amjad, Performance testing (load) of web applications based on test case management, Perspectives in Science, Vol. 8, pp. 355–357, 2016. DOI: https://doi.org/10.1016/j.pisc.2016.04.073
F. F. Hardiansyah, J. L. Buliali, and W. Wibisono, Internet Connection Control based on Idle Time Using User Behavior Pattern Analysis, EMITTER International Journal of Engineering Technology., Vol. 2, No. 2, pp. 49-61, 2014. DOI: https://doi.org/10.24003/emitter.v2i2.26
Copyright (c) 2022 EMITTER International Journal of Engineering Technology
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The copyright to this article is transferred to Politeknik Elektronika Negeri Surabaya(PENS) if and when the article is accepted for publication. The undersigned hereby transfers any and all rights in and to the paper including without limitation all copyrights to PENS. The undersigned hereby represents and warrants that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required. The undersigned represents that he/she has the power and authority to make and execute this assignment. The copyright transfer form can be downloaded here .
The corresponding author signs for and accepts responsibility for releasing this material on behalf of any and all co-authors. This agreement is to be signed by at least one of the authors who have obtained the assent of the co-author(s) where applicable. After submission of this agreement signed by the corresponding author, changes of authorship or in the order of the authors listed will not be accepted.
Retained Rights/Terms and Conditions
- Authors retain all proprietary rights in any process, procedure, or article of manufacture described in the Work.
- Authors may reproduce or authorize others to reproduce the work or derivative works for the author’s personal use or company use, provided that the source and the copyright notice of Politeknik Elektronika Negeri Surabaya (PENS) publisher are indicated.
- Authors are allowed to use and reuse their articles under the same CC-BY-NC-SA license as third parties.
- Third-parties are allowed to share and adapt the publication work for all non-commercial purposes and if they remix, transform, or build upon the material, they must distribute under the same license as the original.
Plagiarism Check
To avoid plagiarism activities, the manuscript will be checked twice by the Editorial Board of the EMITTER International Journal of Engineering Technology (EMITTER Journal) using iThenticate Plagiarism Checker and the CrossCheck plagiarism screening service. The similarity score of a manuscript has should be less than 25%. The manuscript that plagiarizes another author’s work or author's own will be rejected by EMITTER Journal.
Authors are expected to comply with EMITTER Journal's plagiarism rules by downloading and signing the plagiarism declaration form here and resubmitting the form, along with the copyright transfer form via online submission.
