Analisis Usability Pada Sistem Informasi LAPORBUP Menggunakan Performance Measurement, Retrospective Think Aloud dan User Experience Questionnaire
DOI:
https://doi.org/10.30865/klik.v3i6.807Keywords:
Evaluation; Information Systems; Performance Measurement; Retrospective Think Aloud; User ExperienceAbstract
Since 5 years of its use until now there has never been an evaluation at LAPORBUP and it is not yet known how high the level of user satisfaction is in using LAPORBUP. In addition, several problems were found in LAPORBUP which were felt by users related to the interface and system functionality. These problems indicate that LAPORBUP is still not in accordance with the needs, it is necessary to carry out an evaluation analysis of the overall usability of the system by measuring the effectiveness and efficiency as well as the level of user satisfaction. The LAPORBUP evaluation involved 54 respondents obtained from OPD representatives and active users of LAPORBUP. Processing of this evaluation data is carried out using the Performance Measurement technique to measure system effectiveness and efficiency, as well as Retrospective Think Aloud and User Experience Questionnaire to measure aspects of user satisfaction. The results of the Performance Measurement evaluation show that the LAPORBUP application has not been effective because several problems were found when the respondents worked on the task scenarios. Furthermore, UEQ data analysis was carried out using the UEQ Data Analysis Tool by comparing the value of each aspect with the available product data set. Based on the analysis conducted, the attractiveness aspect is included in the good category with a value of 1.72. The clarity aspect is included in the category above the average with a value of 1.48. The efficiency aspect is included in the category above the average with a value of 1.18. The aspect of accuracy is included in the good category with a value of 1.55. The stimulation aspect is included in the very good category with a value of 2.13. The novelty aspect is included in the Very Good category with a value of 1.64. The recommendations generated from Retrospective Think Aloud consist of 7 recommendations on the complaints page, 14 recommendations on the management page, 10 recommendations on the regent's page, and 9 recommendations on the OPD page. The results of the analysis show that improvements can be made to aspects of clarity and efficiency so as to improve the quality of LAPORBUP services
Downloads
References
Bagian Hukum Kab Lombok Timur, Peraturan Bupati (Perbup) Tentang Perubahan Atas Peraturan Bupati Nomor 40 Tahun 2019 Tentang Kedudukan, Susunan Organisasi, Uraian Tugas, Fungsi dan Tata Kerja Dinas Komunikasi, Informatika dan Persandian. 2019. Accessed: May 17, 2023. [Online]. Available: https://peraturan.bpk.go.id/Home/Details/131500/perbup-kab-lombok-timur-no-40-tahun-2019
Pemerintah Pusat, “Undang-undang (UU) No. 25 Tahun 2009.” 2009. Accessed: May 17, 2023. [Online]. Available: https://peraturan.bpk.go.id/Home/Details/38748/uu-no-25-tahun-2009
Kementerian Pendayagunaan Aparatur Negara dan Reformasi Birokrasi, Peraturan Menteri Pendayagunaan Aparatur Negara dan Reformasi Birokrasi tentang Road Map Pengembangan Sistem Pengelolaan Pengaduan Pelayanan Publik Nasional. 2015. Accessed: May 17, 2023. [Online]. Available: https://peraturan.bpk.go.id/Home/Details/132672/permen-pan-rb-no-3-tahun-2015
I. M. A. W. PUTRA and I. M. A. O. K. A. GUNAWAN, “Pengembangan Sistem Informasi Agenda, Arsip Dan Persuratan Bappeda Kabupaten Badung,” Majalah Ilmiah Universitas Tabanan, vol. 18, no. 1, pp. 63–70, 2021.
I. M. A. O. Gunawan and H. Hariyanti, “Evaluasi Kepuasan Pengguna Pada Website SMK Wira Harapan Menggunakan System Usability Scale,” Smart Comp: Jurnalnya Orang Pintar Komputer, vol. 11, no. 4, pp. 607–614, 2022.
S. Putro, K. Kusrini, and M. P. Kurniawan, “Penerapan Metode UEQ dan Cooperative Evaluation untuk Mengevaluasi User Experience Lapor Bantul,” Creative Information Technology Journal, vol. 6, no. 1, p. 27, 2020, doi: 10.24076/citec.2019v6i1.242.
P. A. T. Ashshofiah, S. R. Natasia, Y. E. Hartanti, and J. Muhammad, “Evaluasi Usability Website Dinas Tenaga Kerja Dan Trasmigrasi Kabupaten XYZ Menggunakan Metode Think-Aloud,” Jurnal Teknologi Informasi, vol. 5, no. 2, pp. 134–143, 2021, doi: 10.36294/jurti.v5i2.2057.
I. M. A. O. Gunawan, I. M. A. W. Putra, and K. L. Damayanthi, “Evaluasi Usability pada Website Pustakawan Ganeca Digital Menggunakan User Experience Questionnaire dan Think Aloud,” Syntax Literate; Jurnal Ilmiah Indonesia, vol. 6, no. 1, pp. 99–111, 2021.
N. Luh Putri Ari Wedayanti, N. Kadek Ayu Wirdiani, and I. Ketut Adi Purnawan, “Evaluasi Aspek Usability pada Aplikasi Simalu Menggunakan Metode Usability Testing,” Jurnal Ilmiah Merpati (Menara Penelitian Akademika Teknologi Informasi), vol. 7, no. 2, p. 113, 2019, doi: 10.24843/jim.2019.v07.i02.p03.
I. Made Agus Oka Gunawan and G. Indrawan, “SINTECH Journal | 67 PENGEMBANGAN SISTEM INFORMASI KEMAJUAN AKADEMIK MENGGUNAKAN MODEL INCREMENTAL BERBASIS EVALUASI USABILITY DAN WHITE BOX TESTING”, [Online]. Available: https://doi.org/10.31598
M. Sulistiya, Z. Mu, S. R. Natasia, and M. Yusuf, “Penerapan Metode Think Aloud untuk Evaluasi Usability pada Website Dinas Pendidikan dan Kebudayaan Kota MNO,” vol. 16, no. 1, pp. 25–32, 2020.
I. M. A. W. Putra, I. M. A. O. Gunawan, I. P. B. Suyasa, I. P. D. Suarnatha, and I. G. J. A. Putra, “EVALUASI LEARNING MANAGEMENT SYSTEM (LMS) PADA BADAN KEPEGAWAIAN DAN PENGEMBANGAN SUMBER DAYA MANUSIA (BKPSDM) KABUPATEN TABANAN,” Community Development Journal: Jurnal Pengabdian Masyarakat, vol. 4, no. 2, pp. 2652–2660, 2023.
Juniantari and nyoman T. A. Putra, “Analisis Sistem Informasi Dpmptsp Menggunakan Metode User Dpmptsp Information System Analysis Using the User Experience,” Jurnal Informatika dan Komputer, vol. 4, no. 1, pp. 31–37, 2021, doi: 10.33387/jiko.
A. L. T. Adinegoro, R. I. Rokhmawati, and H. M. Az-Zahra, “Analisis Pengalaman Pengguna pada Website E-commerce Dengan Menggunakan Usability Testing dan User Experience Questionnaire (UEQ) (Studi pada Lazada.co.id, Blibli.com dan JD.id),” Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, vol. 2, no. 11, pp. 5862–5870, 2018, [Online]. Available: http://j-ptiik.ub.ac.id/index.php/j-ptiik/article/view/3439
J. J. Tejada, J. Raymond, and B. Punzalan, “On the Misuse of Slovin’s Formula.”
T. Yuliyana, I. K. R. Arthana, and K. Agustini, “Usability Testing pada Aplikasi POTWIS,” JST (Jurnal Sains dan Teknologi), vol. 8, no. 1, p. 12, 2019, doi: 10.23887/jst-undiksha.v8i1.12081.
A. M. Ersa, “Usability Evaluation Website E-Government Layanan Aspirasi dan Pengaduan Online (LAPOR!): Perbandingan Antara Existing Product dan Development Product,” Uniersitas Indonesia, 2015.
M. Schrepp and J. Thomaschewski, “Handbook for the modular extension of the User Experience Questionnaire,” Mensch & Computer, pp. 1–19, 2019.
Justin Mifsud, “Usability Metrics - A Guide To Quantify The Usability Of Any System - Usability Geek. ,” 2015. https://usabilitygeek.com/usability-metrics-a-guide-to-quantify-system-usability/ (accessed Dec. 19, 2022).
M. A. W. Sadnyana, I. G. M. Darmawiguna, S. Kom, and I. M. A. Pradnyana, “Evaluasi Usability Sistem Informasi Prakerin Pendidikan Teknik Informatika di Universitas Pendidikan Ganesha dengan Metode Usability Testing,” KARMAPATI (Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika), vol. 6, no. 2, pp. 309–319, 2017.
A. Sularsa and A. S. Prihatmanto, “Evaluasi User Experiences Produk iDigital Museum dengan Menggunakan UEQ,” Jurnal Teknologi Informasi, vol. 2, no. 2, pp. 56–62, 2015.
H. B. Santoso, M. Schrepp, R. Yugo Kartono Isal, A. Y. Utomo, and B. Priyogi, “Measuring user experience of the student-centered E-learning environment,” Journal of Educators Online, vol. 13, no. 1, pp. 1–79, 2016.
A. A. I. I. Paramitha, G. R. Dantes, and G. Indrawan, “The evaluation of web based academic progress information system using heuristic evaluation and user experience questionnaire (UEQ),” Proceedings of the 3rd International Conference on Informatics and Computing, ICIC 2018, pp. 1–6, 2018, doi: 10.1109/IAC.2018.8780430.
M. Schrepp, A. Hinderks, and J. Thomaschewski, “Construction of a Benchmark for the User Experience Questionnaire (UEQ),” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 4, p. 40, 2017, doi: 10.9781/ijimai.2017.445.
L. D. Farida, “Pengukuran User Experience Dengan Pendekatan Usability,” Seminar Nasional Teknologi Informasi dan Multimedia 2016, pp. 6–7, 2016.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Analisis Usability Pada Sistem Informasi LAPORBUP Menggunakan Performance Measurement, Retrospective Think Aloud dan User Experience Questionnaire
ARTICLE HISTORY
How to Cite
Issue
Section
Copyright (c) 2023 Mohamad Ariansidi, I Made Candiasa, I Made Gede Sunarya
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
