SENTAKU: A Web-Based Tournament Management System with Zero-Shot LLM Referee Evaluation for Shorinji Kempo
DOI:
https://doi.org/10.24002/ijis.v9i1.14529Abstract
This paper presents SENTAKU (Sistem Elektronik Pertandingan Kenshi Unggul), a referee analytics platform for Shorinji Kempo built on a PHP-based competition management system. The core contribution is a structured referee analytics framework that (i) computes seven per-referee statistical indicators from the raw embu score matrix, (ii) submits them with a structured prompt to Llama 3.3 70B via the Groq API, and (iii) audits the generated report through an objective content audit of coverage, numerical grounding, and section completeness. Two research questions are addressed: whether the framework surfaces referee patterns invisible to manual workflows, and whether a zero-shot LLM with structured context produces text faithful to the underlying statistics. Deployment at POPDA DIY 2026 (5 contingents, 53 randori athletes, 10 judges, 111 matches) surfaced component-level calibration differences and same-regency scoring patterns unattainable through paper workflows. However, the LLM report named only six of ten judges, cited no numerical value from the prompt, and omitted two of five requested sections, while introducing no fabricated content. These findings indicate that absence of hallucination alone is insufficient to guarantee faithful LLM reporting: zero-shot prompting can fail through systematic under-utilisation of numerical input even when explicitly required. Schema-enforced decoding is motivated as the next step
References
[1] Y. Wen and F. Wang, “Design and Application of Major Sports Events Management Information System Based on Integration Algorithm,” Comput. Intell. Neurosci., vol. 2022, pp. 1–10, May 2022, doi: 10.1155/2022/6480522.
[2] K. Pelechrinis, “Quantifying implicit biases in refereeing using NBA referees as a testbed,” Sci. Rep., vol. 13, no. 1, p. 4664, Mar. 2023, doi: 10.1038/s41598-023-31799-y.
[3] T. Gasparetto and K. Loktionov, “Does the Video Assistant Referee (VAR) mitigate referee bias on professional football?,” PLoS One, vol. 18, no. 11, p. e0294507, Nov. 2023, doi: 10.1371/journal.pone.0294507.
[4] C. H. Kim, K. Y. Lee, and Y. Kwon, “Does VAR reduce referee bias? Causal evidence from global professional football leagues,” Int. J. Sports Sci. Coach., Nov. 2025, doi: 10.1177/17479541251391395.
[5] F. Shu, X. Xu, and J. Mao, “Exploring Referee Bias in Basketball: A Case Study of the Chinese Basketball Association,” in Proceedings of the 2024 International Conference on Sports Technology and Performance Analysis, New York, NY, USA: ACM, Dec. 2024, pp. 391–399. doi: 10.1145/3723936.3723997.
[6] V. Carvalho, P. T. Esteves, C. Nunes, W. F. Helsen, and B. Travassos, “The assessment of the match performance of association football referees: Identification of key variables,” PLoS One, vol. 18, no. 9, p. e0291917, Sep. 2023, doi: 10.1371/journal.pone.0291917.
[7] M. Li, X. Wang, and S. Zhang, “The effect of video assistant referee (VAR) on match performance in elite football: A systematic review with meta-analysis,” Proc. Inst. Mech. Eng. P J. Sport. Eng. Technol., Jun. 2024, doi: 10.1177/17543371241254596.
[8] A. Cook and O. Karakuş, “LLM-Commentator: Novel fine-tuning strategies of large language models for automatic commentary generation using football event data,” Knowl. Based. Syst., vol. 300, p. 112219, Sep. 2024, doi: 10.1016/j.knosys.2024.112219.
[9] M. Connor and M. O’Neill, “Large Language Models in Sport Science & Medicine: Opportunities, Risks and Considerations,” May 2023.
[10] Y. Zhang, R. Qu, and O. Girard, “Faster, more accurate? A feasibility study on replacing human judges with artificial intelligence in video review for the Paris Olympics Taekwondo competition,” Front. Sports Act. Living, vol. 7, Aug. 2025, doi: 10.3389/fspor.2025.1632326.
[11] A. R. Hevner, S. T. March, J. Park, and S. Ram, “Design Science in Information Systems Research1,” MIS Quarterly, vol. 28, no. 1, pp. 75–106, Mar. 2004, doi: 10.2307/25148625.
[12] Y. Zhang, X. Zhao, J. Shen, K. Shi, and Y. Yu, “Optimization of Sports Event Management System Based on Wireless Sensor Network,” J. Sens., vol. 2021, no. 1, Jan. 2021, doi: 10.1155/2021/1174351.
[13] A. Passerini, A. Gema, P. Minervini, B. Sayin, and K. Tentori, “Fostering effective hybrid human-LLM reasoning and decision making,” Front. Artif. Intell., vol. 7, Jan. 2025, doi: 10.3389/frai.2024.1464690.
[14] Z. Yang, H. Xia, J. Li, Z. Chen, Z. Zhu, and W. Shen, “Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models Through Question Answering from Text to Video,” Electronics (Basel)., vol. 14, no. 3, p. 461, Jan. 2025, doi: 10.3390/electronics14030461.
[15] A. R. Doshi, J. J. Bell, E. Mirzayev, and B. S. Vanneste, “Generative artificial intelligence and evaluating strategic decisions,” Strategic Management Journal, vol. 46, no. 3, pp. 583–610, Mar. 2025, doi: 10.1002/smj.3677.
[16] Z. Ji et al., “Survey of Hallucination in Natural Language Generation,” ACM Comput. Surv., vol. 55, no. 12, pp. 1–38, Dec. 2023, doi: 10.1145/3571730.
[17] L. Huang et al., “A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions,” ACM Trans. Inf. Syst., vol. 43, no. 2, pp. 1–55, Mar. 2025, doi: 10.1145/3703155.
[18] D. Anh-Hoang, V. Tran, and L.-M. Nguyen, “Survey and analysis of hallucinations in large language models: attribution to prompting strategies or model behavior,” Front. Artif. Intell., vol. 8, Sep. 2025, doi: 10.3389/frai.2025.1622292.
[19] V. C. Storey, W. T. Yue, J. L. Zhao, and R. Lukyanenko, “Generative Artificial Intelligence: Evolving Technology, Growing Societal Impact, and Opportunities for Information Systems Research,” Information Systems Frontiers, vol. 27, no. 5, pp. 2081–2102, Oct. 2025, doi: 10.1007/s10796-025-10581-7.
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Indonesian Journal of Information Systems as journal publisher holds copyright of papers published in this journal. Authors transfer the copyright of their journal by filling Copyright Transfer Form and send it to Indonesian Journal of Information Systems.

Indonesian Journal of Information Systems is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.












