Development of Application Based on Augmented Reality as A Learning of History and Culture in Architecture Case Study Pathok Negoro Mosques Yogyakarta


  • Hendro Trieddiantoro Putro Universitas Teknologi Yogyakarta
  • Endang Setyowati Universitas Teknologi Yogyakarta


Pathok Negoro Mosques, Cultural Heritage, Augmented Reality, Mobile AR, AR Heritage


Pathok Negoro Mosques is an architectural masterpiece. These mosques are part of history in forming Yogyakarta. The existence of the Sultan’s Ngayogyakarta Palace is inseparable from the Pathok Negoro Mosques building. These mosques also have a function as a defensive system of the Islamic kingdom in Yogyakarta. Arguably, the current generation is getting deprived of the intellectual heritage of culture and history. The history and culture of the Pathok Negoro Mosques will be the content of this research. This research aims to develop an interactive application for learning the history and culture of architecture based on augmented reality. Augmented reality applications developed using unity. This research is proposed to be carried out in 2 stages. The first stage is related to the collection of the historical and cultural context of the mosque. The second stage is the development of an AR application for Android mobile devices. The reference data was made into the AR application with several methods, such as plane detection and image tracking. The research managed to develop a mobile augmented reality application in Unity3D 2018.3.14f1 for android devices that consists of the narrative recorded voice of brief history and culture the Pathok Negoro Mosques. The app also shows a well-ordered animation of building structure such as roof, roof insulation, roof structure and column of Pathok Negoro Mosques. Moreover, the research showed a clear step and issue of making an augmented reality app as learning of history and culture of Pathok Negoro Mosques

Author Biographies

Hendro Trieddiantoro Putro, Universitas Teknologi Yogyakarta

Hendro Trieddiantoro Putro is a researcher that focuses on digital architecture and computational design. His latest research is utilizing BIM, Virtual Reality, and Augmented Reality in digital heritage. He is a lecturer of the bachelor architecture study program at University Technology of Yogyakarta. He joined as team teaching at design studio, building technology, building physics, and bioclimatic architecture. He holds bachelor's and master's degree from Gadjah Mada University. His thesis explores spatial perception in architecture using Virtual Reality.

Endang Setyowati, Universitas Teknologi Yogyakarta

Endang Setyawati is a researcher that focuses on the typology morphology of heritage building and cultural heritage. Her latest research is explain the Pathok Negoro Mosques as the form of territorial defense region of Mataram Kingdom of Islam Java in Jogjakarta. She is a lecturer of the Bachelor of Architecture at the University Technology of Yogyakarta. She joined as a team teaching at the design studio, architecture history, and building structure. She holds a doctoral degree from Diponegoro University. Her doctoral thesis explains the Form, Function, and Architectural Meaning of Pathok Negoro Mosque as Defense of the Yogyakarta Sultanate.


C. D. A. Depari, Konservasi ARSITEKTUR Kota Yogyakarta. Yogyakarta: Penerbit Kanisius, 2013.

Handinoto, Arsitektur dan kota-kota di Jawa pada masa kolonial / Handinoto. Yogyakarta: Graha Ilmu, 2010.

C. Chen, M. Hsu, and I. Lee, "Applying augmented reality to visualize the history of traditional architecture in Taiwan," Proc. 22nd CIPA Symp., no. 1, 2009, [Online]. Available:

K. Y. Chin, C. X. Hou, C. S. Wang, and K. F. Lee, "Using Augmented Reality Technology for the Development of Historic Building Teaching Application: A Mackay Culture Course," Proc. - IEEE 17th Int. Conf. Adv. Learn. Technol. ICALT 2017, pp. 87–88, 2017, doi: 10.1109/ICALT.2017.7.

E. Setyowati, G. Hardiman, T. W. Murtini, and V. R. V Surya, Mengenal Lebih Jauh Masjid Islam Jawa: dalam arsitektur masjid pathok negoro. GalangPress, 2017.

C. Panou, L. Ragia, D. Dimelli, and K. Mania, "An architecture for mobile outdoors augmented reality for cultural heritage," ISPRS Int. J. Geo-Information, vol. 7, no. 12, 2018, doi: 10.3390/ijgi7120463.

G. D. Voinea, F. Girbacia, C. C. Postelnicu, and A. Marto, Exploring Cultural Heritage Using Augmented Reality Through Google's Project Tango and ARCore, vol. 904. Springer International Publishing, 2019.

E. Setyawati, A. Asyifa, H. T. Putro, and M. Ischak, "Developing A Virtual Reality Application of Pathok Negoro Mosque for Digital Conservation," J. Archit. Des. Urban., vol. 2, no. 1, p. 1, Oct. 2019, doi: 10.14710/jadu.v2i1.5517.

S. F. El-Hakim, J. A. Beraldin, M. Picard, and G. Godin, "Detailed 3D reconstruction of large-scale heritage sites with integrated techniques," IEEE Comput. Graph. Appl., vol. 24, no. 3, pp. 21–29, 2004, doi: 10.1109/MCG.2004.1318815.

A. T. Albourae, C. Armenakis, and M. Kyan, "Architectural heritage visualization using interactive technologies," Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. - ISPRS Arch., vol. 42, no. 2W5, pp. 7–13, Aug. 2017, doi: 10.5194/isprs-archives-XLII-2-W5-7-2017.

H. Kolivand, A. El Rhalibi, M. Tajdini, S. Abdulazeez, and P. Praiwattana, "Cultural Heritage in Marker-Less Augmented Reality: A Survey," Adv. Methods New Mater. Cult. Herit. Preserv., 2019, doi: 10.5772/intechopen.80975.

A. Ufkes and M. Fiala, "A markerless augmented reality system for mobile devices," Proc. - 2013 Int. Conf. Comput. Robot Vision, CRV 2013, pp. 226–233, 2013, doi: 10.1109/CRV.2013.51.

J. P. S. do M. Lima, F. P. M. Simoes, L. S. Figueiredo, and J. Kelner, "Model Based Markerless 3D Tracking applied to Augmented Reality," J. Interact. Syst., vol. 1, no. 1, p. 1, 2010, doi: 10.5753/jis.2010.560.

Unity3D, "About AR Foundation," 2019.

ARCore, “ARCore Overview,” 2019.

Antariksa, “Makna Budaya dalam Konservasi Bangunan dan Kawasan,” Makna Budaya dalam Konserv. Bangunan dan Kaw., no. 1985, pp. 1–9, 2009.

L. Sapto Pamungkas, C. Meytasari, and H. Trieddiantoro, "Virtual Reality As A Spatial Experience For Architecture Design: A Study of Effectiveness for Architecture Students," SHS Web Conf., vol. 41, p. 05005, Jan. 2018, doi: 10.1051/shsconf/20184105005.

H. T. Putro, "Immersive Virtual Reality for Tourism and Creative Industry Development," 3rd Int. Conf. Creat. Ind., no. August, pp. 1–6, 2015.

S. S. Sørensen, "The Development of Augmented Reality as a Tool in Architectural and Urban Design," 2013.

N. Desai, "Recreation of history using augmented reality," Accent. Trans. Image Process. Comput. Vis., vol. 4, no. 10, pp. 1–5, Feb. 2018, doi: 10.19101/TIPCV.2017.39019.

S. Brusaporci, G. Ruggieri, F. Sicuranza, and P. Maiezza, “Augmented Reality for Historical Storytelling. The INCIPICT Project for the Reconstruction of Tangible and Intangible Image of L'Aquila Historical Centre," Proceedings, vol. 1, no. 9, p. 1083, Nov. 2017, doi: 10.3390/proceedings1091083.

J.-G. Han, K.-W. Park, K.-J. Ban, and E.-K. Kim, "Cultural Heritage Sites Visualization System based on Outdoor Augmented Reality," AASRI Procedia, vol. 4, pp. 64–71, Jan. 2013, doi: 10.1016/J.AASRI.2013.10.011.

Lee, Kim, Ahn, and Woo, "Remote Diagnosis of Architectural Heritage Based on 5W1H Model-Based Metadata in Virtual Reality," ISPRS Int. J. Geo-Information, vol. 8, no. 8, p. 339, Jul. 2019, doi: 10.3390/ijgi8080339.

A. K. Azmin, M. H. Kassim, F. Abdullah, and A. N. Z. Sanusil, "Architectural heritage restoration of rumah datuk setia via mobile augmented reality restoration," Plan. Malaysia, vol. 15, no. 1, pp. 139–150, 2017, doi: 10.21837/pmjournal.v15.i6.229.

ARCore, "Augmented Images for Android NDK," 2019.

augmentedstartups, "ARCore,", 2018.

ARCore, “ARCore supported devices,” 2019.



2022-01-10 — Updated on 2022-01-24