Design of an Immersive Holographic Museum Experience Enhanced by Large Language Models

Fran Cantos. (2025). Design of an Immersive Holographic Museum Experience Enhanced by Large Language Models. Final Career Project (TFG). Universidad Politécnica de Madrid, ETSI Telecomunicación.

Abstract:
This project’s main objective is to design and implement an immersive museum experience enhanced by holographic technology and Large Language Models (LLMs). To do so, the idea is to create an interactive virtual museum, where visitors can explore artwork through a holographic projection, using the system Holo-Wall by Tekle Holographics. Secondary objectives for this project are: to engage the users with experience, to increase their return likelihood, and to elevate their learning outcome. Therefore, a gamification component is proposed to enhance the user’s participation through a game based on trivia questions generated by an LLM. Through this project, several technologies are explored and applied. Firstly, Unity Engine is a development platform capable of creating three-dimensional scenarios that simulate a museum’s environment. Secondly, a holographic Holo-Wall system inte- gration, that allows the projection of visual content as a hologram, transforming the experience. Finally, language models like Llama 3.1B are used, through Ollama, to generate multiple-choice questions with different levels of difficulty.