Exploring and Designing Innovative Methods of Interaction With Mixed Reality Using Current Technology, Utilizing Reality as UI

In this project-based research, we aim to identify and explore innovative methods of interaction with mixed reality environments using current technology and design principles from the field of human-computer interaction. To do so, we will review relevant literature on this topic and use the Meta Quest 2 device as a standard for its features and capabilities in our observations. Our focus is on utilizing embodied interaction and hand gesture recognition to create more immersive and intuitive experiences for users by incorporating their hands and surrounding everyday objects as a user interface to communicate with the virtual environment. The resulting minimum viable product will consist of a set of interaction designs and scenario proposals that utilize these elements. While user testing is not a part of this research, we will draw on theories and principles from the fields of human-centered design and interaction design to inform our design choices. The implications of these findings for the future of mixed reality technology and its potential applications will also be discussed.