Toronto Metropolitan University
Alhamdan, Yasmeen MRP.pdf (1.59 MB)

Leveraging from Artificial Intelligence (AI) In Advancing the Augmented Reality (AR) Grocery Shopping Experience

Download (1.59 MB)
posted on 2023-05-24, 20:10 authored by Yasmeen Alhamdan

Globally, people are extremely eager to save time and money while maintaining healthy life choices, especially when performing essential activities such as in-store grocery shopping. This paper presents a system that integrates Artificial Intelligence (AI) methods with Augmented Reality (AR) techniques to enhance the grocery shopping experience through the use of smart glasses. Our proposed framework deploys a Convolutional Neural Network (CNN) object detection model that allows for item identification. By simultaneously retrieving data from a large nutrition database, personal medical reports, and other grocery store related datasets, our intelligent system is able to provide user-centric nutrition facts, health and wellness tips, and unhealthy selection warnings that are augmented on a real time broadcasting of the smart glasses. Our state-of-the-art framework (CoShopper) demonstrates high accuracy in detecting grocery items, improves product selection, increases cost efficiency, and reduces the time spent in the process.





  • Master of Digital Media


  • Digital Media

Granting Institution

Ryerson University

LAC Thesis Type

  • MRP

Thesis Advisor

Dr. Naimul Khan