YOLOv11–BLIP Integration for Real-Time Assistive Navigation: Object Detectionand Scene Captioning on Android
2025 (English) Independent thesis Advanced level (degree of Master (Two Years)), 20 HE credits
Student thesis
Abstract [en]
This study presents the development and evaluation of a real-time assistive navigation system integrating YOLOv8 and YOLOv11 object detection models with the BLIP image captioning framework. Indoor object images across ten classes were collected, annotated, and used to train both models under identical conditions. Model evaluation metrics demonstrated that YOLOv11 achieved superior precision, recall, and mean Average Precision compared to YOLOv8, making it the preferred choice for deployment.
The selected YOLOv11 model was integrated with BLIP to generate contextual natural language descriptions, enhancing navigation feedback for visually impaired users. An Android application was developed to facilitate real-time navigation through voice input, GPS-based routing, and text-to-speech guidance, supported by a FastAPI backend for image processing and caption generation. The integrated system was tested in real-world scenarios, confirming its potential for enhancing user mobility and situational awareness.
Place, publisher, year, edition, pages 2025. , p. 26
Keywords [en]
YOLOv11, YOLOv8, BLIP, object detection, image captioning, assistive navigation, Android application, FastAPI, computer vision, real-time AI
National Category
Computer Sciences
Identifiers URN: urn:nbn:se:hv:diva-24329 Local ID: EXA620 OAI: oai:DiVA.org:hv-24329 DiVA, id: diva2:2002662
Subject / course Computer science
Educational program Master in AI and automation
Supervisors
Examiners
2025-10-132025-10-012025-10-13 Bibliographically approved