System update
On Tuesday, August 18th, between 12-1pm, a planned system update of DiVA will take place. During this time, DiVA will not be available.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Design and implementation of an IoT-controlled robotic system: Using machine vision and virtual assistant technology
University West, Department of Engineering Science.
2025 (English)Independent thesis Advanced level (degree of Master (One Year)), 21 HE creditsStudent thesis
Abstract [en]

This thesis presented the design and implementation of an IoT-controlled robotic system that integrates machine vision and virtual assistant technologies to enable intuitive and context-aware human-robot interaction. Motivated by the need for more accessible and intelli-gent robotic systems in domestic and assistive contexts, the project explored how natural language interfaces, real-time visual perception, and modular robotic control could be unified to perform complex manipulation tasks in constrained environments.The developed system integrated an open-source robotic arm with a cloud-based voice interface using Amazon Alexa and a real-time machine vision module powered by YOLOv8 and OpenCV.

The Robot Operating System (ROS) served as the middleware platform, man-aging communication between the voice interface, perception system, and actuation mod-ules. This architecture enabled the robot to receive spoken commands, detect and localize objects within the scene, and execute corresponding manipulation tasks. The implementation demonstrated successful task execution, confirming the system’s ability to link voice-based interaction with reliable visual perception in a modular, low-cost configuration.The research addressed two primary questions related to the system’s technical viability and its impact on usability.

Findings confirmed that virtual assistant integration significantly enhances accessibility while maintaining operational precision. Despite limitations such as reliance on monocular vision and open-loop control, the prototype proved effective in per-forming real-time object-based tasks. The thesis concludes by outlining avenues for future work, including integration of depth sensing, on-device AI, dialogue-based interaction, and adaptive learning. Collectively, this work contributes to advancing intelligent, voice-enabled robotic systems designed for human-centric environments.

Place, publisher, year, edition, pages
2025. , p. 59
Keywords [en]
IoT, robotics, machine vision, human-robot interaction, voice-controlled systems, assistive robotics, ROS
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:hv:diva-24486Local ID: EXR600OAI: oai:DiVA.org:hv-24486DiVA, id: diva2:2009880
Subject / course
Robotics
Educational program
Robotteknik
Supervisors
Examiners
Available from: 2025-11-17 Created: 2025-10-29 Last updated: 2025-12-01Bibliographically approved

Open Access in DiVA

fulltext(2869 kB)314 downloads
File information
File name FULLTEXT01.pdfFile size 2869 kBChecksum SHA-512
f25568f7c609a4d3c9134916d5e41a12bcb1622e84d89a0e10de2a73fec2641fb7cdd77d396fbfe1025baf28d5ce7a6d25a0c6566a00b99fd20de4f24fcc449d
Type fulltextMimetype application/pdf

By organisation
Department of Engineering Science
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 331 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf