Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Development of a modular AI-based robotbin picking system for small objects
University West, Department of Engineering Science.
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

The first step in many industrial manufacturing processes is the provision of individual parts that need to be retrieved from bins, sorted and placed in a predefined matter. With the increasing needfor flexible automation, robot-based bin picking systems are a promising solution for this.

This thesis provides a comprehensive overview of the aspects and challenges involved in robot bin picking. With the aim of automating the handling of small electronic components, a new binpicking system is designed, developed and realised based on the current state of the art.

The use of AI enables fast and robust detection and classification of objects, but requires large amounts of training data. Therefore, a pipeline for generating synthetic training is developed using the 3D software Blender. Photorealistic renderings based on CAD data and textures allow training of AI models that can perform detection, classification and segmentation tasks in real industrial environments. The successful reduction of the synthetic-to-real domain gap represents a major success not only for the bin picking system. Other AI-supported industrial applications can also benefit from the data generated via this pipeline in the future.

Image processing for the bin picking system is implemented as a two-stage process. A neural network trained on synthetic data performs 2D object detection and classification. A combination of RANSAC and ICP feature matching algorithms perform 3D pose estimation based on 2D regions of interest.

Implementation and tests of the system are carried out on a demonstrator in an industrial robotcell. A 6-axis robot with parallel gripper and a state-of-the-art structured light 3D camera are used for this purpose. The latest 3D camera hardware with particularly high resolution enables the detection, localisation and precise oriented gripping of small objects. This has so far been given little consideration in the context of industrial bin picking and represents a technical innovation.The integration of commercial gripping and path planning software enables collision-free handling of the objects by the robot. The bin picking system is validated using real scenarios with electronic components and welding nuts. The effectiveness of the system is demonstrated for a number of simplified bin picking scenarios.This work lays the foundation for the optimisation, further development and industrial testing of the bin picking system. Individual modules from this work can also be used for other industrial machine vision applications.

Place, publisher, year, edition, pages
2024. , p. 131
Keywords [en]
Robotics, Automation, Bin Picking, Image Processing, Artificial Intelligence
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:hv:diva-21902Local ID: EXC915OAI: oai:DiVA.org:hv-21902DiVA, id: diva2:1873941
Subject / course
Robotics
Educational program
Master in robotics and automation
Supervisors
Examiners
Available from: 2024-06-28 Created: 2024-06-19 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

By organisation
Department of Engineering Science
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 71 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf