Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Conceptual framework of scheduling applying discrete event simulation as an environment for deep reinforcement learning
University West, Department of Engineering Science, Division of Production Systems. (PTW)ORCID iD: 0000-0001-8962-0924
University West, Department of Engineering Science, Division of Production Systems. (PTW)ORCID iD: 0000-0002-4091-7732
University West, Department of Engineering Science, Division of Production Systems. (PTW)
Research and Technology Development, Volvo Group Trucks Operations, Gothenburg (SWE).
Show others and affiliations
2022 (English)In: Procedia CIRP, E-ISSN 2212-8271, Vol. 107, p. 955-960Article in journal (Refereed) Published
Abstract [en]

Increased environmental awareness is driving the manufacturing industry towards novel ways of energy reduction to become sustainable yet stay competitive. Climate and enviromental challenges put high priority on incorporating aspects of sustainability into both strategic and operational levels, such as production scheduling, in the manufacturing industry. Considering energy as a parameter when planning makes an already existing highly complex task of production scheduling even more multifaceted. The focus in this study is on inverse scheduling, defined as the problem of finding the number of jobs and duration times to meet a fixed input capacity. The purpose of this study was to investigate how scheduling can be formulated, within the environment of discrete event simulation coupled with reinforcement learning, to meet production demands while simultaneously minimize makespan and reduce energy. The study applied the method of modeling a production robot cell with its uncertainties, using discrete event simulation combined with deep reinforcement learning and trained agents. The researched scheduling approach derived solutions that take into consideration the performance measures of energy use. The method was applied and tested in a simulation environment with data from a real robot production cell. The study revealed opportunities for novel approaches of studying and reducing energy in the manufacturing industry. Results demonstrated a move towards a more holistic approach for production scheduling, which includes energy usage, that can aid decision-making and facilitate increased sustainability in production. We propose a conceptual framework for scheduling for minimizing energy use applying discrete event simulation as an environment for deep reinforcement learning.

Place, publisher, year, edition, pages
2022. Vol. 107, p. 955-960
Keywords [en]
Reinforcement learning; Discrete event simulation; Energy optimal scheduling; Inverse scheduling; Industty 4.0
National Category
Production Engineering, Human Work Science and Ergonomics
Research subject
Work Integrated Learning; Production Technology
Identifiers
URN: urn:nbn:se:hv:diva-18474DOI: 10.1016/j.procir.2022.05.091Scopus ID: 2-s2.0-85132264077OAI: oai:DiVA.org:hv-18474DiVA, id: diva2:1668691
Conference
55th CIRP Conference on Manufacturing Systems
Note

The work was carried out at the Production Technology Centre at University West, Sweden supported by the Swedish Governmental Agency for Innovation Systems (Vinnova) under the project SmoothIT and by the KK Foundation under the project Artificial and Human Intelligence through Learning (AHIL). Their support is gratefully acknowledged. Assistance provided by Master's students Maria Vincenta Vivo and Mohammadali Zakeriharandi was greatly appreciated. 

Available from: 2022-06-13 Created: 2022-06-13 Last updated: 2024-09-04

Open Access in DiVA

fulltext(3387 kB)140 downloads
File information
File name FULLTEXT01.pdfFile size 3387 kBChecksum SHA-512
e821b8aeb5cf9a514e3cf5f03b4ca7719095b3f6017c1ef96b604791086e3a34f592b329de195c10b39b9091408be9f0fd6638a09645df0798f723e5467283ee
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Eriksson, Kristina M.Ramasamy, SudhaZhang, XiaoxiaoDanielsson, Fredrik

Search in DiVA

By author/editor
Eriksson, Kristina M.Ramasamy, SudhaZhang, XiaoxiaoDanielsson, Fredrik
By organisation
Division of Production Systems
In the same journal
Procedia CIRP
Production Engineering, Human Work Science and Ergonomics

Search outside of DiVA

GoogleGoogle Scholar
Total: 140 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 213 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf