Change search
Link to record
Permanent link

Direct link
Publications (10 of 22) Show all publications
Nilsen, M. (2024). Anomaly detection in optical monitoring of laser beam welding. In: oel Andersson, Shrikant Joshi, Lennart Malmsköld, Fabian Hanning (Ed.), Sustainable Production through Advanced Manufacturing, Intelligent Automation and Work Integrated Learning: Proceedings of the 11th Swedish Production Symposium (SPS2024) (pp. 280-288). IOS Press
Open this publication in new window or tab >>Anomaly detection in optical monitoring of laser beam welding
2024 (English)In: Sustainable Production through Advanced Manufacturing, Intelligent Automation and Work Integrated Learning: Proceedings of the 11th Swedish Production Symposium (SPS2024) / [ed] oel Andersson, Shrikant Joshi, Lennart Malmsköld, Fabian Hanning, IOS Press , 2024, p. 280-288Chapter in book (Refereed)
Abstract [en]

Robotized laser beam welding is one important process in manufacturing, offering efficient welding while minimizing the heat input. Nonetheless, this method is sensitive to various deviations, including fixture problems, heat-induced distortions, and inaccuracies in tool handling. Such deviations can lead to significant defects like lack of fusion, particularly when welding square butt joints without gaps. Detecting these defects through visual inspection or non-destructive methods is challenging. To address this, real-time monitoring and automatic intervention are necessary. One effective sensor for monitoring laser beam welding is the photodiode, which captures optical emissions from the process. Research has demonstrated correlations between these emissions and process stability. Photodiodes are costeffective and easily integrated into welding tools, making them ideal for industrial applications. However, the challenge lies in analyzing the output signals and defining thresholds for identifying deviations from normal conditions. Thus, there's a need for an automated method to set threshold values based on measured data. Machine learning offers a solution, particularly through supervised, unsupervised, or semi-supervised methods. Supervised machine learning requires labeled data, involving time-consuming experiments with nominal and deviating cases, making it less feasible for industrial setups. This paper suggests using unsupervised learning for anomaly detection, relying solely on data from nominal welding cases for model training. In this approach, a model is trained using photodiode data from a single nominal weld case and subsequently tested on data collected during experiments involving laser beam offsets during welding. The results demonstrate the promise of this method for monitoring closed square butt-joint laser beam welding, even with limited training data from nominal cases. 

Place, publisher, year, edition, pages
IOS Press, 2024
Series
Advances in Transdisciplinary Engineering, ISSN 2352-751X, E-ISSN 2352-7528 ; 52
Keywords
Laser beam welding, anomaly detection, machine learning, photodiodes
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology
Identifiers
urn:nbn:se:hv:diva-22739 (URN)10.3233/ATDE240172 (DOI)9781643685106 (ISBN)9781643685113 (ISBN)
Note

CC BY NC 4.0

Available from: 2024-12-11 Created: 2024-12-11 Last updated: 2024-12-11
Mi, Y., Sikström, F., Nilsen, M., Mishra, A. K. & Ancona, A. (2024). Deep Learning for Joint Gap Width Classification and Tack Weld Detection in Laser Beam Welding. 2024 New Trends in Signal Processing (NTSP), 1-6
Open this publication in new window or tab >>Deep Learning for Joint Gap Width Classification and Tack Weld Detection in Laser Beam Welding
Show others...
2024 (English)In: 2024 New Trends in Signal Processing (NTSP), p. 1-6Article in journal (Refereed) Published
Abstract [en]

Laser Beam Welding (LBW) requires precise control to ensure high-quality welds. Accurate classification of joint gap widths and detection of tack welds are crucial for optimizing the process and enhancing product reliability. This study investigates the application of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to classify instant joint gap widths and detect the presence of tack welds during welding. The goal is to facilitate adaptive joint gap bridging in robotized and autogenous butt joint welding. Sequences of images resembling a time series were captured during welding of prepared workpieces with varying joint gap widths along the joint line. The results demonstrate that CNNs significantly outperform RNNs, achieving over 99 percent classification accuracy in both validation and test datasets, and 96 percent accuracy under conditions of substantial noise. These findings underscore the potential of CNNs in enhancing the precision and adaptability of welding automation. However, challenges remain in generalizing the CNN model to diverse and noisy operational environments.

Place, publisher, year, edition, pages
IEEE, 2024
Keywords
deep learning, convolutional neural network, CNN, recurrent neural networks, RNN, machine vision, image classification, robotized welding, laser beam welding, butt joints
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology
Identifiers
urn:nbn:se:hv:diva-22569 (URN)10.23919/ntsp61680.2024.10726306 (DOI)
Funder
Knowledge Foundation
Available from: 2024-10-29 Created: 2024-10-29 Last updated: 2024-10-31
Rahmani Dehaghani, M., Sahraeidolatkhaneh, A., Nilsen, M., Sikström, F., Sajadi, P., Tang, Y. & Wang, G. G. (2024). System identification and closed-loop control of laser hot-wire directed energy deposition using the parameter-signature-quality modeling scheme. Journal of Manufacturing Processes, 112, 1-13
Open this publication in new window or tab >>System identification and closed-loop control of laser hot-wire directed energy deposition using the parameter-signature-quality modeling scheme
Show others...
2024 (English)In: Journal of Manufacturing Processes, ISSN 1526-6125, Vol. 112, p. 1-13Article in journal (Refereed) Published
Abstract [en]

Hot-wire directed energy deposition using a laser beam (DED-LB/w) is a method of metal additive manufacturing (AM) that has benefits of high material utilization and deposition rate, but parts manufactured by DED-LB/w suffer from a substantial heat input and undesired surface finish. Hence, regulating the process parameters and monitoring the process signatures to control the final quality during the deposition is crucial to ensure the quality of the final part. This paper explores the dynamic modeling of the DED-LB/w process and introduces a parameter-signature-quality modeling and control approach to enhance the quality of modeling and control of part qualities that cannot be measured in situ. The study investigates different process parameters that influence the melt pool width (signature) and bead width (quality) in single and multi-layer beads. The proposed modeling approach utilizes a parameter-signature model as F1 and a signature-quality model as F2. Linear and nonlinear modeling approaches are compared to describe a dynamic relationship between process parameters and a process signature, the melt pool width (F1). A fully connected artificial neural network is employed to model and predict the final part quality, i.e., bead width, based on melt pool signatures (F2). Finally, the effectiveness and usefulness of the proposed parameter-signature-quality modeling is tested and verified by integrating the parameter-signature (F1) and signature-quality (F2) models in the closed-loop control of the width of the part. Compared with the control loop with only F1, the proposed method shows clear advantages and bears potential to be applied to control other part qualities that cannot be directly measured or monitored in situ.

Place, publisher, year, edition, pages
Elsevier, 2024
Keywords
Laser hot-wire directed energy deposition System identification, Multi-layer perceptron, In situ monitoring, Closed-loop control
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology
Identifiers
urn:nbn:se:hv:diva-21214 (URN)10.1016/j.jmapro.2024.01.029 (DOI)001168491700001 ()2-s2.0-85182880993 (Scopus ID)
Available from: 2024-01-19 Created: 2024-01-19 Last updated: 2024-09-19Bibliographically approved
Mi, Y., Guglielmi, P., Nilsen, M., Sikström, F., Palumbo, G. & Ancona, A. (2023). Beam shaping with a deformable mirror for gap bridging in autogenous laser butt welding. Optics and Lasers in Engineering, 169, Article ID 107724.
Open this publication in new window or tab >>Beam shaping with a deformable mirror for gap bridging in autogenous laser butt welding
Show others...
2023 (English)In: Optics and Lasers in Engineering, ISSN 0143-8166, Vol. 169, article id 107724Article in journal (Refereed) Published
Abstract [en]

In autogenous laser butt welding the variability of the joint gap can cause problems in terms of weld seam quality. A suitable strategy to alleviate this is to dynamically shape the laser beam instead of a circular-shaped beam with typical Gaussian or top hat distributions. Currently available systems cannot reach sufficient performance due to both the real time control system for the shape variation and the limited laser power currently manageable. In the present work, the possibility of bridging the joint gap during welding using a deformable mirror to elongate the focused laser beam from circular to transversal elliptical shape was investigated. The effect of the beam shaping on the geometry of the weld pool and of the weld cross sections was analysed, for different values of the gap in comparison with a circular Gaussian beam. It was demonstrated that the adoption of a transversal elliptical laser beam makes the welding process more stable, especially for large gaps (i.e. larger than the circular beam radius). Thanks to the beam shaping, the extension of the fused zone (in terms of the cross section area, height and width) resulted to be less sensitive to the gap's dimension; in addition, the extension of the heat affected zone and the presence of undercuts were evidently reduced.

Keywords
Laser beam welding, Beam shaping, Process monitoring, Microstructure, Steel
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology
Identifiers
urn:nbn:se:hv:diva-20684 (URN)10.1016/j.optlaseng.2023.107724 (DOI)001041329900001 ()2-s2.0-85164226707 (Scopus ID)
Funder
Knowledge Foundation, 20170315Knowledge Foundation, 20210094
Available from: 2023-12-29 Created: 2023-12-29 Last updated: 2024-10-31Bibliographically approved
Ancona, A., Sikström, F., Christiansson, A.-K., Nilsen, M., Mi, Y. & Kisielewicz, A. (2023). Monitoring and control of directed energy deposition using a laser beam (1.ed.). In: Pederson, Robert, Andersson, Joel & Joshi, Shrikant V. (Ed.), Additive Manufacturing of High-Performance metallic Materials: (pp. 612-638). Elsevier
Open this publication in new window or tab >>Monitoring and control of directed energy deposition using a laser beam
Show others...
2023 (English)In: Additive Manufacturing of High-Performance metallic Materials / [ed] Pederson, Robert, Andersson, Joel & Joshi, Shrikant V., Elsevier, 2023, 1., p. 612-638Chapter in book (Refereed)
Abstract [en]

To be a successful competitor among other technologies, metallic laser-directed energy depositionusing a laser beam would benefit from the support of intelligent automation making the processrobust, repeatable, and cost-efficient. This calls for technology leaps towards robust and accuratedetection and estimation of the conditions during processing and control schemes for robustperformance. This chapter discusses how developments in sensor technology and model-basedsignal processing can contribute to advancements in in-process monitoring of directed energydeposition using a laser beam and how developments in model-based feedforward- and feedbackcontrol can support automation. The focus is on how machine vision, optical emission spectroscopy,thermal sensing, and electrical process signals can support monitoring, control and better processunderstanding. These approaches are industrially relevant and have a high potential to support amore sustainable manufacturing. 

Place, publisher, year, edition, pages
Elsevier, 2023 Edition: 1.
Keywords
Directed energy deposition using a laser beam; Electrical process signals; Feedstock wire and powder; Infrared imaging; Machine vision; Model-based control; Photo detection; Radiation pyrometry; Signal processing; Spectroscopy
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology
Identifiers
urn:nbn:se:hv:diva-21079 (URN)9780323918855 (ISBN)9780323913829 (ISBN)
Available from: 2023-12-14 Created: 2023-12-14 Last updated: 2024-01-11Bibliographically approved
Jadidi, A., Mi, Y., Sikström, F., Nilsen, M. & Ancona, A. (2022). Beam Offset Detection in Laser Stake Welding of Tee Joints Using Machine Learning and Spectrometer Measurements. Sensors, 22(10)
Open this publication in new window or tab >>Beam Offset Detection in Laser Stake Welding of Tee Joints Using Machine Learning and Spectrometer Measurements
Show others...
2022 (English)In: Sensors, E-ISSN 1424-8220, Vol. 22, no 10Article in journal (Refereed) Published
Abstract [en]

Laser beam welding offers high productivity and relatively low heat input and is one key enabler for efficient manufacturing of sandwich constructions. However, the process is sensitive to how the laser beam is positioned with regards to the joint, and even a small deviation of the laser beam from the correct joint position (beam offset) can cause severe defects in the produced part. With tee joints, the joint is not visible from top side, therefore traditional seam tracking methods are not applicable since they rely on visual information of the joint. Hence, there is a need for a monitoring system that can give early detection of beam offsets and stop the process to avoid defects and reduce scrap. In this paper, a monitoring system using a spectrometer is suggested and the aim is to find correlations between the spectral emissions from the process and beam offsets. The spectrometer produces high dimensional data and it is not obvious how this is related to the beam offsets. A machine learning approach is therefore suggested to find these correlations. A multi-layer perceptron neural network (MLPNN), support vector machine (SVM), learning vector quantization (LVQ), logistic regression (LR), decision tree (DT) and random forest (RF) were evaluated as classifiers. Feature selection by using random forest and non-dominated sorting genetic algorithm II (NSGAII) was applied before feeding the data to the classifiers and the obtained results of the classifiers are compared subsequently. After testing different offsets, an accuracy of 94% was achieved for real-time detection of the laser beam deviations greater than 0.9 mm from the joint center-line.

Place, publisher, year, edition, pages
MDPI, 2022
Keywords
laser beam offset; feature selection; laser beam welding; machine learning; spectrometer; tee joint
National Category
Bioinformatics and Systems Biology
Research subject
Production Technology
Identifiers
urn:nbn:se:hv:diva-18671 (URN)10.3390/s22103881 (DOI)000803647200001 ()35632290 (PubMedID)2-s2.0-85130378549 (Scopus ID)
Funder
Knowledge Foundation, 20170315
Available from: 2022-06-28 Created: 2022-06-28 Last updated: 2024-04-12
Nilsen, M., Sikström, F. & Christiansson, A.-K. (2019). A study on change point detection methods applied to beam offset detection in laser welding. Paper presented at 17th Nordic Laser Materials Processing Conference - (NOLAMP17), 27 –29 August 2019. Procedia Manufacturing, 36, 72-79
Open this publication in new window or tab >>A study on change point detection methods applied to beam offset detection in laser welding
2019 (English)In: Procedia Manufacturing, E-ISSN 2351-9789, Vol. 36, p. 72-79Article in journal (Refereed) Published
Abstract [en]

This paper presents an experimental study where a photodiode integrated into a laser beam welding tool is used to monitor laser beam spot deviations fromthe joint, the beam offset. The photodiode system is cost effective and typically easy to implement in an industrial system. The selected photodiode is a silicondetector sensitive in the spectral range between 340-600nm which corresponds to the spectral emissions from the plasma plume. The welding application is closed-square-butt joint welding where a laser beam offset can cause lack of fusion in the resulting weld. The photodiode signal has been evaluated by two different change point detection methods, one off-line and one on-line method, with respect to their detection performance. Off-line methods can be used to guide post weld inspection and on-line methods have the potential to enable on-line adaptive control or the possibility to stop the process for repair. The performance of the monitoring system and the change point detection methods have been evaluated from data obtained during laser beam welding experiments conducted on plates of stainless steel. The results clearly indicates the possibility to detect beam offsets by photodiode monitoring.

Keywords
Laser beam welding; monitoring; photodiode; change point detection
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology; ENGINEERING, Manufacturing and materials engineering
Identifiers
urn:nbn:se:hv:diva-14384 (URN)10.1016/j.promfg.2019.08.011 (DOI)2-s2.0-85072523021 (Scopus ID)
Conference
17th Nordic Laser Materials Processing Conference - (NOLAMP17), 27 –29 August 2019
Funder
Vinnova, 2016-03291
Available from: 2019-09-05 Created: 2019-09-05 Last updated: 2020-01-17Bibliographically approved
Nilsen, M., Sikström, F. & Christiansson, A.-K. (2019). Adaptive control of the filler wire rate during laser beam welding of squared butt joints with varying gap width. The International Journal of Advanced Manufacturing Technology, 102(9-12), 3667-3676
Open this publication in new window or tab >>Adaptive control of the filler wire rate during laser beam welding of squared butt joints with varying gap width
2019 (English)In: The International Journal of Advanced Manufacturing Technology, ISSN 0268-3768, E-ISSN 1433-3015, Vol. 102, no 9-12, p. 3667-3676Article in journal (Refereed) Published
Abstract [en]

Adding filler wire control to autogenous laser beam welding of squared butt joints offers a means to widen up the tight fit-up tolerances associated with this process. When the gap width varies, the filler wire rate should be controlled to assure a constant geometry of the resulting weld seam. A dual mode sensing system is proposed to estimate the joint gap width and thereby control the filler wire rate. A vision camera integrated into the welding tool together with external LED illumination and a laser line projection enables two sensing modes, one surface feature extraction mode and one laser triangulation-based mode. Data from the both modes are fused in a Kalman filter, and comparisons show that the fusing of the data gives more robust estimation than estimates from each single mode. A feed-forward control system adaptively adjusts the filler wire rate based on the estimations ofthe joint gap width in front of the keyhole. The focus is on keeping the data processing simple and affordable, and the real-time performance of the sensor and control system has been evaluated by welding experiments. It is shown that the proposed system can be used for on-line control of the filler wire rate to achieve a constant weld geometry during varying joint gap widths

Keywords
Laser beam welding, Filler wire, Squared butt joints, Varying gap width, Feature extraction, Laser triangulation, Sensor fusion
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology; ENGINEERING, Manufacturing and materials engineering
Identifiers
urn:nbn:se:hv:diva-13640 (URN)10.1007/s00170-019-03325-w (DOI)000469060700066 ()2-s2.0-85067693903 (Scopus ID)
Funder
Vinnova, 2016-03291
Available from: 2019-02-28 Created: 2019-02-28 Last updated: 2020-02-03Bibliographically approved
Sikström, F. & Nilsen, M. (2019). Beam offset detection in laser stake welding of tee joints based on photodetector sensing. Paper presented at 17th Nordic Laser Material Processing Conference (NOLAMP17), 27 –29 August 2019, Trondheim. Procedia Manufacturing, 36, 64-71
Open this publication in new window or tab >>Beam offset detection in laser stake welding of tee joints based on photodetector sensing
2019 (English)In: Procedia Manufacturing, E-ISSN 2351-9789, Vol. 36, p. 64-71Article in journal (Refereed) Published
Abstract [en]

This paper presents an experimental study where a photodetector is used in a laser beam welding tool to monitor beam deviations (beam offsets) in stake welding of tee joints. The aim is to obtain an early detection of deviations from the joint centerline in this type of welding where the joint is not visible from the top side. The photodetector used is a GaP diode sensitive in the spectral range 150-550 nm corresponding to the spectral emissions form the plasma plume during keyhole welding. The photodetector signal has been evaluated by change point detection methods with respect to their detection performance. Both an off-line and an on-line method have been evaluated. The off-line method can be used to guide post weld inspection and the on-line method has the potential to enable on-line adaptive position control and/or the possibility to stop the process for repair. The results shows that the proposed method can be used as a go/no go system and to guide post weld inspection.

Keywords
Laser beam welding, tee joint, process monitoring, photodetector
National Category
Manufacturing, Surface and Joining Technology
Research subject
ENGINEERING, Manufacturing and materials engineering; Production Technology
Identifiers
urn:nbn:se:hv:diva-14385 (URN)10.1016/j.promfg.2019.08.010 (DOI)2-s2.0-85072518609 (Scopus ID)
Conference
17th Nordic Laser Material Processing Conference (NOLAMP17), 27 –29 August 2019, Trondheim
Funder
Knowledge Foundation
Available from: 2019-09-05 Created: 2019-09-05 Last updated: 2020-01-17Bibliographically approved
Elefante, A., Nilsen, M., Sikström, F., Christiansson, A.-K., Maggipinto, T. & Ancona, A. (2019). Detecting beam offsets in laser welding of closed-square-butt joints by wavelet analysis of an optical process signal. Optics and Laser Technology, 109, 178-185
Open this publication in new window or tab >>Detecting beam offsets in laser welding of closed-square-butt joints by wavelet analysis of an optical process signal
Show others...
2019 (English)In: Optics and Laser Technology, ISSN 0030-3992, E-ISSN 1879-2545, Vol. 109, p. 178-185Article in journal (Refereed) Published
Abstract [en]

Robotized laser beam welding of closed-square-butt joints is sensitive to the positioning of the laser beam with respect to the joint since even a small offset may result in a detrimental lack of sidewall fusion. An evaluation of a system using a photodiode aligned coaxial to the processing laser beam confirms the ability to detect variations of the process conditions, such as when there is an evolution of an offset between the laser beam and the joint. Welding with different robot trajectories and with the processing laser operating in both continuous and pulsed mode provided data for this evaluation. The detection method uses wavelet analysis of the photodetector signal that carries information of the process condition revealed by the plasma plume optical emissions during welding. This experimental data have been evaluated offline. The results show the potential of this detection method that is clearly beneficial for the development of a system for welding joint tracking.

Keywords
Laser beam welding, Joint tracking, Butt joints, Photodiode, Wavelet analysis
National Category
Manufacturing, Surface and Joining Technology
Research subject
Production Technology; ENGINEERING, Manufacturing and materials engineering
Identifiers
urn:nbn:se:hv:diva-12832 (URN)10.1016/j.optlastec.2018.08.006 (DOI)000446949600023 ()2-s2.0-85051138319 (Scopus ID)
Funder
Vinnova, 2016-03291
Note

Funding: People Programme (Marie Curie Actions) of the European Union's Seventh Framework Programme (FP7/2007-2013) under REA grant agreement no 608473 (MoRE program project "Hy-Las"

Available from: 2018-08-21 Created: 2018-08-21 Last updated: 2021-02-03Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-8771-7404

Search in DiVA

Show all publications