Advances in Production Engineering & Management
Volume 19 | Number 2 | June 2024 | pp 157–181
https://doi.org/10.14743/apem2024.2.499
Flexible Job-shop Scheduling Problem with parallel operations using Reinforcement Learning: An approach based on Heterogeneous Graph Attention Networks
Lv, Q.H.; Chen, J.; Chen, P.; Xun, Q.F.; Gao, L.
ABSTRACT AND REFERENCES (PDF) |
FULL ARTICLE TEXT (PDF)
A B S T R A C T
The Flexible Job-shop Scheduling Problem (FJSP) has received considerable scholarly attention as a classic problem. However, in practical industrial manufacturing scenarios, it is common for an operation to have multiple preceding parallel operations. This not only necessitates adhering to the sequential relationships inherent in FJSP but also requires ensuring that preceding operations are completed simultaneously whenever feasible. We term this scenario as the Flexible Job-shop Scheduling Problem with Parallel Operations (FJSP-PO), a pervasive challenge encountered across nearly every production line in real-world discrete manufacturing applications. Despite its prevalence, there is a noticeable scarcity of research on FJSP-PO in existing literature. Given the objective of synchronizing multiple preceding operations, FJSP-PO presents a broader solution space and more intricate optimization challenges compared to traditional FJSP. To address this, we propose an Attention Restart method based on Heterogeneous Graph Attention Networks (AR-HGAT). Leveraging a heterogeneous graph network structure and reinforcement learning, AR-HGAT learns the implicit features of operations and machines through node-level and semantic-level attention mechanisms. The AR mechanism is utilized to determine the optimal scheduling of operations at specific time slots. Compared to existing FJSP methods, our AR-HGAT approach demonstrates superior performance in terms of inference time and solution effectiveness. Furthermore, we conducted a comparative analysis using authentic operational data from companies and contrasted it with results obtained from an online tree search algorithm, thereby providing empirical validation of the effectiveness of the proposed AR-HGAT method.
A R T I C L E I N F O
Keywords • Flexible scheduling; Flexible Job-shop Scheduling Problem (FJSP); Unified scheduling model;
Parallel operations; Reinforcement learning; Heterogeneous Graph Networks; Attention Restart method based on Heterogeneous Graph Attention Networks (AR-HGAT)
Corresponding author • Gao, L.
Article history • Received 18 June 2024, Revised 25 June 2024, Accepted 29 June 2024
Published on-line • 29 August 2024
E X P O R T C I T A T I O N
» RIS format (EndNote, ProCite, RefWorks, and most other reference management software)
» BibTeX (JabRef, BibDesk, and other BibTeX-specific software)
» Plain text
