A literature review on deep reinforcement learning for machine scheduling problems

IF 14.9 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL Journal of Manufacturing Systems Pub Date : 2026-04-01 Epub Date: 2026-01-12 DOI:10.1016/j.jmsy.2025.12.017
Constantin Waubert de Puiseau , Furkan Ercan , Jannik Peters , Marvin Brune , Hasan Tercan , Christopher Prinz , Tobias Meisen , Bernd Kuhlenkötter
{"title":"A literature review on deep reinforcement learning for machine scheduling problems","authors":"Constantin Waubert de Puiseau ,&nbsp;Furkan Ercan ,&nbsp;Jannik Peters ,&nbsp;Marvin Brune ,&nbsp;Hasan Tercan ,&nbsp;Christopher Prinz ,&nbsp;Tobias Meisen ,&nbsp;Bernd Kuhlenkötter","doi":"10.1016/j.jmsy.2025.12.017","DOIUrl":null,"url":null,"abstract":"<div><div>Machine scheduling represents a core challenge in industrial production systems due to its inherently complex combinatorial nature and its critical role in enhancing operational efficiency. With recent advances in artificial intelligence, deep reinforcement learning (DRL) has gained increasing attention as an innovative tool to address scheduling tasks with a self-adapting, data-driven approach. This survey presents a comprehensive review of 143 publications between 2018 and February 2025 that apply DRL to machine scheduling problems. We develop a structured framework to classify and compare problem settings, algorithmic designs, and evaluation methodologies. Key aspects such as action and observation space design, reward functions, neural network architectures, and experimental benchmarks are systematically analyzed. The review identifies current trends, outlines promising patterns, and highlights open research opportunities for DRL-based scheduling solutions. The goal of this survey is to make the rapidly evolving research landscape more accessible to both academics and practitioners and to identify the next steps in research and application. To facilitate reproducible research and customized analysis, we publish the dataset underpinning this review, which includes 61 annotated features per publication, allowing for customizable filtering and further in-depth exploration of niches within the field. This dataset is publicly accessible <span><span>online</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"85 ","pages":"Pages 96-126"},"PeriodicalIF":14.9000,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278612525003140","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/12 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0

Abstract

Machine scheduling represents a core challenge in industrial production systems due to its inherently complex combinatorial nature and its critical role in enhancing operational efficiency. With recent advances in artificial intelligence, deep reinforcement learning (DRL) has gained increasing attention as an innovative tool to address scheduling tasks with a self-adapting, data-driven approach. This survey presents a comprehensive review of 143 publications between 2018 and February 2025 that apply DRL to machine scheduling problems. We develop a structured framework to classify and compare problem settings, algorithmic designs, and evaluation methodologies. Key aspects such as action and observation space design, reward functions, neural network architectures, and experimental benchmarks are systematically analyzed. The review identifies current trends, outlines promising patterns, and highlights open research opportunities for DRL-based scheduling solutions. The goal of this survey is to make the rapidly evolving research landscape more accessible to both academics and practitioners and to identify the next steps in research and application. To facilitate reproducible research and customized analysis, we publish the dataset underpinning this review, which includes 61 annotated features per publication, allowing for customizable filtering and further in-depth exploration of niches within the field. This dataset is publicly accessible online.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
机器调度问题中深度强化学习的文献综述
机器调度是工业生产系统的核心挑战,因为它本身具有复杂的组合性质,在提高运行效率方面具有关键作用。随着人工智能的最新进展,深度强化学习(DRL)作为一种创新工具,通过自适应、数据驱动的方法来解决调度任务,受到越来越多的关注。本调查对2018年至2025年2月期间将DRL应用于机器调度问题的143份出版物进行了全面审查。我们开发了一个结构化的框架来分类和比较问题设置、算法设计和评估方法。系统分析了行动和观察空间设计、奖励函数、神经网络架构和实验基准等关键方面。该综述确定了当前的趋势,概述了有希望的模式,并强调了基于drl的调度解决方案的开放研究机会。这项调查的目的是使快速发展的研究领域更容易为学者和从业者所了解,并确定研究和应用的下一步。为了促进可重复的研究和定制分析,我们发布了支持本综述的数据集,其中包括每篇出版物的61个注释功能,允许自定义过滤和进一步深入探索该领域的利基。此数据集可在线公开访问。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Manufacturing Systems
Journal of Manufacturing Systems 工程技术-工程:工业
CiteScore
23.30
自引率
13.20%
发文量
216
审稿时长
25 days
期刊介绍: The Journal of Manufacturing Systems is dedicated to showcasing cutting-edge fundamental and applied research in manufacturing at the systems level. Encompassing products, equipment, people, information, control, and support functions, manufacturing systems play a pivotal role in the economical and competitive development, production, delivery, and total lifecycle of products, meeting market and societal needs. With a commitment to publishing archival scholarly literature, the journal strives to advance the state of the art in manufacturing systems and foster innovation in crafting efficient, robust, and sustainable manufacturing systems. The focus extends from equipment-level considerations to the broader scope of the extended enterprise. The Journal welcomes research addressing challenges across various scales, including nano, micro, and macro-scale manufacturing, and spanning diverse sectors such as aerospace, automotive, energy, and medical device manufacturing.
期刊最新文献
A data-driven framework for sub-bottleneck detection in sequential production systems based on the Steptime methodology Proactive optimization of the molten aluminum supply system in mega low-pressure die-casting RDE-Net: An RGB-Depth-EMG fusion network for real-time fine-grained action recognition in human-robot collaborative assembly Collaborative surface patterning through cascaded ergodic control and automatic task allocation Unified Embodiment Description for functional evaluation of used components in circular manufacturing systems
wanfang
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1