IEEE/CAA Journal of Automatica Sinica
Citation: | W. Xu, C. Zhao, J. Cheng, Y. Wang, Y. Q. Tang, T. Zhang, Z. M. Yuan, Y. S. Lv, and F.-Y. Wang, “Transformer-based macroscopic regulation for high-speed railway timetable rescheduling,” IEEE/CAA J. Autom. Sinica, vol. 10, no. 9, pp. 1822–1833, Sept. 2023. doi: 10.1109/JAS.2023.123501 |
[1] |
I. A. Hansen, Railway Timetable & Traffic: Analysis, Modelling, Simulation. Hamburg, Germany: Eurailpress, 2008.
|
[2] |
P. Xu, F. Corman, Q. Peng, and X. Luan, “A train rescheduling model integrating speed management during disruptions of high-speed traffic under a quasi-moving block system,” Transportation Research Part B: Methodological, vol. 104, pp. 638–666, 2017. doi: 10.1016/j.trb.2017.05.008
|
[3] |
L. Chen, L. Shi, Q. Zhou, H. Sheng, and Y. Cheng, “Secure bipartite tracking control for linear leader-following multiagent systems under denial-of-service attacks,” IEEE/CAA J. Autom. Sinica, vol. 9, no. 8, pp. 1512–1515, 2022. doi: 10.1109/JAS.2022.105758
|
[4] |
G. Wang, J. Wu, R. He, and B. Tian, “Speed and accuracy tradeoff for lidar data based road boundary detection,” IEEE/CAA J. Autom. Sinica, vol. 8, no. 6, pp. 1210–1220, 2021. doi: 10.1109/JAS.2020.1003414
|
[5] |
H. Dong, X. Liu, M. Zhou, W. Zheng, J. Xun, S. Gao, H. Song, Y. Li, and F.-Y. Wang, “Integration of train control and online rescheduling for high-speed railways in case of emergencies,” IEEE Trans. Computational Social Systems, vol. 9, no. 5, pp. 1574–1582, 2022. doi: 10.1109/TCSS.2021.3119944
|
[6] |
B. Ning, H. Dong, W. Zheng, J. Xun, S. Gao, H. Wang, L. Meng, and Y. Li, “Integration of train control and online rescheduling for high-speed railways: challenges and future,” Acta Autom. Sinica, vol. 45, no. 12, pp. 2208–2217, 2019.
|
[7] |
B. Ning, “Parallel rail transportation system,” Chinese J. Intelligent Science and Technology, vol. 1, no. 3, p. 215, 2019.
|
[8] |
S. Zhan, L. G. Kroon, L. Veelenturf, and J. C. Wagenaar, “Real-time high-speed train rescheduling in case of a complete blockage,” Transportation Research Part B: Methodological, vol. 78, pp. 182–201, 2015. doi: 10.1016/j.trb.2015.04.001
|
[9] |
X. Wu, M. Yang, W. Lian, M. Zhou, H. Wang, and H. Dong, “Cascading delays for the high-speed rail network under different emergencies: A double layer network approach,” IEEE/CAA J. Autom. Sinica, 2023. DOI: 10.1109/JAS.2022.105530
|
[10] |
A. D'Ariano, F. Corman, D. Pacciarelli, and M. Pranzo, “Reordering and local rerouting strategies to manage train traffic in real time,” Transportation Science, vol. 42, no. 4, pp. 405–419, 2008. doi: 10.1287/trsc.1080.0247
|
[11] |
T. Zhang, D. Shen, S. Jiang, and H. Xu, “Adaptive fixed-time antilock control of levitation system of high-speed maglev train,” IEEE Trans. Intelligent Vehicles, vol. 8, no. 5, pp. 3394–3404, May 2023. doi: 10.1109/TIV.2022.3158619
|
[12] |
S. Roy and A. Maji, “High-speed rail station location optimization using customized utility functions,” IEEE Intelligent Transportation Systems Magazine, vol. 15, no. 3, pp. 26–35, 2023. doi: 10.1109/MITS.2022.3207411
|
[13] |
L. Veelenturf, M. Kidd, V. Cacchiani, L. G. Kroon, and Toth, “A railway timetable rescheduling approach for handling large-scale disruptions,” Transportation Science, vol. 50, no. 3, pp. 841–862, 2016. doi: 10.1287/trsc.2015.0618
|
[14] |
J. Bi, H. Yuan, J. Zhai, M. Zhou, and H. V. Poor, “Self-adaptive bat algorithm with genetic operations,” IEEE/CAA J. Autom. Sinica, vol. 9, no. 7, pp. 1284–1294, 2022. doi: 10.1109/JAS.2022.105695
|
[15] |
M. Zhou, H. Dong, X. Liu, H. Zhang, and F.-Y. Wang, “Integrated timetable rescheduling for multidispatching sections of high-speed railways during large-scale disruptions,” IEEE Trans. Computational Social Systems, vol. 9, no. 2, pp. 366–375, 2022. doi: 10.1109/TCSS.2021.3069754
|
[16] |
B. Fan, C. Roberts, and P. Weston, “A comparison of algorithms for minimising delay costs in disturbed railway traffic scenarios,” J. Rail Transport Planning & Management, vol. 2, no. 1–2, pp. 23–33, 2012.
|
[17] |
B. B. Schasfoort, K. Gkiotsalitis, O. A. Eikenbroek, and E. C. Van Berkum, “A dynamic model for real-time track assignment at railway yards,” J. Rail Transport Planning &Management, vol. 14, p. 100198, 2020.
|
[18] |
L. Li, Y. Lin, N. Zheng, and F.-Y. Wang, “Parallel learning: A perspective and a framework,” IEEE/CAA J. Autom. Sinica, vol. 4, no. 3, pp. 389–395, 2017. doi: 10.1109/JAS.2017.7510493
|
[19] |
Q. Miao, Y. Lv, M. Huang, X. Wang, and F.-Y. Wang, “Parallel learning: Overview and perspective for computational learning across Syn2Real and Sim2Real,” IEEE/CAA J. Autom. Sinica, vol. 10, no. 3, pp. 1284–1294, 2023.
|
[20] |
F.-Y. Wang, “Agent-based control for networked traffic management systems,” IEEE Intelligent Systems, vol. 20, no. 5, pp. 92–96, 2005. doi: 10.1109/MIS.2005.80
|
[21] |
Z. Li, C. Chen, and K. Wang, “Cloud computing for agent-based urban transportation systems,” IEEE Intelligent Systems, vol. 26, no. 1, pp. 73–79, 2011. doi: 10.1109/MIS.2011.10
|
[22] |
F.-Y. Wang, “Parallel control and management for intelligent transportation systems: Concepts, architectures, and applications,” IEEE Trans. Intelligent Transportation Systems, vol. 11, no. 3, pp. 630–638, 2010. doi: 10.1109/TITS.2010.2060218
|
[23] |
Y. Lv, Y. Chen, J. Jin, Z. Li, P. Ye, and F. Zhu, “Parallel transportation: Virtual-real interaction for intelligent traffic management and control,” Chinese J. Intelligent Science and Technology, vol. 1, no. 1, pp. 21–33, 2019.
|
[24] |
C. Zhao, Y. Lv, J. Jin, Y. Tian, J. Wang, and F.-Y. Wang, “DeCAST in TransVerse for parallel intelligent transportation systems and smart cities: Three decades and beyond,” IEEE Intelligent Transportation Systems Magazine, vol. 14, no. 6, pp. 6–17, 2022. doi: 10.1109/MITS.2022.3199557
|
[25] |
C. Zhao, X. Dai, Y. Lv, J. Niu, and Y. Lin, “Decentralized autonomous operations and organizations in TransVerse: Federated intelligence for smart mobility,” IEEE Trans. Systems,Man,and Cybernetics: Systems, vol. 53, no. 4, pp. 2062–2072, Apr. 2023. doi: 10.1109/TSMC.2022.3228914
|
[26] |
Y. Zhou, Y. Kou, and M. Zhou, “Bilevel memetic search approach to the soft-clustered vehicle routing problem,” Transportation Science, vol. 57, no. 3, pp. 701–716, 2022.
|
[27] |
Y. Zhou, W. Xu, Z.-H. Fu, and M. Zhou, “Multi-neighborhood simulated annealing-based iterated local search for colored traveling salesman problems,” IEEE Trans. Intelligent Transportation Systems, vol. 23, no. 9, pp. 16 072–16 082, 2022.
|
[28] |
H. Dong, H. Zhu, Y. Li, Y. Lv, S. Gao, Q. Zhang, and B. Ning, “Parallel intelligent systems for integrated high-speed railway operation control and dynamic scheduling,” IEEE Trans. Cybernetics, vol. 48, no. 12, pp. 3381–3389, 2018. doi: 10.1109/TCYB.2018.2852772
|
[29] |
F.-Y. Wang, “Toward a revolution in transportation operations: AI for complex systems,” IEEE Intelligent Systems, vol. 23, no. 6, pp. 8–13, 2008. doi: 10.1109/MIS.2008.112
|
[30] |
M. Ghahramani, Y. Qiao, M. C. Zhou, A. O’Hagan, and J. Sweeney, “AI-based modeling and data-driven evaluation for smart manufacturing processes,” IEEE/CAA J. Autom. Sinica, vol. 7, no. 4, pp. 1026–1037, 2020. doi: 10.1109/JAS.2020.1003114
|
[31] |
Y. Lv, Y. Duan, W. Kang, Z. Li, and F.-Y. Wang, “Traffic flow prediction with big data: A deep learning approach,” IEEE Trans. Intelligent Transportation Systems, vol. 16, no. 2, pp. 865–873, 2015.
|
[32] |
Y. Lv, Y. Chen, L. Li, and F.-Y. Wang, “Generative adversarial networks for parallel transportation systems,” IEEE Intelligent Transportation Systems Magazine, vol. 10, no. 3, pp. 4–10, 2018. doi: 10.1109/MITS.2018.2842249
|
[33] |
L. Li, X. Wang, K. Wang, Y. Lin, J. Xin, L. Chen, L. Xu, B. Tian, Y. Ai, J. Wang, D. Cao, Y. Liu, C. Wang, N. Zheng, and F.-Y. Wang, “Parallel testing of vehicle intelligence via virtual-real interaction,” Science Robotics, vol. 4, no. 28, p. eaaw4106, 2019. doi: 10.1126/scirobotics.aaw4106
|
[34] |
Y. Chen, H. Chen, P. Ye, Y. Lv, and F.-Y. Wang, “Acting as a decision maker: Traffic-condition-aware ensemble learning for traffic flow prediction,” IEEE Trans. Intelligent Transportation Systems, vol. 23, no. 4, pp. 3190–3200, 2022. doi: 10.1109/TITS.2020.3032758
|
[35] |
Z. Li, G. Xiong, Y. Tian, Y. Lv, Y. Chen, P. Hui, and X. Su, “A multi-stream feature fusion approach for traffic prediction,” IEEE Trans. Intelligent Transportation Systems, vol. 23, no. 2, pp. 1456–1466, 2022. doi: 10.1109/TITS.2020.3026836
|
[36] |
Z. Zhang, H. Liu, M. Zhou, and J. Wang, “Solving dynamic traveling salesman problems with deep reinforcement learning,” IEEE Trans. Neural Networks and Learning Systems, vol. 34, no. 4, pp. 2119–2132, Apr. 2023. doi: 10.1109/TNNLS.2021.3105905
|
[37] |
J. Wang, Q. Zhang, and D. Zhao, “Highway lane change decision-making via attention-based deep reinforcement learning,” IEEE/CAA J. Autom. Sinica, vol. 9, no. 3, pp. 567–569, 2022. doi: 10.1109/JAS.2021.1004395
|
[38] |
B. Li, G. Wu, Y. He, M. Fan, and W. Pedrycz, “An overview and experimental study of learning-based optimization algorithms for the vehicle routing problem,” IEEE/CAA J. Autom. Sinica, vol. 9, no. 7, pp. 1115–1138, 2022. doi: 10.1109/JAS.2022.105677
|
[39] |
D. Šemrov, R. Marsetič, M. Žura, L. Todorovski, and A. Srdic, “Reinforcement learning approach for train rescheduling on a single-track railway,” Transportation Research Part B: Methodological, vol. 86, pp. 250–267, 2016. doi: 10.1016/j.trb.2016.01.004
|
[40] |
H. Khadilkar, “A scalable reinforcement learning algorithm for scheduling railway lines,” IEEE Trans. Intelligent Transportation Systems, vol. 20, no. 2, pp. 727–736, 2018.
|
[41] |
I. Gong, S. Oh, and Y. Min, “Train scheduling with deep Q-network: A feasibility test,” Applied Sciences, vol. 10, no. 23, p. 8367, 2020. doi: 10.3390/app10238367
|
[42] |
Y. Zhu, H. Wang, and R. M. Goverde, “Reinforcement learning in railway timetable rescheduling,” in Proc. IEEE 23rd Int. Conf. Intelligent Transportation Systems, 2020, pp. 1–6.
|
[43] |
M. Obara, T. Kashiyama, and Y. Sekimoto, “Deep reinforcement learning approach for train rescheduling utilizing graph theory,” in Proc. IEEE Int. Conf. Big Data, 2018, pp. 4525–4533.
|
[44] |
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in Neural Information Processing Systems, vol. 30, pp. 5998–6008, 2017.
|
[45] |
A. Higgins, E. Kozan, and L. Ferreira, “Optimal scheduling of trains on a single line track,” Transportation Research Part B: Methodological, vol. 30, no. 2, pp. 147–161, 1996. doi: 10.1016/0191-2615(95)00022-4
|
[46] |
A. D’ariano, D. Pacciarelli, and M. Pranzo, “A branch and bound algorithm for scheduling trains in a railway network,” European J. Operational Research, vol. 183, no. 2, pp. 643–657, 2007. doi: 10.1016/j.ejor.2006.10.034
|
[47] |
L. Xia, J. Xu, Y. Lan, J. Guo, W. Zeng, and X. Cheng, “Adapting markov decision process for search result diversification,” in Proc. 40th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, 2017, pp. 535–544.
|
[48] |
I. Amit and D. Goldfarb, “The timetable problem for railways,” Developments in Operations Research, vol. 2, no. 1, pp. 379–387, 1971.
|
[49] |
S. Araya, K. Abe, and K. Fukumori, “An optimal rescheduling for online train traffic control in disturbed situations,” in Proc. IEEE Conf. Decision and Control, 1983, pp. 489–494.
|
[50] |
R. L. Sauder and W. M. Westerman, “Computer aided train dispatching: Decision support through optimization,” Interfaces, vol. 13, no. 6, pp. 24–37, 1983. doi: 10.1287/inte.13.6.24
|
[51] |
J. Rodriguez, “A constraint programming model for real-time train scheduling at junctions,” Transportation Research Part B: Methodological, vol. 41, no. 2, pp. 231–245, 2007. doi: 10.1016/j.trb.2006.02.006
|
[52] |
S. Li, Y. Liu, and X. Qu, “Model controlled prediction: A reciprocal alternative of model predictive control,” IEEE/CAA J. Autom. Sinica, vol. 9, no. 6, pp. 1107–1110, 2022. doi: 10.1109/JAS.2022.105611
|
[53] |
F. Corman, A. D’Ariano, D. Pacciarelli, and M. Pranzo, “A tabu search algorithm for rerouting trains during rail operations,” Transportation Research Part B: Methodological, vol. 44, no. 1, pp. 175–192, 2010. doi: 10.1016/j.trb.2009.05.004
|
[54] |
S. Dündar and İ. Şahin, “Train re-scheduling with genetic algorithms and artificial neural networks for single-track railways,” Transportation Research Part C: Emerging Technologies, vol. 27, pp. 1–15, 2013. doi: 10.1016/j.trc.2012.11.001
|
[55] |
H. Khadilkar, “Scheduling of vehicle movement in resource-constrained transportation networks using a capacity-aware heuristic,” in Proc. American Control Conf., 2017, pp. 5617–5622.
|
[56] |
M. Wang, L. Wang, X. Xu, Y. Qin, and L. Qin, “Genetic algorithm-based particle swarm optimization approach to reschedule high-speed railway timetables: A case study in China,” J. Advanced Transportation, vol. 2019, pp. 1–12, 2019. doi: 10.1155/2019/6090742
|
[57] |
F. Corman and L. Meng, “A review of online dynamic models and algorithms for railway traffic management,” IEEE Trans. Intelligent Transportation Systems, vol. 16, no. 3, pp. 1274–1284, 2014.
|
[58] |
V. Cacchiani, D. Huisman, M. Kidd, L. Kroon, P. Toth, L. Veelenturf, and J. Wagenaar, “An overview of recovery models and algorithms for real-time railway rescheduling,” Transportation Research Part B: Methodological, vol. 63, pp. 15–37, 2014. doi: 10.1016/j.trb.2014.01.009
|
[59] |
W. Fang, S. Yang, and X. Yao, “A survey on problem models and solution approaches to rescheduling in railway networks,” IEEE Trans. Intelligent Transportation Systems, vol. 16, no. 6, pp. 2997–3016, 2015. doi: 10.1109/TITS.2015.2446985
|
[60] |
Q. Wu, C. Cole, and T. McSweeney, “Applications of particle swarm optimization in the railway domain,” Int. J. Rail Transportation, vol. 4, no. 3, pp. 167–190, 2016. doi: 10.1080/23248378.2016.1179599
|
[61] |
K. Arulkumaran, M. Deisenroth, M. Brundage, and A. A. Bharath, “Deep reinforcement learning: A brief survey,” IEEE Signal Processing Magazine, vol. 34, no. 6, pp. 26–38, 2017. doi: 10.1109/MSP.2017.2743240
|
[62] |
L. Li, Y. Lv, and F.-Y. Wang, “Traffic signal timing via deep reinforcement learning,” IEEE/CAA J. Autom. Sinica, vol. 3, no. 3, pp. 247–254, 2016. doi: 10.1109/JAS.2016.7508798
|
[63] |
X. Chen, G. Xiong, Y. Lv, Y. Chen, B. Song, and F.-Y. Wang, “A collaborative communication-Qmix approach for large-scale networked traffic signal control,” in Proc. IEEE Int. Intelligent Transportation Systems Conf., 2021, pp. 3450–3455.
|
[64] |
J. Xi, F. Zhu, Y e, Y. Lv, H. Tang, and F.-Y. Wang, “HMDRL: Hierarchical mixed deep reinforcement learning to balance vehicle supply and demand,” IEEE Trans. Intelligent Transportation Systems, vol. 23, no. 11, pp. 21861–21872, 2022. doi: 10.1109/TITS.2022.3191752
|
[65] |
C. Zhang, F. Zhu, X. Wang, L. Sun, H. Tang, and Y. Lv, “Taxi demand prediction using parallel multi-task learning model,” IEEE Trans. Intelligent Transportation Systems, vol. 23, no. 2, pp. 794–803, 2022. doi: 10.1109/TITS.2020.3015542
|
[66] |
L. Ning, Y. Li, M. Zhou, H. Song, and H. Dong, “A deep reinforcement learning approach to high-speed train timetable rescheduling under disturbances,” in Proc. IEEE Intelligent Transportation Systems Conf., 2019, pp. 3469–3474.
|
[67] |
R. Wang, M. Zhou, Y. Li, Q. Zhang, and H. Dong, “A timetable rescheduling approach for railway based on monte carlo tree search,” in Proc. IEEE Intelligent Transportation Systems Conf., 2019, pp. 3738–3743.
|
[68] |
C. Zhao, X. Dai, X. Wang, L. Li, Y. Lv, and F.-Y. Wang, “Learning Transformer-based cooperation for networked traffic signal control,” in Proc. IEEE 25th Int. Conf. Intelligent Transportation Systems, 2022, pp. 3133–3138.
|
[69] |
H. Song, S. Gao, Y. Li, L. Liu, and H. Dong, “Train-centric communication based autonomous train control system,” IEEE Trans. Intelligent Vehicles, vol. 8, no. 1, pp. 721–731, Jan. 2023. doi: 10.1109/TIV.2022.3192476
|
[70] |
T. Song, H. Pu, Schonfeld, and J. Hu, “Railway alignment optimization under uncertainty with a minimax robust method,” IEEE Intelligent Transportation Systems Magazine, vol. 15, no. 1, pp. 333–346, 2022.
|
[71] |
L. Ning, M. Zhou, Z. Hou, R. M. Goverde, F.-Y. Wang, and H. Dong, “Deep deterministic policy gradient for high-speed train trajectory optimization,” IEEE Trans. Intelligent Transportation Systems, vol. 23, no. 8, pp. 11562–11574, 2022. doi: 10.1109/TITS.2021.3105380
|
[72] |
L. Zhu, X. Li, D. Huang, H. Dong, and L. Cai, “Distributed cooperative fault-tolerant control of high-speed trains with input saturation and actuator faults,” IEEE Trans. Intelligent Vehicles, vol. 8, no. 2, pp. 1241–1251, Feb. 2023. doi: 10.1109/TIV.2022.3168550
|
[73] |
A. Torralba, M. Garcia-Castellano, M. Hernandez-Gonzalez, J. Garcia-Martin, V. Perez-Mira, R. Fernandez-Sanzo, A. Jacome-Moreno, and F. J. Gutierrez-Rumbao, “Smart railway operation aid system for facilities with low-safety requirements,” IEEE Intelligent Transportation Systems Magazine, vol. 13, no. 3, pp. 253–267, 2021. doi: 10.1109/MITS.2019.2962148
|
[74] |
Q. Pu, X. Zhu, R. Zhang, J. Liu, D. Cai, and G. Fu, “Multiobjective optimization on the operation speed profile design of an urban railway train with a hybrid running strategy,” IEEE Intelligent Transportation Systems Magazine, vol. 14, no. 4, pp. 230–243, 2022. doi: 10.1109/MITS.2021.3066067
|
[75] |
G. Zhu, R. Sun, X. Sun, Y. Wei, and B. Wu, “Parallel and collaborative passenger flow control of urban rail transit under comprehensive emergency situation,” IEEE Trans. Intelligent Vehicles, vol. 8, no. 4, pp. 2842–2856, Apr. 2023. doi: 10.1109/TIV.2023.3235109
|
[76] |
Y. Wang, Y. Lv, J. Zhou, Z. Yuan, Q. Zhang, and M. Zhou, “A policy-based reinforcement learning approach for high-speed railway timetable rescheduling,” in Proc. IEEE Int. Intelligent Transportation Systems Conf., 2021, pp. 2362–2367.
|