A journal of IEEE and CAA , publishes high-quality papers in English on original theoretical/experimental research and development in all areas of automation
Volume 6 Issue 1
Jan.  2019

IEEE/CAA Journal of Automatica Sinica

  • JCR Impact Factor: 11.8, Top 4% (SCI Q1)
    CiteScore: 17.6, Top 3% (Q1)
    Google Scholar h5-index: 77, TOP 5
Turn off MathJax
Article Contents
Long Chen, Xuemin Hu, Wei Tian, Hong Wang, Dongpu Cao and Fei-Yue Wang, "Parallel Planning: A New Motion Planning Framework for Autonomous Driving," IEEE/CAA J. Autom. Sinica, vol. 6, no. 1, pp. 236-246, Jan. 2019. doi: 10.1109/JAS.2018.7511186
Citation: Long Chen, Xuemin Hu, Wei Tian, Hong Wang, Dongpu Cao and Fei-Yue Wang, "Parallel Planning: A New Motion Planning Framework for Autonomous Driving," IEEE/CAA J. Autom. Sinica, vol. 6, no. 1, pp. 236-246, Jan. 2019. doi: 10.1109/JAS.2018.7511186

Parallel Planning: A New Motion Planning Framework for Autonomous Driving

doi: 10.1109/JAS.2018.7511186

the National Natural Science Foundation of China 61773414

the National Natural Science Foundation of China 61806076

Hubei Provincial Natural Science Foundation of China 2018CFB158

More Information
  • Motion planning is one of the most significant technologies for autonomous driving. To make motion planning models able to learn from the environment and to deal with emergency situations, a new motion planning framework called as "parallel planning" is proposed in this paper. In order to generate sufficient and various training samples, artificial traffic scenes are firstly constructed based on the knowledge from the reality. A deep planning model which combines a convolutional neural network (CNN) with the Long Short-Term Memory module (LSTM) is developed to make planning decisions in an end-toend mode. This model can learn from both real and artificial traffic scenes and imitate the driving style of human drivers. Moreover, a parallel deep reinforcement learning approach is also presented to improve the robustness of planning model and reduce the error rate. To handle emergency situations, a hybrid generative model including a variational auto-encoder (VAE) and a generative adversarial network (GAN) is utilized to learn from virtual emergencies generated in artificial traffic scenes. While an autonomous vehicle is moving, the hybrid generative model generates multiple video clips in parallel, which correspond to different potential emergency scenarios. Simultaneously, the deep planning model makes planning decisions for both virtual and current real scenes. The final planning decision is determined by analysis of real observations. Leveraging the parallel planning approach, the planner is able to make rational decisions without heavy calculation burden when an emergency occurs.


  • loading
  • [1]
    M. L. Cummings and S Guerlain, "Developing operator capacity estimates for supervisory control of autonomous vehicles, " Hum. Factors, vol. 49, no. 1, pp. 1-15, Feb. 2007. http://med.wanfangdata.com.cn/Paper/Detail/PeriodicalPaper_PM17315838
    X. S. Hu, H. Wang, and X. L. Tang, "Cyber-physical control for energy-saving vehicle following with connectivity, " IEEE Trans. Ind. Electron., vol. 64, no. 11, pp. 8578-8587, Nov. 2017. http://ieeexplore.ieee.org/document/7926369/
    C. Katrakazas, M. Quddus, W. H. Chen, and L. Deka, "Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions, " Transport. Res. C, vol. 60, pp. 416-442, Nov. 2015. http://www.sciencedirect.com/science/article/pii/S0968090X15003447
    S. M. Zhang, W. W. Deng, Q. R. Zhao, H. Sun, and B. Litkouhi, "Dynamic trajectory planning for vehicle autonomous driving, " in Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, Manchester, UK, 2013, pp. 4161-4166. http://ieeexplore.ieee.org/document/6722462/
    L. Zuo, Q. Guo, X. Xu, and H. Fu, "A hierarchical path planning approach based on A* and least-squares policy iteration for mobile robots, " Neurocomputing, vol. 170, pp. 257-266, Dec. 2015. http://dl.acm.org/citation.cfm?id=2827268
    R. X. Cui, Y. Li, and W. S. Yan, "Mutual information-based Multi-AUV path planning for scalar field sampling using multidimensional RRT, " IEEE Trans. Syst., Man, Cybern.: Syst., vol. 46, no. 7, pp. 993-1004, Jul. 2016. http://ieeexplore.ieee.org/document/7345594
    X. M. Hu, L. Chen, B. Tang, D. P. Cao, and H. B. He, "Dynamic path planning for autonomous driving on various roads with avoidance of static and moving obstacles, " Mech. Syst. Signal Process., vol. 100, pp. 482-500, Feb. 2018.
    S. M. LaValle, Planning Algorithms. Cambridge: Cambridge University Press, 2006.
    K. Fragkiadaki, P. Agrawal, S. Levine, and J. Malik, "Learning visual predictive models of physics for playing billiards, " arXiv: 1511.07404, 2015. http://arxiv.org/abs/1511.07404
    W. Z. Hu, Q. Zhuo, C. S. Zhang, and J. K. Li, "Fast branch convolutional neural network for traffic sign recognition, " IEEE Intellig. Transport. Syst. Mag., vol. 9, no. 3, pp. 114-126, Jul. 2017. http://ieeexplore.ieee.org/document/7990644/
    M. Kurdej, J. Moras, V. Cherfaoui, and P. Bonnifait, "Map-aided evidential grids for driving scene understanding, " IEEE Intellig. Transport. Syst. Mag., vol. 7, no. 1, pp. 30-41, Jan. 2015. http://ieeexplore.ieee.org/xpls/icp.jsp?arnumber=7014409
    T. Gindele, S. Brechtel, and R. Dillmann, "Learning driver behavior models from traffic observations for decision making and planning, " IEEE Intellig. Transport. Syst. Mag., vol. 7, no. 1, pp. 69-79, Jan. 2015. http://ieeexplore.ieee.org/xpls/icp.jsp?arnumber=7014400
    M. Pfeiffer, M. Schaeuble, J. Nieto, R. Siegwart, and C. Cadena, "From perception to decision: A data-driven approach to end-to-end motion planning for autonomous ground robots, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), Singapore, 2017, pp. 1527-1533. http://arxiv.org/abs/1609.07910
    F. Y. Wang, "Artificial societies, computational experiments, and parallel systems: A discussion on computational theory of complex social-economic systems, " Complex Syst. Complex. Sci., vol. 1, no. 4, pp. 25-35, Apr. 2004.
    F. Y. Wang, "Parallel system methods for management and control of complex systems, " Control Decision, vol. 19, no. 5, pp. 485-484, May 2004. http://en.cnki.com.cn/Article_en/CJFDTotal-KZYC200405001.htm
    F. Y. Wang, "Agent-based control for networked traffic management systems, " IEEE Intellig. Syst., vol. 20, no. 5, pp. 92-96, Sep.-Oct. 2005. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=IEEE%20Intelligent%20Systems&volume=20&issue=5&spage=92
    F. Y. Wang, "Toward a revolution in transportation operations: AI for complex systems, " IEEE Intellig. Syst., vol. 23, no. 6, pp. 8-13, Nov.-Dec. 2008. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=IEEE%20Intelligent%20Systems&volume=23&issue=6&spage=8
    N. Zhang, F. Y. Wang, F. H. Zhu, D. B. Zhao, and S. M. Tang, "DynaCAS: Computational experiments and decision support for ITS, " IEEE Intellig. Syst., vol. 23, no. 6, pp. 19-23, Nov.-Dec. 2008. http://gateway.proquest.com/openurl?res_dat=xri:pqm&ctx_ver=Z39.88-2004&rfr_id=info:xri/sid:baidu&rft_val_fmt=info:ofi/fmt:kev:mtx:article&genre=article&jtitle=IEEE%20Intelligent%20Systems&atitle=DynaCAS%3A%20Computational%20Experiments%20and%20Decision%20Support%20for%20ITS
    F. Y. Wang, "The emergence of intelligent enterprises: From CPS to CPSS, " IEEE Intellig. Syst., vol. 25, no. 4, pp. 85-88, Jul.-Aug. 2010. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=IEEE%20Intelligent%20Systems&volume=25&issue=4&spage=85
    F. Y. Wang, "Parallel control and management for intelligent transportation systems: concepts, architectures, and applications, " IEEE Trans. Intellig. Transport. Syst., vol. 11, no. 3, pp. 630-638, Sep. 2010. http://ieeexplore.ieee.org/document/5549912/
    F. Y. Wang, "Agent-based control strategies for smart and safe vehicles, " in Proc. IEEE Int. Conf. Vehicular Electronics and Safety, Shaan'xi, China, 2005, pp. 331-332.
    F. Y. Wang, "Scanning the issue and beyond: Parallel driving with software vehicular robots for safety and smartness, " IEEE Trans. Intellig. Transport. Syst., vol. 15, no. 4, pp. 1381-1387, Aug. 2014. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6871456
    T. X. Bai, S. Wang, Z. Shen, D. P. Cao, N. N. Zheng, and F. Y. Wang, "Parallel robotics and parallel unmanned systems: framework, structure, process, platform and applications, " Acta Autom. Sinica, vol. 43, no. 2, pp. 161-175, Feb. 2017. http://www.en.cnki.com.cn/Article_en/CJFDTOTAL-MOTO201702001.htm
    F. Y. Wang, N. N. Zheng, D. P. Cao, C. M. Martinez, L. Li, and T. Liu, "Parallel driving in CPSS: A unified approach for transport automation and vehicle intelligence, " IEEE/CAA J. Autom. Sinica, vol. 4, no. 4, pp. 577-587, Sep. 2017. http://www.cnki.com.cn/Article/CJFDTotal-ZDHB201704001.htm
    [25 K. F. Wang, C. Gou, and F. Y. Wang, "Parallel vision: An ACP-based approach to intelligent vision computing, " Acta Autom. Sinica, vol. 42, no. 10, pp. 1490-1500, Oct. 2016. http://www.en.cnki.com.cn/Article_en/CJFDTOTAL-MOTO201610003.htm
    P. Furgale and T. D. Barfoot, "Visual teach and repeat for long-range rover autonomy, " J. Field Robot., vol. 27, no. 5, pp. 534-560, Sep.-Oct. 2010. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=Journal%20of%20Field%20Robotics&volume=27&issue=5&spage=534
    M. Mathieu, C. Couprie, and Y. Lecun, "Deep multi-scale video prediction beyond mean square error, " arXiv: 1511.05440, 2015. http://arxiv.org/abs/1511.05440
    C. Y. Zhang and Y. L. Tian, "Automatic video description generation via LSTM with joint two-stream encoding, " in Proc. 23rd Int. Conf. Pattern Recognition, Cancun, Mexico, 2016, pp. 2924-2929. http://ieeexplore.ieee.org/document/7900081/
    D. P. Kingma and M. Welling, "Auto-encoding Variational Bayes, " In Proc. 2nd Int. Conf. Learning Representations (ICLR), Ithaca, NY, 2014. http://arxiv.org/abs/1312.6114
    Y. C. Pu, Z. Gan, R. Henao, X. Yuan, C. Y. Li, A. Stevens, and L. Carin, "Variational autoencoder for deep learning of images, labels and captions, " in Proc. 29th Conf. Neural Information Processing Systems (NIPS), Barcelona, Spain, 2016. http://arxiv.org/abs/1609.08976
    E. Santana, M. Emigh, and J. C. Principe, "Information theoretic-learning auto-encoder, " in Proc. Int. Joint Conf. Neural Networks, Vancouver, BC, Canada, 2016, pp. 3296-3301. http://ieeexplore.ieee.org/document/7727620/
    I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets, " in Advances in Neural Information Processing Systems 27, Montreal, Quebec, Canada, 2014, pp. 2672-2680. http://dl.acm.org/citation.cfm?id=2969125
    A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks, " arXiv: 1511.06434, 2015. http://arxiv.org/abs/1511.06434
    E. Denton, S. Chintala, A. Szlam, and R. Fergus, "Deep generative image models using a laplacian pyramid of adversarial networks, " arXiv: 1506.05751, 2015. http://dl.acm.org/citation.cfm?id=2969239.2969405
    C. Vondrick, H. Pirsiavash, and A. Torralba, "Generating videos with scene dynamics, " in Advances in Neural Information Processing Systems 29, Barcelona, Spain, 2016, pp. 613-621. http://arxiv.org/abs/1609.02612
    E. Santana and G. Hotz, "Learning a driving simulator, " arXiv: 1608.01230, 2016. http://arxiv.org/abs/1608.01230
    S. Sivaraman and M. M. Trivedi, "Looking at vehicles on the road: A survey of vision-based vehicle detection, tracking, and behavior analysis, " IEEE Trans. Intellig. Transport. Syst., vol. 14, no. 4, pp. 1773-1795, Dec. 2013. http://ieeexplore.ieee.org/document/6563169/


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索


    Article Metrics

    Article views (2342) PDF downloads(145) Cited by()


    DownLoad:  Full-Size Img  PowerPoint