| Citation: | Z. Chen, Z. Ma, C. Yang, F. Li, Y. Liu, and W. Gui, IEEE/CAA J. Autom. Sinica, early access, 2026. doi: 10.1109/JAS.2026.126173 |
| [1] |
A. Newell and H. Simon, “The logic theory machine–a complex information processing system,” IRE Trans. Inf. Theory, vol. 2, no. 3, pp. 61−79, Sep. 1956. doi: 10.7249/p868
|
| [2] |
J. A. Feldman and D. H. Ballard, “Connectionist models and their properties,” Cogn. Sci., vol. 6, no. 3, pp. 205−254, Jul. 1982. doi: 10.1207/s15516709cog0603_1
|
| [3] |
R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, vol. 1. Cambridge, MA, USA: MIT Press, 1998.
|
| [4] |
J. Tan, J. Shi, L. Wu, B. Chen, H. Tang, C. Zhang, W. Zhang, S. Wang, and J. Wan, “Embodied intelligence empowering customized manufacturing: Architecture, opportunities, and challenges,” IEEE Access, vol. 13, pp. 92740−92755, May 2025. doi: 10.1109/ACCESS.2025.3572778
|
| [5] |
H. Xue and F. D. Salim, “PromptCast: A new prompt-based learning paradigm for time series forecasting,” IEEE Trans. Knowl. Data Eng., vol. 36, no. 11, pp. 6851−6864, Nov. 2024. doi: 10.1109/TKDE.2023.3342137
|
| [6] |
D. Spathis and F. Kawsar, “The first step is the hardest: Pitfalls of representing and tokenizing temporal data for large language models,” J. Am. Med. Inform. Assoc., vol. 31, no. 9, pp. 2151−2158, Sep. 2024. doi: 10.1093/jamia/ocae090
|
| [7] |
Y. Duan, J. Zhou, Z. Wang, Y.-K. Wang, and C.-T. Lin, “DeWave: Discrete EEG waves encoding for brain dynamics to text translation,” in Proc. 37th Int. Conf. Neural Information Processing Systems, New Orleans, LA, USA, 2023, Art. no. 432.
|
| [8] |
D. Cao, F. Jia, S. Ö. Arik, T. Pfister, Y. Zheng, W. Ye, and Y. Liu, “TEMPO: Prompt-based generative pre-trained transformer for time series forecasting,” in Proc. 12th Int. Conf. Learning Representations, Vienna, Austria, 2024. (查阅网上资料, 未找到页码信息, 请确认补充)
|
| [9] |
M. Jin, S. Wang, L. Ma, Z. Chu, J. Y. Zhang, X. Shi, et al., “Time-LLM: Time series forecasting by reprogramming large language models,” in Proc. 12th Int. Conf. Learning Representations, Vienna, Austria, 2024. (查阅网上资料, 未找到页码信息, 请确认补充)
|
| [10] |
P. F. Christiano, J. Leike, T. B. Brown, M. Martic, S. Legg, and D. Amodei, “Deep reinforcement learning from human preferences,” in Proc. 31st Int. Conf. Neural Information Processing Systems, Long Beach, CA, USA, 2017, pp. 4302−4310.
|
| [11] |
M. Hwang, G. Lee, H. Kee, C. Kim, K. Lee, and S. Oh, “Sequential preference ranking for efficient reinforcement learning from human feedback,” in Proc. 37th Int. Conf. Neural Information Processing Systems, New Orleans, LA, USA, 2023, Art. no. 2133.
|
| [12] |
K. Lee, L. M. Smith, and P. Abbeel, “PEBBLE: Feedback-efficient interactive reinforcement learning via relabeling experience and unsupervised pre-training,” in Proc. 38th Int. Conf. Machine Learning, 2021, pp. 6152−6163. (查阅网上资料, 未找到对应的出版地信息, 请确认补充)
|
| [13] |
J. Park, Y. Seo, J. Shin, H. Lee, P. Abbeel, and K. Lee, “SURF: Semi-supervised reward learning with data augmentation for feedback-efficient preference-based reinforcement learning,” in Proc. 10th Int. Conf. Learning Representations, 2022. (查阅网上资料, 未找到对应的出版地及页码信息, 请确认补充)
|
| [14] |
B. Ibarz, J. Leike, T. Pohlen, G. Irving, S. Legg, and D. Amodei, “Reward learning from human preferences and demonstrations in Atari,” in Proc. 32nd Int. Conf. Neural Information Processing Systems, Montréal, Canada, 2018, pp. 8022−8034.
|
| [15] |
P. Barnett, R. Freedman, J. Svegliato, and S. Russell, “Active reward learning from multiple teachers,” in Proc. Workshop on Artificial Intelligence Safety 2023 co-located with the 37th AAAI Conf. Artificial Intelligence, Washington DC, USA, 2023.(查阅网上资料, 未找到对应的页码信息, 请确认补充)
|
| [16] |
A. Glaese, N. McAleese, M. Trębacz, J. Aslanides, V. Firoiu, T. Ewalds, et al., “Improving alignment of dialogue agents via targeted human judgements,” arXiv preprint arXiv: 2209.14375, 2022.
|
| [17] |
T. Everitt, V. Krakovna, L. Orseau, and S. Legg, “Reinforcement learning with a corrupted reward channel,” in Proc. 26th Int. Joint Conf. Artificial Intelligence, Melbourne, Australia, 2017, pp. 4705−4713.
|
| [18] |
A. Pan, K. Bhatia, and J. Steinhardt, “The effects of reward misspecification: Mapping and mitigating misaligned models,” in Proc. 10th Int. Conf. Learning Representations, 2022.(查阅网上资料, 未找到对应的出版地及页码信息, 请确认补充)
|
| [19] |
D. Dai, L. Dong, Y. Hao, Z. Sui, B. Chang, and F. Wei, “Knowledge neurons in pretrained transformers,” in Proc. 60th Annu. Meeting of the Association for Computational Linguistics, Dublin, Ireland, 2022, pp. 8493−8502.
|
| [20] |
E. Mitchell, C. Lin, A. Bosselut, C. Finn, and C. D. Manning, “Fast model editing at scale,” in Proc. 10th Int. Conf. Learning Representations, 2022.(查阅网上资料, 未找到对应的出版地及页码信息, 请确认补充)
|
| [21] |
J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. H. Chi, Q. V. Le, and D. Zhou, “Chain-of-thought prompting elicits reasoning in large language models,” in Proc. 36th Int. Conf. Neural Information Processing Systems, New Orleans, LA, USA, 2022, Art. no. 1800.
|
| [22] |
H. Trivedi, N. Balasubramanian, T. Khot, and A. Sabharwal, “Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions,” in Proc. 61st Annu. Meeting of the Association for Computational Linguistics, Toronto, Canada, 2023, pp. 10014−10037.
|
| [23] |
N. Varshney, W. Yao, H. Zhang, J. Chen, and D. Yu, “A stitch in time saves nine: Detecting and mitigating hallucinations of LLMs by validating low-confidence generation,” arXiv preprint arXiv: 2307.03987, 2023.
|
| [24] |
P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, et al., “Retrieval-augmented generation for knowledge-intensive NLP tasks,” in Proc. 34th Int. Conf. Neural Information Processing Systems, Vancouver, BC, Canada, 2020, Art. no. 793.
|
| [25] |
C. Yang, Y. Liu, K. Huang, B. Sun, Y. Li, X. Chen, and W. Gui, “Intelligent model library for nonferrous metal industry: Construction method and application,” Strategic Study CAE, vol. 24, no. 4, pp. 188−201, 2022.
|
| [26] |
Z.-P. Chen, J. Han, C.-H. Yang, and W.-H. Gui, “An exploration of a new paradigm for constructing industrial domain-specific embodied intelligent control large models,” Acta Autom. Sinica, vol. 51, no. 11, pp. 2454−2472, Nov. 2025.
|
| [27] |
Y. Wang, X. Yue, and W. Chen, “Critique fine-tuning: Learning to critique is more effective than learning to imitate,” arXiv preprint arXiv: 2501.17703, 2025.
|
| [28] |
E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “LoRA: Low-rank adaptation of large language models,” in Proc. 10th Int. Conf. Learning Representations, 2022. (查阅网上资料, 未找到对应的出版地及页码信息, 请确认补充)
|
| [29] |
Z. Hu, L. Wang, Y. Lan, W. Xu, E.-P. Lim, L. Bing, X. Xu, S. Poria, and R. Lee, “LLM-adapters: An adapter family for parameter-efficient fine-tuning of large language models,” in Proc. Conf. Empirical Methods in Natural Language Processing, Singapore, Singapore, 2023, pp. 5254−5276.
|
| [30] |
L. Fang, J. Shi, L. Wu, J. Tan, and J. Wan, “Perspectives and prospects on embodied intelligence-empowered smart manufacturing,” J. Intell. Manuf., 2026, DOI: 10.1007/s10845-025-02763-6.
|
| [31] |
A. Liu, B. Feng, B. Xue, B. Wang, B. Wu, C. Lu, et al., “DeepSeek-V3 technical report,” arXiv preprint arXiv: 2412.19437, 2024.
|
| [32] |
S. Wang, M. Hu, Q. Li, M. Safari, and X. Yang, “Capabilities of GPT-5 on multimodal medical reasoning,” arXiv preprint arXiv: 2508.08224, 2025.
|
| [33] |
G. Comanici, E. Bieber, M. Schaekermann, I. Pasupat, N. Sachdeva, I. Dhillon, et al., “Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities,” arXiv preprint arXiv: 2507.06261, 2025.
|
| [34] |
A. Grattafiori, A. Dubey, A. Jauhri, A. Pandey, A. Kadian, A. Al-Dahle, et al., “The llama 3 herd of models,” arXiv preprint arXiv: 2407.21783, 2024.
|
| [35] |
D. Guo, D. Yang, H. Zhang, J. Song, P. Wang, Q. Zhu, et al, “DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning,” Nature, vol. 645, no. 8081, pp. 633−638, Sep. 2025. doi: 10.1038/s41586-025-09422-z
|
| [36] |
A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, et al., “Qwen3 technical report,” arXiv preprint arXiv: 2505.09388, 2025.
|