| Citation: | H. Li, S. Zhu, and Y. Song, “Hierarchical knowledge masking for edge-deployable mixed language models,” IEEE/CAA J. Autom. Sinica, vol. 13, no. 11, pp. 2620–2622, Nov. 2026. doi: 10.1109/JAS.2025.125933 |
| [1] |
Y. Chen and S. Chu, “Large language models in wargaming: Methodology, application, and robustness,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 2024, pp. 2894−2903.
|
| [2] |
P. K. Davis and P. Bracken, “Artificial intelligence for wargaming and modeling,” J. Def. Model. Simul., vol. 22, no. 1, pp. 25−40, Jan. 2025. doi: 10.1177/15485129211073126
|
| [3] |
J. Devlin, M. W. Chang, K. Lee, et al., “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proc. Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota, 2019, pp. 4171−4186.
|
| [4] |
Y. Sun, S. Wang, Y. Li, et al., “ERNIE: Enhanced representation through knowledge integration,” arXiv preprint arXiv: 1904.09223, 2019.
|
| [5] |
Z. Zhang, X. Han, Z. Liu, et al., “ERNIE: Enhanced language representation with informative entities,” in Proc. 57th Annu. Meeting of the Association for Computational Linguistics, Florence, Italy, 2019, pp. 1441−1451.
|
| [6] |
B. He, D. Zhou, J. Xiao, et al., “BERT-MK: Integrating graph contextualized knowledge into pre-trained language models,” in Proc. Findings of the Association for Computational Linguistics, 2020, pp. 2281−2290.
|
| [7] |
Y. Zhang, Z. Chen, Y. Fang, et al., “Knowledgeable preference alignment for LLMs in domain-specific question answering,” in Proc. Findings of the Association for Computational Linguistics, Bangkok, Thailand, 2024, pp. 891−904.
|
| [8] |
Y. Qin, Y. Lin, R. Takanobu, et al., “ERICA: Improving entity and relation understanding for pre-trained language models via contrastive learning,” in Proc. 59th Annu. Meeting of the Association for Computational Linguistics and the 11th Int. Joint Conf. Natural Language Processing, 2021, pp. 3350−3363.
|
| [9] |
A. Vaswani, N. Shazeer, N. Parmar, et al., “Attention is all you need,” Proc. 31st Int. Conf. Neural Information Processing Systems, Long Beach, CA, USA, 2017, 6000–6010.
|
| [10] |
M. Joshi, D. Chen, Y. Liu, et al., “SpanBERT: Improving pre-training by representing and predicting spans,” Trans. Assoc. Comput. Ling., vol. 8, pp. 64−77, Jan. 2020.
|
| [11] |
Y. Sun, S. Wang, Y. Li, et al., “ERNIE 2.0: A continual pre-training framework for language understanding,” in Proc. 34th AAAI Conf. Artificial Intelligence, New York, NY, USA, 2020, pp. 8968−8975.
|
| [12] |
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in Proc. 3rd Int. Conf. Learning Representations, San Diego, USA, 2015.
|
| [13] |
P. A. Azad and H. Beigy, “Multi-BERT: Leveraging adapters for low-resource multi-domain adaptation,” in Proc. 10th Workshop Noisy and User-generated Text, Albuquerque, USA, 2025, pp. 108−116.
|
| [14] |
T. Wolf, L. Debut, V. Sanh, et al., “Transformers: State-of-the-art natural language processing,” in Proc. Conf. Empirical Methods in Natural Language Processing: System Demonstrations, 2020, pp. 38−45.
|
JAS-2025-0664_Supplementary Materials.pdf
|
|