A journal of IEEE and CAA , publishes high-quality papers in English on original theoretical/experimental research and development in all areas of automation

IEEE/CAA Journal of Automatica Sinica

  • JCR Impact Factor: 18.3, Top 1 (SCI Q1)
    CiteScore: 28.2, Top 1% (Q1)
    Google Scholar h5-index: 95, TOP 5
Turn off MathJax
Article Contents
H. Li, S. Zhu, and Y. Song, “Hierarchical knowledge masking for edge-deployable mixed language models,” IEEE/CAA J. Autom. Sinica, vol. 13, no. 11, pp. 2620–2622, Nov. 2026. doi: 10.1109/JAS.2025.125933
Citation: H. Li, S. Zhu, and Y. Song, “Hierarchical knowledge masking for edge-deployable mixed language models,” IEEE/CAA J. Autom. Sinica, vol. 13, no. 11, pp. 2620–2622, Nov. 2026. doi: 10.1109/JAS.2025.125933

Hierarchical Knowledge Masking for Edge-Deployable Mixed Language Models

doi: 10.1109/JAS.2025.125933
More Information
  • loading
  • [1]
    Y. Chen and S. Chu, “Large language models in wargaming: Methodology, application, and robustness,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 2024, pp. 2894−2903.
    [2]
    P. K. Davis and P. Bracken, “Artificial intelligence for wargaming and modeling,” J. Def. Model. Simul., vol. 22, no. 1, pp. 25−40, Jan. 2025. doi: 10.1177/15485129211073126
    [3]
    J. Devlin, M. W. Chang, K. Lee, et al., “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proc. Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota, 2019, pp. 4171−4186.
    [4]
    Y. Sun, S. Wang, Y. Li, et al., “ERNIE: Enhanced representation through knowledge integration,” arXiv preprint arXiv: 1904.09223, 2019.
    [5]
    Z. Zhang, X. Han, Z. Liu, et al., “ERNIE: Enhanced language representation with informative entities,” in Proc. 57th Annu. Meeting of the Association for Computational Linguistics, Florence, Italy, 2019, pp. 1441−1451.
    [6]
    B. He, D. Zhou, J. Xiao, et al., “BERT-MK: Integrating graph contextualized knowledge into pre-trained language models,” in Proc. Findings of the Association for Computational Linguistics, 2020, pp. 2281−2290.
    [7]
    Y. Zhang, Z. Chen, Y. Fang, et al., “Knowledgeable preference alignment for LLMs in domain-specific question answering,” in Proc. Findings of the Association for Computational Linguistics, Bangkok, Thailand, 2024, pp. 891−904.
    [8]
    Y. Qin, Y. Lin, R. Takanobu, et al., “ERICA: Improving entity and relation understanding for pre-trained language models via contrastive learning,” in Proc. 59th Annu. Meeting of the Association for Computational Linguistics and the 11th Int. Joint Conf. Natural Language Processing, 2021, pp. 3350−3363.
    [9]
    A. Vaswani, N. Shazeer, N. Parmar, et al., “Attention is all you need,” Proc. 31st Int. Conf. Neural Information Processing Systems, Long Beach, CA, USA, 2017, 6000–6010.
    [10]
    M. Joshi, D. Chen, Y. Liu, et al., “SpanBERT: Improving pre-training by representing and predicting spans,” Trans. Assoc. Comput. Ling., vol. 8, pp. 64−77, Jan. 2020.
    [11]
    Y. Sun, S. Wang, Y. Li, et al., “ERNIE 2.0: A continual pre-training framework for language understanding,” in Proc. 34th AAAI Conf. Artificial Intelligence, New York, NY, USA, 2020, pp. 8968−8975.
    [12]
    D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in Proc. 3rd Int. Conf. Learning Representations, San Diego, USA, 2015.
    [13]
    P. A. Azad and H. Beigy, “Multi-BERT: Leveraging adapters for low-resource multi-domain adaptation,” in Proc. 10th Workshop Noisy and User-generated Text, Albuquerque, USA, 2025, pp. 108−116.
    [14]
    T. Wolf, L. Debut, V. Sanh, et al., “Transformers: State-of-the-art natural language processing,” in Proc. Conf. Empirical Methods in Natural Language Processing: System Demonstrations, 2020, pp. 38−45.
  • JAS-2025-0664_Supplementary Materials.pdf

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(5)  / Tables(3)

    Article Metrics

    Article views (22) PDF downloads(5) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return