Publications

2025

Ningyu Xu, Qi Zhang, Chao Du, Qiang Luo, Xipeng Qiu, Xuanjing Huang, and Menghan Zhang. 2025. Revealing emergent human-like conceptual representations from language prediction. Proceedings of the National Academy of Sciences. [paper] [code and data]

2024

Ningyu Xu, Qi Zhang, Menghan Zhang, Peng Qian, and Xuanjing Huang. 2024. On the Tip of the Tongue: Analyzing Conceptual Representation in Large Language Models with Reverse-Dictionary Probe. arXiv preprint arXiv:2402.14404. [paper] [pdf] [code]

2023

Ningyu Xu, Qi Zhang, Jingting Ye, Menghan Zhang, and Xuanjing Huang. 2023. Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization. In Findings of the Association for Computational Linguistics: EMNLP 2023. Association for Computational Linguistics. [paper] [pdf] [code]

2022

Ningyu Xu, Tao Gui, Ruotian Ma, Qi Zhang, Jingting Ye, Menghan Zhang, and Xuanjing Huang. 2022. Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. [paper] [pdf] [code]