Publications — after ChatGPT

• Nexus: An Omni-Perceptive And-Interactive Model for Language, Audio, And Vision
  Che Liu, Yingji Zhang, Dong Zhang, Weijie Zhang, Chenggong Gong, Haohan Li, Yu Lu, Shilin Zhou, Yue Lu, Ziliang Gan, Ziao Wang, Junwei Liao, Haipang Wu, Ji Liu, André Freitas, Qifan Wang, Zenglin Xu, Rongjuncheng Zhang, Yong Dai
  ACM MM 2025, arXiv: 2503.01879 ACM MM 2025, arXiv: 2503.01879

• MME-finance: A multimodal finance benchmark for expert-level understanding and reasoning
  Ziliang Gan, Yu Lu, Dong Zhang, Haohan Li, Che Liu, Jian Liu, Ji Liu, Haipang Wu, Chaoyou Fu, Zenglin Xu, Rongjunchen Zhang, Yong Dai
  ACM MM 2025 Dataset, arXiv:2411.03314 ACM MM 2025 Dataset, arXiv:2411.03314

• IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation
  Fan Lin, Shuyi Xie, Yong Dai*, Wenlin Yao, Tianjiao Lang, Zishan Xu, Zhichao Hu, Xiao Xiao, Yuhong Liu, Yu Zhang
  NeurIPS 2024, arXiv: 2409.18892 NeurIPS 2024, arXiv: 2409.18892

• Self-playing Adversarial Language Game Enhances LLM Reasoning
  Pengyu Cheng, Tianhao Hu, Han Xu, Zhisong Zhang, Yong Dai, Lei Han, Nan Du
  NeurIPS 2024, arXiv: 2404.10642 NeurIPS 2024, arXiv: 2404.10642

• On Diversified Preferences of Large Language Model Alignment
  Dun Zeng, Yong Dai*, Pengyu Cheng, Tianhao Hu, Wanshun Chen, Nan Du, Zenglin Xu
  EMNLP 2024 Findings, arXiv: 2312.07401 EMNLP 2024 Findings, arXiv: 2312.07401

• TencentLLMEval: a hierarchical evaluation of Real-World capabilities for human-aligned LLMs
  Shuyi Xie, Wenlin Yao, Yong Dai, Shaobo Wang, Donlin Zhou, Lifeng Jin, Xinhua Feng, Pengzhi Wei, Yujie Lin, Zhichao Hu, Dong Yu, Zhengyou Zhang, Jing Nie, Yuhong Liu
  arXiv:2311.05374 arXiv:2311.05374

• WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
  Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Yong Dai, Hongming Zhang, Zhenzhong Lan, Dong Yu
  ACL 2024, arXiv:2401.13919 ACL 2024, arXiv:2401.13919

• Adversarial Preference Optimization
  Pengyu Cheng, Yifan Yang, Jian Li, Yong Dai, Nan Du
  ACL 2024 Findings, arXiv:2311.08045 ACL 2024 Findings, arXiv:2311.08045

• Everyone deserves a reward: Learning customized human preferences
  Pengyu Cheng, Jiawen Xie, Ke Bai, Yong Dai, Nan Du
  arXiv:2309.03126 arXiv:2309.03126

• Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
  Jiawen Xie, Pengyu Cheng, Xiao Liang, Yong Dai, Nan Du
  ACL 2024, arXiv:2308.13191 ACL 2024, arXiv:2308.13191

Publications — pretrain techniques

• Is Whole Word Masking Always Better for Chinese BERT?”: Probing on Chinese Grammatical Error Correction
  Yong Dai, Linyang Li, Cong Zhou*, Zhangyin Feng, Enbo Zhao, Xipeng Qiu, Piji Li, Duyu Tang
  Findings of ACL 2022 Findings of ACL 2022

• Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
  Linyang Li ,Yong Dai, Duyu Tang, Xipeng Qiu, Zenglin Xu, Shuming Shi
  NLPCC 2023 NLPCC 2023

Publications — applications of PLMs

• Effidit: Your AI Writing Assistant
  Shuming Shi, Enbo Zhao, Duyu Tang, Yan Wang, Piji Li, Wei Bi, Haiyun Jiang, Guoping Huang, Leyang Cui, Xinting Huang, Cong Zhou, Yong Dai, Dongyang Ma
  arXiv:2208.01815 arXiv:2208.01815

• One model, multiple modalities: A sparsely activated approach for text, sound, image, video and code
  Yong Dai, Duyu Tang, Liangxin Liu, Minghuan Tan, Cong Zhou, Jingquan Wang, Zhangyin Feng, Fan Zhang, Xueyu Hu, Shuming Shi
  Under review Under review

• SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills
  Zhangyin Feng, Yong Dai, Fan Zhang, Duyu Tang, Xiaocheng Feng, Shuangzhi Wu, Bing Qin, Yunbo Cao, Shuming Shi
  ICASSP 2024 ICASSP 2024

• Emage: Non-Autoregressive Text-to-Image Generation
  Zhangyin Feng, Runyi Hu, Liangxin Liu, Fan Zhang, Duyu Tang,Yong Dai, Xiaocheng Feng, Jiwei Li, Bing Qin, Shuming Shi
  arXiv:2312.14988 arXiv:2312.14988

• Exploring and Adapting Chinese GPT to Pinyin Input Method
  Minghuan Tan, Yong Dai, Duyu Tang, Zhangyin Feng, Guoping Huang, Jing Jiang, Jiwei Li, Shuming Shi
  ACL 2022 ACL 2022

• Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors
  Cong Zhou, Yong Dai, Duyu Tang, Enbo Zhao, Zhangyin Feng, Li Kuang, Shuming Shi
  arXiv:2204.12052 arXiv:2204.12052

• When Federated Learning Meets Pre-trained Language Models’ Parameter-Efficient Tuning Methods
  Zhuo Zhang, Yuanhang Yang, Yong Dai, Lizhen Qu, Zenglin Xu
  Findings of ACL 2023 Findings of ACL 2023

• Skillnet-nlu: A sparsely activated model for general-purpose natural language understanding
  Fan Zhang, Duyu Tang, Yong Dai, Cong Zhou, Shuangzhi Wu, Shuming Shi
  arXiv:2203.03312 arXiv:2203.03312

• Contextualize knowledge bases with transformer for end-to-end task-oriented dialogue systems
  Yanjie Gou, Yinjie Lei, Lingqiao Liu, Yong Dai, Chunxu Shen
  EMNLP 2022 (Oral) EMNLP 2022 (Oral)

Publications — UDA and Graph learning

• Adversarial training based multi-source unsupervised domain adaptation for sentiment analysis
  Yong Dai, Jian Liu, Xiancong Ren, Zenglin Xu
  AAAI 2020 AAAI 2020

• Unsupervised sentiment analysis by transferring multi-source knowledge
  Yong Dai, Jian Liu, Jian Zhang, Hongguang Fu, Zenglin Xu
  Cognitive Computation Cognitive Computation

• Graph fusion network for text classification
  Yong Dai, Linjun Shou, Ming Gong, Xiaolin Xia, Zhao Kang, Zenglin Xu, Daxin Jiang
  Knowledge-Based Systems Knowledge-Based Systems