Publications

Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung (2024). Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks.

PDF Cite Code Dataset Project

Linyuan Gong, Mostafa Elhoushi, Alvin Cheung (2024). AST-T5: Structure-Aware Pretraining for Code Generation and Understanding.

PDF Cite Code

Linyuan Gong, Chenyan Xiong, Xiaodong Liu, Payal Bajaj, Yiqing Xie, Alvin Cheung, Jianfeng Gao, Xia Song (2023). Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers. In ACL 2023.

PDF Cite Code Video DOI

Linyuan Gong, Jiayi Wang, Alvin Cheung (2023). ADELT: Transpilation Between Deep Learning Frameworks.

PDF Cite

Jianhao Shen, Chenguang Wang, Linyuan Gong, Dawn Song (2022). Joint Language Semantic and Structure Embedding for Knowledge Graph Completion. In COLING 2022.

PDF Cite Code

Xinyun Chen, Linyuan Gong, Alvin Cheung, Dawn Song (2021). PlotCoder: Hierarchical Decoding for Synthesizing Visualization Code in Programmatic Context. In ACL 2021.

PDF Cite Code Video DOI

Yilun Xu, Yang Song, Sahaj Garg, Linyuan Gong, Rui Shu, Aditya Grover, Stefano Ermon (2021). Anytime Sampling for Autoregressive Models via Ordered Autoencoding. In ICLR 2021.

PDF Cite Code Slides

Juyong Kim, Linyuan Gong, Justin Khim, Jeremy C. Weiss, Pradeep Ravikumar (2020). Improved Clinical Abbreviation Expansion via Non-Sense-Based Approaches. In ML4H (NeurIPS Workshop) 2020.

PDF Cite Code

Zhenhui Xu, Linyuan Gong, Guolin Ke, Di He, Shuxin Zheng, Liwei Wang, Jiang Bian, Tie-Yan Liu (2020). MC-BERT: Efficient Language Pre-Training via a Meta Controller.

PDF Cite Code

Yingce Xia, Xu Tan, Fei Tian, Fei Gao, Weicong Chen, Yang Fan, Linyuan Gong, Yichong Leng, Renqian Luo, Yiren Wang, Lijun Wu, Jinhua Zhu, Tao Qin, Tie-Yan Liu (2019). Microsoft Research Asia's Systems for WMT19. In WMT19 (ACL 2019 Workshop).

PDF Cite DOI

Linyuan Gong, Di He, Zhuohan Li, Tao Qin, Liwei Wang, Tieyan Liu (2019). Efficient training of BERT by progressively stacking. In ICML 2019.

PDF Cite Code