Tianyang Liu

Ph.D. Student at UC San Diego

me_no_bg.png

I am a Ph.D. student (2024-) in Computer Science at UC San Diego, advised by Prof. Julian McAuley.

My research focuses on Natural Language Processing (NLP), and I am broadly interested in Large Language Models (LLMs). Specifically, I explore areas such as reasoning (LLM Reasoners), tool augmentation (ToolkenGPT), and code generation (RepoBench, StarCoder2). I am also interested in building code agents. Currently, I am deeply engaged in LLM evaluation, believing that the future belongs to those who do evals. \(^†\)

Prior to my Ph.D. studies, I completed my Master’s degree in Computer Science at UC San Diego, working with Prof. Julian McAuley and Prof. Zhiting Hu. During this time, I also collaborated with Prof. Muhao Chen from UC Davis. Before that, I earned my Bachelor’s degree from Wuhan University. I have also interned at NVIDIA, working with Gaoyan Xie and his team on CUDA code agents.

I am actively seeking undergraduate and master’s students interested in collaborating on research projects related to code generation, agents, benchmarking, reasoning, and similar topics. If you’re passionate about these areas, please don’t hesitate to email me.

News

Oct 10, 2024 🤖 We pre-release Decentralized Arena for automated, scalable, and transparent LLM evaluation.
Sep 20, 2024 🎉 DRPO is accepted to the main conference of EMNLP 2024!
Jul 10, 2024 🎉 LLM Reasoners is accepted to COLM 2024!
Feb 28, 2024 💫 We release StarCoder 2, a family of open LLMs for code.
Jan 16, 2024 🎉 RepoBench gets accepted to ICLR 2024!

Selected Publications [view all]

2024

  1. pre-release
    Yanbin Yin, Zhen WangKun Zhou, Xiangdong Zhang, Shibo HaoYi Gu, Jieyuan Liu, Somanshu Singla, Tianyang LiuEric P. Xing, Zhengzhong Liu, Haojian Jin, and 1 more author
    Pre-release, 2024
    Final version will be released soon.
  2. EMNLP (main)
    Somanshu Singla*, Zhen Wang*Tianyang Liu, Abdullah Ashfaq, Zhiting Hu, and Eric P. Xing
    EMNLP, 2024
  3. COLM
    Shibo HaoYi Gu, Haotian Luo, Tianyang Liu, Xiyan Shao, Xinyuan Wang, Shuhua Xie, Haodi Ma, Adithya Samavedhi, Qiyue Gao, Zhen Wang, and Zhiting Hu
    COLM, 2024
    Also to appear at Large Language Model (LLM) Agents workshop at ICLR 2024
  4. preprint
    Anton Lozhkov, Raymond Li, Loubna Ben Allal, Federico Cassano, Joel Lamy-Poirier, Nouamane Tazi, Ao Tang, Dmytro Pykhtar, Jiawei Liu, Yuxiang Wei, Tianyang Liu, Max Tian, and 54 more authors
    arXiv preprint, 2024
  5. NAACL
    Tianyang LiuFei Wang, and Muhao Chen
    NAACL, 2024
  6. ICLR
    Tianyang LiuCanwen Xu, and Julian McAuley
    ICLR, 2024

2023

  1. NeurIPS
    Shibo HaoTianyang LiuZhen Wang, and Zhiting Hu
    NeurIPS, 2023
    Oral (67 out of 12345 submissions), Best Paper Award at SoCal NLP 2023

Services

Invited Reviewer

2025
  • AAAI
  • ICLR
  • AISTATS
2024
  • NeurIPS
  • COLM
  • ICML
  • ICLR
  • ACL ARR (Feb, Apr, Jun, Aug, Oct)
2023
  • ACL ARR (Dec)
  • NLPCC