CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Models

Hao Yu, Bo Shen, Dezhi Ran, Jiaxin Zhang, Qi Zhang, Yuchi Ma, Guangtai Liang, Ying Li, Qianxiang Wang, Tao Xie
February, 2024
Cite DOI
Type
Conference paper
Publication
IEEE/ACM 46th International Conference on Software Engineering
Dezhi Ran
Dezhi Ran
Ph.D. student

My research interests include software engineering, foundation models, and reinforcement learning.