avatar

Yiyang Zhou

Computer Science PhD
The University of North Carolina at Chapel Hill

Chapel Hill, US

 zhouyiyangailab@gmail.com


About Me

I’m currently a CS Ph.D. student at UNC Chapel Hill, advised by Prof. Huaxiu Yao. Previously, I was a master’s student majoring in Computer Science and Technology at Xi’an Jiaotong University, conducting research under the guidance of Prof. Jihua Zhu.

Research Interests

Selected Publications and Preprints

  1. NeurIPS
    VHELM: A Holistic Evaluation of Vision Language Models
    Tony Lee*, Haoqin Tu*, Chi Heem Wong*, Wenhao Zheng, Yiyang Zhou, Yifan Mai, Josselin Somerville Roberts, Michihiro Yasunaga, Huaxiu Yao, Cihang Xie, Percy Liang
    NeurIPS 2024.
    Website PDF GitHub
  2. NeurIPS
    Calibrated Self-Rewarding Vision Language Models
    Yiyang Zhou*, Zhiyuan Fan*, Dongjie Cheng*, Sihan Yang, Zhaorun Chen, Chenhang Cui, Xiyao Wang, Yun Li, Linjun Zhang, Huaxiu Yao
    NeurIPS 2024 (the short version is presented in ICML 2024 Workshop on Foundation Models in the Wild).
    Website PDF GitHub
  3. NeurIPS
    CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models
    Peng Xia, Ze Chen, Juanxi Tian, Yangrui Gong, Ruibo Hou, Yue Xu, Zhenbang Wu, Zhiyuan Fan, Yiyang Zhou, Kangyu Zhu, Wenhao Zheng, Zhaoyang Wang, Xiao Wang, Xuchao Zhang, Chetan Bansal, Marc Niethammer, Junzhou Huang, Hongtu Zhu, Yun Li, Jimeng Sun, Zongyuan Ge, Gang Li, James Zou, Huaxiu Yao
    NeurIPS 2024 (the short version is presented in ICML 2024 Workshop on Foundation Models in the Wild).
    Website PDF GitHub
  4. arXiv
    MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?
    Zhaorun Chen*, Yichao Du*, Zichen Wen*, Yiyang Zhou*, Chenhang Cui, Zhenzhen Weng, Haoqin Tu, Chaoqi Wang, Zhengwei Tong, Qinglan Huang, Canyu Chen, Qinghao Ye, Zhihong Zhu, Yuqing Zhang, Jiawei Zhou, Zhuokai Zhao, Rafael Rafailov, Chelsea Finn, Huaxiu Yao
    Arxiv 2024 (the short version is presented in ICML 2024 Workshop on Foundation Models in the Wild).
    Website PDF GitHub
  5. arXiv
    Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
    Yiyang Zhou*, Chenhang Cui*, Rafael Rafailov, Chelsea Finn, Huaxiu Yao
    Arxiv 2024 (the short version is presented in ICLR 2024 R2-FM Workshop).
    Website PDF GitHub
  6. ECCV
    How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs
    Haoqin Tu*, Chenhang Cui*, Zijun Wang*, Yiyang Zhou, Bingchen Zhao, Junlin Han, Wangchunshu Zhou, Huaxiu Yao, Cihang Xie
    ECCV 2024.
    Website PDF GitHub
  7. ICLR
    Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
    Yiyang Zhou*, Chenhang Cui*, Jaehong Yoon, Linjun Zhang, Zhun Deng, Chelsea Finn, Mohit Bansal, Huaxiu Yao
    ICLR 2024 (the short version is presented in NeurIPS 2023 Instruction Workshop).
    Website PDF GitHub

  8. arXiv
    mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
    Qinghao Ye*, Haiyang Xu*, Guohai Xu*, Jiabo Ye, Ming Yan, Yiyang Zhou, Junyang Wang, Anwen Hu, Pengcheng Shi, Yaya Shi, Chenliang Li, Yuanhong Xu, Hehong Chen, Junfeng Tian, Qian Qi, Ji Zhang, Fei Huang
    Arxiv 2023.
    Website PDF Hugging Face GitHub

Experiences

(1) Microsoft - Research Intern

(2) The University of North Carolina at Chapel Hill - Research Intern (2023-2024, Chapel Hill, US)

(3) Sun Yat-sen University - Research Intern (2023, China)

(4) Alibaba DAMO Academy - Research Intern (2023, Hangzhou, China)

(5) UBS - Investment Intern (2019-2022, Hong Kong, Singapore)

Awards

Other Fields

Web3, Chinese whale, Trader, Amateur Poker, Hotel Management

Services

Conference Reviewers

Journal Reviewers