Zilong Zheng

Research Scientist at BIGAI

Email: z.zheng[at]ucla[dot]edu

I am a research scientist and team lead in NLP at Beijing Institute of General Artificical Intelligence (BIGAI).

I received my Ph.D. degree from the Department of Computer Science at University of California, Los Angeles (UCLA), under the supervision of Prof. Song-chun Zhu. Before that, I obtained bachelor degree of Computer Science at University of Minnesota. I also received B.E. degree from University of Electronic Science and Technology of China (UESTC).

My research interests lie in the intersection of statistical machine learning, vision-language modeling and cognition. Current research themes include:

  • Generative Modeling: Statistical generative modeling (energy-based models) for vision and language.
  • Multimodal Understanding: Fine-grained vision-language alignment and explainable VL modeling.
  • Cognitive Language Reasoning: Understand and reason underlying information in language and human conversations.

I am always looking for self-motivated interns and long-term collaborators. Please contact me if you have excellent background or share similar research interests with me.

News

2022/07 Our work on bidirectional value alignment is accepted for Science Robotics Volume July! :sparkles: :smile:
2022/01 One paper is accepted in ICLR’22 as an Oral paper!
2021/12 One paper is accepted for Oral presentation in AAAI’22!
2021/05 I am awarded as CVPR Outstanding Reviewer for CVPR’21.
2021/03 Three papers are accepted in CVPR’21, including two Oral papers!

Publications

*: Equal contribution

Latest

  1. In situ bidirectional human-robot value alignment ScienceRobotics
    Luyao Yuan*, Xiaofeng Gao*, Zilong Zheng*, Mark Edmonds, Ying Nian Wu, Federico Rossano, Hongjing Lu, Yixin Zhu, and Song-Chun Zhu
    Science Robotics , 2022

2022

  1. SHARP: Search-Based Adversarial Attack for Structured Prediction NAACL'22
    Liwen Zhang, Zixia Jia, Wenjuan Han, Zilong Zheng, and Kewei Tu
    Findings of Annual Conference of the North American Chapter of the Association for Computational Linguistics (NACCL) , 2022
  2. Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling Oral ICLR'22
    Bo Wan, Wenjuan Han, Zilong Zheng, and Tinne Tuytelaars
    The Tenth International Conference on Learning Representations (ICLR) , 2022
  3. Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships CVPR'22
    Chao Lou*, Wenjuan Han, Yuhuan Lin, and Zilong Zheng*
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2022
  4. Energy-Based Generative Cooperative Saliency Prediction Oral AAAI'22
    Jing Zhang, Jianwen Xie, Zilong Zheng, and Nick Barnes
    The Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI) , 2022

2021

  1. Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Multi-Modal Conditional Learning TPAMI
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2021
  2. Learning Triadic Belief Dynamics in Nonverbal Communication from Videos Oral CVPR'21
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2021
  3. Patchwise Generative ConvNet: Training Energy-Based Models from a Single Natural Image for Internal Learning Oral CVPR'21
    Zilong Zheng, Jianwen Xie, and Ping Li
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2021
  4. Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification CVPR'21
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2021
  5. GRICE: A Grammar-based Dataset for Recovering Implicature and Conversational rEasoning ACL'21
    Findings of ACL, ACL-IJCNLP , 2021
  6. Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler AAAI'21
    Jianwen Xie, Zilong Zheng, and Ping Li
    The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI) , 2021
  7. Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation AAAI'21
    The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI) , 2021

2020

  1. Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis TPAMI
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2020
  2. Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs ICRA'20
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) , 2020
  3. Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns Oral AAAI'20
    The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI) , 2020

2019

  1. Reasoning Visual Dialogs with Structural and Partial Observations Oral CVPR'19
    Zilong Zheng*, Wenguan Wang*, Siyuan Qi*, and Song-Chun Zhu
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2019
  2. Learning Dynamic Generator Model by Alternating Back-Propagation Through Time Spotlight AAAI'19
    The Thirty-Third AAAI Conference on Artificial Intelligence (AAAI) , 2019

2018

  1. Learning Descriptor Networks for 3D Shape Synthesis and Analysis Oral CVPR'18
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2018

Professional Services

  • Conference reviewer for ICML 2022; ICLR 2022; CVPR 2019-2022; NeurIPS 2020-2021; AAAI 2020-2022; ICCV 2019-2021; ECCV 2020; BMVC 2020; WACV 2021
  • Journal reviewer for International Journal of Computer Vision (IJCV), Pattern Recognition (PR), Neurocomputing