Siheng Zhao

Greetings! I'm a Senior student at School of Artificial Intelligence, Nanjing University. Nowadays I work as Research Assistant at HKU NLP Group with Prof. Tao Yu.

Previously, I was a funded visiting student at Department of Computer Science, National University of Singapore, where I'm honoured to work with Prof. Lin Shao. I was also an Intern at NJU NLP Group, advised by Prof. Shu-Jian Huang.

My research interests now lie at the intersection of Natural Language Processing and Reinforcement Learning. My long-term goal is to develop a language-centric agent that can interact with the physical world (Robot Agent), browse websites (Web Agent), play video games (Game Agent) and process data (Data Agent).

Besides, I'm also interested in Robot Learning, especially Deformable Object Manipulation, Differentiable Simulation and 3D Perception.

Email  /  Google Scholar  /  Semantic Scholar  /  Github  /  Twitter

News
  • [Oct, 2023] Give a talk on our new paper Text2Reward at Shanghai AI Lab.
  • [Oct, 2023] Serve as a Reviewer at ICRA 2024.
  • [July, 2023] One paper accepted by ICCV 2023.
  • [June, 2023] One paper accepted by IROS 2023.
  • [June, 2023] Begin internship at HKU NLP Group.
    • Publications

            /

    		Text2Reward: Automated Dense Reward Function Generation for Reinforcement Learning
    Tianbao Xie*, Siheng Zhao*, Chen Henry Wu, Yitao Liu, Qian Luo, Victor Zhong, Yanchao Yang, Tao Yu
    In submission

    [arxiv] [project]

    		DiffClothAI: Differentiable Cloth Simulation with Intersection-free Frictional Contact and Differentiable Two-Way Coupling with Articulated Rigid Bodies
    Xinyuan Yu*, Siheng Zhao*, Siyuan Luo, Gang Yang, Lin Shao
    International Conference on Intelligent Robots and Systems (IROS) 2023

    [paper] [project] [video]

    Academic Performance
    GPA: 94.6/100, Rank: 1/97
    Related A+ courses Computer Vision and Pattern Recognition. (A+)
    Advanced Machine Learning. (A+)
    Data Structure and Algorithms. (A+)
    Probability Theory and Statistics. (A+)
    Optimization Methods. (A+)
    Advanced Algebra. (A+)
    Numerical Methods. (A+)
    Real Variable Function and Functional Analysis. (A+)
    Distributed and Parallel Processing. (A+)
    Operating Systems. (A+)
    Knowledge Representation and Processing. (A+)
    Mathematical Logic. (A+)
    ...
    Bao Gang Scholarship & Special Prize Nomination, 2023
    Heng Fang Scholarship, 2022
    People's Scholarship, 2022
    National Scholarship, 2021, the Highest Honor in China's University
    China Telecom Scholarship, 2021
    Outstanding Student Leader, 2021, 2022
    Outstanding Student in Social Practice, 2021
    Services
    • Conference Reviewer:
      • IEEE International Conference on Robotics and Automation (ICRA) 2024
    Talks
  • Oct.2023: Text2Reward: Automated Dense Reward Function Generation for Reinforcement Learning, Shanghai AI Lab
  • Apr.2023: Large Language/Multimodal Model for Robotics: a High-level Planner, Nanjing University, NLP Group

    •  

    Template source