Sihong He

Toward General Embodied AI.

prof_pic.jpg
sihonghe.ai at gmail.com https://sihonghe.com

Hi, my name is Sihong He, an incoming Assistant Professor of Computer Science at UTA.

I am looking for highly motivated Ph.D. students/summer interns/visiting students to join my lab. If you are passionate about related research topics, please email with your CV, transcripts, and several sentences about your research interest. Please include “Future-Maverick” in your email subject/context (this is my email filter). I have a chinese-version hiring ads, click the link to see details.

I received my Ph.D. degree from the Department of Computer Science and Engineering, University of Connecticut, working with Dr. Fei Miao. Before my Ph.D. journey at UConn, I received my M.S. degree in Statistics at UC Irvine in 2019 and my B.E. degree in Financial Mathematics in 2017 at SUSTC (南方科技大学) which was newly established in 2011 at Shenzhen, China. (click to read a short story about it). I enjoy trying new things, learning new knowledge, and exploring the frontiers of research (which is also a reason why I studied in three different departments during my UG/MS/PhD life :blush:). I also serve as a reviewer/PC member for several top conferences and journals and was selected as a CPS rising star and rising star in AI in 2024.

My long-term research goal is to achieve General Embodied AI. Currently, I mainly focus on developing efficient, robust, secure, adaptive, and explainable decision-making strategies to advance General Embodied AI. My research interests include:

  • Intelligent Decision-Making: LLM/Foundation models for decision making, explainable and safe decision-making.
  • Reinforcement Learning (RL): robust RL, multi-agent RL, federated RL, explainable RL, etc.
  • Cyber-Physical Systems (CPS): smart city, intelligent transportation, connected autonomous vehicles, smart logistics, robotics, etc.
  • Control and Optimization: optimal control, robust optimization, distributionally robust optimization.

So far, my research has focused on robust multi-agent reinforcement learning for robust interconnected CPS, data-driven robust optimization for efficient mobile CPS, and on the security and safety of CPS. In addition to system modeling, theoretical analysis, and algorithm design, my work involves experimental validation of real-world data. My work has been published in prestigious journals and conferences including International Conference on Intelligent Robots and Systems (IROS), International Conference on Robotics and Automation (ICRA), IEEE Transactions on Intelligent Transportation Systems (TITS), ACM Transactions on Cyber-Physical Systems (TCPS), IEEE Transactions on Mobile Computing (TMC) and Transactions on Machine Learning Research (TMLR).

I am open to research discussion and collaboration, please feel free to send me email!

news

Apr 17, 2024 I am looking for highly motivated Ph.D. students/summer interns/visiting students to join my lab. If you are passionate about related research topics, please email with your CV, transcripts, and several sentences about your research interest. Please include “Future-Maverick” in your email subject/context (this is my email filter).
Apr 15, 2024 I will join the Department of Computer Science and Engineering (CSE), at the University of Texas at Arlington (UTA) as an Assistant Professor this fall!
Apr 14, 2024 It’s my honor to receive a Summer Doctoral Dissertation Fellowship from UConn.
Apr 8, 2024 It’s my honor to be selected as a CPS Rising Star.
Mar 26, 2024 I passed my thesis defense and am officially a Doctor of Philosophy in CSE now. Thanks to all the people who have supported me to finish my Ph.D. degree!
Dec 18, 2023 It’s my honor to be selected as a Rising Star in AI.
Nov 10, 2023 It’s my honor to be selected as a 2024 cohort of NC State University Building Future Faculty Program.
Oct 17, 2023 Our Journal paper “FairMove: A Data-Driven Vehicle Displacement System for Jointly Optimizing Profit Efficiency and Fairness of Electric For-Hire Vehicles” is accepted to IEEE Transactions on Mobile Computing. Congratulations and Many thanks to Guang!
Sep 8, 2023 It’s my honor to receive IROS Travel Grants. See you in Detroit.
Sep 1, 2023 I passed my proposal defense and am formaly a Ph.D. candidate now. Thanks to my committee members and all audience attending my oral presentation. 🥰
Jun 23, 2023 Two papers have been accepted to IROS2023! :sparkles: Check our papers here: “A robust and constrained multi-agent reinforcement learning framework for electric vehicle AMoD systems” and “Robust electric vehicle balancing of autonomous mobility-on-demand system: A multi-agent reinforcement learning approach”. Many thanks to my collaborators, Shuo, Shaofeng and Yue. See you in Detroit!
May 25, 2023 A journal paper “Robust Multi-Agent Reinforcement Learning with State Uncertainty” is accepted to Transactions on Machine Learning Research! :smile: We provide the first attempt at the theoretical and empirical analysis of robust MARL problem with state uncertainty in this paper.
Mar 8, 2023 Two papers are accepted to AI for Agent-Based Modelling (AI4ABM) Workshop at the International Conference on Learning Representations (ICLR) 2023 :smile:!
Jan 28, 2023 A conference paper is accepted to ICRA! :sparkles: :smile:
Jan 26, 2023 A journal paper “Data-Driven Distributionally Robust Electric Vehicle Balancing for Autonomous Mobility-on-Demand Systems Under Demand and Supply Uncertainties” is published on IEEE Transactions on Intelligent Transportation Systems!

selected publications

  1. Robust Multi-Agent Reinforcement Learning with State Uncertainty
    Sihong He, Songyang Han, Sanbao Su, and 3 more authors
    Transactions on Machine Learning Research (TMLR), 2023
  2. Data-Driven Distributionally Robust Electric Vehicle Balancing for Autonomous Mobility-on-Demand Systems Under Demand and Supply Uncertainties
    Sihong He, Zhili Zhang, Shuo Han, and 5 more authors
    IEEE Transactions on Intelligent Transportation Systems, 2023
  3. Data-driven distributionally robust electric vehicle balancing for mobility-on-demand systems under demand and supply uncertainties
    Sihong He, Lynn Pepin, Guang Wang, and 2 more authors
    In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020