Yunshuang Li

Hello world!

I am a second-year Ph.D. student in Computer Science at University of Southern California, where I am co-advised by Prof. Daniel Seita and Prof. Gaurav Sukhatme.

I received a M.S. degree in Robotics at University of Pennsyvania in May 2024. I was a member of Perception, Action, & Learnin (PAL) Research Group, advised by Prof. Dinesh Jayaraman. Previoulsy, I worked with Prof. Qi Dou at Chinese University of Hong Kong as an undergard researcher. I received my Honorable B.S. degree in Automatic Control from Chu Kochen Honors College, Zhejiang University in 2022.

Email  /  CV  /  Google Scholar  /  LinkedIn  /  Twitter

profile photo

Research

I'm interested in learning for dexterous robot manipulation. Specifically, my research explores how to effectively improve robotic capabilities under resource constraints by making effective use of available data and physical resources. My ultimate goal is to advance robotic manipulation toward human-level dexterity, enabling robots to learn and adapt effectively.

(* indicates equal contribution, † indicates equal advising)

In Submission
Learning Geometry-Aware Dexterous Manipulation in Pushing and Pulling
Yunshuang Li, Yiyang Ling, Gaurav Sukhatme, Daniel Seita
In Submission
arXiv / project page / video / code

We propose Geometry-aware Dexterous Pushing and Pulling, a method for nonprehensile manipulation which frames the problem as synthesizing and learning pre-contact dexterous hand poses that lead to effective pushing and pulling.

CoRL
Task-Oriented Hierarchical Object Decomposition for Visuomotor Control
Jianing Qian, Yunshuang Li, Bernadette Bucher, Dinesh Jayaraman
Conference on Robot Learning (CoRL), 2024
arXiv / project page / video / code

We propose to train a large combinatorial family of representations organized by scene entities. This hierarchical object decomposition for task-oriented representations permits selectively assembling different representations specific to each task while scaling in representational capacity with the complexity of the scene and the task.

RSS
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
DROID Dataset Team
Robotics: Science and Systems (RSS), 2024
arXiv / project page / video

ICRA
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy
Zichen Zhang*, Yunshuang Li*, Osbert Bastani, Abhishek Gupta, Dinesh Jayaraman, Yecheng Jason Ma, Luca Weihs
LEAP worshop @ CoRL 2023 (Oral, Best paper award)
FMDM worshop @ NeurIPS 2023 (Oral, 6/112)
International Conference on Robotics and Automation (ICRA) 2024 (Best Computer Vision Paper Finalist)
arXiv / project page / video / code

ICRA
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Open X-Embodiment Team
International Conference on Robotics and Automation (ICRA) 2024 (Best Conference Paper Award)
arXiv / project page / video / code

CoRL
Vision-Based Contact Localization Without Touch or Force Sensing
Leon Kim, Yunshuang Li, Michael Posa, Dinesh Jayaraman
Conference on Robot Learning (CoRL), 2023
arXiv / project page / video / code

We propose a challenging vision-based extrinsic contact localization task: with only a single RGB-D camera view of a robot workspace, identify when and where an object held by the robot contacts the rest of the environment.

CMPB
PEg TRAnsfer Workflow recognition challenge report: Do multimodal data improve recognition?
Arnaud Huaulmé, Kanako Harada, (et al., including Yunshuang Li, Yonghao Long, Qi Dou)
Computer Methods and Programs in Biomedicine, 2023
arXiv

This is the report paper on Workflow Recognition Challenge in MICCAI 2021. I lead the MedAIR team and rank the first over all the 5 rank method in one sub-challenge on multi-modal (videos and kinematics) workflow recognition of robotic surgery videos.


Service

Mentorship: Ethan Foong
Conference reviewer: CoRL
Workshop reviewer: NeurIPS, ICRA, RSS
Teaching Assistant at USC: CSCI 103: Introduction to Programming, Fa25.
Teaching Assistant at UPenn: MEAM 5200: Introduction to Robotics, Sp23; CIS 5200: Machine Learning, Fa23; CIS 5190, Applied Machine Learning, Sp24.
Fife-Penn Python Club: Instructor in Spring 23 at G.W. Carver High School.


Awards

----PhD----
USC Viterbi School of Engineering Fellowship, 2024
USC WiSE Graduate Top-Off Award(10k$), 2024
CoRL 2024 Travel Grant, 2024
----Master----
Best Conference Paper Award ICRA, 2024
UPenn MS Outstanding Research Award, 2024
UPenn President Gutmann Leadership Award, 2023
UPenn Summer Internship Award, 2023
Best Paper Award at CoRL LEAP workshop, 2023
CoRL 2023 Travel Grant, 2023
----Undergrad----
Chiang Chen Overseas Graduate Fellowship (10 students each year in mainland China, 50k$), 2022
Outstanding Graduate of Zhejiang Province issued by Department of Education of Zhejiang Province, 2022
National Scholarship issued by the Ministry of Education of PRC, 2021
First Prize Scholarship issued by Zhejiang University, 2018-2021


Media

The 2024 SEAS Graduate Awards Ceremony Spotlight


Inspired by the template here.