2026-10-07 · America/Los_Angeles · 论文 · #13

RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning

Recently, approaches that leverage human video datasets for robot policy training have become increasingly prevalent. However, most existing hand trackers regress pose from cropped frames with limited priors on hand motion and object interaction, resulting in inaccurate and physically inconsistent estimates. Moreover, the lack of physical cues, e.g., contact and force, limits the use of human videos for robot policy training. To this end, we propose RLHND, a video foundation model-based hand tracking model that jointly estimates hand pose and realistic tactile information from monocular…

热度 43.1 / 100；排名与评分保留该期记录。