Computer Vision/ Perception - UW Robotic Manipulation

Project information

  • Category: Computer Vision - Robotic Perception
  • Context: University of Washington - Research Assistant
  • Year:: 2024
  • Advisor: Yi Li
  • Leading Professor and PI: Dieter Fox
  • Github: Link to Repo

Tracking unseen objects in dynamic industrial robotic contexts, like distribution warehouses, presents challenges in handling rearrangements and tracking items through temporal gaps. The complexity rises when robots encounter objects beyond their training sets. To address these challenges, the research introduces synthetic and real-world datasets, and proposes a paradigm with an efficient transformer module, which outperformed recent methods in experiments. As Research Assistant I led the public release of the implementation. This included the refactoring, cleaning and testing of the codebase and rerunning experiments to ensure proper functionality of the implementation.

  • ML/DL Tech: Robotics, Computer Vision, Perception, Manipulation
  • Tools:Linux, CLI, Python, CUDA, PyTorch