Skip to content

Perception Pipeline for Humanoid Arms for Robot Learning Lab@MIRMI (TUM)

Notifications You must be signed in to change notification settings

tanmayyb/percept

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

77 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Perception Pipeline

Goal: Fast (~30Hz) perception pipline for workspace approximation research for heuristic-based multi-agent planning framework (PMAF) by Laha et al 2023. Support both sim/real-world perception for multiple cameras.

Rviz PointCloud Rviz Primitives

Requirements

Hardware Stack
1. CUDA-capable PC (Our Setup: i7 8000U + RTX3070)
2. Intel Realsense 435i (for Real-World)
3. Franka Emika Panda Robot Arms (for Real-World)
Software Stack
1. Ubuntu 20.04 Focal Fossa (iso)
2. ROS 1 Noetic (debian)
3. Conda + CUDA (instructions)
4. librealsenseSDK (debian)
5. CoppeliaSim 4.1.0 EDU (for simulation,binaries)

Setup

  • Install aforementioned requirements and clone this git repo
  • Run ./setup.sh - this will create a virtual environment and install all dependencies and libraries
  • Set $COPPELIASIM_ROOT to the CoppeliaSim installation directory (for simulation)

Credits

Collaborators

  • Riddhiman Laha
  • Tinayu Ren

Projects

  • CuPoch
  • Open3D
  • CoppeliaSim
  • PyRep (by stepjam)

Performance

Performance w/o RBS:

Profiling Perception Pipeline

About

Perception Pipeline for Humanoid Arms for Robot Learning Lab@MIRMI (TUM)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published