Sim2Real Transfer to the Real Robot

Multi-Embodiment Generalization + Grasp Data Generation

Left to Right: Object-only, Object + Robotiq-2f-140 grasps, Franka Panda, Suction gripper


SOTA on FetchBench [Han et. al. CoRL 2024] Grasping Benchmark in Isaac Sim

GraspGen is a Diffusion-based Model

GraspGen models grasp generation as a iterative Denoising Diffusion Probabilistic Model (DDPM) process.

Realtime Grasp Predictions

Inference is realtime (~20 Hz before TensorRT), 21X less memory than prior work on grasp discriminators

Abstract

Grasping is a fundamental robot skill, yet despite significant research advancements, learning-based 6-DOF grasping approaches are still not turnkey and struggle to generalize across different embodiments and in-the-wild settings. We build upon the recent success on modeling the object-centric grasp generation process as an iterative diffusion process. Our proposed framework - GraspGen - consists of a Diffusion-Transformer architecture that enhances grasp generation, paired with an efficient discriminator to score and filter sampled grasps. We introduce a novel and performant on-generator training recipe for the discriminator. To scale GraspGen to both objects and grippers, we release a new simulated dataset consisting of over 53 million grasps. We demonstrate that GraspGen outperforms prior methods in simulations with singulated objects across different grippers, achieves state-of-the-art performance on the FetchBench grasping benchmark, and performs well on a real robot with noisy visual observations.

Project Video

BibTeX

@article{murali2025graspgen,
      title={GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Training},
      author={Murali, Adithyavairavan and Sundaralingam, Balakumar and Chao, Yu-Wei and Yamada, Jun and Yuan, Wentao and Carlson, Mark and Ramos, Fabio and Birchfield, Stan and Fox, Dieter and Eppner, Clemens},
      journal={arXiv preprint arXiv:2507.13097},
      url={https://arxiv.org/abs/2507.13097},
      year={2025},
    }

This website is made from the template from Nerfies.