industry news
Subscribe Now

Orbbec launches out-of-the-box AMR solution with NVIDIA Isaac Perceptor at ROSCon 2024

Odense, Denmark, Oct 22, 2024 – Orbbec, a leading 3D camera provider, today announced the Orbbec Perceptor Developer Kit (OPDK), an out-of-the-box autonomous mobile robot (AMR) solution preloaded with NVIDIA Isaac Perceptor. The OPDK is designed for AMR developers who seek a powerful, hardware-software integrated kit to develop AI applications for dynamic and unstructured environments in warehouses and factories.

The Orbbec Gemini 335L cameras, integrated with NVIDIA Jetson AGX Orin system-on-modules, combine active and passive stereo vision technologies for seamless operations in both indoor and outdoor conditions. The Gemini 335L cameras offer in-camera depth processing powered by Orbbec’s MX6800 ASIC, and a precise multi-camera sync system. 

The NVIDIA Jetson AGX Orin offers up to 275 trillion operations per second (TOPS) of performance, pre-trained AI models, reference AI workflows, and vertical application frameworks in robotics, vision AI and sensor fusion.

The Gemini 335L’s in-camera depth processing frees up GPU, CPU and NPU resources on the Jetson AGX Orin to run visual simultaneous localization and mapping (SLAM) and odometry for improved mapping in rapidly changing environments. This efficient system now increases resources for AI applications for dynamic object detection and pose estimation. 

The out-of-the-box OPDK system solution for AMR features:

  • Preloaded with NVIDIA Isaac Perceptor for robot development and control. Optimized for AMR development, enabling rapid prototyping and deployment.
  • 360-degree visual SLAM with four RGB-D cameras, with in-camera depth processing and capable of indoor and outdoor operations.
  • Option to use visual odometry from cuVSLAM or wheel odometry from robots.

AMR developers can leverage CUDA-accelerated libraries and AI models, streamlining the development process and accelerating time to market. 

The OPDK system components include:

  • Four Orbbec Gemini 335L RGB-D Cameras: Depth resolution up to 1280×800 at 30 FPS, offering high-precision depth data with a wide field of view (4*90° horizontal, 65° vertical) and USB connectivity, and IP65 rating for dust and water protection. 
  • Multi-Camera Synchronization: Orbbec Sync Hub enables precise camera synchronization, enabling seamless multi-angle data collection with minimal interference. 
  • NVIDIA Jetson AGX Orin (64GB) Developer Kit: AI-powered compute engine with up to 275 TOPS of AI performance, support from the NVIDIA JetPack software development kit, NVIDIA Isaac ROS, AI models, and tools that make it ideal for complex robotics tasks such as vision processing from multi-camera data streams, AI model inference, visual SLAM and 3D scene reconstruction.

“The Orbbec Perceptor Dev Kit gives developers a truly out-of-the-box experience with a feature-rich, comprehensive system to begin AI application development immediately,” said Amit Banerjee, Head of Partnerships at Orbbec. “This collaboration with NVIDIA enables us to provide compelling advantages to AMR developers to navigate the complexities of 3D sensing and computer vision algorithms with OPDK.”

Orbbec also announced today the Gemini 335Lg Stereo Vision 3D Camera, the latest addition to the Gemini 330 Series. With GMSL2 and secure FAKRA connection, the Gemini 335Lg achieves stable and smooth data transmission over longer distances and overcomes challenges from vibrations caused by movement over uneven terrain or electromagnetic interference. A version of the OPDK with GMSL cameras will be available soon.

For further information about OPDK visit https://www.orbbec.com/opdk/ or contact Orbbec for scheduling meetings at ROSCon.

About Orbbec

Founded in 2013, Orbbec is on a mission to democratize robotics and AI vision technology, offering products that deliver performance and value spanning structured light, stereo vision and ToF technologies. Orbbec’s technology powers robotics, manufacturing, logistics, retail, 3D scanning, healthtech and fitness solutions. With in-house R&D, state-of-the-art factory, supply chain management and global support, Orbbec also offers ODM engagements for custom and embedded designs. Follow Orbbec on X, Facebook, and LinkedIn for the latest updates and innovations in 3D vision technology.

One thought on “Orbbec launches out-of-the-box AMR solution with NVIDIA Isaac Perceptor at ROSCon 2024”

Leave a Reply

featured blogs
Oct 24, 2024
This blog describes how much memory WiFi IoT devices actually need, and how our SiWx917M Wi-Fi 6 SoCs respond to IoT developers' call for more memory....
Oct 17, 2024
One of the most famous mechanical calculators of all time is the Curta, which was invented by Curt Herzstark (1902-1988)....

featured chalk talk

SLM Silicon.da Introduction
Sponsored by Synopsys
In this episode of Chalk Talk, Amelia Dalton and Guy Cortez from Synopsys investigate how Synopsys’ Silicon.da platform can increase engineering productivity and silicon efficiency while providing the tool scalability needed for today’s semiconductor designs. They also walk through the steps involved in a SLM workflow and examine how this open and extensible platform can help you avoid pitfalls in each step of your next IC design.
Dec 6, 2023
51,842 views