If you are a ROS developer/user and you blog about it, ROS wants those contributions on this page ! All you need for that to happen is:
have an RSS/Atom blog (no Tweeter/Facebook/Google+ posts)
open a pull request on planet.ros tracker indicating your name and your RSS feed/ATOM url. (You can just edit the file and click "Propose File Change" to open a pull request.)
make your ROS related posts tagged with any of the following categories: "ROS", "R.O.S.", "ros", "r.o.s."
Warnings
For security reasons, html iframe, embed, object, javascript will be stripped out. Only Youtube videos in object and embed will be kept.
Guidelines
Planet ROS is one of the public faces of ROS and is read by users and potential contributors. The content remains the opinion of the bloggers but Planet ROS reserves the right to remove offensive posts.
Blogs should be related to ROS but that does not mean they should be devoid of personal subjects and opinions : those are encouraged since Planet ROS is a chance to know more about ROS developers.
Posts can be positive and promote ROS, or constructive and describe issues but should not contain useless flaming opinions. We want to keep ROS welcoming :)
ROS covers a wide variety of people and cultures. Profanities, prejudice, lewd comments and content likely to offend are to be avoided. Do not make personal attacks or attacks against other projects on your blog.
Suggestions ?
If you find any bug or have any suggestion, please file a bug on the planet.ros tracker.
I am prototyping **EdgeAI Forge**, a local-first engineering architecture intended to help generate, test, benchmark, and document ROS 2 and machine-vision pipelines.
The initial target workflow is a ROS 2 vision pipeline generator. Given a requirement such as:
> Read frames from a USB camera, run object detection, publish detections, expose health status, benchmark performance, and prepare deployment to Jetson.
the system should eventually produce reviewed artifacts including:
- package manifests and directory structure;
- Python or C++ nodes;
- topics, messages, services, and actions;
- parameters and launch files;
- unit, integration, and launch tests;
- simulation or recorded-data validation;
- Docker/Jetson packaging;
- FPS and latency benchmarks; and
- assumptions, limitations, and operating documentation.
The current proof of concept contains Planner, Vision, and ROS prompt agents backed by a local Ollama endpoint. It generates design output, not production-ready ROS packages. A broader scaffold contains API, dashboard, infrastructure, and observability components.
The safety boundary is important: generated robot-motion or production-deployment artifacts should never run automatically. The intended sequence includes simulation, test evidence, human review, explicit approval, logging, and rollback.
I would appreciate feedback from the ROS community on:
1. Which package archetype would make the best first supported template?
2. How should generated packages be evaluated beyond compilation and linting?
3. Which launch_testing, rosbag, Gazebo, or other simulation patterns should be mandatory?
4. How should the generator encode QoS, lifecycle nodes, diagnostics, and hardware assumptions?
5. What safeguards would make this useful without encouraging unsafe deployment practices?
I’m a 2nd-year Mechanical Engineering student at NIT Jalandhar, currently exploring Robotics and Automation.
I’m starting my journey with C++/Python, electronics, CAD and eventually ROS 2. My long-term goal is to work on real robotics projects and eventually pursue research/internship opportunities in robotics.
I’m looking to connect with:
• Students who are also learning Robotics/ROS 2
• People working on interesting robotics projects
• Researchers/engineers who are open to collaboration or guidance
• Students who have previously pursued robotics research internships
If you’re on a similar journey, I’d love to connect and learn together.
Also, if there are any beginner-friendly open-source robotics projects where a student can contribute, I’d really appreciate suggestions.
Hi all, I’m an MEng Robotics & AI student at UCL working on perception/tracking pipelines (recently built a person re-ID and tracking evaluation pipeline, and a Gaussian-splat reconstruction quality evaluator). I’m trying to understand a specific problem better: how do teams currently notice when a perception or sensor-fusion stack has silently degraded in production, before it causes a visible failure? Do you rely on manual spot-checks, logging + alerts, a formal calibration schedule, or something else? Genuinely trying to learn what’s actually painful here vs. what’s already a solved problem, not selling anything. Would appreciate any war stories, even short ones.
I’m a 4th-year Computer Engineering student in Palestine (Birzeit University, graduating 2027). I focus on embedded systems and robotics. I have US citizenship, but I never lived or worked in the US. There’s no embedded or robotics industry here at all, so I can’t really build experience or a network locally. I’m trying to move to the US, but I’m not sure where to start.
My background: ROS2 control software for a multi-agent robotics platform, FreeRTOS firmware on custom boards, and a competition robot (WRO Future Engineers) that I built from the PCB up to the low level firmware. I’m fine with relocating, that’s not a problem for me.
I’m not sure what the right next step is. Should I look for a job directly, try to get into a US grad program first, or something else? If you work in robotics or made a similar move yourself, what would you do in my place?
I’ve been working on a ROS2 Dev Container Feature and just updated my VSCode ROS2 Workspace Template to use it instead of my pre-built ROS Docker images.
The feature is here:
Source:
The main thing I wanted was to select the ROS distro once in devcontainer.json and have both local development and CI use that same configuration.
I also cleaned up a bunch of the old X11/WSLg configuration. WSL2 GUI support now works through the normal VS Code Dev Container setup, and native Linux X11 support is available as a separate opt-in feature.
If you’re using ROS2 with Dev Containers, I’d be interested to hear how it works for your setup!
I have been looking into rosidl::Buffer and the current buffer backend support, particularly for large variable-length payloads such as images and point clouds.
One idea I am interested in is a CPU shared-memory backend for rosidl::Buffer.
I realize that this overlaps to some extent with functionality that already exists at lower layers. For example, some middleware / RMW implementations already provide shared-memory transport or other zero-copy optimizations. Depending on the implementation, moving data through shared memory may therefore already be possible without introducing a dedicated Buffer backend.
What I am trying to understand is whether there is still a useful role for shared memory at the rosidl::Buffer layer.
My interest is specifically in large variable-length fields where avoiding copies of the payload itself is useful. Rather than treating shared memory only as a transport optimization for a serialized message, a Buffer backend could potentially make the payload storage itself shared and let a buffer-aware RMW transport a descriptor or reference when appropriate.
This seems potentially complementary to transport-level shared memory rather than necessarily a replacement for it. On the other hand, I can also imagine that the overlap with middleware-native SHM mechanisms may be a reason why such a backend has not been pursued.
In particular, I would be interested in hearing:
Has anyone already explored a CPU shared-memory backend for rosidl::Buffer?
Is sharing the backing storage of large variable-length payloads considered an intended use of the Buffer backend abstraction?
Before prototyping something in this direction, I wanted to check whether there is already related work or design discussion that I have missed. I previously explored a similar problem for CUDA IPC in this discussion, so I would especially like to avoid independently reimplementing something that is already being worked on elsewhere.
I briefly mentioned an order-sensitive state diagnostic in another thread, but that was the wrong place for it. Posting it separately here with an executable reproducer.
The idea is simple: three consecutive pose samples in, one scalar residual out. It quantifies how much the result shifts when you change the nesting order of state composition.
Synthetic test results:
Smooth linear motion: 4.9848e-08
Abrupt pose/orientation jump: 0.000881456
This is absolutely not a validated anomaly detector yet. Normalization, frame conventions and real-world thresholds all need work.
No ROS, Eigen, or external dependencies required to run the reproducer.
I am Ammaar Ahmed. I am pursuing a bachelor’s degree in Robotics and Automation Engineering at FAST NUCES Islamabad, Pakistan. My interest in ROS began about a year and a half ago, when I started building robots with ROS running on raspberry pi.
This summer I have been working on ROS 2 client library performance monitoring with OSRF, with guidance from Kimberly McGuire and Skyler Medeiros. The project is still in progress, but its main workflow now works from benchmark execution to a public dashboard. I wanted to share what it does, what has been completed, and what I plan to improve during the rest of the GSoC period.
Why this project exists
ROS 2 gives developers several choices for how an application communicates and runs. These include different client libraries, middleware implementations, executors, communication modes, and process layouts. These choices are useful because robots have different needs, but they also make performance difficult to compare.
A change that works well for small messages may behave differently with large messages. Results can also change when nodes move from one process to several processes. Looking at one number without knowing how it was produced can therefore give the wrong impression.
ROS 2 benchmark tools already produce detailed measurements, but their output is spread across many files and test scenarios. Reading those files by hand makes it difficult to answer common questions:
Did this ROS 2 version become faster or slower?
Is a slowdown widespread, or limited to one demanding test?
Did latency improve at the cost of CPU or memory?
Were both runs produced by the same workload?
This project connects benchmark execution, result processing, and visualization. Its purpose is to make the results easier to reproduce, compare, and understand.
Current Status and Workflow
The project provides a CLI workflow for running a reduced rclcpp benchmark matrix. It covers publish/subscribe communication, client/service calls, multiple message sizes, middleware implementations, communication modes, and both single-process and multi-process layouts.
The ros2-performance-monitoring run command executes the supported benchmark suite and converts the raw benchmark outputs into a consistent JSONL format. The dashboard up command launches local Prometheus and Grafana services for interactive analysis. Docker and the Docker Compose plugin are required. The project also supports container and image reuse, CPU pinning, alternative ROS distributions, separate Pub/Sub or service suites, and additional configuration options described in the README.md.
The workflow is:
Run a ROS 2 benchmark
↓
Collect benchmark results
↓
Normalize measurements
↓
Compare runs in the dashboard
The dashboard helps answer both what changed and why it changed . The default view compares two benchmark runs, summarizes the overall result, and highlights the metrics that deserve attention. The manual explorer lets you compare one exact workload by matching the same topology, middleware, communication mode, payload size, and process layout on both sides. A coverage view checks whether two runs contain the same tests before comparing them.
The dashboard displays latency, throughput, CPU usage, memory usage, and message reliability where available. It also preserves benchmark metadata including the ROS distribution, middleware, executor, benchmark commit, client library source, hardware platform, payload size, and process layout.
Default comparison view
Figure X. Default dashboard comparing the median Jazzy and median Lyrical benchmark runs.
Manual explorer
Figure Y. Manual explorer showing matching benchmark configurations for detailed investigation.
The public dashboard currently contains five Jazzy runs, five Lyrical runs, and one median summary for each distribution. Every benchmark in the supported matrix runs for 60 seconds. Containers are pinned to the same physical performance cores, and the Jazzy and Lyrical run order is alternated to reduce scheduling and thermal bias. The median summaries provide the primary comparison, while the individual runs remain available to inspect run-to-run variation. Results are published only after the full dataset has been validated.
The complete workflow from running benchmarks to exploring comparisons is working locally, and the dashboard is publicly available at performance.ammaar.lol. Current work focuses on improving repeated run summaries and handling incomplete upstream benchmark data.
I would like to thank Kimberly McGuire and Skyler Medeiros for their guidance, careful reviews, and feedback throughout the project. I am also grateful to OSRF, the ROS community, and everyone who answered questions and made me feel welcome in the community.
Work completed so far
Built a single CLI workflow that prepares the benchmark project, runs it in Docker, and saves the results.
Added a consistent result format so measurements from many benchmark files can be searched and compared together.
Covered publish and subscribe tests as well as client and service tests, from 10-byte messages through 4 MiB messages.
Added support for Fast DDS, Cyclone DDS, and the available Zenoh configurations.
Recorded the context needed for fair comparisons, including ROS version, middleware, executor, process layout, communication mode, source revisions, and machine platform.
Added checks that reject missing or incompatible result files instead of silently presenting partial data as complete.
Built guided, detailed, and manual Grafana views for comparing latency, throughput, CPU, memory, reliability, and test coverage.
Replaced the confusing headline percentages with a plain language comparison result, a reason, and a suggested next action.
Added safe container reuse and image reuse so repeated benchmarks do not rebuild large Docker images unnecessarily.
Added optional CPU pinning to reduce interference on machines with different types of CPU cores.
Added tests and documentation throughout the benchmark, parsing, exporting, and dashboard workflow.
Deployed a public read only dashboard and documented how its code, data, archives, and services are maintained.
Work remaining
There is still time left in the GSoC period. The main remaining work is:
Turn repeated run aggregation into a supported command that validates matching runs, excludes warm ups, records its sources, produces median results, and communicates variability clearly.
Handle incomplete upstream output, including non finite values, missing latency files, unreliable message counters, multi-process synchronization, and pinned submodule revisions.
Make result activation and archiving safer, and move duplicated knowledge about benchmark directory layouts into shared metadata.
Fix Kilted support, improve setup documentation, and test the complete workflow on clean machines.
Support for rclpy, hosted automation, CI benchmarking, hosting under performance.ros2.org and a small local graphical launcher are possible stretch or post GSoC efforts. The CLI workflow would remain the main implementation so the project stays scriptable and reproducible.
I would value your feedback
If you work with ROS 2 performance, maintain a client library or middleware implementation, or are simply curious about how two ROS versions compare, please try the public dashboard. I would especially like to know whether the overall result makes sense without prior benchmark knowledge, whether you can find the scenario behind a warning, and what information would help you trust or question a comparison.
Feedback from both experienced ROS developers and people seeing these measurements for the first time would be very useful and appreciated from the depths of my heart. Thanks for reading.
For industrial robotics teams, simulation is useful only when the important parts of the simulated system behave enough like the real system to support better engineering decisions. A robot arm that looks right but reaches to the wrong pose is an obvious problem. A gripper that looks right but responds differently during contact can be harder to notice, and in manipulation work it may matter even more.
At Southwest Research Institute, we have been developing and evaluating Physical AI approaches for high-mix manipulation. The broader effort combines teach-through-demonstration with simulation, with the goal of supplementing demonstrations through reinforcement learning. Our lab setup includes Universal Robots UR5e arms and Robotiq 2F-85 grippers. The full workcell matters, but the gripper became the clearest example of a practical problem many robotics teams are beginning to face: the asset that is available is rarely the same thing as the asset that is ready for production-oriented simulation.
Isaac Sim representation of the lab system
Photograph of the lab setup
The first problem: available assets are not automatically usable assets
A common starting point in a simulation project is to use the assets that are already available in the simulator or in the ROS ecosystem. That was our starting point as well. Isaac Sim includes Robotiq gripper assets, and there are public Robotiq-related resources in the ROS and ROS 2 ecosystem. Those resources are valuable, but in our testing they did not immediately give us the behavior we needed.
The issues were not cosmetic. We encountered practical asset-structure and behavior problems, including difficulty restructuring an articulation root, gripper assets that were not instanceable, and contact behavior that failed when a mimic joint encountered an object asymmetrically at one finger pad. Each of those issues matters in a production-oriented simulation workflow.
For readers who do not spend their day in USD internals, an “instanceable” asset is one that can be referenced and reused cleanly rather than copied and manually modified each time. That matters when a simulated workcell becomes more complex or when the same asset must appear in many scenes. A “mimic joint” is a joint whose motion follows another joint. For a mechanically coupled gripper, mimic behavior can be the right abstraction because the physical hardware is not simply two independent fingers driven by unrelated commands.
That distinction is central to the Robotiq 2F-85.
Why the Robotiq 2F-85 is a useful test case
The Robotiq 2F-85 is a parallel gripper, but its mechanism is not as simple as two independent pads moving toward each other. It includes closed-loop mechanical behavior, which creates challenges for simulation asset authoring. The practical modeling decision becomes: should the gripper be represented with one driven joint and mimic behavior, or should both sides be driven independently?
A single driven joint with mimic behavior is attractive because it better reflects how the gripper is normally commanded. Driving both sides independently can make an asset move in simulation, but it introduces extra controller and joint-state complexity and moves the simulation farther away from the real gripper abstraction. We evaluated that path by importing a URDF into USD and adding drives to both sides. For our purposes, that direction created more complexity than value, and it likely would still have required mimic behavior to represent the coupled mechanism faithfully.
NVIDIA’s Isaac Sim documentation includes a tutorial on rigging closed-loop structures using a Robotiq 2F-85 gripper, and that tutorial points to a workflow that starts from a CAD/Onshape representation and then adds the physics, joint, and drive configuration needed to make the asset functional in Isaac Sim. That detail is important: import is only the beginning. A realistic gripper asset still needs careful authoring and validation.
What we tried from the ROS ecosystem
After our initial asset testing, we reviewed several public resources related to Robotiq grippers, including the older ROS-Industrial Robotiq repository, PickNik’s ros2_robotiq_gripper, and UW-Lab resources and assets. It’s worth noting that Robotiq does not currently provide first-party assets for its grippers; all of the resources we tested are community-maintained.
The best-performing candidate in our lab testing was the UW-Lab calibrated USD asset for the Robotiq 2F-85. That asset appears to follow the same general pattern as the Isaac Sim closed-loop structure workflow, with additional modifications. Out of the box, it behaved better than the other candidates we tested. Even though it uses mimic behavior, it did not break when an object contacted one finger before the other, and we did not observe the unexpected mesh behavior we saw elsewhere when larger forces were applied.
Simulated Robotiq 2F-85 mounted on the UR arm
That made the UW-Lab asset a much better starting point. It did not make the problem disappear.
The remaining fidelity gap
The physical Robotiq 2F-85 still exhibited behavior that the simulation did not capture. In the real gripper, when an object is grasped near the base-side region of the finger pads, the pads can angle inward slightly. When the object is grasped farther out on the pads, the pads remain parallel.
In our simulation, that behavior was not represented. The simulated kinematics and physics did not capture the same pad motion we observed on the physical gripper.
Physical Robotiq 2F-85 on the lab robot
That may sound like a small difference. In manipulation, small differences at the contact interface can become large differences in outcome. A grasping policy trained or validated in simulation is sensitive to contact geometry, friction, compliance, joint coupling, and failure modes. A gripper asset that works for visualization may still be insufficient for reinforcement learning, synthetic data generation, or pre-deployment validation.
The broader lesson: conversion is not fidelity
ROS users tend to start with URDF, and for good reason. URDF is familiar, widely supported, and often the most available robot description format for ROS-based systems. SDF is also common in simulation workflows. USD and OpenUSD offer a powerful scene representation for modern simulation and digital-twin workflows. But moving from URDF or SDF to USD does not automatically create the physical and behavioral information needed for high-fidelity simulation.
A converter can translate what is present. It cannot reliably invent what is missing.
That is where the SimReady idea is useful. NVIDIA describes SimReady as more than placing simulation data into a USD file. The goal is to represent simulation-ready content through named, typed, validated properties that tools can interpret, validate, and use. In NVIDIA’s broader description, SimReady assets include physics properties, semantic labels, material attributes, and, where needed, behavioral or articulation data.
For robotics teams, that framing exposes the real gap. A useful production asset is not merely a mesh. It is not merely a URDF. It is not merely a USD file. It is a validated representation of geometry, kinematics, dynamics, contacts, materials, semantics, and control-relevant behavior at the level required by the task.
Practical takeaways for robotics teams
First, validate assets against the behavior that matters for the application. Loading the asset, moving the joints, and rendering the workcell are necessary checks, but they are not enough. For manipulation, validation should include contact cases, asymmetric grasps, edge grasps, expected failure modes, verification of the mesh geometries, and comparisons against the physical hardware.
Second, choose the simulated command abstraction deliberately. For a mechanically coupled gripper, independent finger drives may be convenient during asset authoring, but they may also create a mismatch with the real system. If the physical gripper is commanded as a coupled mechanism, the simulation should preserve that abstraction unless there is a clear reason to do otherwise.
Third, track asset provenance and simulator version. Isaac Sim documentation, import workflows, asset structure, and tuning parameters can vary between versions. A gripper that behaves acceptably in one workflow may require different configuration in another. Asset source, simulator version, import method, and post-import modifications should be captured as part of the engineering record.
Fourth, treat conversion as the start of an asset-authoring workflow rather than the end. URDF-to-USD or SDF-to-USD conversion is valuable, but high-fidelity simulation still requires authoring, tuning, and validation. The missing information often lives with the equipment manufacturer or must be measured experimentally.
Finally, involve equipment manufacturers where possible. Manufacturers are often best positioned to provide richer kinematic, dynamic, material, and behavioral information about their products. The robotics community would benefit from a more standard way to move that information from manufacturer data into ROS-compatible descriptions, USD-based simulation assets, and validation tests.
Toward a better ROS-to-SimReady workflow
The Robotiq 2F-85 experience points to a larger opportunity for the ROS-Industrial, open-source robotics, simulation, AI, and equipment-manufacturer communities. We need workflows that preserve what ROS users already rely on while adding the physical and behavioral fidelity required by modern high-fidelity simulation.
A practical workflow could look something like this:
Manufacturers provide CAD, URDF or SDF descriptions, kinematic details, material properties, actuator behavior, and validation data;
ROS and open-source tools support accessible robot descriptions and integration;
USD-based simulation workflows support composition, reuse, and high-quality scene representation; and
SimReady-style validation defines whether an asset is ready for the intended class of simulation tasks.
The important point is that “simulation ready” should become an engineering claim that can be tested, not a label applied because an asset loads in a simulator.
There are signs this is starting to happen. When we contacted Robotiq prior to publication, they indicated that “an official C++ SDK, ROS 2 driver, URDF and updated Isaac Sim assets are in active development.”
Conclusion
Our experience with the Robotiq 2F-85 was a reminder that the hard part of simulation is not always the robot arm, the environment, or the renderer. Sometimes the hard part is the contact behavior of a gripper pad at the exact point where the simulated world meets the physical one.
URDF, SDF, USD, and SimReady all have roles to play, but no single file format solves the fidelity problem by itself. For production robotics, a simulation asset earns trust only when it reproduces the behaviors that affect the task. The closer the ROS, simulation, AI, and equipment communities can align around that standard, the less time teams will spend rebuilding the same assets and the more confidence they can place in simulation before deploying to real hardware.
For years, there has been a strong and consistent demand for seamless Protobuf serialization in ROS/ROS 2. While there are excellent existing tools in the community, integrating them cleanly into a high-performance, production-ready pipeline often comes with friction.
protoros2 does not reinvent the wheel. Instead, it acts as a non-intrusive “Tri-State Orchestration Engine” that elegantly binds third-party Open-Source foundations into a unified architecture. It allows you to use Protobuf in your stack without compromise.
It provides an out-of-the-box EnterpriseNode wrapper that offers multi-channel communication:
• Proto Channel (Zero-Intrusive Fast-Path): Transparently inspects the underlying RMW serialization format at runtime. If the RMW supports Protobuf natively, it routes messages directly via rclcpp::SerializedMessage. If not, it gracefully falls back to standard CDR via rclcpp::TypeAdapter.
• Flat Channel (Performance Bonus): An optional bypass channel optimized for ultra-low latency IPC (powered by Iceoryx shared memory), fully adapted to the ROS 2 executor ecosystem.
Key Features & Use Cases
We designed protoros2 to be flexible enough to accommodate different team workflows, supporting multiple “Single Source of Truth” (SSOT) architectures seamlessly:
• Use Case A: Standard ROS 2 .msg as SSOT
Write your standard .msg files as usual. protoros2 works seamlessly with standard RMWs (CDR only) or native Protobuf RMWs without altering your application logic. In fallback modes, it can even handle simultaneous CDR and Protobuf topic ecosystems flawlessly.
• Use Case B: AI/Robotics .proto as SSOT
For AI-first teams, define your data structures natively in .proto. protoros2 can either co-exist with a generated mirror IDL or operate purely on .proto, bypassing .msg entirely for a direct, zero-overhead binding.
• Native ROS 2 Executor Support:
Whether you prefer standard Callback Push, WaitSets, CallbackGroups (Mutually Exclusive/Reentrant), Polling Subscribers, or Intra-Process Comm—protoros2 natively integrates these paradigms out of the box.
• MLOps Ecosystem Ready:
Full compatibility with mcap format and rosbag2 plugins. Data scientists can consume protobuf bags directly with native python bindings.
Enterprise Security Built-in
To ensure consistency in large-scale deployments, protoros2 utilizes strict C++ access controls to safely encapsulate the raw rclcpp::Node. It intercepts and disables risky dynamic ROS 2 configurations (like parameter services and QoS overriding) at compile time, guaranteeing predictable behavior on the vehicle edge without sacrificing the standard ROS 2 developer experience.
Acknowledgement
This work stands on the shoulders of giants. We want to express our deepest gratitude to the following incredible projects and their contributors, without which protoros2 would not have been possible:
Shivam will introduce the concepts of Forward and Inverse Kinematics, explain where it fits into robotics (and how important it is!) and get into technical details of how to apply it and how the math works.
Also featured two lighting talks
The Pupper Project team will give an update of their progress and hopefully show off their puppy
We are opening early-access evaluations for ADEL 2.0 (Autonomous Deterministic Executive Layer), a bare-metal C++/Rust execution engine built for ultra-low latency, zero-jitter control loops.
While designed for microsecond satellite maneuver planning under severe compute bounds, ADEL 2.0 provides immediate utility for terrestrial robotics, BVLOS drone flight controllers, and autonomous hardware running ROS/ROS2 node topologies.
Lightweight memory footprint suitable for embedded edge targets.
Interactive Monitor & Visualizer:
We are actively scheduling 15-day to 30-day Hardware-in-the-Loop (HIL) benchmarking pilots with robotics hardware teams and autonomous system integrators.
Feel free to test the live monitor above or reach out at annesham649@gmail.com if you’d like to benchmark ADEL 2.0 against your current ROS control stack!
We have been working on adding real-time functionality to rcl and rclcpp since 2022.
In response to this proposal, we have created a new package that provides real-time functionality without changing the existing packages.
The previous discussion is as follows: ROS lacks a unified mechanism to formally support real-time functionality, and we have tried to achieve this by adding functionality to rcl and rclcpp.
On the other hand, it has been pointed out in past PTCs that it makes it difficult to check at release time and to support the OS.
Since CallbackIsolatedExecutor was announced around the same time, we have also changed our policy to provide functionality in separate packages.
For now, we provide rclcpp-friendly classes. There are four things to do:
Add package description to CMakeLists.txt and package.xml
Add a configuration file in YAML format
Change the main routine in the source file
Change rclcpp::init, rclcpp::shutdown to the rclcpp_realtime namespace
Change executors to be able to apply thread attributes provided by rclcpp_realtime
This allows thread attribute settings to be applied to executors by specifying an environment variable or a configuration file with --ros-args.
See the README below for details.
Despite the name, real-time support, not much has been done.
The thread attributes can be managed through the extended rcl interfaces; APIs for thread operations, abstracted by these attributes, are provided, and executors that use the attributes have been added.
In the future, we will change the mutexes and condition variables used in rclcpp_realtime on an RTOS to call OS-native APIs.
Another challenge is to make intra-process communication real-time, so we can guarantee real-time performance in robot systems that run on a single PC.
TL;DR: A workspace-level uv-managed venv works on stock apt-installed ROS 2 — including a PyTorch+CUDA node — but we hit five reproducible failure modes on the way (verified on Jazzy; none of the mechanisms are Jazzy-specific). Key measurement: the known shebang workaround ([build_scripts] executable = /usr/bin/env python3) does not cover --symlink-install, so when colcon is launched from the system Python there is currently no complete workaround. Below are four minimal change proposals for colcon/ament — all opt-in, none fixing the venv’s location or name, with no behavior change for workspaces that do not use a venv.
Background
PEP 668 disabled pip install into the system Python on Ubuntu 24.04, and deep-learning robotics often needs exact version pins and custom package indexes (e.g. torch==2.6.0+cu124) that package.xml/rosdep currently has no way to declare. A per-workspace virtual environment with pyproject.toml and a lockfile — managed here with uv — is one practical answer. In Letting Python Be Python, the idea that workspaces could become venvs was raised, along with the question of what it would take to get there; Status of Colcon building “standards-based” Python packages covers the related build-tool work. This post adds empirical data to that discussion: we migrated a real robot stack to uv while keeping colcon, ros2 run, and ros2 launch in use, and recorded what broke and why.
What works and what breaks
With a venv created by uv venv --system-site-packages from the distro interpreter, and python-preference = "only-system" set in the [tool.uv] section of pyproject.toml, everything builds and a torch+CUDA inference node runs on the venv’s Python, with lockfile reproducibility and custom wheel indexes.
Setup: Ubuntu 24.04 / apt Jazzy / Python 3.12.3 / setuptools 68.1.2 / uv 0.11.28, and pyproject.toml (click for more details)
Along the way we hit five reproducible failure modes. All of them can be worked around, but the workarounds are not covered by official documentation, so they are easy to rediscover independently:
#
Failure mode
Cause
Current workaround
1
Every shell needs two setup steps (source install/setup.bashand venv activation), in order
The ROS environment and the venv have no knowledge of each other
Hand-written shell setup per project
2
colcon treats directories inside the venv as packages during discovery
Package discovery descends into every subdirectory
ros2 run executes ament_python nodes with the system interpreter even while a venv is active
colcon runs setup.py with its own sys.executable; setuptools writes that interpreter into console-script shebangs
Incomplete — see next section (ros2/ros2#1094, open since 2021)
4
numpy 2.x in the venv breaks apt-built extensions (cv_bridge) at import
Jazzy binaries are built against numpy 1.26’s C ABI
Pin numpy<2 in the workspace
5
uv provisions its own standalone CPython, which mismatches distro-built C extensions
uv’s default python-preference
python-preference = "only-system" in pyproject.toml ([tool.uv])
The remaining gap
Four of the five have complete workarounds; #3 does not. A known mitigation is [build_scripts] executable = /usr/bin/env python3 in setup.cfg (mechanism related to colcon-core#183, reported in ros2/ros2#1094). We measured it on Jazzy:
Regular colcon build: works — scripts get env shebangs and resolve to the active venv.
colcon build --symlink-install: not applied — the develop/editable code path keeps #!/usr/bin/python3, so the mode commonly used during development is not covered.
Launching colcon from the venv itself — .venv/bin/python -m colcon build — covers both modes (with --system-site-packages, the apt-installed colcon is importable from the venv, so nothing extra needs to be installed). The limitation: the venv’s absolute path is written into the generated shebangs, so the result does not survive venv recreation and install/ is not relocatable.
Bottom line: when colcon is launched from the system Python — the common configuration in tutorials and CI — there is currently no complete workaround.
Proposed changes
One design principle for all four: opt-in, no fixed venv location or name, and no behavior change for workspaces that do not involve a venv.
P1 — discovery: skip any directory containing pyvenv.cfg (the PEP 405 marker every venv has) during package discovery — an automatic COLCON_IGNORE for venvs of any name, in any location.
P2 — shebangs: an option to emit #!/usr/bin/env python3 shebangs on both the install and the develop (--symlink-install) code paths. The setup.cfg mitigation covers only the install path and has to be repeated in every package; an option at the build-tool level would cover a whole workspace at once. Where no venv is active, env python3 resolves to /usr/bin/python3 as before.
P3 — activation: record the path of the interpreter colcon built with under install/, and let setup.bash read it and, if that interpreter belongs to a venv, activate it (with an opt-out environment variable). This is a minimal mechanism for the “workspaces as venvs” idea from the threads above, and it leaves the venv’s location entirely up to the user.
Relation to existing work
colcon-uv manages Python dependencies per package, installed during colcon build. This post focuses on one environment and one lockfile per workspace; the two granularities address different needs (per-package isolation vs. one shared environment for a whole launch graph) and can coexist.
Pixi as a co-official installation method concerns how ROS itself is installed. The scope here is different and does not compete with it: keeping the standard apt installation and making the Python layer of one workspace reproducible.
ros-python-wheels distributes ROS client libraries as pip-installable wheels. The direction here is complementary: using pip/uv-managed dependencies inside a standard, apt-based ROS workspace.
A similar uv setup (--system-site-packages + lockfile) has been shared in Status of Colcon building “standards-based” Python packages, with nodes started directly through python. The measurements above cover the case where colcon, ros2 run, and ros2 launch stay in use.
Open questions
For P1: would a package-identification extension in colcon-core, modeled on the existing COLCON_IGNORE one, be an acceptable shape — or would this fit better as a separately distributed extension package?
For P2, which layer would be better suited to handle the develop-path shebang — colcon-core, or the setuptools develop machinery?
For those running workspace-level venvs with colcon in CI or on production robots: which failure modes are missing from the list above (overlays, cross-compilation, non-Ubuntu platforms)?
I’ve been working on a global planning engine aimed at warehouse/fleet
deployments, and I just opened a free API tier. I’d love feedback from people
running real Nav2 fleets.
What it does
You upload an occupancy grid once. It solves a field for your goal (charging
station, pick station, dock), and from then on every path query — from any
start cell — returns a strictly optimal path in microseconds, without
re-searching the map.
The pitch for fleet operators: the cost of global planning stops scaling with
the number of robots.
Measured numbers (C++ core, single thread, low-end 2-core CPU)
1M-cell 3D warehouse map (100³, mezzanine floors + rack walls):
Metric
VectorField
A* (C++, typical)
One-time solve per goal
47 ms
—
Query, any start pose
7 µs
~5 ms, every query
Optimality
1.0000 (BFS-verified)
optimal
Peak memory
5 MB
—
10,000 simultaneous queries
70 ms total
~50 s
Dynamic sites: obstacle removal (cleared shelves, opened gates) is patched
exactly, 5.9× faster than a rebuild, zero error. Every solve is a fixed,
bounded number of identical array operations, so worst-case latency is known
in advance — relevant if you need timing guarantees for certification.
Where this fits in a ROS stack
Input: an occupancy grid (the same data you already publish on /map or
keep in a costmap_2d layer)
Output: an optimal cell path per query
Today: plain REST API, so anything that can HTTP can plan. A native Nav2
global-planner plugin (drop-in replacement for Navfn) is on the roadmap —
the field-reuse model maps nicely onto multi-goal / fleet planners, which is
exactly where Navfn recomputes the most.
Typical integration I’m picturing: your fleet manager uploads the map once per
shift (or per layout change), then every robot’s global plan request is a
~7 µs lookup instead of a Navfn re-search.
Honest limitations
Built for structured, mostly-static environments — warehouses, factories,
indoor drones. Not for highly dynamic unstructured spaces.
Obstacle insertion currently uses a repair fallback; exact fast insertion is
roadmap work.
It’s a hosted API (with an on-prem license option), not an open-source
package. Free tier is genuinely free: 100³ maps, 1,000 solves + 100K
queries/month.
For those running multi-robot fleets: how do you handle global replanning
cost today? Is 5 ms/query/robot actually hurting you, or is local planning
the real bottleneck?
What would a Nav2 plugin need to do for you to consider it (topic/action
interface, costmap update cadence, multi-goal support)?
Any interest in an on-prem / offline deployment for sites without
connectivity?
The OSRF Infrastructure Project is planning to update the Jenkins version of https://build.ros2.org as part of our ongoing efforts to maintain and improve the ROS buildfarm infrastructure. To facilitate this migration, the following services will experience downtime during the maintenance window:
https://build.ros2.org (Jenkins) will be temporarily unavailable or in shutdown mode (not running jobs).
The migration is scheduled to begin on Monday Mon, Aug 3, 2026 11:30 AM UTC (11:30 UTC) and is expected to last for 4 hours. During this time, the buildfarm will be offline, and all queued jobs will need to complete before Jenkins is taken offline.
Once the upgrade is complete, I’ll update this thread to confirm that services are back online. I’ll also be monitoring for any issues that may arise as a result of the upgrade.
Thank you for your patience as we work to improve the ROS buildfarm infrastructure. If you have any questions or concerns, please feel free to reach out in this thread.
Just saw that newly imported Chinese legged and humanoid robots are now banned in USA, what other alternatives are there? I know Unitree had ROS interface in both Go2 dog and G1 humanoid (and you could jailbreak cheap base version instead of expensive research one).
What other alternatives are there?
Will this spur open source/open hardware design?
Again, I’m adding poll of what legged/humanoid robots have you used/planned to use
What legged/humanoid robots have you used/will use?
Recently, I’ve been learning more about Zenoh and its role in the ROS 2 ecosystem. Since most ROS 2 applications rely on DDS for communication, I was curious about how Zenoh approaches the same problem and where it can provide advantages.
From what I’ve learned so far, Zenoh offers a lightweight communication layer that aims to reduce latency, minimize bandwidth usage, and simplify communication across distributed systems. These characteristics make it particularly interesting for robots running on resource-constrained hardware such as the Raspberry Pi or for systems that need to communicate across different networks.
I’m currently developing a mobile robot called Pavlov Mini Wheel, based on ROS 2 Humble, and I’m planning to experiment with Zenoh for communication between the onboard Raspberry Pi and an external laptop running perception and navigation workloads. It seem like an interesting opportunity to compare its behavior with the default DDS-based setup.
This post is the first step in my exploraiton of Zenoh. Over the next few weeks, I plan to document:
Installing Zenoh with ROS 2 Humble
Integrating Zenoh into a existing ROS 2 project
Comparing DDS and Zenoh in practical robotics scenarios
Sharing performance observation from a real robot
If you’ve already used Zenoh in your projects, I’d be happy to hear about your experences, recommendations, or challenges you’ve encountered.
[Update] Thanks to the great feedback in the comments regarding rosbag2 snapshot, I have updated the original post to clarify how YERP and rosbag2 snapshot work perfectly together as a trigger-and-capture pair!
Hi everyone, Recently I have been thinking about a very practical debugging problem in ROS / ROS2 perception pipelines, especially for AMRs and mobile robots. When a robot behaves strangely in the field, the usual workflow is often:
rosbag record everything.
Bring the massive data back.
Replay it and try to find what happened.
Of course, rosbag2 is powerful. I am also aware of rosbag2 snapshot mode, which can keep recent messages in memory and dump a raw topic window when triggered. That is actually very close to the architecture I have in mind. I do not want to replace rosbag2 or its snapshot mode. Instead, I want to explore a lightweight layer above it: an event-triggered Runtime Evidence Layer for ROS perception pipelines.
rosbag2 snapshot: captures the raw ROS topic window.
YERP / EvidenceFlow: decides when the snapshot is worth triggering, records why it was triggered, and adds structured perception-runtime evidence.
So the question is not: Can YERP replace rosbag2? The question is: Can YERP act as the lightweight anomaly detector / evidence sidecar layer that triggers rosbag2 snapshot at the exact right moment?
For example, a robot may run normally most of the time, but occasionally:
average FPS looks fine, but p95 / p99 latency spikes
the local planner receives perception results too late
a detection frame creates too many candidates
postprocess suddenly dominates runtime
the issue is hard to reproduce later
In that case, raw topic replay is useful, but we also need to know:
Why was this moment captured?
Which frame was involved?
Which perception stage became slow? (preprocess, inference, postprocess, callback delay, queue delay, or message age?)
Did output pressure increase? Was there a box-count or candidate-count spike?
That is the role I am exploring for YERP.
Current prototype status
The current YERP Vision prototype has already been tested in a standalone YOLO / edge CV pipeline. It can monitor fields such as preprocess_ms, inference_ms, postprocess_ms, p50/p95/p99 latency, box count, and confidence entropy.
When a runtime pressure event is triggered, it saves local evidence (image.jpg, metadata.json, etc.).
In one test case, a normal-looking YOLO frame was captured not because it was manually labeled as a “[bad frame] ”, but because the runtime trace showed pressure:
The important point is not that the image “looks abnormal”. The important point is: this input frame created measurable runtime pressure, so it became worth saving as evidence.
Community Momentum
This concept is already gaining cross-community traction:
I have introduced this EvidenceFlow approach in the Ultralytics GitHub Discussions, where the team is currently gathering feedback.
I’ve also initiated an open co-testing discussion within the MindSpore Lite community, and developers there are exploring collaboration for edge NPU inference.
Now, I want to bring this discussion to the ROS ecosystem, which is arguably where field debugging is the most painful.
EvidenceFlow Schema v0.1 Draft
Instead of exposing all internal YERP logic, I am thinking about a simple structured sidecar format. A ROS / ROS2 runtime pressure event could look like this:
The goal is not to force every ROS project to use these exact fields, but to discuss what a useful runtime evidence record should contain.
Runtime Overhead
A natural concern is: Will such a probe slow down the robot?
Absolutely valid. A probe should not become the new bottleneck. The design separates the workload:
Fast path (Main inference loop): read existing timestamps, update a fixed-size rolling window, check trigger conditions. No file IO, no large tensor copies, no image saving.
Slow path (Background worker): after a trigger, write JSON / image in a background worker, and optionally call rosbag2 snapshot service. Uses a bounded queue and drops evidence if full to avoid blocking inference.
For production ROS / ROS2 systems, the default modes would likely be shadow_mode (observe only) or (write only when triggered).
How I imagine the rosbag2 integration
Observe: YERP observes perception timing and output metadata.
Log: YERP writes a small EvidenceFlow JSON sidecar.
Trigger: If raw replay is needed, YERP calls rosbag2 snapshot service.
Result: raw bag window + structured reason for capture + perception-stage timing + output metadata.
In short: rosbag2 snapshot tells us what raw ROS messages were around the event. YERP / EvidenceFlow tells us why this event was worth capturing.
Questions for the ROS community
I would really appreciate feedback from people who debug ROS / ROS2 robots in the field.
Does this EvidenceFlow schema cover the information you would want when debugging ROS perception latency?
For ROS2, should such an adapter start at the image topic level, diagnostics level, or executor / callback timing level?
For AMR / mobile robot scenarios, which fields matter most? (frame latency, message age, queue delay, callback delay, TF wait time, etc.)
How do you currently trigger rosbag2 snapshots in real robots? (Manual trigger? Diagnostics threshold? Topic frequency monitoring? Custom anomaly detector? Lifecycle event? Nav2 state?)
Would a small structured JSON sidecar make snapshot bags easier to triage later?
Boundary
To avoid misunderstanding:
YERP is not a replacement for rosbag2.
YERP is not a replacement for tracing or profilers.
YERP does not identify the final root cause by itself.
YERP tries to capture the input frame and runtime metadata that make a case worth investigating.
My current goal is to turn field debugging from “record everything and search later” into “capture structured evidence when runtime pressure actually happens”.
I am sharing this as an early prototype and schema draft. Comments, criticism, field stories, and suggestions are very welcome!
If you find this “Runtime Evidence Layer” concept valuable for your edge AI ROS deployments, or if you are interested in co-designing the ROS2 adapter together, feel free to drop a comment below, open an issue on GitHub, or reach out to me directly!
Over the past few months, I've had the privilege of stepping into the role of leading ROS-Industrial Americas. I'm grateful to Matt Robinson for his years of leadership and the strong community he helped build. At our 2026 Annual Meeting, I had the opportunity to share my first impressions and my vision for where we can go next.
I've reproduced that welcome letter below, because it captures the direction I hope we'll pursue together.
This is my first annual meeting as program director for ROS-Industrial Americas, and one thing has become clear very quickly: the strength of ROS-Industrial has never been a single individual or organization. It's the community itself.
Since we announced the leadership transition, I've heard from dozens of members offering encouragement, advice, questions, and ideas.
You made it immediately obvious that you participate in ROS-Industrial not because of a logo or affiliation, but because you genuinely care about advancing industrial robotics. That commitment matters especially now.
It feels like a lot has changed since our last meeting a year ago. Large language models have rapidly evolved from impressive demonstrations into practical tools used daily by engineers around the world. Those same advances are now beginning to reshape robotics as well.
Major technological shifts create uncertainty, but they also create opportunity. One of the reasons ROS-Industrial exists is to help practitioners evaluate emerging technologies, separate signal from noise, and move useful ideas from research into real-world deployment.
For fourteen years now, ROS-I has helped industrial robotics practitioners advance, adopt, and apply technologies that were once difficult to deploy reliably in industrial contexts. Today, we're seeing another transition. Robotic foundation models, LLMs, Physical AI, synthetic data generation, and learning-enabled systems are creating capabilities that seemed impractical not many years ago.
The question for us is no longer whether these technologies will influence industrial robotics. As we will hear from several speakers, they already have. The question is how we incorporate them responsibly, effectively, openly, and practically into real systems.
As I step into this role, I see part of my responsibility as helping this community ask those questions clearly and answer them together.
ROS-Industrial's mission remains the same: enabling innovation in industrial robotics through collaboration, open-source technology, applied research, and education. New technologies will continue to emerge, and our responsibility is to understand them, evaluate them, and make them useful to industrial practitioners. Today, that includes AI. Tomorrow, it will include technologies not yet imagined.
I am grateful to inherit that mission, and I am committed to stewarding it with diligence, openness, and practical focus.
At this year's meeting, our speakers will introduce new open-source robotics software, explore novel applications of AI, discuss new opportunities for open-source automation, and share real-world experience deploying these solutions in specific contexts. Our workshops will give you a focused opportunity to direct the consortium over the coming years.
But the future of ROS-Industrial will not be determined by keynote speakers, steering committees, or roadmap documents alone. It will be shaped by practitioners who bring real problems, real deployments, real successes, and even real failures back to the community.
I offer my sincere thanks to every one of you and your colleagues who have fed this community over the last year: contributing code, sharing lessons learned, participating in projects, mentoring newcomers, and helping move open-source robotics technology from research into production.
I'm excited about this meeting, but I'm more excited about what we'll all do together in the year ahead.
Sincerely, Jerry Towler Program Director, ROS-Industrial Americas