Success rate drops by half on surfaces with friction below 0.3. Objects under 4cm see 83%+ failure rates. RoboGate runs 20,000 Isaac Sim experiments across Franka Panda & UR5e to uncover these risks before deployment.
GitHub Dataset
20,000 experiments · 2 robots · MIT License
HuggingFace Dataset
robogate-failure-dictionary · Robotics
20,000 Isaac Sim experiments · Franka Panda + UR5e · NVIDIA RTX
$ robogate test --policy v2.3 --baseline v2.2
[1/5] Verifying artifacts... ✓
[2/5] Loading config... ✓
[3/5] Running 68 scenarios...
████████████████████████ 68/68
[4/5] Computing metrics... ✓
[5/5] Generating reports... ✓✅ PASS — Confidence: 92/100
Success Rate: 95.4% ▲ +2.2%
Collisions: 0
Cycle Time: 4.1s
NVIDIA Isaac Sim + RTX · Real Physics Simulation · Franka Panda + UR5e
Random Condition Failure Rate
Danger Zone Conditions
Worst Combination Failure Rate
Friction-Success Correlation #1
NVIDIA built the simulator. RoboGate built deployment validation on top of it.
You only test under normal conditions. Dark environments, tiny objects, surfaces with 0.1 friction — your robot encounters these for the first time in production.
Edge case failure rate 83%+Senior engineers run tests manually. Criteria vary by person. Results are rarely documented.
RoboGate: 68 scenarios, fully automatedNo alerts when success rate drops by 5%. Problems surface only after production stops.
Drift detection: under 5 minAutomatically test new AI policies across 68 scenarios in Isaac Sim.
nominal 20 · edge 15 · adversarial 10 · DR 23
good_policy 68/68 PASS · confidence 76
Data-driven PASS/FAIL decisions with Confidence Score 0-100.
FAIL report + failure evidence auto-generated when thresholds are breached
bad_policy 0/68 FAIL · confidence 25
Automatic performance drift detection + alerts after deployment.
5% drop warning · 10% drop critical · rollback recommendation
Slack · Telegram · Teams
Franka Panda performing Pick & Place tasks in Isaac Sim
good_policy · 68/68 PASS · confidence 76 · 100% success
bad_policy · 0/68 FAIL · confidence 25 · 6 collisions
Send us your policy file and we'll run a free Isaac Sim validation test.
20,000 Isaac Sim experiments completed · MIT License · NVIDIA Isaac Sim 5.1