MCP server for NVIDIA Isaac Sim & Isaac Lab — enables AI tools to control simulation via Model Context Protocol
17 tools with consistent naming (verb_noun pattern) and descriptions present. However, critical gaps: (1) NO input schemas visible in source code, all tools show parameter descriptions in docstrings but FastMCP registration lacks explicit JSON Schema definitions; (2) descriptions average ~150 chars but lack actionable guidance (e.g., 'Call this first', error recovery, prerequisites); (3) no output schemas documented, LLMs cannot plan downstream calls; (4) execute_code tool is extremely high-risk with no dry-run, confirmation, or sandboxing guidance; (5) parameter constraints missing (e.g., prim_type enum, gravity_magnitude range, num_steps bounds); (6) no error handling guidance in any tool description. Tool names are clear (get_*, create_*, set_*, etc.) but descriptions read as API docs, not LLM-optimized prompts.
Add a physics-enabled ground plane to the scene. Args: prim_path: Where to create the ground plane. position: [x, y, z] position, default [0, 0, 0].
Add rigid body physics to an existing prim so it participates in simulation. Args: prim_path: Prim to make into a rigid body. mass: Mass in kg. If None, uses density-based calculation. enable_collision: Whether to add collision shape.
Create a PhysicsScene prim to enable physics simulation. Args: prim_path: Where to create the physics scene prim. gravity_direction: Gravity direction vector, default [0, 0, -1]. gravity_magnitude: Gravity magnitude in m/s^2, default 9.81.
Create a USD prim (3D object) in the Isaac Sim scene. Args: prim_path: Absolute USD path, e.g. "/World/MyCube". prim_type: One of "Cube", "Sphere", "Cylinder", "Cone", "Plane", "Xform", "Capsule". position: [x, y, z] translation in stage units. rotation: [rx, ry, rz] Euler rotation in degrees. scale: [sx, sy, sz] scale factors. color: [r, g, b] diffuse color (0.0-1.0 range). size: Size attribute for geometric prims.
Delete a prim from the USD stage. Args: prim_path: Absolute USD prim path to remove.
No input schemas visible in source code. FastMCP tool registration lacks explicit JSON Schema definitions with type constraints, enums, and ranges. Parameter descriptions exist in docstrings but are not machine-parseable.
No output schemas documented. LLMs cannot infer what fields to expect from tool responses, preventing downstream tool chaining and forcing wasteful discovery calls.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 51 | <=2025-11-25 | v2 |
Execute Python code inside Isaac Sim's runtime. The code runs in Isaac Sim's Python interpreter with full access to all APIs (omni.usd, pxr, carb, etc.). stdout/stderr are captured. Args: code: Python source code to execute.
Get all joint names and their current positions for an articulation. Args: prim_path: Root prim path of the articulation (e.g. "/World/Franka").
Get detailed information about a specific prim in the USD stage. Args: prim_path: Absolute USD prim path, e.g. "/World" or "/World/Cube". Returns prim type, transform, attributes, and children.
Get an overview of the current USD stage in Isaac Sim. Returns root layer path, up-axis, meters-per-unit, total prim count, and a summary of each root-level prim (path, type, children). Call this to understand what is currently in the scene.
List all robot assets available for spawning from the config.
Load a USD asset (robot, object, environment) as a reference. Args: usd_path: Path or URL to the USD file. prim_path: Where to place the asset in the stage. position: [x, y, z] translation. rotation: [rx, ry, rz] Euler rotation in degrees. scale: [sx, sy, sz] scale factors.
Modify an existing prim's transform or visibility. Args: prim_path: Absolute USD prim path. position: New [x, y, z] translation. rotation: New [rx, ry, rz] Euler rotation in degrees. scale: New [sx, sy, sz] scale. visible: Set visibility (true = visible, false = hidden).
Check connectivity to Isaac Sim and return server version. Always call this first to verify the extension is reachable.
Set target positions for joints on an articulation. Args: prim_path: Root prim path of the articulation (e.g. "/World/Franka"). joint_positions: Dict mapping joint name to target position (degrees for revolute, cm for prismatic).
Advance the simulation by a number of physics steps. Args: num_steps: Number of physics steps to advance.
Control the simulation timeline. Args: action: One of "play", "pause", "stop".
Spawn a robot from the asset config or a custom USD path. Args: robot_name: Name of the robot (e.g. "franka", "ur10", "spot", "go2"). See list_available_robots for all options. prim_path: Where to place the robot. Defaults to /World/<robot_name>. position: [x, y, z] translation. rotation: [rx, ry, rz] Euler rotation in degrees. usd_path: Custom USD path/URL. If None, looks up from robot_assets.json.
execute_code tool is extremely high-risk (IRREVERSIBLE risk level) with no dry-run, confirmation step, or sandboxing guidance. Agents can execute arbitrary Python in Isaac Sim without safeguards.
Parameter constraints missing. prim_type should be an enum; gravity_magnitude, num_steps, and array sizes lack min/max bounds; simulation_control action should be an enum. Free-form strings invite hallucinated values.
No error handling guidance in any tool description. Descriptions do not explain what to do if a prim path is invalid, connection fails, or physics simulation diverges. LLMs receive no recovery hints.