Open Source RoboticsRobots, software & field notes

OpenPI

Based on published sources · Not tested by us ·

Overview

Vision-language-action model code, checkpoints and adaptation examples for pi0, pi0-FAST and pi0.5, with backend-specific features and robot-specific action conventions. [S001]

openpi provides code, published checkpoint paths and examples for Physical Intelligence's pi0, pi0-FAST and pi0.5 robot-policy models. The reviewed commit supports the flow-matching head for pi0.5. Upstream describes the release as experimental and warns that adapting a policy to another robot may not succeed. This entry treats those checkpoints as starting points for an experiment, not ready-made controllers for arbitrary hardware. [S001] [S002]

Specifications

DetailDescription
Intended usersRobot-learning researchers able to validate model, data and robot-interface compatibility
Editorial assessment [S001] · Checked 2026-10-01
Required softwareuv-managed Python environment and repository submodules; JAX or supported PyTorch model implementation; Matching checkpoint, normalization statistics and policy configuration; Robot-specific observation/action transformations
Reported by source [S001] [S005] [S006] · Checked 2026-10-01
InstallationFollow the recursive-submodule and uv setup instructions, choose a backend and matched checkpoint, then validate the policy input/output mapping using the provided examples.
Editorial route; no installation or execution performed.
Editorial assessment [S001] [S006] · Checked 2026-10-01
UsesFine-tune a base model on converted data; Compute or deliberately reuse normalization statistics; Serve inference on a separate GPU host; Map image/state observations to robot-specific action chunks
Reported by source [S001] [S005] [S006] · Checked 2026-10-01
File formatsNot known
Development statusDocumented setup available
Research classification from documented artifacts/workflow, not our reproduction or production qualification.
Editorial assessment [S001] · Checked 2026-10-01

3D preview

A robot-part preview is not applicable to this software project profile.

Installation and use

Backend choice changes the available workflow

The pinned README supports JAX and selected PyTorch models. Its PyTorch section excludes pi0-FAST, LoRA, FSDP, mixed-precision training and EMA weights during training. Therefore, a memory estimate or fine-tuning recipe elsewhere in the overview is not automatically available through both implementations. The PyTorch setup also patches transformers 4.53.2; upstream warns that the default uv hardlink mode can propagate those modifications through the shared cache. Review that setup in an isolated environment before reusing it across projects. [S001]

The requirements section says the current training script lacks multi-node support, while the later PyTorch section supplies a multi-node launch example. That discrepancy needs a backend-specific reading and validation; this profile does not assert one universal multi-node capability. Upstream's stated supported system is Ubuntu 22.04 with an NVIDIA GPU. Its single-GPU estimates are greater than 8 GB for inference, 22.5 GB for LoRA and 70 GB for full fine-tuning, not measured requirements from this review. [S001]

A checkpoint needs its configuration and statistics

The README lists base and task-specific checkpoint paths in the public openpi-assets bucket. They are downloaded and cached by the example utilities when used. Selecting a path is only part of setup: the policy configuration supplies the model and data transformations, and normalization statistics accompany the checkpoint. This review inspected these instructions without downloading model payloads. [S001] [S005]

The normalization guide distinguishes recomputing statistics for new data from reusing statistics for a matching pretraining robot. Reuse requires the same action-space definitions, not merely the same robot brand. It recommends evaluating both choices when adapting a task. The guide's base-model conventions include joint angles in radians and gripper positions from zero for open to one for closed, but DROID uses joint-velocity actions and a 15 Hz control frequency. Those differences must be resolved before sending a predicted action to a robot. [S005]

The listed normalization asset identifiers are specific to the documented base-model routes. Do not infer that every statistic applies unchanged to every newer checkpoint. The README's data-conversion workflow also computes statistics before fine-tuning and describes input/output transformations for the selected environment. [S001] [S005]

Remote inference separates environments, not robot semantics

The remote-inference example runs the policy on a GPU server and uses a lightweight WebSocket client in the robot environment. Its client resizes images, converts them to unsigned 8-bit format and sends policy-specific observation keys, state and a task prompt. It returns an action chunk with horizon and action dimensions. The robot-side integration still has to interpret and execute those actions according to the selected policy's conventions. [S006]

Use the repository's no-robot inference example and the relevant robot or simulator instructions as staged integration checks. That is an editorial starting sequence; this publication has not run inference, training, networking or hardware control and does not report latency or task-success measurements. [S001] [S006]

Separate source, checkpoint and training-data rights

The source root license is Apache-2.0. The repository also includes Gemma Terms of Use, which contain use restrictions and distribution obligations. The inspected materials do not establish a complete license mapping for every published checkpoint, so this profile does not label all weights Apache-2.0 or uniformly open source. [S003] [S008]

Likewise, public fine-tuning examples and dataset links do not establish release of the entire pretraining mixture. The overview describes more than 10,000 hours of training data and references both public and internal task data. Availability and rights for the complete mixture remain unresolved here. Source availability, downloadable checkpoints and full training reproducibility are distinct findings. [S001]

Source files and licenses

Available project sources support research coverage; complete build and commercial qualification remain separate.

LayerAvailability / license
softwareavailable · Apache-2.0
Code license; repository also includes separate Gemma terms, and dependencies retain their own terms. [S003]
model weightsavailable · License not fully assessed
README publishes gs://openpi-assets checkpoint paths. Payloads not downloaded. Complete checkpoint license mapping unresolved; bundled Gemma terms are not Apache-2.0 and include use restrictions. [S001] [S008]
datasetsavailable · License not fully assessed
Public fine-tuning data links and conversion examples exist. Full 10k+ hour pretraining mixture availability and constituent rights not established; includes references to internal data. [S001]
documentationavailable · License not fully assessed
Documentation source available; separate documentation-wide rights not established. [S004] [S005] [S006]

References

Links identify the documentation and revisions used in this profile. Access dates record when each source was retrieved.

  1. S001 · Physical-Intelligence / project contributors
    Upstream project overview
    Accessed 2026-10-01 · README.md
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  2. S002 · Physical-Intelligence / project contributors
    Repository revision and release metadata
    Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  3. S003 · Physical-Intelligence / project contributors
    Repository license
    Accessed 2026-10-01 · LICENSE
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  4. S004 · Physical-Intelligence / project contributors
    Pinned repository artifact inventory
    Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 archive file inventory
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  5. S005 · Physical-Intelligence / project contributors
    Pinned openpi: docs/norm_stats.md
    Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / docs/norm_stats.md
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  6. S006 · Physical-Intelligence / project contributors
    Pinned openpi: docs/remote_inference.md
    Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / docs/remote_inference.md
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  7. S007 · Physical-Intelligence / project contributors
    Pinned openpi: pyproject.toml
    Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / pyproject.toml
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

  8. S008 · Physical-Intelligence / project contributors
    Bundled Gemma Terms of Use
    Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / LICENSE_GEMMA.txt
    Source notes

    Source text inspected for the cited scoped claims; see profile claim notes.

Research and review details

Source research only; no installation, physical build or performance test performed. No affiliate links added.

Profile edited 2026-10-01 · Sources checked 2026-10-01 · Next review target 2026-10-31

Revision: 215abfb217dbac7d5f1273282331b9b1866c0479 (commit snapshot; no published stable release found). Software repository activity recorded 2026-08-24 [S002]

Correction guidance · Discussion is not enabled · Profile format 0.6.0-draft.1

Change history