OpenPI
Based on published sources · Not tested by us ·
Overview
Vision-language-action model code, checkpoints and adaptation examples for pi0, pi0-FAST and pi0.5, with backend-specific features and robot-specific action conventions. [S001]
openpi provides code, published checkpoint paths and examples for Physical Intelligence's pi0, pi0-FAST and pi0.5 robot-policy models. The reviewed commit supports the flow-matching head for pi0.5. Upstream describes the release as experimental and warns that adapting a policy to another robot may not succeed. This entry treats those checkpoints as starting points for an experiment, not ready-made controllers for arbitrary hardware. [S001] [S002]
Specifications
| Detail | Description |
|---|---|
| Intended users | Robot-learning researchers able to validate model, data and robot-interface compatibility Editorial assessment [S001] · Checked 2026-10-01 |
| Required software | uv-managed Python environment and repository submodules; JAX or supported PyTorch model implementation; Matching checkpoint, normalization statistics and policy configuration; Robot-specific observation/action transformations Reported by source [S001] [S005] [S006] · Checked 2026-10-01 |
| Installation | Follow the recursive-submodule and uv setup instructions, choose a backend and matched checkpoint, then validate the policy input/output mapping using the provided examples. Editorial route; no installation or execution performed. Editorial assessment [S001] [S006] · Checked 2026-10-01 |
| Uses | Fine-tune a base model on converted data; Compute or deliberately reuse normalization statistics; Serve inference on a separate GPU host; Map image/state observations to robot-specific action chunks Reported by source [S001] [S005] [S006] · Checked 2026-10-01 |
| File formats | Not known |
| Development status | Documented setup available Research classification from documented artifacts/workflow, not our reproduction or production qualification. Editorial assessment [S001] · Checked 2026-10-01 |
3D preview
A robot-part preview is not applicable to this software project profile.
Installation and use
Backend choice changes the available workflow
The pinned README supports JAX and selected PyTorch models. Its PyTorch section excludes pi0-FAST, LoRA, FSDP, mixed-precision training and EMA weights during training. Therefore, a memory estimate or fine-tuning recipe elsewhere in the overview is not automatically available through both implementations. The PyTorch setup also patches transformers 4.53.2; upstream warns that the default uv hardlink mode can propagate those modifications through the shared cache. Review that setup in an isolated environment before reusing it across projects. [S001]
The requirements section says the current training script lacks multi-node support, while the later PyTorch section supplies a multi-node launch example. That discrepancy needs a backend-specific reading and validation; this profile does not assert one universal multi-node capability. Upstream's stated supported system is Ubuntu 22.04 with an NVIDIA GPU. Its single-GPU estimates are greater than 8 GB for inference, 22.5 GB for LoRA and 70 GB for full fine-tuning, not measured requirements from this review. [S001]
A checkpoint needs its configuration and statistics
The README lists base and task-specific checkpoint paths in the public openpi-assets bucket. They are downloaded and cached by the example utilities when used. Selecting a path is only part of setup: the policy configuration supplies the model and data transformations, and normalization statistics accompany the checkpoint. This review inspected these instructions without downloading model payloads. [S001] [S005]
The normalization guide distinguishes recomputing statistics for new data from reusing statistics for a matching pretraining robot. Reuse requires the same action-space definitions, not merely the same robot brand. It recommends evaluating both choices when adapting a task. The guide's base-model conventions include joint angles in radians and gripper positions from zero for open to one for closed, but DROID uses joint-velocity actions and a 15 Hz control frequency. Those differences must be resolved before sending a predicted action to a robot. [S005]
The listed normalization asset identifiers are specific to the documented base-model routes. Do not infer that every statistic applies unchanged to every newer checkpoint. The README's data-conversion workflow also computes statistics before fine-tuning and describes input/output transformations for the selected environment. [S001] [S005]
Remote inference separates environments, not robot semantics
The remote-inference example runs the policy on a GPU server and uses a lightweight WebSocket client in the robot environment. Its client resizes images, converts them to unsigned 8-bit format and sends policy-specific observation keys, state and a task prompt. It returns an action chunk with horizon and action dimensions. The robot-side integration still has to interpret and execute those actions according to the selected policy's conventions. [S006]
Use the repository's no-robot inference example and the relevant robot or simulator instructions as staged integration checks. That is an editorial starting sequence; this publication has not run inference, training, networking or hardware control and does not report latency or task-success measurements. [S001] [S006]
Separate source, checkpoint and training-data rights
The source root license is Apache-2.0. The repository also includes Gemma Terms of Use, which contain use restrictions and distribution obligations. The inspected materials do not establish a complete license mapping for every published checkpoint, so this profile does not label all weights Apache-2.0 or uniformly open source. [S003] [S008]
Likewise, public fine-tuning examples and dataset links do not establish release of the entire pretraining mixture. The overview describes more than 10,000 hours of training data and references both public and internal task data. Availability and rights for the complete mixture remain unresolved here. Source availability, downloadable checkpoints and full training reproducibility are distinct findings. [S001]
Source files and licenses
Available project sources support research coverage; complete build and commercial qualification remain separate.
| Layer | Availability / license |
|---|---|
| software | available · Apache-2.0 Code license; repository also includes separate Gemma terms, and dependencies retain their own terms. [S003] |
| model weights | available · License not fully assessed README publishes gs://openpi-assets checkpoint paths. Payloads not downloaded. Complete checkpoint license mapping unresolved; bundled Gemma terms are not Apache-2.0 and include use restrictions. [S001] [S008] |
| datasets | available · License not fully assessed Public fine-tuning data links and conversion examples exist. Full 10k+ hour pretraining mixture availability and constituent rights not established; includes references to internal data. [S001] |
| documentation | available · License not fully assessed Documentation source available; separate documentation-wide rights not established. [S004] [S005] [S006] |
References
Links identify the documentation and revisions used in this profile. Access dates record when each source was retrieved.
- S001 · Physical-Intelligence / project contributors
Upstream project overview
Accessed 2026-10-01 · README.mdSource notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S002 · Physical-Intelligence / project contributors
Repository revision and release metadata
Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479Source notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S003 · Physical-Intelligence / project contributors
Repository license
Accessed 2026-10-01 · LICENSESource notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S004 · Physical-Intelligence / project contributors
Pinned repository artifact inventory
Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 archive file inventorySource notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S005 · Physical-Intelligence / project contributors
Pinned openpi: docs/norm_stats.md
Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / docs/norm_stats.mdSource notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S006 · Physical-Intelligence / project contributors
Pinned openpi: docs/remote_inference.md
Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / docs/remote_inference.mdSource notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S007 · Physical-Intelligence / project contributors
Pinned openpi: pyproject.toml
Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / pyproject.tomlSource notes
Source text inspected for the cited scoped claims; see profile claim notes.
- S008 · Physical-Intelligence / project contributors
Bundled Gemma Terms of Use
Accessed 2026-10-01 · 215abfb217dbac7d5f1273282331b9b1866c0479 / LICENSE_GEMMA.txtSource notes
Source text inspected for the cited scoped claims; see profile claim notes.
Correction guidance · Discussion is not enabled · Profile format 0.6.0-draft.1