AWOMO
WORLD ACTION MODEL · TECHNICAL REPORT

Awomo-0.5From Visual Generation
to Robot Control

Adapting pretrained image and video generators to jointly predict future observations and robot actions.
Pretrained on 36,800 hours of heterogeneous embodied data and evaluated in simulation and on real robots.

AWOMO · Westlake DI · Awomo-WAM TeamResearch blog
95.9%LIBERO-Plus

Mean success across seven perturbations

96.1%RoboTwin 2.0

Mean success under the Full protocol

64.4%RoboCasa365

Overall success across 50 tasks

73.4%MolmoSpaces

Mean success across four skills

35.3RoboDojo

Overall task progress score

79.7%Piper · Real World

Overall success across 69 real-world entries

01 / INTRODUCTION

Adapting Visual Generators to Robot Control

Robot policies must follow language instructions while adapting to changes in objects, scenes, viewpoints, and task requirements. World action models draw on pretrained visual generators to learn actions jointly with their visual consequences. Adapting these generators to robot control requires an interface for representing and predicting robot actions within the visual backbone. A central design question is how directly action generation can reuse the pretrained components used for visual generation.

We introduce Awomo-0.5, a world action modeling framework that adapts pretrained visual generators to robot control. Our primary model, Awomo-0.5I, represents robot actions as image-like patches and jointly generates a future image and an action chunk, reusing the image transformer’s input and output patch projections. Conditioned on language, the current observation, and robot state, the model jointly denoises a future image and an action chunk.

We also study Awomo-0.5V, a video-based variant that uses learned action encoding and decoding layers within a shared video-action transformer. Both models are pretrained on 36,800 hours of real-robot trajectories, simulated demonstrations, public and in-house egocentric video, and UMI recordings, and our training data is organized around atomic skill families rather than end-to-end tasks. A unified action representation and source-specific validity masks enable joint training across embodiments while retaining visual supervision from data without action labels.

Jointly generate actions and their future visual consequences,
sharing the representations and computation of pretrained visual generators.
Awomo-0.5 Overview
Awomo-0.5 Overview
Scroll horizontally to explore the details
Overview of Awomo-0.5. We pretrain world action models on heterogeneous robot and human data in a unified action space; the resulting Awomo-0.5I performs strongly across simulation and real-world benchmarks.
02 / MODEL EVALUATION

Model Evaluation

We evaluate Awomo-0.5I and Awomo-0.5V on simulation benchmarks and the Piper robot platform, examining task execution, robustness to environmental changes, and composition of learned skills. Each model is adapted separately to each benchmark and compared with representative vision-language-action models (VLAs) and world action models (WAMs).

Simulation and Real-World Results
Awomo-0.5I and Awomo-0.5V on simulation benchmarks and Piper tasks, compared with π0.5 and the strongest VLA and WAM baselines for each benchmark
Scroll horizontally to explore the details
Overall performance across benchmarks. Reference curves show π0.5 and the strongest VLA and WAM baselines on each benchmark. RoboDojo uses full-task success rate; RoboTwin 2.0 uses the C2R protocol, which trains only on clean demonstrations. Each benchmark uses a separately adapted policy.

Simulation Evaluation

RoboDojo, RoboCasa365, LIBERO-Plus, MolmoSpaces, and RoboTwin 2.0 probe diverse task requirements, compositional kitchen tasks, robustness to controlled perturbations, object-interaction skills, and bimanual manipulation, respectively. We study post-training of Awomo-0.5I and Awomo-0.5V on these five simulation benchmarks, training a separate policy for each benchmark and evaluating it under the corresponding protocol.

RoboDojo

The RoboDojo simulation benchmark covers generalization, precision, long-horizon execution, memory, and open-vocabulary instruction following. Evaluation reports both task-progress score and complete-task success rate. For generalization, each metric is averaged across standard and randomized conditions. The overall score and success rate are then computed by averaging their respective values across the five capability dimensions.

Awomo-0.5I obtains an overall score of 35.3 and a success rate of 29.6%. Awomo-0.5V obtains 28.7 and 22.9%, respectively. For Awomo-0.5I, memory has the highest completion rate, at 41.2%; precision and long-horizon execution achieve success rates of 33.5% and 26.8%.

RoboDojo: results by category · score / success rate (%)
ModelGeneralizationPrecisionLong-horizonMemoryOpen-vocabularyOverall
Awomo-0.5I30.3 / 23.839.7 / 33.540.4 / 26.842.3 / 41.224.1 / 22.935.3 / 29.6
Awomo-0.5V26.9 / 20.836.3 / 28.139.0 / 25.013.1 / 12.528.1 / 28.128.7 / 22.9
RoboDojo · Overall. Task progress score is shown on the left and full-task success rate on the right, sorted by score.
Scroll horizontally for the full chart; select a metric above
RoboDojo · Overall. Task progress score is shown on the left and full-task success rate on the right, sorted by score.
View the full comparison
RoboDojo: full model comparison · score / success rate (%)
ModelFamilyGeneralizationPrecisionLong-horizonMemoryOpen-vocabularyOverall
GalaxeaVLA (G0)VLA4.5 / 2.88.1 / 3.812.6 / 5.63.2 / 1.90.7 / 0.75.8 / 3.0
StarVLAVLA3.9 / 2.39.9 / 4.314.2 / 6.53.3 / 2.40.7 / 0.66.4 / 3.2
Xiaomi-Robotics-0VLA7.4 / 5.68.4 / 4.613.5 / 6.95.1 / 3.70.2 / 0.26.9 / 4.2
StarVLA-OFTVLA7.4 / 4.816.1 / 10.214.3 / 6.21.7 / 1.71.4 / 1.38.2 / 4.8
StarVLA-GR00TVLA8.0 / 5.39.6 / 4.716.2 / 7.25.6 / 4.31.9 / 1.98.3 / 4.7
MolmoAct2VLA8.5 / 4.710.9 / 4.515.2 / 7.05.5 / 4.64.8 / 4.49.0 / 5.0
X-VLAVLA10.5 / 6.818.3 / 12.016.5 / 9.84.8 / 3.60.6 / 0.510.1 / 6.5
VLActVLA9.5 / 6.320.6 / 15.220.1 / 13.70.7 / 0.62.4 / 2.310.7 / 7.6
StarVLA-PI_v3VLA11.2 / 8.117.8 / 12.518.5 / 11.04.6 / 4.02.0 / 2.010.8 / 7.5
InternVLA-A1.5VLA10.4 / 6.815.2 / 10.223.8 / 13.84.9 / 3.61.4 / 1.411.2 / 7.1
Pi-05VLA13.4 / 8.212.4 / 5.523.5 / 14.75.9 / 4.72.0 / 1.711.4 / 6.9
Spatial ForcingVLA14.1 / 9.317.3 / 10.623.3 / 14.65.4 / 4.11.8 / 1.612.4 / 8.0
Hy-Embodied-0.5-VLAVLA11.8 / 8.413.8 / 8.025.7 / 14.913.4 / 12.10.7 / 0.613.1 / 8.8
Meituan-Robotics-0VLA13.8 / 8.216.8 / 7.829.6 / 18.610.1 / 8.94.5 / 4.315.0 / 9.5
Xiaomi-Robotics-1VLA23.5 / 17.026.7 / 18.838.4 / 23.77.8 / 6.63.9 / 3.620.1 / 13.9
GalaxeaVLA (G0.5)VLA18.5 / 12.828.3 / 20.444.1 / 32.38.6 / 7.31.7 / 1.620.2 / 14.9
DM0.5 (Dexmal)VLA15.8 / 10.924.8 / 16.833.7 / 19.547.7 / 47.42.4 / 2.124.9 / 19.3
LDA-1BWAM0.8 / 0.13.3 / 0.72.0 / 0.12.1 / 1.80.1 / 0.11.7 / 0.5
Fast-WAMWAM2.3 / 1.12.0 / 0.09.1 / 5.23.5 / 3.40.4 / 0.43.5 / 2.0
AHA-WAMWAM5.8 / 3.35.9 / 2.48.6 / 2.73.0 / 2.80.9 / 0.84.8 / 2.4
GigaWorld-Policy-0WAM5.3 / 2.96.2 / 1.815.5 / 8.93.5 / 2.20.5 / 0.56.2 / 3.3
X-WAMWAM7.4 / 3.36.7 / 1.817.5 / 9.16.3 / 4.70.6 / 0.37.7 / 3.8
OpenWAM-αWAM20.7 / 14.818.4 / 9.334.9 / 25.310.4 / 9.11.4 / 1.117.2 / 11.9
Awomo-0.5VWAM26.9 / 20.836.3 / 28.139.0 / 25.013.1 / 12.528.1 / 28.128.7 / 22.9
Awomo-0.5IWAM30.3 / 23.839.7 / 33.540.4 / 26.842.3 / 41.224.1 / 22.935.3 / 29.6

Standard and randomized generalization yield 37.70 / 30.89% and 22.92 / 16.78%, respectively, where each pair denotes score / success rate. The success-rate drop under randomized generalization identifies robustness as a remaining challenge. The gap between long-horizon score and complete-task success also indicates that partial task progress does not consistently lead to final completion.

Precise positioning and object interactionRoboDojo · Placing a coin
Symbol understanding and action executionRoboDojo · Arithmetic task

RoboCasa365

RoboCasa365 provides 365 kitchen tasks across 2,500 environments. Its multi-task learning benchmark evaluates 50 target tasks comprising 18 Atomic-Seen, 16 Composite-Seen, and 16 Composite-Unseen tasks. The unseen composite split tests whether a policy can execute task compositions excluded from its downstream training data. Evaluation runs 30 trials for each of the 50 target tasks, yielding 1,500 episodes. Overall success is the total number of successful episodes divided by 1,500, equivalent to weighting the three split success rates in an 18:16:16 ratio.

Awomo-0.5I achieves 64.4% overall success (966/1,500), and Awomo-0.5V reaches 62.5% (938/1,500). Both models exceed Xiaomi-Robotics-1’s reported overall success rate of 57.4% by 7.0 and 5.1 percentage points, respectively. Awomo-0.5I performs better on unseen compositions, while Awomo-0.5V is stronger on seen compositions. Both retain substantial success on unseen task compositions, demonstrating generalization beyond the downstream training tasks.

RoboCasa365: results by category · success rate (%)
ModelAtomic-SeenComposite-SeenComposite-UnseenOverall
Awomo-0.5I86.558.845.264.4
Awomo-0.5V85.060.439.462.5
RoboCasa365 · Overall. Models are ranked by success rate.
Scroll horizontally for the full chart; select a metric above
RoboCasa365 · Overall. Models are ranked by success rate.
View the full comparison
RoboCasa365: full model comparison · success rate (%)
ModelFamilyAtomic-SeenComposite-SeenComposite-UnseenOverall
Azero-Robotics-1VLA30.33.81.612.6
π0VLA34.66.11.114.8
π0.5VLA39.67.11.216.9
GR00T N1.6VLA51.19.41.721.9
GR00T N1.5VLA50.714.82.723.9
WorldDreamerVLA66.326.79.035.3
RLDX-1VLA67.627.98.536.0
PRTSVLA66.330.318.839.6
Phasor-m7VLA78.757.431.556.8
Xiaomi-Robotics-1VLA80.257.132.157.4
GigaWorld-Policy 0.1WAM44.411.82.920.7
ABot-M0.5WAM75.637.73.340.3
Awomo-0.5VWAM85.060.439.462.5
Awomo-0.5IWAM86.558.845.264.4

LIBERO-Plus

LIBERO-Plus evaluates manipulation policies under controlled changes to camera viewpoints, robot initial states, language instructions, lighting, background textures, sensor noise, and object layouts. Its 10,030 evaluation tasks test whether a policy remains reliable when the scene and instructions differ from its training conditions. Each evaluation covers all 10,030 task instances, with one rollout per instance. The reported category mean is the arithmetic mean of the seven category success rates, giving equal weight to each perturbation type.

Awomo-0.5I achieves a category mean of 95.9%, and Awomo-0.5V achieves 92.5%. Both models maintain success rates above 97% under background, sensor-noise, camera, and lighting perturbations. Language perturbations, object layouts, and robot initial states are the main remaining challenges for Awomo-0.5V. The two models exceed the 92.0% category mean reported for Qwen-RobotManip-Context, showing strong robustness across the evaluated perturbations.

LIBERO-Plus: results by category · success rate (%)
ModelCameraInitial stateLanguageLightingBackgroundSensor noiseObject layoutCategory mean
Awomo-0.5I98.689.994.399.598.899.191.095.9
Awomo-0.5V98.784.087.997.498.597.883.392.5
LIBERO-Plus · Category mean. Models are ranked by success rate.
Scroll horizontally for the full chart; select a metric above
LIBERO-Plus · Category mean. Models are ranked by success rate.
View the full comparison
LIBERO-Plus: full model comparison · success rate (%)
ModelFamilyCameraInitial stateLanguageLightingBackgroundSensor noiseObject layoutCategory mean
GAMVLA83.170.084.897.294.395.379.186.3
π0.5VLA75.879.483.395.595.089.687.086.5
Multi-view VLAVLA89.660.186.998.095.797.278.286.5
3DVLAVLA75.677.488.697.497.785.386.686.9
ERVLAVLA77.275.387.195.194.792.386.486.9
RLDX-1VLA75.091.892.297.195.580.380.787.5
Reflective VLAVLA95.772.992.292.192.795.473.087.7
ACoT-VLAVLA96.670.479.795.197.195.985.088.5
Anchor-Align VLAVLA96.359.187.299.099.696.997.490.8
QuoVLAVLA98.473.583.796.399.094.890.490.9
CAC-VLAVLA94.872.586.698.998.698.387.691.0
Hermite-VLARegVLA89.285.487.397.796.793.889.991.4
Qwen-RobotManip-ContextVLA89.983.986.598.699.997.987.592.0
Fast-WAMWAM16.444.568.978.253.737.760.751.4
Cosmos-PolicyWAM75.863.381.796.588.992.782.283.0
ImageWAMWAM80.850.391.498.185.593.880.582.9
ABot-M0.5WAM70.587.488.694.089.775.585.284.4
Being-H0.7WAM82.059.082.897.890.093.588.584.8
Awomo-0.5VWAM98.784.087.997.498.597.883.392.5
Awomo-0.5IWAM98.689.994.399.598.899.191.095.9

The reported policies are selected from multiple SFT trials, so these results report selected-checkpoint performance rather than an average over training seeds. The 95.9% and 92.5% category means are distinct from a pooled success rate over all 10,030 rollouts, which weights categories by their episode counts.

MolmoSpaces

MolmoSpaces provides diverse simulated environments for robot navigation and manipulation. We evaluate four manipulation task families: Open, Close, Pick, and Pick-and-Place. These families cover articulated-object interaction and object transport. For each task family, success rate is the number of successful episodes divided by the number of evaluated episodes. The combined average is the arithmetic mean of the Open, Close, Pick, and Pick-and-Place success rates, weighting the four families equally.

Awomo-0.5V achieves a combined average of 73.4%, and Awomo-0.5I reaches 73.0% overall. Both models perform strongly on closing and picking, and exceed PrimeR0’s reported combined average of 60.3%. Their task profiles are complementary: Awomo-0.5V is 13.1 percentage points higher on opening, whereas Awomo-0.5I is 12.1 points higher on Pick-and-Place.

MolmoSpaces: results by category · success rate (%)
ModelPickPick & PlaceOpenCloseFour-skill mean
Awomo-0.5I84.571.049.387.273.0
Awomo-0.5V86.458.962.486.073.4
MolmoSpaces · Four-skill mean. Models are ranked by success rate.
Scroll horizontally for the full chart; select a metric above
MolmoSpaces · Four-skill mean. Models are ranked by success rate.
View the full comparison
MolmoSpaces: full model comparison · success rate (%)
ModelFamilyPickPick & PlaceOpenCloseFour-skill mean
π0-FAST DROIDVLA22.010.911.138.620.7
LAP-VLAVLA24.96.611.445.922.2
π0 DROIDVLA16.212.511.053.123.2
π0.5 DROIDVLA36.413.622.765.134.5
MolmoAct2 DROIDVLA48.323.311.771.338.6
PRTS-DroidVLA53.827.712.076.342.4
WALL-OSS-0.5VLA73.846.016.878.553.8
PrimeR0VLA77.554.627.881.360.3
Psi-R2WAM73.141.59.062.246.4
Vana-PolicyWAM59.736.135.160.847.9
Cosmos3-Nano-PolicyWAM65.535.232.079.153.0
Awomo-0.5VWAM86.458.962.486.073.4
Awomo-0.5IWAM84.571.049.387.273.0

The Awomo-0.5V evaluation contains 1,000 Open, 915 Close, 1,000 Pick, and 1,000 Pick-and-Place instances, each evaluated once, totaling 3,915 episodes. The combined average weights the four families equally rather than weighting by their episode counts.

RoboTwin 2.0

RoboTwin 2.0 evaluates bimanual manipulation across 50 tasks under clean and randomized scene conditions. Its domain randomization varies clutter, lighting, backgrounds, tabletop height, and language instructions, testing policy robustness to changes in the observation and task context. We report two post-training settings: full-data uses both clean and randomized demonstrations, whereas clean-to-random uses clean demonstrations only. Both settings evaluate in clean and randomized scenes.

Full-data training (Full)

Awomo-0.5I achieves 96.0% success in clean scenes and 96.2% in randomized scenes, averaging 96.1% across the two conditions. The difference between conditions is only 0.2 percentage points, indicating consistent aggregate performance under the evaluated randomization. It exceeds MotuBrain’s reported average of 95.9% by 0.2 percentage points.

RoboTwin 2.0 · Full: results by category · success rate (%)
ModelCleanRandomizedMean
Awomo-0.5I96.096.296.1
Awomo-0.5V92.891.692.2
RoboTwin 2.0 · Full · Mean. Models are ranked by success rate.
Scroll horizontally for the full chart; select a metric above
RoboTwin 2.0 · Full · Mean. Models are ranked by success rate.
View the full comparison
RoboTwin 2.0 · Full: full model comparison · success rate (%)
ModelFamilyCleanRandomizedMean
π0VLA65.958.462.2
X-VLAVLA72.872.872.8
π0.5VLA82.776.879.8
LingBot-VLAVLA88.686.787.6
ZR-0VLA88.788.088.3
HoloBrain-0-QWVLA91.992.392.1
G0.5VLA93.792.893.3
Qwen-RobotManipVLA93.794.093.9
X-WAMWAM89.890.790.3
LaWAMWAM92.689.891.2
LingBot-VAWAM92.991.692.2
Faster-WAMWAM92.892.392.6
SelfWAMWAM92.293.192.6
MECo-WAMWAM93.392.092.6
AIMWAM94.092.193.1
ImageWAMWAM93.293.693.4
LingBot-VA 2.0WAM93.893.493.6
Next ForcingWAM94.193.593.8
ABot-M0.5WAM94.094.294.1
MotuBrainWAM95.896.195.9
Awomo-0.5VWAM92.891.692.2
Awomo-0.5IWAM96.096.296.1
Clean-to-Random training (C2R)

Under clean-to-random post-training, Awomo-0.5I reaches 86.8% in clean scenes and 76.0% in randomized scenes, with an average of 81.4%; Awomo-0.5V averages 74.7%. Randomized-scene success is 10.8 percentage points lower than clean-scene success for Awomo-0.5I in this setting. These results characterize robustness after training on clean demonstrations only.

RoboTwin 2.0 · C2R: results by category · success rate (%)
ModelCleanRandomizedMean
Awomo-0.5I86.876.081.4
Awomo-0.5V84.664.874.7
RoboTwin 2.0 · C2R · Mean. Models are ranked by success rate.
Scroll horizontally for the full chart; select a metric above
RoboTwin 2.0 · C2R · Mean. Models are ranked by success rate.
View the full comparison
RoboTwin 2.0 · C2R: full model comparison · success rate (%)
ModelFamilyCleanRandomizedMean
starVLAVLA46.53.224.8
GalaxeaVLAVLA62.712.737.7
Xiaomi Robotics-0VLA62.918.240.6
EventVLAVLA65.615.740.7
X-VLAVLA68.020.944.5
π0.5VLA70.746.058.4
AHA-WAMWAM64.33.233.8
FastWAMWAM77.81.939.9
Abot-M0WAM57.430.443.9
X-WAMWAM70.025.847.9
Spatial ForcingWAM77.226.752.0
OLA-GeoWAM83.033.658.3
4D-WAMWAM81.541.861.7
GigaBrain-0.7WAM66.867.967.4
OLA-SemWAM75.167.671.3
Awomo-0.5VWAM84.664.874.7
Awomo-0.5IWAM86.876.081.4

Real-World Evaluation

We evaluate Awomo-0.5V and Awomo-0.5I on the Piper platform, comparing them with π0.5 and DreamZero. The experiments measure atomic manipulation under seen conditions, transfer to unseen conditions, and generalization to compositions of learned atomic skills.

Single-Goal Demonstrations and Compositional Evaluation

The training set contains 3,921 single-goal demonstrations spanning five task families: pick, place, relative place, drawer close, and drawer open. Piper post-training uses only atomic-task demonstrations; compositional instructions are held out for evaluation. The 69 evaluation entries comprise 44 seen atomic tasks, 19 unseen atomic conditions, and 6 compositional tasks.

Piper Training Data and Evaluation Tasks
Piper Atomic Skill Benchmark: 3,921 single-goal training trajectories and 69 evaluation entries, with atomic tasks, two-object placement, and ordered place-and-stack examples
Scroll horizontally to explore the details
Training data contains only single-goal demonstrations. Evaluation includes atomic tasks and compositions of two learned skills. Placing two objects into a plate allows either order; placing an object and then stacking another requires the specified order.

Performance under Seen and Unseen Conditions

After adaptation on the same Piper demonstrations, Awomo-0.5I achieves 79.7% (55/69) overall success and Awomo-0.5V reaches 69.6% (48/69), compared with 65.2% for π0.5 and 52.2% for DreamZero. Both models outperform the evaluated baselines overall and on compositional tasks.

Piper success rate (%), with successes / trials in parentheses
ModelAtomic-SeenAtomic-UnseenCompositionalOverall
π0.577.3 (34/44)57.9 (11/19)0.0 (0/6)65.2 (45/69)
DreamZero*63.6 (28/44)42.1 (8/19)0.0 (0/6)52.2 (36/69)
Awomo-0.5V81.8 (36/44)52.6 (10/19)33.3 (2/6)69.6 (48/69)
Awomo-0.5I88.6 (39/44)57.9 (11/19)83.3 (5/6)79.7 (55/69)

Under seen conditions, Awomo-0.5I and Awomo-0.5V achieve 88.6% and 81.8% success. Gains over π0.5 come from relative-placement tasks, where the two models reach 75.0% and 60.0%, compared with 50.0% for π0.5. These tasks require identifying the target and reference objects and satisfying the spatial relation specified by the instruction.

Under unseen atomic conditions, Awomo-0.5I achieves 57.9%, matching π0.5. It succeeds on all unseen-color plate-placement, black-basket placement, and first-drawer closing entries. However, none of the evaluated models succeeds on the held-out left-of placement or third-drawer opening conditions. Learned operations transfer to some new objects and containers, while transfer to unseen spatial relations and action–drawer-level combinations remains limited.

From Single Goals to Compositional Instructions

The compositional entries combine trained atomic skills under a single instruction. Four require placing two named blocks into the white plate, with either placement order permitted. Two require placing one block into the plate and then stacking a second block on it. Ordered placement and stacking tests the integration of two different skills with a dependency between their goals. The first operation moves the support block into the plate; the second uses that block as the stacking reference and must follow the specified order.

Awomo-0.5I completes 5/6 compositional entries: all 4 two-object plate-placement tasks and 1 of 2 ordered place-and-stack tasks. Awomo-0.5V completes 2/6, while neither baseline completes a compositional task. Each compositional instruction is evaluated once. These results demonstrate reuse and composition of learned skills within a single instruction after training only on single-goal demonstrations.

Successful Real-Robot Executions
Eight real-robot execution sequences by Awomo-0.5I: seen placement, stacking, and drawer opening; unseen colors, containers, and action–drawer pairings; two-object placement and ordered stacking
Scroll horizontally to explore the details
Representative successful executions by Awomo-0.5I. The sequences cover seen conditions, unseen conditions, and skill compositions, showing the progression from the initial scene to task completion.
Two-object placement: reusing a placement skill for different objectsReal-robot demonstration
Place, then stack: executing different skills in the specified orderReal-robot demonstration
Experimental setup and baselines

The models receive RGB images from front, left-wrist, and right-wrist cameras, together with a 14-dimensional state comprising twelve joint positions and two gripper openings. All policies are adapted on the same 3,921 Piper demonstrations and evaluated with the same instructions, reference scenes, execution budgets, and success criteria. Atomic tasks have a 60-second limit and compositional tasks a 120-second limit. Success is judged manually against each task's goal.

* The evaluated DreamZero baseline starts Piper adaptation from the video-pretrained Wan2.2-TI2V-5B backbone, whereas both Awomo-0.5 variants start from our pretrained checkpoints. Thus, the DreamZero baseline uses the DreamZero architecture with a Wan2.2 initialization; it is not initialized from a robot-pretrained DreamZero policy checkpoint. π0.5 is initialized from the official checkpoint. These comparisons measure the performance of the complete adapted policies under a common downstream protocol; they do not isolate architecture from pretraining data and initialization.

03 / MODEL DESIGN

Architecture and Training Objectives

Awomo-0.5 formulates robot control as conditional flow generation over visual and action variables. The conditioning context contains an embodied prompt, the current camera observations, and the current robot state. The generated variables are a future visual latent and an action chunk of horizon H, with 80 dimensions per step. Both are initialized from noise and iteratively denoised by one shared transformer; the state remains a condition and is not predicted.

Both variants read the same inputs: the text prompt, the camera observations, the robot state, and the visual and action targets, which are noised at a shared flow time t. Each variant turns these inputs into tokens with its own encoders, processes the tokens with its pretrained transformer backbone, and maps the outputs to the visual velocity and the action velocity. The variants differ in the visual prior, the text encoder, and how actions enter and leave the backbone.

Training Architectures
Training Architectures
Scroll horizontally to explore the details
Training architectures of Awomo-0.5I and Awomo-0.5V. Both consume the same types of conditioning inputs and jointly predict visual and action flow velocities. Snowflakes indicate frozen modules; flames indicate trainable modules. Qwen3-VL is frozen during pretraining and unfrozen only for benchmark fine-tuning with subtask objectives.

Awomo-0.5I: Image-Based Action Generation

Awomo-0.5I is initialized from the FLUX.2-klein-base-4B image transformer. The frozen FLUX.2 autoencoder encodes the current frame as a clean reference image and the frame aligned with the end of the action chunk as the noisy future-image target, and both latents are flattened into 128-channel patches. Each action step, an 80-dimensional vector, is zero-padded to the same width and treated as one additional patch. The patch sequence is therefore [reference image, noisy future image, noisy actions], and all patches share the transformer’s input projection and output projection.

A Qwen3-VL-4B-Instruct encoder reads the current observation followed by the text prompt; hidden states from layers 9, 18, and 27 are concatenated into 7,680-dimensional context tokens, and up to 128 text positions are kept. It is frozen in pretraining and unfrozen in fine-tuning only for benchmarks with subtask goals. A linear layer maps the current state to one context token that is inserted after the valid text tokens.

The backbone contains 5 double-stream blocks followed by 20 single-stream blocks with hidden size 3,072. In a double-stream block, the context tokens and the image and action patches keep separate timestep modulation and feed-forward weights and interact through joint attention; a single-stream block processes all tokens with one set of weights. The first 80 channels of the output at each action position give the action velocity, so the model needs no separate action expert and the pretrained image backbone processes actions directly. The future-image patches are decoded by the frozen autoencoder.

Awomo-0.5V: Video-Based Action Generation

Awomo-0.5V is initialized from the Wan2.2-TI2V-5B video transformer. The frozen Wan2.2 video autoencoder encodes the observation clip into video latents, which enter through the backbone’s 3D convolutional patch embedding. A learned action encoder maps noisy actions and their diffusion timestep into the transformer’s token space, and an independent MLP embeds the state. The text prompt is encoded by the frozen UMT5-XXL text encoder and is not part of the token sequence.

Each backbone block applies timestep modulation, self-attention over the video, state, and action tokens, cross-attention to the UMT5-XXL text features, and a feed-forward layer. A video head predicts the velocity of the video latents, and a dedicated MLP decoder maps the action tokens to the action velocity. The initial observation frame is kept clean as context and excluded from the visual loss; the model jointly denoises the following video frames and the aligned actions.

Awomo-0.5V groups time into chunks. Each chunk pairs one block of future video latents with H = 24 actions and the state at the start of the chunk, and pretraining uses four chunks per sample. Awomo-0.5I uses one chunk per sample for some datasets, conditioning on the current frame only, and several chunks per sample for others, conditioning each chunk on the clean frames up to its start.

Attention Masks

The attention masks preserve clean visual history while preventing predicted chunks from leaking future information. The diagram below shows the attention structures of both models.

Attention Masks for Image and Video Models
Attention Masks for Image and Video Models
Scroll horizontally to explore the details
Attention masks for the two models. Rows represent queries and columns represent keys / values. Blue indicates allowed self-attention, purple indicates cross-attention to text, and 0 marks a blocked connection.

Awomo-0.5I Attention Structure

In Awomo-0.5I, the condition tokens (text, state, and clean reference image) attend only to condition tokens, and the noisy image and action tokens attend to all valid tokens. When a sample contains several chunks, the noisy image and action tokens of a chunk attend to the text, the state of that chunk, the clean images up to the chunk start, and the noisy tokens of the same chunk; noisy tokens and states of different chunks do not attend to each other.

Awomo-0.5V Block-Causal Attention

In Awomo-0.5V, self-attention is block-causal over chunks: clean video tokens attend to clean video up to the current block, each state token attends only to itself, and the noisy video and action tokens of a chunk attend to the clean history together with the noisy video, actions, and state of the same chunk. Text enters every non-text token through cross-attention.

These masks let both variants learn from multi-chunk sequences under teacher forcing while retaining the dependency structure required at inference time.

Flow Matching

Pretraining uses paired flow-matching objectives for visual generation and action generation. Let x0 denote the clean visual latent of the prediction target, a future image for Awomo-0.5I and future video content for Awomo-0.5V, and let a0 denote the aligned H × 80 action chunk of horizon H in the unified action space. The conditioning context c contains the instruction, current visual observations, and robot state. For a flow time t ∈ [0, 1] and Gaussian noise εx, εa ∼ 𝒩(0, I), both variables follow the linear interpolation path:

xt = (1 − t)x0 + tεx
at = (1 − t)a0 + tεa

The target velocities are εx − x0 and εa − a0. The shared transformer predicts both velocities, v̂x and v̂a, from the joint noisy input, flow time, and conditioning context.

Joint Visual–Action Training Objective

The training objective is a weighted combination of visual and action flow-matching losses. The visual loss measures the difference between predicted and target velocities. The action loss uses a validity mask m to select dimensions supported by the embodiment and is normalized by the action length H and the number of valid dimensions:

ℒvis = 𝔼[‖v̂x − (εx − x0)‖22]
ℒact = 𝔼[δH‖m‖1 ‖m ⊙ (v̂a − (εa − a0))‖22]
ℒ = λvℒvis + λaℒact

For robot trajectories and retargeted UMI recordings, δ = 1 and both objectives are active. For egocentric sources without reliable robot commands, δ = 0 removes the action loss while retaining the visual objective. Within action-labeled samples, m excludes unsupported embodiment dimensions, allowing a shared model to learn from platforms with different control spaces without fabricating labels.

04 / DATA PIPELINE

Data Pipeline

The pretraining corpus determines the effective upper bound on how far the model can be optimized across heterogeneous embodiments and task families. Accordingly, a large-scale and heterogeneous pretraining mixture is constructed to endow the model with broad embodied perception, spatial reasoning, and action-generation capabilities. Our data pipeline covers collection and generation, a unified action representation, and quality filtering.

36,800 Hours of Pretraining Data

The pretraining corpus contains 36.8K hours across four sources: real-robot trajectories, simulated robot trajectories, UMI human demonstrations, and egocentric human video. Real and simulated robot data combine public and in-house sources. UMI demonstrations come from our collection system, while egocentric video combines public datasets and in-house data. Training sampling ratios are 30%, 30%, 20%, and 20%, respectively.

Pretraining Data Composition
36,800hours of embodied data
Four sources · Joint pretraining
Data source and hoursTraining sampling ratio
Real-robot trajectories11,000 hours
30%
Simulated robot trajectories10,600 hours
30%
UMI human demonstrations5,000 hours
20%
Egocentric human video10,200 hours
20%
Hours and training sampling ratios for the four data sources. Bar lengths show sampling ratios (30% / 30% / 20% / 20%), not each source's share of total recorded hours.

Real-robot trajectories

Real-world robot trajectories provide the most faithful visual observations of robots interacting with the physical world. We combine public and in-house real-robot trajectories totaling 11,000 hours, covering single-arm and bimanual manipulation with different camera configurations. Public datasets include DROID, AgiBot World, RoboCOIN, and RoboMIND. The resulting mixture delivers complementary supervision over robot morphologies, camera viewpoints, object categories, backgrounds, language instructions, and action distributions, which mitigates overfitting to any single embodiment or environment.

Simulated Robot Trajectories: From Worlds to Demonstrations

Simulation generates object arrangements and task layouts that are costly to build physically and covers long-tail situations rarely encountered during teleoperation. We use approximately 2.1K hours of public simulated data from InternData-A1 and NVIDIA Kitchen Demos, plus 8.5K hours comprising 3.6 million demonstrations generated by SimDataEngine. Public sources cover rigid, articulated, deformable, and fluid manipulation, long-horizon tasks, and multi-arm collaboration. In-house generation targets the embodiments and task families of interest.

SimDataEngine is an agentic, simulation-ready pipeline for world construction and demonstration synthesis. It supplies interactive, physically valid, and reproducible synthetic supervision for embodied-policy training. Generation follows a three-tier chain spanning asset, scene, and demonstration.

SimDataEngine: Simulation Data Pipeline
SimDataEngine: an execution graph coordinates scene construction, validation, and bounded repair; image-based reconstruction and asset generation support demonstration synthesis; joint-origin repair illustrates failure localization and revalidation
Scroll horizontally to explore the details
SimDataEngine overview. The graph-native harness coordinates execution, validation, and bounded repair. The illustrated image-driven route uses Unravel to reconstruct scenes using acquired or generated assets, including articulated assets generated by ISArt. PolicyForge synthesizes demonstrations from validated worlds with task, robot, and reset specifications. A schematic example illustrates failure detection and owner routing, followed by joint-origin correction and motion revalidation.

First, a structure-aware asset service (ISArt) generates rigid and articulated objects whose parts and joints remain geometrically consistent. Scene generation proceeds through two complementary pathways: Unravel reconstructs editable scenes from a single image, whereas SimForge synthesizes environments ranging from single-room to multi-room configurations from textual descriptions; both preserve object and articulation identities.

A graph-native execution harness handles construction, validation, and bounded repair, routing failures to the originating module while retaining the unaffected portion of the scene state. On the validated worlds, PolicyForge binds the scene, a task contract (goal, interaction, and success predicates), and a robot-embodiment record, then records synchronized multi-camera RGB imagery, proprioceptive states, and end-effector actions within NVIDIA Isaac Sim. Only episodes satisfying the task-success predicate are retained and exported in LeRobot format.

The pipeline supports multiple embodiments such as Franka, the Piper dual-arm platform, and AgiBot G1/G2. Scale is expanded through digital-cousin variants and sampling across the scene-task difficulty space.

SimForge scene generation: from text descriptions, layouts, and asset configuration to interactive room environments.
Simulated scenes and trajectory generation: configure a scene, robot embodiment, and task, then execute interactions and record trajectories in the generated environment.

UMI Demonstrations: Collection and Retargeting

Approximately 5.0K hours of UMI demonstrations are collected with the DAS system. The setup consists of a DAS-Ego head-mounted six-camera rig and two handheld DAS Grippers with fisheye cameras, deployed in real homes, commercial spaces, and industrial environments. The head-mounted rig observes both hands, while gripper cameras capture close-range manipulation. Each camera records at no less than 1600 × 1300 resolution and 30 Hz, with global synchronization error below 1 ms.

Each 0.5–5 minute clip is collected through crowdsourcing under a strict prohibition on staged actions. Every episode synchronously contains six ego RGB streams, left and right finger RGB, high-precision 6D pose reconstruction for the ego and both fingers, IMU, gripper open-close distance, camera intrinsic and extrinsic calibration, and audio recordings, together with per-frame and per-segment validity flags and quality-inspection labels. Annotation follows a three-level structure (video level, task level, and subtask level), providing coarse semantic descriptions and fine-grained task/subtask segments.

UMI recordings carry no robot commands, so the end-effector state and the action stream are solved from multi-camera video, 6D pose reconstructions, and raw gripper encoder readings, and are expressed in the same absolute end-effector parameterization as robot data. The two grippers populate the two mirrored arm blocks of the unified action space, and slots the rig cannot supply are excluded by the validity mask.

Egocentric Video: Scalable Manipulation Experience

Compared with teleoperated robot trajectories, egocentric human video offers richer and more scalable real-world manipulation experience across scenes, objects, and task semantics. We combine approximately 6.7K hours of public data and 3.5K hours of in-house data, totaling 10.2K hours. Public sources include Ego4D, EgoDex, EgoSuite-Open100K, EgoVerse, EPIC-KITCHENS, and Xperience. These videos lack precise, directly executable robot-state and action annotations, so the corresponding channels are fully masked and training uses only the visual generation objective.

The in-house egocentric corpus is mined from a large pool of short first-person clips, most of which do not show a manipulating operator: many lack visible hands, show a third-person view of another person, or contain only one hand. Labeling every clip with a vision-language model is too costly at this scale, so the filter is distilled from a teacher into a lightweight student.

Egocentric Video Filtering
Four filtering stages: Qwen3.5 teacher labeling, DINOv3 student distillation, two-stage hand-visibility and egocentric-view filtering, and human review to refine prompts and thresholds
Scroll horizontally to explore the details
Egocentric video filtering. A teacher labels a small sample, and a student filters the large corpus for two-hand visibility and egocentric viewpoints. Human reviewers inspect accepted and rejected clips to refine prompts and thresholds.
  1. Teacher labeling. Qwen3.5-27B labels a small subset of roughly 6,000 clips by judging whether both hands of the same operator are clearly visible; hard cases are reviewed by humans and used to refine the teacher prompt, and the resulting labels form the student’s training set.
  2. Student distillation. Each clip is represented by 8 sampled frames, encoded by a frozen DINOv3 ViT-S/16 backbone into a CLS token and 2 × 2 adaptively pooled patch features per frame; a temporal classifier head (MLP, temporal attention, and sigmoid) aggregates the frame features into a clip-level score in [0, 1]. Two heads are trained, one for hand visibility and one for the egocentric view.
  3. Two-stage filtering. The hands-visible head first screens all raw clips, and the egocentric head then keeps only first-person clips in which both forearms are visible within a wide field of view; both stages use a score threshold of 0.7.
  4. Human review. Reviewers inspect sampled accepted and rejected clips against the same criteria, and the resulting confusion counts are used to refine the teacher prompt and tune the thresholds.

Unified 80-Dimensional Action Space

Datasets use different control conventions, including absolute or relative end-effector poses and absolute or relative joint control. To support training across embodiments, we define an 80-dimensional unified action space with fixed semantic slots: 29 dimensions for each arm, 6 each for the base, torso, and head, and 4 reserved dimensions. Each dataset is normalized using the 1st and 99th percentiles per action dimension, then mapped into the corresponding slots by index. Validity masks identify available dimensions; unmapped dimensions do not contribute to action loss.

The 80-dimensional action space has 29 dimensions per arm, 6 each for the base, torso, and head, and 4 reserved slots
Scroll horizontally to view the full diagram
The unified action space and its fixed semantic slots. At inference, the same index mapping retrieves the dimensions for the target embodiment, and denormalization converts them into native robot control commands.

Data Cleaning

Data cleaning follows three stages: visual screening, signal validation, and language review. The pipeline draws on Qwen-RobotManip and incorporates checks for failure modes observed in our collection. Our data cleaning pipeline reduces approximately 60K hours of raw data to 36.8K hours of validated training data. The process is illustrated below on real-robot data.

Real-Robot Data Cleaning Pipeline
Raw trajectories pass visual, signal, and task-semantic checks to produce multiview images, aligned states and actions, language instructions, and action masks
Scroll horizontally to explore the details
Real-robot data cleaning pipeline.
05 / PRETRAINING & ABLATIONS

Pretraining Analysis and Ablations

We study pretraining through training losses, per-skill validation errors, downstream adaptation, and human-data ablations. We also examine action representations and the relationship between open-loop error and closed-loop success.

Pretraining Losses and Validation Errors

The plots below show pretraining losses for both models and Awomo-0.5V's end-effector mean absolute error (EEF MAE) for individual atomic skills. Each skill's validation set is disjoint from training in scenes, objects, and instructions. Error is computed only over valid end-effector position, 6D rotation, and gripper dimensions.

Pretraining Losses and Validation Errors
Left: action and image losses for Awomo-0.5I above action and video losses for Awomo-0.5V. Right: Awomo-0.5V validation EEF MAE per skill, with the skill mean in thick purple
Scroll horizontally to explore the details
Pretraining losses and atomic-skill validation errors. (a) Training losses for Awomo-0.5I (top) and Awomo-0.5V (bottom), with logarithmic vertical axes. (b) Awomo-0.5V's validation EEF MAE for individual skills; the thick purple line is the mean across skills.

Action losses for both models fall rapidly in the first 10,000 steps and then stabilize. Image and video losses decrease more slowly and continue improving through 50,000 steps. Per-skill validation errors generally decline during pretraining, but skills converge to different levels. Per-skill analysis therefore exposes weaker categories hidden by aggregate means and provides a more detailed view of pretraining.

Effect of Embodied Pretraining

On a 10% evaluation subset of LIBERO-Plus, we compare fine-tuning curves initialized from embodied-pretraining checkpoints and visual foundation model weights. The left plot compares Awomo-0.5I with FLUX.2-klein-base-4B initialization; the right compares Awomo-0.5V with Wan2.2 initialization. Both show up to 12,000 optimization steps.

Effect of Embodied Pretraining
Success rate on the LIBERO-Plus 10% evaluation subset over SFT steps; Awomo-0.5I versus FLUX.2 initialization on the left, and Awomo-0.5V versus Wan2.2 on the right
Scroll horizontally to explore the details
The effect of embodied pretraining on LIBERO-Plus adaptation. The horizontal axis is SFT steps and the vertical axis is success rate on the 10% evaluation subset. The left comparison changes only initialization; the right also differs in training configuration.

For Awomo-0.5I, the two runs share code, downstream data, optimization recipe, and evaluation subset, and differ only in initialization: our pretrained checkpoint or the original FLUX.2-klein-base-4B weights. After 1,000 optimizer steps, the pretrained run reaches 84.6% success, compared with 54.0% for the FLUX.2-initialized run. At 12,000 steps, the last evaluated step of the FLUX.2 run, the respective success rates are 92.5% and 85.9%. Because initialization is the only changed variable, this gap measures the effect of pretraining on Awomo-0.5I adaptation within the evaluated budget.

For Awomo-0.5V, the run initialized from our pretrained checkpoint reaches 86.2% success after 2,000 optimizer steps, compared with 56.2% for the Wan2.2-initialized run. At 12,000 steps, the respective success rates are 88.3% and 73.0%. The pretrained run therefore adapts faster and achieves higher success within these observed trajectories. The Awomo-0.5V runs differ in training configuration; their gap is descriptive and does not isolate the causal effect of pretraining.

Human Data Ablations

We run two experiments on RoboTwin 2.0 using an early Awomo-0.5V model. The first compares direct fine-tuning on robot demonstrations with UMI pretraining followed by fine-tuning. Both use the same initialization and joint visual-action objective, then fine-tune for 5 epochs on the same 2,500 clean-scene demonstrations. Adding UMI pretraining increases success from 5.6% to 15.0%, a gain of 9.4 percentage points.

The second experiment fixes the data budget at 1,000 hours and compares 1,000 hours of UMI with 500 hours of UMI plus 500 hours of egocentric video. Initialization, optimizer, learning-rate schedule, and downstream fine-tuning settings are held fixed. The mixed dataset achieves 25.2% mean success, compared with 20.0% for UMI alone, improving in all three repeated evaluations.

In this setting, replacing half of the action-supervised UMI corpus with visual-only egocentric experience improves downstream performance. The comparison supports combining the two forms of human experience, while leaving their individual contributions and the best mixture ratio to further study.

Action-Space Ablations

Action-space ablations use SFT checkpoints at 20K steps and the equally weighted mean of LIBERO-Plus and RoboCasa atomic-task success. Each comparison changes one representation choice. With q01/q99 normalization fixed, 6D rotations improve over 3D axis-angle representations by 0.5 percentage points. With 6D rotations fixed, q01/q99 normalization improves over raw actions by 2.2 points, including a 3.0-point gain on RoboCasa atomic tasks.

Open-loop error and closed-loop success

On unseen RoboCasa365 compositions, open-loop MAE and loss are largely stable after 2.5K steps, while closed-loop success rises from 34.4% at 5K steps to 42.5% at 50K. Changes in open-loop error on unseen tasks therefore do not directly reflect changes in closed-loop success. Agreement between predicted and executed images mainly captures early adaptation and is less useful for distinguishing later checkpoints.

06 / CONCLUSION & OUTLOOK

Conclusion & Outlook

Awomo-0.5 turns pretrained image and video generators into robot policies through two direct action interfaces. Awomo-0.5I shares image-patch projections with actions, while Awomo-0.5V embeds actions in a joint video-action transformer. Combined with a heterogeneous corpus of 36,800 hours and a unified masked action space, both variants adapt to simulation and real-world manipulation tasks. The reported results favor the image-based route for LIBERO-Plus adaptation and real-world skill composition. The present study supports visual generation as a practical backbone for scalable robot learning.

Get Awomo-0.5

Access the technical report, code, and model weights below. The code repository and model pages provide the latest availability of benchmark adaptation code and checkpoints.

Code is released under Apache-2.0. Model weights follow the license listed for each checkpoint; the repository currently specifies CC BY-NC 4.0 for weights. Underlying foundation models retain their respective licenses. Project license details ↗

About AWOMO · Westlake DI
AWOMO develops general-purpose physical intelligence for the real world. The core team originated from Westlake University's Autonomous Intelligence Laboratory (AutoLab). Our work spans world models, embodied learning, and real-world task evaluation, with the aim of developing foundational capabilities that transfer across tasks, scenes, and embodiments.
Awomo-WAM Team · Awomo-0.5 Technical ReportBack to top ↑