CoRAct Research project

REASONING → ACTION → CONSEQUENCE

From Reasoning to ActionConsequence-Grounded Alignment
for Vision-Language-Action Models

Anonymous Author(s)

Align intended motion with generated actions
and their predicted consequences.

PROJECT OVERVIEWVIDEO COMING SOON

See CoRAct in action.

Introduction video will appear here.

01 / THE IDEA

Reasoning should guide execution.

From implicit conditioning to explicit, consequence-grounded alignment.

ABSTRACT

Not just what to do.
But whether the action
follows the reasoning.

Reasoning informs decision-making by connecting intended actions with their expected consequences. Building on this principle, recent vision-language-action models incorporate embodied chains of thought (ECoTs) as an intermediate stage in action generation. However, such guidance remains implicit, as actions are conditioned on the generated ECoTs rather than explicitly optimized to align with them. To bridge this gap, we introduce the Consequence-grounded Reasoning-to-Action alignment method called CoRAct, an offline training framework that explicitly aligns reasoning and action through reward-guided optimization in action noise space.

Specifically, CoRAct formulates two physically grounded ECoT components as verifiable signals: movement specifies the intended motion, whereas waypoints encode the expected spatial consequence of execution. By jointly modeling ECoT reasoning, action generation, and action-conditioned future prediction, a unified Mixture-of-Transformers explicitly couples each action with its articulated intent and predicted consequence. For action candidates generated from sampled noise, CoRAct computes alignment rewards based on motion consistency with the described movement and agreement between predicted outcomes and the specified waypoints. These rewards drive group-relative optimization of the initial noise distribution, steering action generation toward consistency with the articulated intent and expected consequence.

Extensive experiments across RoboCasa, VLABench, and real-world manipulation tasks demonstrate consistent gains in task success and generalization over strong ECoT-based VLA baselines. Further analyses reveal improved reasoning–execution alignment and show that our method can ground externally provided ECoTs in executable behavior, supporting zero-shot adaptation to novel scenarios by leveraging knowledge from powerful VLMs.

The key idea Turn movement descriptions and expected waypoints into verifiable alignment signals.

02 / THE METHOD

One framework.
Two grounded signals.

Jointly model reasoning, actions, and consequences.
Then align them in action noise space.

FIG. 01 / FRAMEWORK Click to enlarge
CoRAct framework: joint modeling of reasoning, action and consequence, followed by alignment optimization in action noise space.
Joint modeling → alignment optimization. The backbone learns reasoning-conditioned actions and action-conditioned future prediction. With the backbone frozen, alignment rewards optimize the conditional noise policy.

Three experts, connected by controlled attention.

A unified Mixture-of-Transformers learns two complementary streams. §3.1

REASON

VLM expert

Predicts structured ECoT: movement and waypoints.

PREDICT

Image expert

Predicts a future observation conditioned on the action.

No ECoT shortcut: ECoT tokens are excluded from the future-prediction stream, so the image expert cannot directly read the target waypoint.

03 / BENCHMARK RESULTS

From alignment to task success.

In-distribution evaluation and generalization across
RoboCasa and VLABench.

SUCCESS RATE (%) ↑
Table 1: VLABench success rates (%)
MethodT1 IDT2 CategoryT3 Common senseT4 Semantic intentT6 Texture
π0.540.622.618.016.125.6
π047.021.229.117.332.2
CoVer-VLA40.923.432.635.426.8
LaST040.921.134.435.026.6
CoRAct Ours51.824.334.436.230.0

CoRAct leads on T1, T2, and T4, and ties LaST0 on T3. π0 has the highest T6 result. Bold indicates the best value in each column.

SOURCE: MANUSCRIPT · TABLE 1All values are transcribed from the supplied paper.
Manuscript reporting note

Tables 1 and 2 report 75.5% for full-model RoboCasa in-distribution success; the prose in §4.3 reports 75.4%. This page uses the table values. The discrepancy has not been independently resolved.

FIG. 02 / GENERALIZATION SETTINGS Click to enlarge
Generalization settings: RoboCasa variations in objects, textures, lighting and scenes; VLABench language and visual changes.
Changing scenes. Changing instructions. RoboCasa varies objects, textures, lighting, and scenes. VLABench evaluates category, common-sense, semantic-intent, and texture settings.

BEYOND SUCCESS RATE

Does the action follow the reasoning?

TABLE 3

With both alignment objectives, the generated actions better match the ECoT’s movement and waypoint targets.

Position error ↓
0.4010.171
cm
Rotation error ↓
0.5340.420
degrees
Gripper agreement ↑
69.78991.800
%
Waypoint error ↓
5.9980.542
pixels

No alignment objectives Both alignment objectives · Table 3. Bars are scaled within each metric.

TABLE 2 Component ablations
Table 2: ablation of ECoT components and alignment objectives
Movement CoTWaypoint CoTMovement align.Waypoint align.VLABenchRoboCasa
————39.268.6
✓———44.372.9
✓✓——47.573.5
✓✓✓—49.374.6
✓✓✓✓51.875.5

04 / CLOSED-LOOP SELF-CORRECTION

Correct the reasoning.
Recover the action.

An external agent revises erroneous movement descriptions.
CoRAct translates the corrected reasoning into actions.

FIG. 03 / AGENT-GUIDED ECOT CORRECTION Click to enlarge
Agent-guided correction example: an incorrect flower-to-vase movement is revised before generating another action chunk.
An external agent revises VLM-generated reasoning and feeds the corrected movement back to CoRAct for action generation.
NO ADDITIONAL POLICY TRAINING

Reasoning becomes an
editable interface.

When the initial ECoT misreads the scene, the agent changes the movement description rather than retraining the policy.

01

Observe the execution state.

02

Revise the movement description.

03

Generate and execute a new action chunk.

Alignment and correction are complementary.

TABLE 4 · SUCCESS (%) ↑
Table 4: closed-loop self-correction on VLABench
Reasoning–action alignmentAgent correctionInsert FlowerChemistry Tube
——24.022.0
✓—26.030.0
—✓52.040.0
✓✓66.052.0

05 / REAL-WORLD EXPERIMENTS

Beyond simulation.

Long-horizon manipulation and semantic understanding
across three real-robot tasks.

FIG. 04 / REAL-ROBOT EXPERIMENTAL SETUP Click to enlarge
Real-world experimental setup for tabletop organization, image-guided word assembly and language-guided fruit selection.
Tabletop organization, image-guided word assembly, and language-guided fruit selection. The paper reports evaluation over 30 trials.
TASK 01

Tabletop
organization

Remove an apple from a plate, then place juice on the plate.

56.6%CoRAct
task success
TASK 02

Image-guided
word assembly

Select and arrange letters to form the word shown in a reference image.

46.6%CoRAct
task success
TASK 03

Language-guided
fruit selection

Pick three specified types of fruit from a bowl.

63.3%CoRAct
task success
TABLE 5 Compare real-robot results
Table 5: real-world task success rates (%)
MethodTabletop organizationImage-guided word assemblyLanguage-guided fruit selection
π0.533.326.656.6
LaST040.033.350.0
CoVer-VLA33.326.650.0
CoRAct56.646.663.3

06 / CITATION

Cite CoRAct.

From reasoning to action,
grounded in consequences.

Read the manuscript
BIBTEX

Citation metadata pending.

The supplied manuscript is anonymized.
A complete citation can be added when author and publication details are available.