Seeing Farther to Act Now

Long-horizon future modeling for robot manipulation
Wenxin Rong1, Haoxuan Wang1, Feiran Wang1, Yasutomo Kawanishi2, Yan Yan1 1University of Illinois at Chicago    2Ritsumeikan University
Motivation: short-horizon prediction picks a locally plausible but wrong target, long horizon reveals the correct one; success rate trends across prediction horizons
Motivation. (a) When the prediction horizon is tied to the action chunk, a locally plausible but wrong target looks fine; a longer horizon exposes the downstream outcome. (b) Short horizons keep fine motion detail, long horizons show task progress. (c) The best horizon depends on the task.
Abstract

World Action Models (WAMs) provide predictive context for robot manipulation by conditioning action generation on imagined future visual states. However, existing WAMs commonly couple the visual prediction horizon to the action horizon, restricting future information to the immediate interaction and potentially obscuring longer-term task consequences. We show that prediction horizon introduces a fundamental trade-off: short-horizon futures preserve fine-grained motion and interaction details, whereas longer-horizon futures capture broader task progression but with greater visual uncertainty, making the most useful temporal scale task dependent. Building on this insight, we propose Seeing Farther to Act Now (SFAN), a multi-timescale world-action model that decouples visual prediction from the executable action horizon and assigns complementary roles to different temporal scales. SFAN uses sparsely sampled long-horizon futures to provide broader task context and generate the primary action prediction, while a complementary short-horizon pathway densely samples nearby futures to predict a residual correction conditioned on the primary action. This asymmetric design allows longer-range futures to guide interaction selection while preserving the fine-grained local information needed to refine how the selected interaction is executed. Extensive experiments on simulated and real-world robot manipulation demonstrate that SFAN consistently outperforms existing baselines, with particularly strong gains on tasks that benefit from longer-horizon future context.

Method

Overview of SFAN

SFAN architecture: shared video generation model with long- and short-horizon temporal modules, primary action DiT and residual DiT
Given the current observation and language instruction, the video generation model produces long- and short-horizon predictive representations using the same number of future tokens but different temporal strides. The sparsely sampled long-horizon representation captures broader task progression and conditions the action model to generate a primary action chunk. The densely sampled short-horizon representation preserves near-term interaction details and predicts a residual correction conditioned on the primary action. The final action chunk combines the two, giving long-horizon guidance with local refinement.
Experiments

Results

69%
Avg. success on 24 RoboCasa tasks (best baseline 66%)
20.75%
Full-task success on 8 composite RoboCasa365 tasks (best baseline 11.75%)
40%
Two-Pen Retrieval on a real robot (best baseline 33%)
33%
Pen–Cup–Plate on a real robot (best baseline 13%)

RoboCasa benchmark

Average success over 24 household tasks on a 7-DoF Franka Panda, with 50 demonstrations per task and 50 rollouts per task.

MethodAverage success

Composite RoboCasa365 tasks

Eight multi-stage tasks with 100 demonstrations each. SFAN leads from the first stage and keeps more rollouts on track in later stages.

Stage-wise success rates on eight composite RoboCasa tasks for GR00T N1.5, UVA, Cosmos-Policy and SFAN
Stage-wise success. Full-task average: SFAN 20.75%, GR00T-N1.5 11.75%, Cosmos-Policy 9.25%, UVA 6.50%.

Real-world experiments

AgileX robot, 100 demonstrations per task, 15 rollouts per method under the same initial configurations.

Two-Pen RetrievalFirst redSecond redFull
GR00T-N1.50.400.200.13
Cosmos-Policy0.600.330.33
SFAN0.730.470.40
Pen–Cup–PlatePen graspCup graspFull
GR00T-N1.50.670.200.07
Cosmos-Policy0.530.130.13
SFAN0.870.470.33
Videos

Real-world rollouts

GR00T-N1.5

Cosmos-Policy

SFAN (Ours)

Citation

BibTeX

@misc{rong2026sfan,
  title     = {Seeing Farther to Act Now: Long-Horizon Future
               Modeling for Robot Manipulation},
  author    = {Rong, Wenxin and Wang, Haoxuan and Wang, Feiran and
               Kawanishi, Yasutomo and Yan, Yan},
  year      = {2026}
}