Capturing Visual Environment Structure Correlates with Control Performance

ICLR 2026
1University of Illinois Urbana-Champaign, 2Toyota Research Institute
Teaser Image

Simulation environments provide access to full world state labels for free (left), enabling our proxy task — state prediction from visual inputs. This proxy strongly correlates with downstream policy success across environments and architectures (right, results for SimplerEnv environment).

Abstract

The choice of visual representation is key to scaling generalist robot policies. However, direct evaluation via policy rollouts is expensive, even in simulation. Existing proxy metrics focus on the representation's capacity to capture narrow aspects of the visual world, like object shape, limiting generalization across environments. In this paper, we take an analytical perspective: we probe pretrained visual encoders by measuring how well they support decoding of environment state—including geometry, object structure, and physical attributes—from images. Leveraging simulation environments with access to ground-truth state, we show that this probing accuracy strongly correlates with downstream policy performance across diverse environments and learning settings, significantly outperforming prior metrics. Our study provides insight into the representational properties that support generalizable manipulation, suggesting that learning to encode full environment state is a promising objective for visual representations for control.

Simulation Experiments

Real World Experiments

Experimental Results

Assessment of Pre-trained Models

We present a systematic comparison of diverse pretrained vision encoders across multiple benchmarks. The results illustrate that there is no single optimal representation for robot manipulation; performance vary significantly depending on execution domains and tasks.

Performance Bar Plot

Correlation Analysis

We evaluate the state regression objective as a proxy for predicting the success rate of downstream policies. As shown below, our proposed proxy task shows a strong correlation and MMRV score in all four different environments (MetaWorld, RoboCasa, SimplerEnv-Google, SimplerEnv-WidowX).

Correlation Plot

BibTeX

@inproceedings{dong2026visualenv,
  title={Capturing Visual Environment Structure Correlates with Control Performance},
  author={Dong, Jiahua and Man, Yunze and Tokmakov, Pavel and Wang, Yu-Xiong},
  booktitle={ICLR},
  year={2026}
}