Sai Rajeswar

Research

Selected publications. For the full list, see Google Scholar.

2026
ICML 2026Enterprise

EnterpriseOps-Gym: Environments and Evaluations for Stateful Agentic Planning and Tool Use in Enterprise Settings

Are agents ready for real enterprise work? A large, realistic stateful environment for long-horizon planning and tool execution under real enterprise constraints, now tracked on the Artificial Analysis leaderboard.

NeurIPS 2026Enterprise

Do Enterprise Systems Need Learned World Models? The Importance of Context to Infer Dynamics

Whether enterprise agents need learned world models, and why reading the live configuration is critical for inferring how business rules cascade through a system.

TMLR 2026Enterprise

Terminal Agents Suffice for Enterprise Automation

Terminal agents with direct API access match or outperform MCP and GUI agents: the same accuracy as web agents at 5–6× lower cost.

ICLR 2026Computer use

Grounding Computer Use Agents on Human Demonstrations

GroundCUA, a large human-verified dataset of desktop UI elements, and the GroundNext models that reach state-of-the-art grounding with a fraction of the training data.

COLM 2026Data

SynthDocBench: A Fully Synthetic, Controlled Benchmark for Long-Context Visual Document Understanding

Varies document length, layout, modality and question type as independent axes to diagnose exactly where vision-language models fail.

2025
NeurIPS 2025Models

AlignVLM: Bridging Vision and Language Latent Spaces for Multimodal Understanding

Maps vision features to a weighted average of the LLM's own text embeddings, so visual tokens stay in a space the language model can read.

NeurIPS 2025Models

Rendering-Aware Reinforcement Learning for Vector Graphics Generation

Renders SVG rollouts, compares them to the input image, and uses that visual feedback as the RL reward.

ICML 2025Computer use

UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction

A license-permissive benchmark for fine-grained evaluation of computer-use agents on real desktops, with dense human-demonstration annotations across 83 applications.

CVPR 2025Models

StarVector: Generating Scalable Vector Graphics Code from Images and Text

Generates editable SVG code with a code-pretrained language model, writing compact primitives instead of traced paths; introduces SVG-Stack (2.1M SVGs) and SVG-Bench.

ICLR 2025Data

BigDocs: An Open Dataset for Training Multimodal Models on Document and Code Tasks

BigDocs-7.5M, an open, license-checked dataset of 7.5 million documents across 30 tasks, and BigDocs-Bench, ten structured-output tasks such as screenshot-to-HTML.

EMNLP 2025 · OralComputer use

WebMMU: A Multimodal, Multilingual Benchmark for Website Understanding and Code Generation

How well can models understand and build websites? A real-world, multilingual benchmark collected with 117 expert annotators.

CoLM 2025Models

BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuning

A state-of-the-art chart reasoning model, with a new dataset and a visual reinforcement fine-tuning recipe.

2024
NeurIPS 2024World models & RL

GenRL: Multimodal Foundation World Models for Generalist Embodied Agents

Specify tasks with vision or language prompts, ground them in the domain's dynamics, and learn the behaviors in imagination, with strong multi-task generalization.

ICLR 2024 · SpotlightWorld models & RL

Choreographer: Learning and Adapting Skills in Imagination

A model-based agent that discovers skills in its world model and adapts them by evaluating many in parallel, in imagination.

ICLR 2024World models & RL

Efficient Dynamics Modeling in Interactive Environments with Koopman Theory

Linearizes nonlinear dynamics in a latent space so long-range prediction can be parallelized, while accounting for the agent's actions.

2023
ICML 2023 · OralWorld models & RL

Mastering Unsupervised Reinforcement Learning from Pixels

Unsupervised model-based pre-training plus a hybrid Dyna-MPC planner for fast adaptation to downstream tasks.

NeurIPS 2023Models

Equivariant Adaptation of Large Pretrained Models

Makes large pretrained models consistent under input transformations, for better sample efficiency and robustness.

CoRL 2023World models & RL

Touch-based Curiosity for Sparse-Reward Tasks

Uses surprise from mismatches in touch feedback to drive exploration in hard, sparse-reward robot tasks.

2022
CVPR 2022Models

Multi-label Iterated Learning for Image Classification with Label Ambiguity

Brings multi-label inductive biases to single-label datasets using iterated learning, inspired by language emergence.

Other work
World models & RL

Representing Positional Information in Generative World Models for Object Manipulation

Position-conditioned and latent-conditioned policy learning that lets world-model agents solve object-positioning tasks.

Computer use

The Unsolved Challenges of LLMs as Generalist Web Agents: A Case Study

What it takes for zero-shot LLM agents to perform novel tasks on HTML-based interfaces, and where they fall short.