Sai Rajeswar
Sai Rajeswar

Sai Rajeswar

Staff Research Lead, ServiceNow Research · Adjunct Professor, Mila · Montréal

I work on the data, benchmarks, and executable environments that decide what AI agents are trained and measured on, across documents, screens, terminals, and long-horizon enterprise workflows. Recent work includes EnterpriseOps-Gym (ICML 2026), a stateful benchmark for agentic planning and tool use in enterprise systems, and UI-Vision (ICML 2025), a desktop GUI benchmark for visual perception and interaction.

My working premise is that evaluation directs optimization: whoever defines what counts as hard, and what counts as solved, sets the training agenda for everyone downstream. So I focus on the instruments that steer capability: benchmarks that isolate real failure modes, datasets grounded in genuine human demonstrations, and environments recovered from real systems where agents can act, fail, adapt, and be scored.

I completed my Ph.D. at Mila / Université de Montréal under Aaron Courville, and spent time as a Research Scientist Intern at Google DeepMind. Before that, I studied computer science at IIT Delhi.

LinkedIn X Google Scholar Email

Research map

What I build, at a glance

Data→ Benchmarks→ Environments→ Agents & harnesses→ World models & RL
1M+downloads of open data, benchmarks and models
12top-venue papers in 2025–26
1stenterprise-agent benchmark on the Artificial Analysis leaderboard

Enterprise benchmarks & environments

6 works

Stateful, policy-governed systems of record where agents act through tools and are graded on the final state of the world.

  • EnterpriseOps-GymICML 20261,150 expert tasks · 164 tables · 512 tools · tracked on the Artificial Analysis leaderboard
  • Terminal Agents Suffice (StarShell)TMLR 2026729 tasks across ServiceNow, GitLab and ERPNext · terminal vs GUI vs curated tools
  • Enterprise World Models (CascadeBench)NeurIPS 2026Can agents predict how business rules cascade? 64 worlds · real execution, synthetic schemas
  • EnterpriseOps-Gym2In progressGenerated enterprise worlds where tasks and verifiers come from the same executed run
  • ESMERALDANeurIPS 2026 WorkshopA benchmark for enterprise service management agent readiness·
  • CodeEvoGymUnder reviewLearning from experience across enterprise software releases: do agents keep up as the software evolves? Real release histories of six web apps

Computer-use benchmarks

5 works

Measuring whether agents can see and act on real screens: desktops, web apps and professional software.

  • UI-VisionICML 2025Desktop GUI grounding · 83 applications · 8K+ query–box pairs
  • GroundCUAICLR 2026Grounding agents on human demonstrations · 87 apps
  • CUA-Suite / VideoCUA202655 hours of continuous expert video · 10K tasks · 87 professional apps
  • WebMMUEMNLP 2025 · OralMultilingual website understanding and code generation · 117 expert annotators
  • LLMs as Generalist Web AgentsCase studyThe unsolved challenges of zero-shot agents on HTML interfaces

Open datasets

6 releases

Licensed, human-grounded data at scale: the raw material for training and measuring multimodal agents.

  • BigDocs-7.5MICLR 20257.5M documents · 30 tasks · license- and provenance-checked
  • GroundCUA dataICLR 20263.56M human-verified UI annotations · 56K screenshots
  • VideoCUA20266M frames of expert computer use, with cursor traces
  • SVG-Stack (with StarVector)CVPR 20252.1M real, permissively licensed SVGs
  • SynthDocBenchCOLM 2026Controlled long-context document benchmark with independent difficulty axes
  • BigChartsCoLM 2025Real-world charts, replotted for accurate labels

Models, agents & harnesses

6 works

Small, specialized models and simple agent interfaces that outperform larger general systems on the right data.

  • StarHarnessarXiv 2026Evolving enterprise agent harnesses with frozen weights · +20–35 pts on ITBench, EnterpriseOps-Gym and AutomationBench
  • Terminal agent harnessTMLR 2026One flexible API interface matches GUI agents at a fraction of the cost
  • StarVectorCVPR 2025Images and text to editable SVG code with a code LLM
  • RLRFNeurIPS 2025RL from rendering feedback: reward the render, not the tokens
  • AlignVLMNeurIPS 2025A vision–language connector that keeps visual tokens in the LLM's own word space
  • BigCharts-R1CoLM 2025Chart reasoning with visual reinforcement fine-tuning

World models & RL

6 works

Agents that imagine before they act, from pixels and robots to enterprise systems.

  • Enterprise world modelsNeurIPS 2026Reading live rules beats memorizing dynamics for unseen companies
  • GenRLNeurIPS 2024Multimodal foundation world models for generalist embodied agents
  • ChoreographerICLR 2024 · SpotlightLearning and adapting skills in imagination
  • Koopman dynamicsICLR 2024Efficient long-range dynamics modeling in interactive environments
  • Unsupervised RL from pixelsICML 2023 · OralModel-based pre-training with a hybrid Dyna-MPC planner
  • Touch-based curiosityCoRL 2023Exploration driven by mismatches in touch feedback

Venues shown are for the main publication; in-progress items are ongoing work.

All publications →

Collaboration: I'm excited to work with students, interns and collaborators on enterprise agents, terminal and computer-use agents, digital-world simulation, and world models for reliable intelligence. Get in touch.