Imperial College ICARL Seminars - Jane X. Wang (Google DeepMind)

We are excited to continue our series with Jane X. Wang (Google DeepMind) who will be talking about SIMA 2: A Generalist Embodied Agent for Virtual Worlds.

The talk will be in person only you will be able to listen and ask questions in person. After the talk there will be a Q&A and a catered networking session.

Abstract

In this talk, I'll motivate and introduce SIMA 2, a generalist embodied agent that understands and acts in a wide variety of 3D virtual worlds. Built upon a Gemini foundation model, SIMA 2 represents a significant step toward active, goal-directed interaction within an embodied environment. Unlike prior work (e.g., SIMA 1) limited to simple language commands, SIMA 2 acts as an interactive partner, capable of reasoning about high-level goals, conversing with the user, and handling complex instructions given through language and images. Across a diverse portfolio of games, SIMA 2 substantially closes the gap with human performance and demonstrates robust generalization to previously unseen environments, all while retaining the base model’s core reasoning capabilities. Furthermore, we demonstrate a capacity for open-ended self-improvement: by leveraging Gemini to generate tasks and provide rewards, SIMA 2 can autonomously learn new skills from scratch in a new environment. This work validates a path toward creating versatile and continuously learning agents for both virtual and, eventually, physical worlds.

About the speaker

Jane X. Wang is a senior staff research scientist at DeepMind, where, as a member of the neuroscience team, she is interested in creating and understanding novel learning algorithms inspired by cognitive science and neuroscience for the next generation of frontier foundation agents. She obtained my Ph.D in Applied Physics from the University of Michigan, where she studied complex systems, physics, and computational neuroscience, before moving on to conduct research in cognitive neuroscience at Northwestern University.

Sponsors

This event is co-hosted by DocSoc and sponsored by Iconic.

Event Venue & Nearby Stays

room 340, 180 Queen's Gate, 180 Queen's Gate, London, United Kingdom

Concerts, fests, parties, meetups - all the happenings, one place.

Get App