Aarhus Universitets segl

Center for Chemistry of Clouds: Specialized Lecture by Henry Moss, Department of Applied Mathematics and Theoretical Physics, University of Cambridge

Return of the Latent Space Cowboys: Rethinking the use of VAEs in Bayesian Optimisation over Structured Spaces

Oplysninger om arrangementet

Tidspunkt

Onsdag 27. november 2024,  kl. 10:00 - 11:00

Sted

1514-121, Aud V, Institut for Kemi, Langelandsgade 140

Speaker:
Henry Moss from Department of Applied Mathematics and Theoretical Physics, University of Cambridge
Info about Early Career Advanced Fellow Henry Moss

Abstract:
Bayesian Optimization in the latent space of generative models has become a powerful method for exploring structured search spaces, such as molecular design. Instead of directly optimizing over complex, high-dimensional discrete structures, this approach maps structured inputs into a fixed-size latent space. Within this space, standard surrogate models and gradient-based optimization routines can be effectively applied. However, because these generative models are not trained with specific downstream tasks in mind, latent space optimization can exhibit problematic behaviours.

In this talk, we explore an alternative method that decouples the surrogate and generative models. Instead of tightly integrating Gaussian Processes with Variational Autoencoders, our method trains these models separately and combines them through a simple Bayesian update. The aim is to develop a sampling strategy that efficiently identifies candidate structures with a high likelihood of achieving the target objective.