Latent space

A compressed, numbers-only version of data, such as an image, where an AI model does much of its work.

Also known as latent representation

Instead of working on every pixel of a large picture, many image models first squash it into a compact summary of numbers, the latent space, work there, then expand the result back into a full image.

It matters because working in latent space made image generation much cheaper to train and run. You meet it in descriptions of image and video generators, often as “latent diffusion”.

See also

Sources

  1. Rombach et al., "High-Resolution Image Synthesis with Latent Diffusion Models", 2022, https://arxiv.org/abs/2112.10752