Close

Welcome to Synthesia AI Research

Synthesia is the world's leader in synthetic media since 2017. We solve fundamental AI problems and build awesome products around them. See more below.
Play Button
Facial mapping - AI Research at SYnthesia

About our AI research

A paradigm shift is coming in content creation. In the not-too-distant future synthetic media will replace the need for physical cameras and complex video editing tasks. Everyone will be able to create high quality video with simple and intuitive interfaces through generative AI techniques. The creative possibilities will be endless!

At Synthesia, our world-class team of researchers and engineers are working to make this possible. Today we are pioneering new techniques to create photo-realistic synthetic actors. Tomorrow, we will create synthetic scenes and put the actor in context. In the future you will be able to create everything you see on the big screen with just a laptop and a bit of imagination.

About our AI avatars

Our mission is to make video creation easy. We generate lifelike synthetic humans and create a performance directly from a script, a process we call text-to-video (TTV).

What makes this hard? We need to match the quality you see in conventional video. The challenge is that we are all accustomed to the subtle nuances of how a person should look, act and sound in a video. Everything that makes a person look real. Any approximation ruins the illusion and you hit the "uncanny valley."

At Synthesia, we solve this through neural video synthesis. We train neural networks to reproduce the photorealistic look and movements you see in existing videos. We have traversed the uncanny valley and we create synthetic humans that look real.

Scenes

We create learned 2D and 3D neural representations of shape appearance and motion for controllable video synthesis of people.

Efficiency

We create efficient representations that can be quickly trained and deployed as a fast runtime for video synthesis.

Generalization

We aim to provide complete freedom to create new content while minimizing the time required to record training data.

Speech

We create facial expressions that match verbal cues for speech to create a physically plausible representation in any language.

Dynamics

We generate nonverbal cues and body language to create an emotional, expressive, and engaging performance in the video.

Our Research challenges

Our goal is high-fidelity, photorealistic and controllable neural video synthesis. We are replacing physical cameras with generative synthesis. We conduct foundational research with our co-founders Prof. Matthias Niessner (TUM) and Prof. Lourdes Agapito (UCL) to develop 3D neural rendering techniques that synthesize realistic video.

Here's some of the problems we tackle today →

Synthesia AI Research leadership

Jonathan Starck - CTO at Synthesia.io
Jonathan Starck
I'm a CTO at Synthesia where I lead our AI Research teams. We are solving fundamental and exciting AI problems on a daily basis.
Read more on LinkedIn
Matthias Nissner : co-founder of Synthesia and a Professor at the Technical University of Munich
Matthias Niessner
I'm a co-founder of Synthesia and a Professor at the Technical University of Munich where I lead the Visual Computing Lab.
Read more on Wikipedia
Lourdes Agapito: co-founder of Synthesia and a Professor of 3D Vision
Lourdes Agapito
I'm a co-founder of Synthesia and a Professor of 3D Vision in the Department of Computer Science at University College London (UCL).
Read more on Wikipedia

Our ethics standards

1

People first. Always.

As a company pioneering this new kind of media we’re aware of responsibility we have. It is clear to us that artificial intelligence and similarly powerful technologies cannot be built with ethics as an afterthought. It needs to be front and centre, an integral part of the company: reflected in both company policy and in the technology we are building. It is also the reason why we are an active member of Content Authenticity Initiative which was started by Adobe in 2019.
2
We will not offer our software for public use. All content will go through an explicit internal screening process before being released to our trusted clients.
Read more about content moderation framework.
3
We will never re-enact someone without their explicit consent. This includes politicians or celebrities for satirical purposes. Our celebrity campaign with David Beckham won CogX Outstanding Achievement in Social Good Use Of AI Award in 2019.
4
We will continue to actively work with media organisations, governments and research institutions to develop best practices and educate on video synthesis technologies.

Want to join our AI Research team?

We're constantly on the lookout for outstanding AI researchers. See our current openings below.

Want to see who we are and how we work?

Victor Riparbelli - Synthesia CEO & Co-founder
Want to work in a really exciting startup that works on bleeding edge video tech? We can't wait to get to know you.
In a world with ever increasing demand for new content, Synthesia enables us not only to natively localize content but also to create and update existing videos for brands to engage and communicate more effectively with global consumers.
Francisco Lima
 - 
Hogarth Worldwide