Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:

– Shopify: https://shopify.com/lex (https://shopify.com/lex) to get 14-day free trial

– Weights & Biases: https://lexfridman.com/wnb (https://lexfridman.com/wnb)

– Magic Spoon: https://magicspoon.com/lex (https://magicspoon.com/lex) and use code LEX to get $5 off

– Blinkist: https://blinkist.com/lex (https://blinkist.com/lex) and use code LEX to get 25% off premium

EPISODE LINKS:

Oriol’s Twitter: https://twitter.com/oriolvinyalsml (https://twitter.com/oriolvinyalsml)

Oriol’s publications: https://scholar.google.com/citations?user=NkzyCvUAAAAJ (https://scholar.google.com/citations?user=NkzyCvUAAAAJ)

DeepMind’s Twitter: https://twitter.com/DeepMind (https://twitter.com/DeepMind)

DeepMind’s Instagram: https://instagram.com/deepmind (https://instagram.com/deepmind)

DeepMind’s Website: https://deepmind.com (https://deepmind.com)

Papers:

1. Gato: https://deepmind.com/publications/a-generalist-agent (https://deepmind.com/publications/a-generalist-agent)

2. Flamingo: https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model (https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model)

3. Language Models are Few-Shot Learners: https://arxiv.org/abs/2005.14165 (https://arxiv.org/abs/2005.14165)

4. Emergent Abilities of Large Language Models: https://arxiv.org/abs/2206.07682 (https://arxiv.org/abs/2206.07682)

5. Attention Is All You Need: https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf (https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf)

PODCAST INFO:

Podcast website: https://lexfridman.com/podcast (https://lexfridman.com/podcast)

Apple Podcasts: https://apple.co/2lwqZIr (https://apple.co/2lwqZIr)

Spotify: https://spoti.fi/2nEwCF8 (https://spoti.fi/2nEwCF8)

RSS: https://lexfridman.com/feed/podcast/ (https://lexfridman.com/feed/podcast/)

YouTube Full Episodes: https://youtube.com/lexfridman (https://youtube.com/lexfridman)

YouTube Clips: https://youtube.com/lexclips (https://youtube.com/lexclips)

SUPPORT & CONNECT:

– Check out the sponsors above, it’s the best way to support this podcast

– Support on Patreon: https://www.patreon.com/lexfridman (https://www.patreon.com/lexfridman)

– Twitter: https://twitter.com/lexfridman (https://twitter.com/lexfridman)

– Instagram: https://www.instagram.com/lexfridman (https://www.instagram.com/lexfridman)

– LinkedIn: https://www.linkedin.com/in/lexfridman (https://www.linkedin.com/in/lexfridman)

– Facebook: https://www.facebook.com/lexfridman (https://www.facebook.com/lexfridman)

– Medium: https://medium.com/@lexfridman (https://medium.com/@lexfridman)

OUTLINE:

Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.

(00:00) – Introduction

(05:18) – AI

(20:14) – Weights

(26:33) – Gato

(1:01:22) – Meta learning

(1:15:21) – Neural networks

(1:37:46) – Emergence

(1:44:30) – AI sentience

(2:08:27) – AGI