Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel

Big Technology Podcast

Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.


---

Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.


Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology


Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

Learn more about your ad choices. Visit megaphone.fm/adchoices

More description

Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.


---

Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.


Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology


Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

Learn more about your ad choices. Visit megaphone.fm/adchoices

2025-04-23 41 min
Listen elsewhere

Available Results

Generated results are saved to your library for reuse and search.

No generated results are available for this episode yet.

Transcript

No transcript is available for this episode yet.
Sign in to generate a transcript for review.
Sign in

Chapters

No chapters available.