告别谷歌12小时后，Jeff Dean 谈了AI的下一个十年
Ranking
Overall
57
Content
60
Popularity
N/A
No observed public metrics; popularity remains neutral/archived.
Merged summary
TL;DR - Jeff Dean's first public interview after leaving Google (Stanford, Aug 7 2026, moderated by Dawn Song), covering the origins of MoE and TensorFlow, how he picks long-horizon problems, and his new company Discovery Loop, which aims to automate the scientific discovery loop.
- MoE's motivation was decoupling capacity from per-token compute — a modular "expert" design inspired by brain region specialization — and early experiments showed ~10x training efficiency gains, which he treats as the signal that a direction is right.
- TensorFlow retrospective: two regrets are not shipping eager execution from day one (later popularized by PyTorch/JAX) and the
contribdirectory, which fragmented into multiple redundant implementations of the same functionality. - Research heuristics: skim ~10 papers or 100 abstracts rather than deeply read one, to build a dynamic map of the field; pick problems where part of the path is visible but the critical stretch is untraveled; use first-principles back-of-envelope estimates to discard ~90% of dead ends.
- Discovery Loop, founded with four longtime collaborators (MapReduce/Bigtable/TensorFlow/MoE), targets automating the full loop — decompose problem, hypothesize, design/run experiments, iterate — compressing weeks-long cycles to minutes and running thousands in parallel; incorporated as a public benefit corporation.
Sources (1)
告别谷歌12小时后，Jeff Dean 谈了AI的下一个十年
Public signals
N/A
TL;DR - Jeff Dean's first public interview after leaving Google (Stanford, Aug 7 2026, moderated by Dawn Song), covering the origins of MoE and TensorFlow, how he picks long-horizon problems, and his new company Discovery Loop, which aims to automate the scientific discovery loop.
- MoE's motivation was decoupling capacity from per-token compute — a modular "expert" design inspired by brain region specialization — and early experiments showed ~10x training efficiency gains, which he treats as the signal that a direction is right.
- TensorFlow retrospective: two regrets are not shipping eager execution from day one (later popularized by PyTorch/JAX) and the
contribdirectory, which fragmented into multiple redundant implementations of the same functionality. - Research heuristics: skim ~10 papers or 100 abstracts rather than deeply read one, to build a dynamic map of the field; pick problems where part of the path is visible but the critical stretch is untraveled; use first-principles back-of-envelope estimates to discard ~90% of dead ends.
- Discovery Loop, founded with four longtime collaborators (MapReduce/Bigtable/TensorFlow/MoE), targets automating the full loop — decompose problem, hypothesize, design/run experiments, iterate — compressing weeks-long cycles to minutes and running thousands in parallel; incorporated as a public benefit corporation.