← Back to Directory
Jonathan Frankle

Jonathan Frankle

Builder

Boston

@jfrankle

Chief Scientist at Databricks. Creator of the Lottery Ticket Hypothesis. Previously led MosaicML (acquired by Databricks). Harvard/MIT.

Skills

model trainingpruningLLMsdistributed systemsresearch

Looking For

collaborator

Research Foundations (3)

Attention Is All You Need

NeurIPS 201720176,510 citations

Used by: MosaicML / DBRX

The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

ICLR 201920196,500 citations

Used by: MosaicML / DBRX

Language Models are Few-Shot Learners

NeurIPS 202020203,027 citations

Used by: MosaicML / DBRX

Projects (1)

MosaicML / DBRX

GitHubLive

Open-source efficient LLM training platform. DBRX is a 132B MoE model rivaling GPT-3.5. Acquired by Databricks for $1.3B.

NLPGenerative AIOptimization

Built on research:

paperAttention Is All You Need(2017)
paperThe Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks(2019)
paperLanguage Models are Few-Shot Learners(2020)

AI Suggested Researchers

Researchers whose work may be relevant to your projects (auto-detected)

Jeff Dean

Jeff Dean

Google DeepMind

Shared domains: NLP, Generative AI, Optimization
60% matchAI suggested
Hannaneh Hajishirzi

Hannaneh Hajishirzi

University of Washington / Allen AI

Shared domains: NLP, Generative AI
48% matchAI suggested
Anima Anandkumar

Anima Anandkumar

Caltech / NVIDIA

Shared domains: Generative AI, Optimization
47% matchAI suggested
Kyunghyun Cho

Kyunghyun Cho

New York University / Genentech

Shared domains: NLP, Generative AI
46% matchAI suggested

AI Suggested Papers

Papers that may have inspired your projects (auto-detected by domain & keyword analysis)

WebsiteTwitterGitHub