← Back to Directory
Bryan Catanzaro

Bryan Catanzaro

Builder

Santa Clara

@bcatanzaro

VP of Applied Deep Learning at NVIDIA. Led teams behind CUDA deep learning libraries, Megatron-LM, and GPU-accelerated AI infrastructure.

Skills

CUDAdeep learningGPU computingdistributed trainingC++

Looking For

collaboratorhiring

Research Foundations (2)

Attention Is All You Need

NeurIPS 201720176,510 citations

Used by: Megatron-LM

Language Models are Few-Shot Learners

NeurIPS 2020202018,500 citations

Used by: Megatron-LM

Projects (1)

Megatron-LM

GitHub

NVIDIA's framework for training large transformer language models efficiently across thousands of GPUs using model and data parallelism.

NLPGenerative AI

Built on research:

paperAttention Is All You Need(2017)
paperLanguage Models are Few-Shot Learners(2020)

AI Suggested Researchers

Researchers whose work may be relevant to your projects (auto-detected)

Luke Zettlemoyer

Luke Zettlemoyer

University of Washington / Meta AI

Shared domains: NLP, Generative AI
69% matchAI suggested
Hannaneh Hajishirzi

Hannaneh Hajishirzi

University of Washington / Allen AI

Shared domains: NLP, Generative AI
68% matchAI suggested
Kyunghyun Cho

Kyunghyun Cho

New York University / Genentech

Shared domains: NLP, Generative AI
66% matchAI suggested
Aaron Courville

Aaron Courville

Mila / Université de Montréal

Shared domains: NLP, Generative AI
66% matchAI suggested

AI Suggested Papers

Papers that may have inspired your projects (auto-detected by domain & keyword analysis)

WebsiteTwitterGitHub