← Back to Directory
Tri Dao

Tri Dao

Builder

Princeton

@tridao

Assistant Professor at Princeton and co-founder of Together AI. Creator of FlashAttention — the IO-aware exact attention algorithm used everywhere.

Skills

FlashAttentionsystems MLCUDApythonefficient transformers

Looking For

collaboratorhiring

Research Foundations (2)

Attention Is All You Need

NeurIPS 201720176,510 citations

Used by: FlashAttention

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

EMNLP 2014201416,000 citations

Used by: FlashAttention

Projects (1)

FlashAttention

GitHub

IO-aware exact attention algorithm that is 2-4x faster and uses 5-20x less memory. Now integrated into PyTorch and used by virtually all LLM training runs.

Generative AINLP

Built on research:

paperAttention Is All You Need(2017)
paperLearning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation(2014)

AI Suggested Researchers

Researchers whose work may be relevant to your projects (auto-detected)

Luke Zettlemoyer

Luke Zettlemoyer

University of Washington / Meta AI

Shared domains: Generative AI, NLP
62% matchAI suggested
Hannaneh Hajishirzi

Hannaneh Hajishirzi

University of Washington / Allen AI

Shared domains: Generative AI, NLP
61% matchAI suggested
Tomas Mikolov

Tomas Mikolov

Czech Institute of Informatics (CIIRC)

Shared domains: Generative AI, NLP
52% matchAI suggested
Jacob Devlin

Jacob Devlin

Google

Shared domains: Generative AI, NLP
52% matchAI suggested

AI Suggested Papers

Papers that may have inspired your projects (auto-detected by domain & keyword analysis)

WebsiteTwitterGitHub