Noam Shazeer

Build a Large Language Model From Scratch

by Sebastian Raschka · uses "Attention Is All You Need..."

Pinecone AI Education & Canopy

by James Briggs · uses "Attention Is All You Need..."

sentence-transformers

by Nils Reimers · uses "Attention Is All You Need..."

TRL (Transformer Reinforcement Learning)

by Lewis Tunstall · uses "Attention Is All You Need..."

Hugging Face Inference Endpoints

by Philipp Schmid · uses "Attention Is All You Need..."

GPT-NeoX / Pythia

by Stella Biderman · uses "Attention Is All You Need..."

Together AI Platform

by Vinicius Moens · uses "Attention Is All You Need..."

Mistral AI Models

by Arthur Mensch · uses "Attention Is All You Need..."

Sakana AI — Evolutionary Model Merging

by David Ha · uses "Attention Is All You Need..."

Imbue AI Agents

by Kanjun Qiu · uses "Attention Is All You Need..."

Adept ACT-1

by David Luan · uses "Attention Is All You Need..."

Jasper AI

by Dave Rogenmoser · uses "Attention Is All You Need..."

Character.AI

by Daniel De Freitas · uses "Attention Is All You Need..."

Inflection Pi / Microsoft AI

by Mustafa Suleyman · uses "Attention Is All You Need..."

Perplexity AI

by Aravind Srinivas · uses "Attention Is All You Need..."

ElevenLabs Voice AI

by Mati Staniszewski · uses "Attention Is All You Need..."

AssemblyAI Universal-2

by Dylan Fox · uses "Attention Is All You Need..."

Deepgram Nova-2

by Scott Stephenson · uses "Attention Is All You Need..."

Snorkel AI

by Alex Ratner · uses "Attention Is All You Need..."

Weights & Biases

by Lukas Biewald · uses "Attention Is All You Need..."

DataRobot

by Jeremy Fiance · uses "Attention Is All You Need..."

Cohere

by Aidan Gomez · uses "Attention Is All You Need..."

Run:ai

by Abid Javed · uses "Attention Is All You Need..."

Semantic Scholar

by Michael Schmitz · uses "Attention Is All You Need..."

Lexion AI

by Ammad Ahmad · uses "Attention Is All You Need..."

OLMo

by Dirk Groeneveld · uses "Attention Is All You Need..."

Megatron-LM

by Bryan Catanzaro · uses "Attention Is All You Need..."

PyTorch

by Soumith Chintala · uses "Attention Is All You Need..."

Hugging Face Transformers

by Thomas Wolf · uses "Attention Is All You Need..."

RAG (Retrieval-Augmented Generation)

by Patrick Lewis · uses "Attention Is All You Need..."

LoRA

by Edward Hu · uses "Attention Is All You Need..."

bitsandbytes / QLoRA

by Tim Dettmers · uses "Attention Is All You Need..."

FlashAttention

by Tri Dao · uses "Attention Is All You Need..."

Mamba

by Albert Gu · uses "Attention Is All You Need..."

Qwen

by Junyang Lin · uses "Attention Is All You Need..."

Reka AI Models

by Yi Tay · uses "Attention Is All You Need..."

PaLM Training Infrastructure

by Reiner Pope · uses "Attention Is All You Need..."

Open Assistant

by Christoph Schuhmann · uses "Attention Is All You Need..."

Circuits / Mechanistic Interpretability

by Chris Olah · uses "Attention Is All You Need..."

Lil'Log

by Lilian Weng · uses "Attention Is All You Need..."

Contextual AI RAG 2.0

by Douwe Kiela · uses "Attention Is All You Need..."

DSPy

by Omar Khattab · uses "Attention Is All You Need..."

ALiBi Positional Encoding

by Ofir Press · uses "Attention Is All You Need..."

Machine Learning Mastery

by Jason Brownlee · uses "Attention Is All You Need..."

Hugging Face Transformers

by Clem Delangue · uses "Attention Is All You Need..."

Latent Space & smol.ai

by Swyx (Shawn Wang) · uses "Attention Is All You Need..."

fast.ai

by Jeremy Howard · uses "Attention Is All You Need..."

ML Paper Explanations (YouTube)

by Yannic Kilcher · uses "Attention Is All You Need..."

Replit

by Amjad Masad · uses "Attention Is All You Need..."

tinygrad

by George Hotz · uses "Attention Is All You Need..."

v0 by Vercel

by Guillermo Rauch · uses "Attention Is All You Need..."

DocETL

by Shreya Shankar · uses "Attention Is All You Need..."

Suno AI

by Martin Camacho · uses "Attention Is All You Need..."

nanoGPT

by Andrej Karpathy · uses "Attention Is All You Need..."

MosaicML / DBRX

by Jonathan Frankle · uses "Attention Is All You Need..."

LangChain

by Harrison Chase · uses "Attention Is All You Need..."

MIT 6.S191 — Introduction to Deep Learning

by Alexander Amini · uses "Attention Is All You Need..."

Liquid Foundation Models

by Ramin Hasani · uses "Attention Is All You Need..."