← Back to Directory
Edward Hu

Edward Hu

Builder

NYC

@edwardjhu

Researcher at Microsoft. Inventor of LoRA and co-inventor of muP — enabling efficient fine-tuning and hyperparameter transfer for large models.

Skills

LoRAfine-tuningNLPpythondeep learning

Looking For

collaboratormentor

Research Foundations (2)

Attention Is All You Need

NeurIPS 201720176,510 citations

Used by: LoRA

Semi-Supervised Classification with Graph Convolutional Networks

ICLR 2017201721,000 citations

Used by: LoRA

Projects (1)

LoRA

GitHub

Low-Rank Adaptation of Large Language Models. The most widely adopted parameter-efficient fine-tuning method, reducing trainable parameters by 10,000x.

NLPGenerative AI

Built on research:

paperAttention Is All You Need(2017)
paperSemi-Supervised Classification with Graph Convolutional Networks(2017)

AI Suggested Researchers

Researchers whose work may be relevant to your projects (auto-detected)

Luke Zettlemoyer

Luke Zettlemoyer

University of Washington / Meta AI

Shared domains: NLP, Generative AI
65% matchAI suggested
Hannaneh Hajishirzi

Hannaneh Hajishirzi

University of Washington / Allen AI

Shared domains: NLP, Generative AI
64% matchAI suggested
Tom Brown

Tom Brown

OpenAI

Shared domains: NLP, Generative AI
63% matchAI suggested
Kyunghyun Cho

Kyunghyun Cho

New York University / Genentech

Shared domains: NLP, Generative AI
61% matchAI suggested

AI Suggested Papers

Papers that may have inspired your projects (auto-detected by domain & keyword analysis)

WebsiteTwitterGitHub