← Back to Directory
Ofir Press

Ofir Press

Builder

Princeton

@ofirpress

Researcher at Princeton. Inventor of ALiBi positional encoding enabling length generalization in transformers without position embeddings.

Skills

transformersNLPpositional encodingresearchpython

Looking For

collaboratorjob

Research Foundations (2)

Attention Is All You Need

NeurIPS 201720176,510 citations

Used by: ALiBi Positional Encoding

Artificial Intelligence: A Modern Approach

Pearson (4th Edition)202072,000 citations

Used by: ALiBi Positional Encoding

Projects (1)

ALiBi Positional Encoding

GitHub

Attention with Linear Biases enables transformers to generalize to longer sequences than seen during training without learned position embeddings.

NLPGenerative AI

Built on research:

paperAttention Is All You Need(2017)
paperArtificial Intelligence: A Modern Approach(2020)

AI Suggested Researchers

Researchers whose work may be relevant to your projects (auto-detected)

Hannaneh Hajishirzi

Hannaneh Hajishirzi

University of Washington / Allen AI

Shared domains: NLP, Generative AI
63% matchAI suggested
Kyunghyun Cho

Kyunghyun Cho

New York University / Genentech

Shared domains: NLP, Generative AI
60% matchAI suggested
Aaron Courville

Aaron Courville

Mila / Université de Montréal

Shared domains: NLP, Generative AI
60% matchAI suggested
Luke Zettlemoyer

Luke Zettlemoyer

University of Washington / Meta AI

Shared domains: NLP, Generative AI
60% matchAI suggested

AI Suggested Papers

Papers that may have inspired your projects (auto-detected by domain & keyword analysis)

WebsiteTwitterGitHub