Stella Biderman
BuilderNYC
@stellaathena
Executive Director of EleutherAI. Leading the largest open-source AI research collective building GPT-NeoX, Pythia, and open LLMs.
Skills
Looking For
Research Foundations (3)
Attention Is All You Need
Used by: GPT-NeoX / Pythia
Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
Used by: GPT-NeoX / Pythia
Language Models are Few-Shot Learners
Used by: GPT-NeoX / Pythia
Projects (1)
EleutherAI's open-source large language model suite. Pythia provides 16 model checkpoints (70M-12B) for scientific study of LLM training dynamics.
Built on research:
AI Suggested Researchers
Researchers whose work may be relevant to your projects (auto-detected)
Hannaneh Hajishirzi
University of Washington / Allen AI
Kyunghyun Cho
New York University / Genentech
Aaron Courville
Mila / Université de Montréal
Luke Zettlemoyer
University of Washington / Meta AI
AI Suggested Papers
Papers that may have inspired your projects (auto-detected by domain & keyword analysis)
For GPT-NeoX / Pythia:
OLMo: Accelerating the Science of Language Models
ACL 2024 · 2024 · 800 citations
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
NAACL 2019 · 2019 · 108,124 citations
Llama 2: Open Foundation and Fine-Tuned Chat Models
arXiv preprint · 2023 · 7,200 citations