← Back to Directory
Sebastian Raschka

Sebastian Raschka

Builder

Austin

@rasbt

Staff Research Engineer at Lightning AI. Author of 'Machine Learning with PyTorch and Scikit-Learn' and 'Build a Large Language Model From Scratch'.

Skills

PyTorchLLMsmachine learningtechnical writingpython

Looking For

collaboratormentor

Research Foundations (2)

Attention Is All You Need

NeurIPS 201720176,510 citations

Used by: Build a Large Language Model From Scratch

Language Models are Few-Shot Learners

NeurIPS 202020203,027 citations

Used by: Build a Large Language Model From Scratch

Projects (1)

Build a Large Language Model From Scratch

GitHubLive

Hands-on book and code repository teaching LLM internals from the ground up. Covers pretraining, fine-tuning, and RLHF with clear PyTorch implementations.

NLPGenerative AI

Built on research:

paperAttention Is All You Need(2017)
paperLanguage Models are Few-Shot Learners(2020)

AI Suggested Researchers

Researchers whose work may be relevant to your projects (auto-detected)

Kyunghyun Cho

Kyunghyun Cho

New York University / Genentech

Shared domains: NLP, Generative AI
69% matchAI suggested
Aaron Courville

Aaron Courville

Mila / Université de Montréal

Shared domains: NLP, Generative AI
69% matchAI suggested
Hannaneh Hajishirzi

Hannaneh Hajishirzi

University of Washington / Allen AI

Shared domains: NLP, Generative AI
66% matchAI suggested
Luke Zettlemoyer

Luke Zettlemoyer

University of Washington / Meta AI

Shared domains: NLP, Generative AI
60% matchAI suggested

AI Suggested Papers

Papers that may have inspired your projects (auto-detected by domain & keyword analysis)

WebsiteTwitterGitHub