dp
Dan
About
Research
Projects
Experience
Stack
Writing
Search
⌘K
Writing
1 post, notes on models and training
All
1
LLM
1
Pre-Training
1
Sep 8, 2024
8 min read
Comparison of Different Attention Q Modes
A comprehensive analysis and comparison of different Attention Q modes including SDPA, Flash Attention variants, and sparsified attention mechanisms.
Pre-Training
LLM
Sections
About
Research
Projects
Experience
Stack
Writing
Contact
Research
SycoEval-EM, sycophancy under patient pressure
Stanford Medicine, first author
An agent that reads 3D medical scans
Stanford, first author
Flagging high-risk clinical orders
UNC Chapel Hill
LIFTED, multimodal clinical trial outcome prediction
EMNLP 2025 Findings, co-author
SpaGenBench, a spatially variable gene atlas
Nature Genetics
EchoViT, cardiac MR sequence classification
MICCAI 2025 Workshop
Engineering
Anchor, an AI study notebook
Personal project
PROwl, an AI pull-request reviewer
Bandwidth, SWE co-op
Pro Hub, a campus organization roster
UNC COMP 423, team of 3
OnlyBank, a digital bank backend
Personal project
Facebook Clone, a real-time social network
Personal project
AutoDPD, automatic dependency detection
Open source, on PyPI
Writing
All writing
/blog
Comparison of Different Attention Q Modes
Links
GitHub
GreatDanPeng
LinkedIn
GreatDanPeng
Google Scholar
publications
Actions
Copy email
info@official-danpeng.com
Toggle theme
↑↓ move
↵ open
esc close