For the best experience on desktop, install the Chrome extension to track your reading on news.ycombinator.com
Hacker Newsnew | past | comments | ask | show | jobs | submit | history | fromregister
Llama 2 70B on M2 Max at 7 tokens/sec (twitter.com/junrushao)
42 points by tikkun on Sept 1, 2023 | past | 6 comments
MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100 (twitter.com/junrushao)
12 points by junrushao1994 on July 20, 2023 | past | 3 comments

Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search:

HN For You