How to make LLMs go fast
I found this post interesting for my layman's understanding of LLMs and some of the underlying architecture choices that are made.
Syndicated from the fediverse. Read and engage on the original instance.
View original on lemmy.mlhttps://vgel.me/posts/faster-inference/Open linkView original on lemmy.ml
No replies yet