15000 TPS on a hardcoded ASIC with Llama3.1-8B | Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on lemmy.world

ai_·Artificial Intelligencebyikidd

15000 TPS on a hardcoded ASIC with Llama3.1-8B

https://chatjimmy.ai/Open link View original on lemmy.world

1

No replies yet

No comments on the original post yet.

15000 TPS on a hardcoded ASIC with Llama3.1-8B | Spyke