Apple collaborates with NVIDIA to research faster LLM performance
Apple engineers have shared new details on a collaboration with NVIDIA to implement faster text generation performance with large language models.
https://9to5mac.com/2024/12/18/apple-collaborates-with-nvidia-to-research-faster-llm-performance/Open linkView original on lemmy.world
7 replies
Super ironic that Apple are working with NVIDIA, and have launched their own AI offering, but you can't connect any kind of GPU to any Mac that they currently sell.
Yes, because it would make the Mac worse. Nvidia GPUs are comically inefficient.
EDIT: tech illiterate shit-for-brains downvoted this comment.
Because of the diminishing returns in using larger and larger models, I’m hopeful that this could lead to more efficient LLM implementations that aren’t so harmful to the environment. Just maybe.
“We made Siri faster but each request now drains a lake.”
"Hey, Siri, give me a real-time count of all existing lakes and update it every second."
Siri: “Let me search it on the web.”
Two ::: spoiler spoiler dickheads ::: are better than one