Spyke

Replies

Comment on

The Living Web: Will there eventually be a protocol on top of (or as a part of) ActivityPub to run distributed LLMs on instances, with the LLMs feeding on the data generated by the Fediverse?

Reply in thread

What do you mean by "stay alive"? LLMs are statistical models that require a lot of number crunching in order to output a response. That's not something you can just host without some major costs associated (Far more than any single Fediverse instance for sure, GPUs are not cheap to rent).

You reached the end