Spyke

Replies

Comment on

Distinguishing features of Long COVID identified through immune profiling - Nature

Reply in thread

I'm not an expert but I feel for you and will try my TLDR.

They did a study of almost 300 people. They split these into two groups, some with long COVID and some without.

They then tried to determine if those with long COVID had a signature in their antibodies. That's what "immuno phenotyping" means ... finding a unique pattern in antibody types and responses.

They did indeed find those signatures or patterns. Specifically, people with long COVID had more of specific types of antibodies and faster antibody responses to COVID and other viruses like Epstein Barr.

These differences between these two groups might help to identify and diagnose long COVID.

Further study is recommended (edit: almost all papers end with this recommendation)

python

Comment on

Textual Web takes a Textual-powered TUI and turns it in to a web application

Reply in thread

I went over to their Discord server and here's what I was able to glean.

I gather they run a web-facing server which accepts text I/O from your Textual apps running on your personal machine or server, probably as a daemon. The connection between these two is via normal TCP/IP connections which your firewall already allows. Your Textual apps receive keyboard and mouse events and text.

They claim it should be "essentially free" for hobby use.

The text stream between your apps and their servers will eventually be (or are) encrypted.

Comment on

How much gpu do i need to run a 90b model

The new $3000 NVidia Digit has 128 GB of fast RAM in an Apple-M4-like unified-memory configuration, reportedly. NVidia claims it is twice as fast as an apple stack at least at inference. Four of these stacked can run a 405B model, again according to NVidia.

In my case I want the graphics power of an GPU and VRAM for other purposes as well. So I'd rather buy a graphics card. But regarding a 90B model, I do wonder if it is possible with two A6000 at 64 GB and a 3 bit quant.

Comment on

Anytype as an alternative to Notion or Obsidian

Reply in thread

The community can only read the source code, as of yet. All of the source code has been provided by a set of internal developers.

The fact that it is open source means that, if somehow two malware elements have made it into the source code, then someone will eventually report it. But this doesn't mean that two malware elements cannot be there right now.

These two malware hits on total virus scan should be communicated to the developers.

Comment on

Lemmy instances that are focused on mirroring Reddit content?

Let's say I have a favorite sport and there exists a sub_ named: r/.

Let's also say there already exits a Lemmy community and that community is struggling to get off the ground: [email protected]

I can see a value add if your project directly helps [email protected] get started; but I don't see how it does. If anything wouldn't your project compete with [email protected] and therefore hinder it?

It might be different if your project directly tied r/ to [email protected] but it doesn't.

Comment on

Is Arli AI a legit cloud LLM inference service? Any user experience?

Reply in thread

I tried Mistral Nemo 12B instruct this morning. It's actually quite good. I'd say it's close to dolphin mistral 8x7B which is a monster in size and very smart, about 45 or 50GB. So I'd say Arli is a good deal Mistral Nemo 12B for 4 or $5 per month and privacy so they claim.

If you don't mind logging for some questions, you can get access to very good or if not the best models at lmsys.org without monetary cost. Just go to the "Arena". This is where you contribute with your blind evaluation by voting which of two is better. I often get models like 4o and sonnet 3.5 by Anthropic, google's best, etc., and at other times many good 70B models. You see two answers at once and vote your favorite between the two. In return, you get "free" access.

Be careful with AMD GPUs as they are not as well supported for local AI. However, support is gaining ground. Some people are doing it but it takes effort and hassle, from what I've read.

Comment on

How much gpu do i need to run a 90b model

Reply in thread

Not exactly. Digits still uses a Blackwell GPU, only it uses unified RAM as virtual VRAM instead of actual VRAM. The GPU is probably a down clocked Blackwell. Speculation I've seen is that these are defective and repurposed Blackwells; good for us. By defective I mean they can't run at full speed or are projected to have the cracking die problem, etc.

Comment on

Instance / Server evaporation

Thanks for the replies. So I guess USENET had/has an advantage here, as all USENET servers replicate "all" newsgroups automatically. To the extent that one server exists, the newsgroup lives on regardless of its origination point. In that sense, the collective work of all contributors is not lost until the retention date passes.

The ActivityPub proposal mentioned by @chris seems to be a good enough equivalent, at least for communities that are shared.

Comment on

Is Arli AI a legit cloud LLM inference service? Any user experience?

I know that people are using P40 and P100 GPUs. These are outdated but still work with some software stacks / applications. The P40 GPU, once very cheap for the amount of VRAM, is no longer as cheap as it was probably because folks have been picking them up for inference.

I'm getting a lot done with an NVidia GTX 1080 which only has 8GB VRAM. I can run a quant of dolphin Mixtral 7x8B and it works well enough. It takes minutes to load, almost too long for me, but after that I get 3-5 TPS with some acceptable delay between questions.

I can even run Miqu quants at 2 or 3 bits. It's super smart even at these low quant levels.

llama 3.1 8B runs great with this 1080 8BG GPU at 4_K_M and also 5 or 6_K_M. I believe I can run gemma 9B f16 at 8 bpw.

Comment on

[US] Brokerage with decent API?

Reply in thread

Interactive Brokers is also my next choice. Although, beware that you have to install Java runtime from Oracle in order to be able to log in to they servers. Java runtime environment has seen many beaches of security in the past, particularly the Internet was still in adolescence. Oracle claims to have solved those but this needs to be verified.

I'm waiting for Schwab mainly because, as it turns out, there is magic there. Namely, our assets are protected from online fraud. I'm sure there are limits to that protection. And that protection has applied to their normal online accounts. Will it apply to API accounts? We will have to reread the fine print when it's final.