Spyke

Replies

Comment on

New Ways to Corrupt LLMs: The wacky things statistical-correlation machines like LLMs do – and how they might get us killed

Reply in thread

Every time I see a headline like this I’m reminded of the time I heard someone describe the modern state of AI research as equivalent to the practice of alchemy.

Not sure if you're referencing the same thing, but this actually came from a presentation at NeurIPS 2017 (the largest and most prestigious machine learning/AI conference) for the "Test of Time Award." The presentation is available here for anyone interested. It's a good watch. The presenter/awardee, Ali Rahimi, talks about how over time, rigor and fundamental knowledge in the field of machine learning has taken a backseat compared to empirical work that we continue to build upon, yet don't fully understand.

Some of that sentiment is definitely still true today, and unfortunately, understanding the fundamentals is only going to get harder as empirical methods get more complex. It's much easier to iterate on empirical things by just throwing more compute at a problem than it is to analyze something mathematically.

Comment on

Framework’s first desktop is a strange—but unique—mini ITX gaming PC

Reply in thread

Useless is a strong term. I do a fair amount of research on a single 4090. Lots of problems can fit in <32 GB of VRAM. Even my 3060 is good enough to run small scale tests locally.

I'm in CV, and even with enterprise grade hardware, most folks I know are limited to 48GB (A40 and L40S, substantially cheaper and more accessible than A100/H100/H200). My advisor would always say that you should really try to set up a problem where you can iterate in a few days worth of time on a single GPU, and lots of problems are still approachable that way. Of course you're not going to make the next SOTA VLM on a 5090, but not every problem is that big.

Comment on

God damnit

Mildly useful tip: when you take a card or battery out of your camera, leave the door open until you put it back in. That way you'll know if you forgot to put one of them back into the camera. I do this and it's saved me a few times.

Comment on

So glad I'm ditching these fucking idiots

Reply in thread

IMO the bigger problem with FreeCAD is the topological naming problem. It's very easy to get frustrated because your model broke due to a change you made in an earlier feature.

The UI isn't amazing though, and that unfortunately happens quite a bit with open source software. Hopefully it'll go the way of Blender and KiCAD with an eventual major release that overhauls the UI.

Comment on

What a good dude

Reply in thread

As of right now VLC also doesn't properly support Wayland, but MPV does. It's a great piece of software!

Agree on the sentiment about VLC though, having an open source project demonstrate what is possible and stand the test of time definitely paves the way for future work and improvements.

Comment on

Bambu Lab Controversy Deepens: Firmware Update Sparks Backlash

Reply in thread

I agree with your thoughts. I hate what Bambu has done to the industry in terms of starting a patents arms race and encouraging other companies to reject open source, but I do love how they've pushed innovation and have made 3D printing easier for people just looking for a tool.

I hope the DIY printers like Voron, Ratrig, VzBot, and E3NG can continue the spirit of the RepRap movement.

Comment on

So glad I'm ditching these fucking idiots

Reply in thread

Ondel has a nicer user interface, but I personally use and recommend realthunder's LinkStable branch of FreeCAD. Mainline FreeCAD (and by extension, Ondsel) suffer from the topological naming problem, which can be especially jarring to users coming from proprietary CAD software. realthunder put a lot of work into a solution that handles the problem pretty well, so I'm using his fork until toponaming gets mainlined.

Comment on

Europe reaches a deal on the world's first comprehensive AI rules

Reply in thread

I'm a researcher in ML and that's not the definition that I've heard. Normally the way I've seen AI defined is any computational method with the ability to complete tasks that are thought to require intelligence.

This definition admittedly sucks. It's very vague, and it comes with the problem that the bar for requiring intelligence shifts every time the field solves something new. We sort of go "well, given these relatively simple methods could solve it, I guess it couldn't have really required intelligence."

The definition you listed is generally more in line with AGI, which is what people likely think of when they hear the term AI.

Comment on

*Permanently Deleted*

Reply in thread

Their GPU situation is weird. The gaming GPUs are good value, but I can't imagine Intel makes much money from them due to the relatively low volume yet relatively large die size compared to competitors (B580 has a die nearly the size of a 4070 despite being competing with the 4060). Plus they don't have a major foothold in the professional or compute markets.

I do hope they keep pushing in this area still, since some serious competition for NVIDIA would be great.

Comment on

ditch discord!

Reply in thread

Personally, I'd prefer that projects use forums for community discussions rather than realtime chat platforms like Discord or Matrix. I think the bigger problem of projects using Discord is not that it's closed source, but rather that it makes it difficult to search (since no indexing by search engines) and the format deprioritizes having discussion on a topic over a long period of time. Since Matrix is also intended for chat, it has these same issues (though at least you can preview a room without making an account).

Comment on

Fusion360 free Startup option is going away!

Reply in thread

Entirely fair! I think FreeCAD is still fine for hobbyists like myself though. It does take quite a bit of getting used to (I came from Fusion360 and Inventor first) since it operates somewhat differently, but it's good that we have at least one option.

Hopefully it'll see more development and become substantially more viable in the future.