Spyke
buildapc·BuildapcbyRedNight

What Did I Just Buy?

UPDATE: They responded to me. It is indeed the RTX 4070 SUPER 12GB (Not 16GB). The listing will appear correctly again on 1/24/2024

I know this community is mainly about building a PC, but wanted to get some opinions from the experts.

So I know very little about hardware, but wanted to move away from my old standard laptop for a gaming and local LLM inference desktop. Decided current series Nvidia GPU with 16BG VRAM would be good.

Saw this pre-order product on newegg and jumped on it: "iBUYPOWER Gaming Desktop RTX 4070 Super 16GB, i7-47000F, 32GB DDR5, 2TB SSD, Windows 11 Home" $1,799.99

Only after I realized the CPU model number doesn't exist and the RTX 4070 Super maxes out at 12GB VRAM, right? Do you think they meant the RTX 4070 Ti Super?

What do you guys think? Thanks

View original on lemmy.ml

I mean, maybe ask first, buy later next time?

If you really want to self host LLM's you'll need far more GPU memory than that.

9
RedNightreply
lemmy.ml

Should have spent more time...you're right.

According to some articles, you can self host smaller parameter LLMs and/or quantized versions. For example the 7B models. Recommendations were 16GB+. Some even pulled off lower

1

Thanks for the response! That website says its good if it is indeed the i7-14700F 🤞 Maybe just a typo

1
lemmy.ca

If it doesn't exist anymore, that's probably a good sign that there were mistakes in the post.

9
RedNightreply
lemmy.ml

I'm primarily hoping whatever GPU does arrive has 16GB VRAM. That was a main requirement I was trying to satisfy

1
lemmy.ca

Personally, I would try to refund/cancel the order.
You don't really know what they are going to ship you, all you know is that what the shop listing said doesn't exist (unless the hardware companies are making announcements between now and when the product ships).

1
RedNightreply
lemmy.ml

They responded to me. It is indeed the RTX 4070 SUPER 12GB (Not 16GB). Going to cancel order

The listing will appear correctly again on 1/24/2024

2

You reached the end

What Did I Just Buy? | Spyke