Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

1
Been out of it for a while, new stuff finally pushing me to upgrade. Am I sane?
Post Flair (click to view more posts with a particular flair)
Post Body

Back in my day, when I was following this stuff closely, we didn't have none of this fancy DDR5 ram. No, good old DDR3 was enough for us. And we thought a 14nm process node was small! Imagine that! 14nm! Why, might as well be Core2 by today's standards!

Anyway, despite following this stuff for a while, I haven't really paid close attention since the launch of Zen. Zen 1. The OG Zen. What I've been doing hasn't required me to pay more attention, until now, when not only is the old computer [a FX-83something w/ 20GB of RAM and a GTX 1060 3GB--I asked for 6, got 3--that replaced a 560 because that's how GPUs were back in 2020 and, apparently, very little has changed] getting rather hot and noisy--more than typically so for a construction core--but is grossly insufficient when I want to clobber together 5 open-source transformer models into an unholy resemblance of life. I mean, ultimately, all this stuff gets deployed on remote servers and such [I'm futzing about with high-bandwidth ARM instances as we speak], but I need something a little more potent under my desk.

So I've gone out and parted myself out a build. My priorities are:

1) small--I prefer small aesthetically, and frankly, I could use something a little more portable.

2) RAM bandwidth--this is the biggest bottleneck on LLMs today

3) LLM/Machine learning performance

4) Virtualization performance [sometimes you really need five Linux VMs running at once to test stuff out easily, y'now?]

5) gaming performance, but this is way back there

6) can be converted to a server in the near future with mere addition of a few 2.5" flash SSDs

7) official windows 11 support [jk]

Henceforth lies the obligatory PCpartpicker list. That, at least, has not changed.

PCPartPicker Part List

Type Item Price
CPU Intel Core i5-13500 2.5 GHz 14-Core Processor $244.85 @ Newegg
Motherboard Gigabyte H610I Mini ITX LGA1700 Motherboard $109.23 @ Amazon
Memory TEAMGROUP T-Force Vulcan 64 GB (2 x 32 GB) DDR5-5200 CL40 Memory $149.99 @ Amazon
Storage TEAMGROUP MP33 PRO 2 TB M.2-2280 PCIe 3.0 X4 NVME Solid State Drive $95.99 @ Amazon
Video Card Acer Predator BiFrost OC Arc A770 16 GB Video Card $299.99 @ B&H
Case Thermaltake Core V1 Mini ITX Desktop Case $54.98 @ Amazon
Power Supply SeaSonic S12III 500 W 80 Bronze Certified ATX Power Supply $65.44 @ Amazon
Prices include shipping, taxes, rebates, and discounts
Total $1020.47
Generated by PCPartPicker 2024-01-18 15:41 EST-0500

Points of concern:

  • I've heard the i5-13500 and below use the 12th gen Intel architecture, while 13600 use 13th gen. Not sure I want nominal 125W TDP for the extra $50 though...
  • Are Intel chips still fucky with the TDP? This is a bit of a concern since, y'now, ITX and all that
  • There's not any reasonable competition to the Arc A770 if my constraints are "does not cost a bajillion dollars and has 16GB of RAM" right? NVIDIA seems to have cut down on their RAM to sabotage DL/AI customers. AMD has shite software support and the new RX whatchamacallit only has a 128-bit bus anyway, despite being 16GB, while Intel seems much more keen on supporting this stuff. Waiting for Battlemage also seems a losing proposition as it's unclear if it will even have 16GB of RAM.

Apologies for the long, rambling post, I mostly just want affirmation that I haven't completely lost touch and that I haven't badly misunderstood the market situation presently.

Author
Account Strength
100%
Account Age
5 years
Verified Email
Yes
Verified Flair
No
Total Karma
221,025
Link Karma
16,824
Comment Karma
202,817
Profile updated: 1 week ago
Posts updated: 7 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
10 months ago