NVLink bridge worth it for dual RTX 3090? : r/LocalLLaMA - Reddit
I recently got hold of two RTX 3090 GPUs specifically for LLM inference and training. Everything seems to work well and I can finally fit a 70B model into the VRAM with 4 bit quantization. I am …
4070 super or used 3090 : r/buildapc - Reddit
The 3090 has about 5% better performance than the 4070 Super. With that said I would go with the newer card for all the new features. The 4070 Super can absolutely handle 4k. If you want …
Seeking dual 3090 or 4090+3090 and 3090 setup advice for
Nov 23, 2023 · Any ideas on how I can fit two air-cooled 3090s or 4090+3090 in O11 XL avoiding possible thermal throttling and affecting GPU lifespan? I am reluctantly open to buying a new …
Undervolting an Nvidia RTX msi gaming x trio 3090 - Reddit
Jan 13, 2023 · My system: i7-12700k CPU msi gaming x trio 3090 32gb gskill ripjaws V 3200 mhz ram 760W Seasonic Platinum PSU from around 2015 (practically new from a usage …
3090 or 4070 for 4K gaming? : r/buildapc - Reddit
Jun 19, 2023 · 3090 is faster than 4070, especially at the 4K, plus more vram which matters at 4k. The only downside is the TDP, 3090 is a power hag. Reply reply kou07 •
Is an used rtx 3090 a good option now? : r/nvidia - Reddit
Oct 22, 2022 · People tend to forget that older hardware doesn't get worse lol. 3090 is still an amazing gpu, for 600-700 I think its a great buy. I have a 3080 and have considered getting a …
Doesn't a 4090 massively overpower a 3090 for running local LLMs?
Jul 7, 2023 · People seem to consider them both as about equal for the price / performance. I know 4090 doesn't have any more vram over 3090, but in terms of tensor compute according …
Should I get a new RTX 4070 or a used 3090 for nearly the same
Nov 1, 2023 · I found someone that I can buy RTX 3090 from with a price cheaper by 50$ than RTX 4070. Can anyone help me with choosing between them? The 3090 is super clean and …
[D] Does the Geforce RTX 3000 series GPU support bfloat16
Sep 2, 2020 · We know it's the same type of tensor cores in the 3090 as the A100, Nvidia confirmed this. Also the 24GB in the 3090 and only 10GB in the 3080 seems like a pretty …
Upgrade from RTX 3090 : r/nvidia - Reddit
Dec 15, 2022 · Upgrade from RTX 3090 Hey guys, hope you are doing fine So, I bought a 3090 for a very good price a month ago to my new build with an i7-13700kf, the doubt is, I mainly …