What if the RAM/GPU shortage is deliberate?

(xn--vk5b17r.online)

37 points | by theoneone 18 hours ago

9 comments

  • jmholla 11 hours ago
    From the opposite angle, there's apparently evidence that the RAM companies themselves are price fixing: https://www.tomshardware.com/tech-industry/samsung-sk-hynix-...
    • Klonoar 10 hours ago
      The existence of a lawsuit is not evidence.
      • john01dav 5 hours ago
        That's false. It's evidence, but it isn't conclusive. Someone thought that the law suit was worth filing, and that could be because the law suit has a chance of succeeding. It could also be some other reason, and it could also fail even if completely good faith -- this is why the evidence is non-conclusive.
  • tencentshill 6 hours ago
    The memory manufacturers don't believe the rate is sustainable, so are hesitant to start up new production to meet demand when it will inevitably crash. They have to operate on longer timescales than software companies.
  • xyzsparetimexyz 12 hours ago
    So you're arguing that ai companies overbought memory to increase scarcity? Possibly even buying e.g. consumer ddr?
    • happyPersonR 8 hours ago
      Hyperscalers and social media companies hired tech talent to keep folks from starting their own companies and keep other companies from hiring them.

      memory companies are known to price fix as well, so i could really see either possibility tbh

      and why not both?

    • theoneone 12 hours ago
      just a theory! The end result was too make it difficult for me and you to run llms on our systems, and you need porwerfull system to run them. But some months ago, those powerfull systems where affordable for end consumers. Now, good luck buying let's say 128gb ddr5.
      • MildlySerious 10 hours ago
        Do you believe this is more likely than corporations trying to restrict the supply for their corporate competitors? My thinking would be that we're just caught in the crossfire. The percentage of people seriously running their own models locally would hardly be any less diminishing if hardware prices were at their previous levels.
  • bob1029 7 hours ago
    A single bit of HBM consumes 2-3x the manufacturing capacity that a single bit of conventional DRAM does.
  • 0n0n0m0uz 2 hours ago
    Its certainly plausible but what % of consumers would actually buy RAM and do it themselves? The most profitable regular mainstream user would gladly pay $20 and use a simple web interface and not worry about anything else.
  • stevenhuang 6 hours ago
    I think this misunderstands basic supply and demand.

    If there's this much global demand for RAM, there is simply no need to speculate further about intent; all else being equal, prices would have risen naturally anyways.

    Of course, the rise in prices is also incidentally convenient for those that have RAM, and would make it harder for others to compete, but whether this was intentional is beside the point.

  • theoneone 18 hours ago
    Some personal thoughts on the current ram/GPU shortage -price hikes.
  • ukblewis 9 hours ago
    You are aware that a 1 trillion parameter model won’t run on any quantity of consumer hardware, even heavily quantized… you need a data center for that. And that is not even to talk of the Kimi K3 model which is in the ballpark of 3 trillion
    • throw1234567891 1 hour ago
      You don’t need a datacenter. 1T model requires 1T of RAM. Not easy to come by today in a compact factor but nowhere near the datacenter.
    • layla5alive 9 hours ago
      You do not need a data center - just a single rack will do to run it fast. Or about 100x 5090s.
  • D__J 9 hours ago
    [flagged]