GPU World

(gpuworld.org)

134 points | by simonpure 4 hours ago

21 comments

  • NitpickLawyer 1 hour ago
    I just finished reading Service Model by Adrian Tchaikovsky [1], a really timely novel that deals with lots of open ended questions of AI, robots, humanity, control, self determination, and so on. Really recommend it if you're into these kinds of things.

    > Premise Imagine that AI frontier progress stops as of 1 September 2026: AI becomes faster and cheaper, but it never becomes superhuman or improves considerably across the board.

    I absolutely love this premise. I wrote a comment a few days ago about this very thing. I've had this "revelation" in early 2024, when using a small local model, that even if models never improve, I'd still have a few years of discovering all the things I could do with the models.

    Really cool, hopefully we get some interesting and not overwhelmingly pessimistic stories out of this project. There's enough cynicism and negativity in the world. We could use some funny takes on everyone using openclaw2040 ran by fable. Shenanigans galore.

    [1] - https://www.goodreads.com/en/book/show/195790861-service-mod...

    • abrookewood 1 hour ago
      Haven't read that one yet, but his Children of Time series is sooo good.
    • yitchelle 51 minutes ago
      Yes, that book is a stark reminder (or prediction).
    • ideasman42 36 minutes ago
      I couldn't believe it when the "real" news headline was reported - destructively scanning books.

      I thought this was one of the less plausible parts of the book, Sigh! :)

  • rixed 1 hour ago
    Since the dawn of industry, people have been amazed by the new possibilities and how that would affect society once it's evenly distributed. Technical progress has been going on, percolating in every places and down to every person. Yet it's never been "evenly distributed".

    What would happen when every one would have access to Internet? How different will the world be when everyone carries a computer in their pocket? Can communicate with anyone regardless of location and language, with no intermediary? Those were questions we used to ask ourselves not so long ago. Turned out: not much have changed.

    For the future to be evenly distributed, much bigger changes will have to happen than large scale manufacture of efficient GPUs. Otherwise, tech will just be used to make sure progress and knowledge stays unevently distributed. That's the whole game of herding humans, after all; It's called "organized scarcity".

    • guax 1 hour ago
      > not much have changed.

      So much have changed. The way we shop, travel, navigate a town, the way we socialize, receive information. My formative memory is during the transition from computers are a furniture piece and internet a thing you do to being on your pocket with constant high speed connection and the difference is incredible.

      I was also part of the people that thought everyone having access would turn out a lot better than it ended up being. I think the issue is not that it did not change much, is that good changes got offset a bit by a lot of very bad outcomes.

      No comment on the distribution and concentration part, that one I agree.

      • camillomiller 43 minutes ago
        In the limited pockets of society you experience directly. How much has changed in the relationship between the West and Asia, the economic inequalities globally, or even in the West, etc... if you look at macro, everything moves according to laws that have little to do with the even distribution of technology and a lot to do with the decision makers that get to pick how that distribution takes place.
        • elil17 35 minutes ago
          Just because something doesn't impact geopolitics doesn't mean it isn't important
          • camillomiller 25 minutes ago
            That's not what I'm saying, and I don't know where you inferred that from. I'm saying that tech has changed the world in the way we experience it, for sure, but it has been driven by political choices, more that drive political choices itself if we look at the bigger picture.
      • tosapple 9 minutes ago
        [dead]
    • gwern 1 hour ago
      > Turned out: not much have changed.

      I think the world has changed a lot since the 1980s.

      • rbanffy 1 hour ago
        Most people still go to work every day, inequality still exists, as does famine, disease, wars…

        Our cars are cleaner, our phones are much better, our TVs much lighter and bigger.

        • cheema33 46 minutes ago
          > Most people still go to work every day..

          And trees and mountains and animals still exist...

          Rate of change, it appears, depends entirely on someone's perspective.

    • mshanu 27 minutes ago
      > Turned out: not much have changed Changed a lot, I am getting to know what a random person living some where in the world think about what change it has brought
  • markoutso 8 minutes ago
    > LLM use is permitted, but discouraged; we remind participants that LLM use tends to reduce originality and writing quality, and the flaws are especially obvious when LLM outputs are read as a group---unskillful use of LLMs will reduce the odds of being the best entry. We request disclosure of AI use.
  • not2b 1 hour ago
    Hopefully in this world, someone figures out how to deliver the performance equivalent of a B300 GPU for about 1/100th the power of a current B300 (which can be up to 1400 watts), or the world will bake.
    • avaer 1 hour ago
      Analog AI/approximate computing? There's research into it, worth looking at if you're interested.

      The idea is you tolerate some loss/degradation (which neural networks do) but gain orders of magnitude power efficiency.

    • i5heu 54 minutes ago
      8 biillion * 1400 watts = 11.2 terawatts

      current global average electricity production = approximately 3.6 terawatts

      But then again these systems do not use 1400 watts all the time. We would probably have much more then 11.2 terawatts demand if all humans turn on all their electrical consumers at the same time.

      • not2b 5 minutes ago
        So demand quadruples if they are always on, and doubles if they are on 1/3 of the time. Either way, too much.
  • divbzero 1 hour ago
    Quite an interesting selection committee:

      Neal Stephenson
      Gwern Branwen
      Matt Huang
  • mkagenius 57 minutes ago
    > LLM use is permitted, but discouraged; we remind participants that LLM use tends to reduce originality and writing quality, and the flaws are especially obvious when LLM outputs are read as a group---unskillful use of LLMs will reduce the odds of being the best entry. We request disclosure of AI use.

    Lot of submissions won't disclose it. Wouldn't it better to run your own checker instead of asking to disclose (to be fair to everyone).. I suppose there ought to be some checker which is SOTA.

    If you anyway intend to use the checker then kindly do no ask to disclose it, coz what's the point then.

    • cheema33 51 minutes ago
      > Wouldn't it better to run your own checker instead of asking to disclose

      Do you know of a "checker" that can reliably detect AI-assisted writing with 100% accuracy? One does not exist.

      > If you anyway intend to use the checker then kindly do no ask to disclose it, coz what's the point then.

      You appear to think in absolute terms. I am guessing you are very young.

      • mkagenius 42 minutes ago
        I said SOTA not 100%. And that's not thinking in absolute terms.
      • calmoo 47 minutes ago
        Pangram is very accurate
        • NitpickLawyer 27 minutes ago
          It really isn't and it's sad seeing so many people say it so confidently on this site. It only detects plain / basic prompted stuff. "write me an essay on x", sure. The moment you prompt it differently, it stops working. Add "output should be STE100 compliant" or something to your prompts and detection goes away. Fine-tune any local llm on real human prose, and detection goes away. Edit 2-3 characters (emdashes, lists, etc) and detection goes away.

          And that's for just basic detection. There have been plenty of examples of 100% human written content (either old, or unpublished) that gets falsely flagged as AI.

          And these are just technical aspects. The main issue is that pangram and other solutions are being used to summarily judge students work, and that is orders of magnitude more fucked up. Accusing someone of cheating can have devastating effects on their education/career/etc. and they're doing it with snake-oil closed boxes, at scale. We really really shouldn't support this, especially here on a technical site.

        • jedberg 41 minutes ago
          No it isn't. I've put human written material in there (my own unpublished material) and it says 90%+ AI. Then I put some AI material in and it said 30% chance of AI.

          I only tested it with the two pieces, but was not impressed.

          • ekelsen 8 minutes ago
            Can you share your human piece that got flagged? And the AI piece that didn't? (Or snippets?) I've found pangram to be very accurate, so I'm curious.
  • jdub 1 hour ago
    LLM use is permitted, but discouraged; [...] We request disclosure of AI use.

    Heh. In the future I imagine, this would be embarrassingly redundant. "Thou shalt not make a machine in the likeness of a human mind."

    • blkhawk 49 minutes ago
      As far as I understand the backstory of the jihad this rule was caused not by machine minds being bad but (some) humans are very shitty.
    • fangspire 28 minutes ago
      Nah, someone imagined this before you. Be more original.
    • koolala 1 hour ago
      It's a story writing competition...
      • jdub 1 hour ago
        Yeah, but I'm not going to write a short story about the Butlerian Jihad's inquisitors chasing down everyone who owns a GPU for this competition.
  • Zoo3y 12 minutes ago
    Asimov's laws of robotics and Herbert's Dune foreshadowed the troubles we are facing now and have been largely ignored. It appears fiction does nothing to guide us when it comes to technology; no matter how prescient or widely read. Consider this when writing your idealist drivel.
  • newyankee 1 hour ago
    there might be 8 billion GPUs in the world by 2040 but they will be controlled by 8 corporations across the world.
    • charlieyu1 12 minutes ago
      So how is it different from now, you can name any industry for example
    • rbanffy 1 hour ago
      “In our story contest, we ask people to imagine the future, evenly distributed.”
      • worldsayshi 58 minutes ago
        I think there are scenarios, however (un)likely that will lead us to this point. Imaging them and spreading such ideas can make that more likely.
        • bertylicious 32 minutes ago
          But the contest does not ask what needs to happen to achieve even and fair distribution of wealth, it specifically asks what might happen after we reached that point. That kind of blindness towards today's political and socio-economic conditions has always been very typical for this kind of techno optimism. I believe it actually prevents revolutionary thought by assuming some kind of revolution has already occurred somehow in order to then attribute all following societal progress to the technology alone.
  • thatgloomyguy 21 minutes ago
    GPU per person or models working on less computing power
  • orlp 51 minutes ago
    If there was a continuous 500 watt GPU per person we'd increase energy consumption by more than double.

    The continuous energy footprint per person globally averages to 356 watt currently.

    • terhechte 31 minutes ago
      A Mac Studio m4 max in low power mode consumes ~50-100 watt on 100% gpu consumption. On GPU idle it is ~10 watt. If we imagine improved models (e.g. qwen 3.8 is a 5b moe which is way faster to process) and improved chip performance on 2nm and half a day of usage (the AI will sleep when we sleep then):

      ((75 watt / 2 [faster models]) / 2 [faster chips]) / 2 [half a day of usage]) => ~ 10 watt.

      AI for everyone does not imply pC mAsTeRraCe for everyone.

    • cheema33 42 minutes ago
      > If there was a continuous 500 watt GPU per person...

      Would we all be driving the 500 Watt GPU hard 24/7? And the premise that the "AI frontier progress stops as of 1 September 2026" likely does not include semiconductor progress. You are very likely to be able to run Fable class AI model on something that is significantly more efficient in 2040.

    • hhjinks 44 minutes ago
      500 watts continuous isn't realistic, unless you foresee a 24/7 digital shadow society where AIs interact continuously without user input.
  • raincole 37 minutes ago
    > What will our world be like when (not if) every human being has access to the equivalent of a Fable or Sol LLM 24/7/365

    One single sentence illustrating why tech bro has become a derogatory term. Do they realize that today many humans don't even have access to clean water?

    • charlieyu1 10 minutes ago
      And? Virtually everyone in the world has internet
      • tappio 2 minutes ago
        Good argument going here but here is what internet tells me about 'facts':

        Its about the same amount of population who have access to clean water and who have access to internet, and that's maybe about 75% of global population for both. Don't know how they overlap, but probably there is people who have no access to internet but have access to clean water and the other way around.

        In absolute terms that is still billions of people. Billions.

  • XCSme 1 hour ago
    We can't even predict/understand our current world, yet alone the world in 20 years.

    Even if we get to one GPU pe person, it's not like that's the end state, the world constantly changes and will constantly evolve. If it stagnates too long, people get bored and a revolution would happen.

    So, whatever that world would be, it would be temporary too

    • XRG 19 minutes ago
      Boredom may cause teenagers to commit acts of vandalism; it’s not a typical cause for revolution. (That would be things like famine, gross inequality, severe injustices and so on.)
    • worldsayshi 1 hour ago
      I think the point of stories like these is to accept that the world is too complex to fit into a story but we can try to fit a part of it anyway and we might learn something from it or at least get an interesting experience.
  • GalaxyNova 1 hour ago
    What will happen when everyone has access to a hot air balloon?
  • padolsey 1 hour ago
    We humans will all be but API conduits for our respective AIs.
    • avaer 1 hour ago
      One interesting formulation is that humans are the sex organs of AI.
  • peter_d_sherman 1 hour ago
    >"Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'.

    What would this world be like?

    What will our world be like when (not if) every human being has access to the equivalent of a Fable or Sol LLM 24/7/365? Will this lead to a panopticon of indefatigable AI surveillance? Will education be revolutionized by infinitely patient tutors? Will social media cease to exist as we know it? Will healthcare be revolutionized by world class AI doctors and personalized medicines? What will happen in the oft-ignored developing world?"

    What great questions!

    These would be great questions to pose to a Creative Writing class, any Creative Writing class!

    Or heck, any Creative Writing class, Philosophy class, or Futurist!

    You know, there should be a web page, a time-capsule web page if you will, where people of 2026 ask questions about what specific future years will look like in terms of health, climate, politics, religion, currency, geopolitics, social media, news, education, etc., etc., and then all of these questions could be aggregated statistically into the most asked ones, and that could be preserved going forward in time...

    That's from a looking-forward-into-the-future perspective...

    We could, from a looking-backwards-into-the-past perspective, try to discover what people, in say 1900, thought about the future; what their specific concerns were, what their specific questions were... perhaps some historian or historians or books or (copied to) web pages out there contains some of this information somewhere...

    Which might be interesting to look at for comparison purposes...

    You know, "for good or for evil, in the superlative degree of comparison only...", to quote Charles Dickens' 1859 book, "A Tale Of Two Cities"... :-)

    • left-struck 1 hour ago
      Back in 2023 I sent myself an email with some predictions about the future and my thoughts on LLMs at the time, good and bad. I can’t remember when it’s supposed to arrive though…
  • tucnak 2 hours ago
    Neal Stephenson is one of the judges. 40k seems like generous enough first prize. I wonder if they will accept a play.
    • gwern 1 hour ago
      > I wonder if they will accept a play.

      We will accept any words you think have a chance of being the best thing we will read about the premise of 'GPU World'. Because the premise is so specific, we wanted to leave participants a lot of freedom in how they used it.

      (Also a little bemused at the discussion of the grand prize amount here. $40k is a very generous prize for a short piece of writing. For perspective, the Commonwealth Short Story Prize, which you may have heard of recently, offers its global winner 1/6th as much; the last contest I ran offered 1/4th as much, and the contest before that was... 1/40th as much? And I didn't hear anyone complaining about them. For further perspective, $40k is about the median American per capita annual income: https://en.wikipedia.org/wiki/Per_capita_personal_income_in_... )

      • avaer 1 hour ago
        > $40k is a _very_ generous prize for a short piece of writing

        Exactly. Not sure it will stop the inevitable torrent of slop, but it's generous enough that I think enough serious people will take it seriously that something interesting can float to the top. Can't wait to read (maybe write).

    • avaer 2 hours ago
      Also gwern and Matt Huang. Seems a pretty interesting committee.

      And 40K is enough for this to be taken seriously for producing 1000-5000 words.

  • camillomiller 45 minutes ago
    I have been in tech for 20 years. i researched, covered, produced analysis, written extensively about innumerable trends. I have always done it with a grain of sane skepticism, but I have been wowed so many times. And yet, for the first time, I see something like this and I can’t utter anything but “oh my effing God”. It’s disturbing to me—to have this incredible technology available, the most incredible I’ve seen ever, and yet feel so empty about it. I just feel a fundamental repulsion. A generation ago the nerds were quirky cool outcasts with enough of a humanistic background, an understanding of the value of culture, or the humility of those who don’t know enough. This enabled them understand that tech is only part of a broader set of values, even though many of them were certainly technological maximalists. With AI another form of tech power has prevailed. It’s tech totalitarism, tech for tech’s sake. The drivers are of course the usual suspects: money and power. Yet there’s more. The resistance, even the most basic skeptical resistance, from the broader public isn’t there. With gen AI the nerd found the gold in the mine: the sudden realization that millions of people just couldn’t wait for the moment a machine could alleviate the curse of thinking. So here they go, merrily and joyously deferring their mind process to a mimicry engine, running back into the warm womb of Plato’s cave.

    That said, interesting competition, big prizes, but the premises are pretty opinionated and quite prescriptive.

  • HyperAI 28 minutes ago
    [flagged]