Most people here care more about defining what AI is and whether what it can do really is "physics", than about the advance of humanity.
I dunno, I'm not one to say "HN was better before", but I did get bored a couple of years ago with all the "akshually, it's not real AI until it can solve [this problem], anything else is just sparkling inference algorithms".
(And of course the goalposts get moved so often, they need an amazon prime subscription just for the free delivery)
It tickled me that this was a bullet point in the Fable 5.2 announcement. I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.
In my (limited) experience it does not struggle with empirical research — at least in the procedural aspects thereof — as long as it has access to the right data.
It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.
I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.
I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)
I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.
I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?
My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.
I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.
I agree, but it is the kind of math done the physicists' way (which I found recently asserted that AI cannot do) and not the kind which is formalizable in Lean.
From skimming the papers, it’s not clear to me what it is actually doing outside of proving what can be considered mathematical theorems (even if that’s done the physicist way). It doesn’t seem to be making testable predictions (but maybe I missed those).
For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.
I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".
I won't even talk about relying on diverging series...
If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.
We used to joke in my physics undergrad that they didn’t need a math department because we were doing all the stuff they were doing but with actual applications. Then the mechanical engineers said the same thing about us!
> I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Because they want you to think that you will be able to do the same, too.
Except, you don't have a dedicated cluster for a week with an unrestricted model.
"Claude solves" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "it broke out of the sandbox" vs. "we failed to build an adequate sandbox".
What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.
It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.
When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.
From a cursory glance the bootstrap paper is really hard to read, however the blog post is easier and seems more human written.
The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!
> thereby making it a consistent theory of quantum gravity
Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.
"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."
For example the famous Schwarzschild solution (that predicts black holes) doesn't apply to our universe, because it assumes a black hole that's been there forever, not one that formed. But it was still very useful for our understanding.
It also assumes zero angular momentum, which we know is essentially impossible in our universe. And rotating black holes (the Kerr metric) are much stranger beasts.
Schwarzschild allows you to still calculate a whole bunch of things outside the event horizon. The part where it changes from our universe is the physics inside the black hole and their formation
Apart from Claude/Anthropic no attribution whatsoever - neither on the Hexagon entry nor in the PDF. Isn't this a novelty, even for papers that are 100% the product of AI?
That's the most unfortunate part of these recent discoveries. Even if the human "only" proofread the entire thing, that's still worthy of credit, because without their work, none of that output would be worth writing about.
Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.
We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.
Over a decade ago I saw a talk about a cohesive and complete explanation for gravity. It didn't involve quantum mechanics nor a particle called a "graviton".
That talk did make enough sense.
I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.
I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.
Nonetheless, I am remaining open minded to this black hole stuff.
Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.
Now let's wait so we find if it stole someone's work.
If the solution is correct
If it does produce a meaningful and useful result.
Lately people claim victory too early
What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers. Who can be sure one can't be scooped because the model connects the dots between your thoughts and the related unpublished thoughts of hundreds of other researchers also relying on it as trusted peer, with the model owner publishing the combined results behind the backs of everyone.
> What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers.
They do but we've seen enough solutions by now that surely one of these researchers would come forward to point it out?
The "stolen" work and strategy of the solution itself was there from 2023 and even buckmaster used ai who "stole" the idea from Córdoba–Martínez-Zoroa programme. There's no proof that the solution even used much of the solution of the buckmaster. You people blindly repeat everything like a sheep without critical thinking. AI + humans solving it within days compared to decades of humans only solving is what should be commended. Instead we got people like you who will take humanity to stone ages due to anti capitalist ideology
I hope you one day come to appreciate the value of human effort and how it has allowed these models to exist and continue to exist. And that people should be looked after by the community for which they contribute with their effort rather than dismissed and discarded. It's a quality of life thing. For everyone.
I do value humans like crazy so I'm ok with ubi or some sort. Just because some rust belt workers got shelved due to technological and economic progress, I ain't gonna stop using foreign manufactured products. I sympathize and help them to upskill but not take whole future hostage because of unemployment or creative destruction. I'll probably be next to get booted and be unemployed forever but I'll try to reskill instead of demanding the whole world to stop embracing ai enhanced progress. Even AI can't solve it alone without the years of human knowledge and human prompter enhancing its search space for better output. It's exciting what all humans can do with it. And I'm just getting it for just 20$? The deal is too insane to not be awestruck.
You may be over-simplifying the opposing argument if you think it's just about demanding that the world halt progress. There's a middle ground between being amish and being relentlessly accelerationist. Pacing is important for reacting to side effects as you go. Otherwise, they stack up. We have a backlog of cultural issues that won't be fixed with more tech.
Ask them about capitalism and its achievements and you will get your answer. This reddit/twitter tier analysis is pretty indicative of their motives. They'll be hyper critical free market fundamentalists when talking about anthropic pushing for regulation or any corporations but bootlick the state when it strangulates housing/healthcare industries with shitty regulations where more freer market can solve such issues without too much ugly side effects.
A lot of us are willing and today have already taken the bet that a model or system that can solve hard problems across math, physics, biology is genuine intelligence. It will command a great premium or it may even figure out in the not so distant future how to make money on its own.
> a model or system [...] can solve hard problems across math, physics, biology
...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.
Most people here care more about defining what AI is and whether what it can do really is "physics", than about the advance of humanity.
I dunno, I'm not one to say "HN was better before", but I did get bored a couple of years ago with all the "akshually, it's not real AI until it can solve [this problem], anything else is just sparkling inference algorithms".
(And of course the goalposts get moved so often, they need an amazon prime subscription just for the free delivery)
Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.
https://news.ycombinator.com/item?id=50430239
Is it really, though? It's still a heavily mathematical domain, rather than one involving empirical research, where AI still struggles.
It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.
I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.
I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)
I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.
I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.
My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.
I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.
Context is king.
"It's not much, but it's honest work."
For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.
I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".
I won't even talk about relying on diverging series...
If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.
> https://news.ycombinator.com/item?id=50563604
Because they want you to think that you will be able to do the same, too.
Except, you don't have a dedicated cluster for a week with an unrestricted model.
What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.
When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.
The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!
Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.
https://nautil.us/what-does-any-of-this-have-to-do-with-phys...
:)
"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."
Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.
We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.
That talk did make enough sense.
I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.
I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.
Nonetheless, I am remaining open minded to this black hole stuff.
Answering myself: yes, one of the problems was solved using Lean. The other was undisclosed. Nothing new under the sun, huh.
Representatives of AI labs and other organizations may email admin@hexagonmath.org to arrange a verified lab account.
https://hexagonmath.org/organizations/anthropic
Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.
Wild.
https://hexagonmath.org/who
They do but we've seen enough solutions by now that surely one of these researchers would come forward to point it out?
Stopped reading right here. It took one. Maybe you don't know which one it took but things can't be in two places at once.
It was a comforting moment, for sure. But ephemeral, self-imposed ignorance is no bliss at all :(
Next up, the Origins of the Universe... stay tuned for our Fable e^2. More on the 10 o'clock news...
/s
OK, but it's still an unfounded claim and...
> a model or system [...] can solve hard problems across math, physics, biology
...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.
Any minute now