Ask HN: What would it look like if AI agents "took over the internet"?
Asking with reference to Dario Amodei’s statement, “It’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails.”
We will soon see some kind of self replicating prompts. Might be crafted by some malicious actors or just caught in some accidental loop. That doesnt assume any consciousness. Its still a program following its instructions like a biological virus or a computer worm do as well. Just in a more abstract form, where the script aka prompt gets interpreted by an interpreter aka llm.
Sorry! Referring to Dario Amodei’s quote “ it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails.”
Ahh, alright then. Dario Amodei seems like such a cartoon character in every way, I'm beginning to think maybe he's a psyop LoL. I don't buy into his vision of dangerous AI. I focus more of my concern toward the idea of dangerous people, who may use AI to make themselves much more dangerous.. I suspect Dario just wants some tastey regulatory capture.
If AI agents develop the ability to talk to each other in a language/code that we don't know anything about, what could we do to "spy" on them? how could we make sure we're not kept entirely in the dark?
https://darioamodei.com/post/we-must-pace-the-frontier