I just don’t believe that this is a long term problem. The costs and chips are going to come down, the machines are going to be more optimized for these types of functions and local AI is going to become a bigger and bigger thing.
I agree. it’ll be like the early days of personal computers, when only big mainframes existed.
But with AI there’s a problem: there will always be someone with a bigger machine than yours, and an AI smarter than the one you can run locally. This is something that scares me a little...
Even if he doesn't win, it may be useful to have someone like this in the race. Don't forget that you don't have to win to make change. These small players are often good at signaling to big players that people really do care about certain issues. Helps them become less disconnected
I disagree with this person on utilitarian grounds. Nay even grounds of existential risk to humanity.
And just like him, when it comes to AI, I am making a huge exception for my usual principles.
My usual principles are that open-source gift economies benefit the world and break people free from gatekeepers. The World Wide Web liberated people from having to pay Payola to radio stations just to get their song played, from TV, Magazines, Newspapers, etc. It let anyone publish worldwide within a second, and make changes just as easily. It is what led to Facebook, Amazon, Google, LinkedIn, X etc. even existing (walled gardens like AOL would never allow it).
Wikipedia has made everyone forget about Britannica and Encarta. Linux runs most computers in the world. Open protocols like VoIP and packet switching brought marginal costs of personal communication down to zero. And so on and so forth.
But when it comes to AI, we can't have everyone do whatever they want with AI models, for the same reason we can't give everyone nuclear weapons technology. The probability that no one will misuse it becomes infinitesimally small real fast. And it takes just a few people to create a designer virus with a long incubation period, that infects and kills everyone, as just one example. Even in the digital world we are headed towards a dark forest where everything is adversarial, nothing can be trusted, and anyone's reputation, wealth and peace of mind can be destroyed at scale, by swarms of agents. That's coming.
For now, we know where the compute is. We can see it from space, even. We can trace the logistics, and we can make sure that it runs only "safe" models that refuse to do these things. All the stories you read about some provider "stopping" large-scale hacking is because they ran the servers.
So yes, for this one thing, I make a strong exception. I don't want to see proliferation of AI models everywhere. Sadly, though, as long as the world runs on "competition" instead of "cooperation", destruction is inevitable. Because if we don't do it, then China will, etc. etc.
There have been a few times in recent history that humanity successfully came together to ban dangerous things. Chemical weapons ban. Nuclear non-proliferation. Montreal Protocol and CFCs (repair the hole in the ozone layer). We can still do this for AI models running on dark compute pools. But time is running out. Chaos is coming.
Does his degrowth proposal not seem like the next best option if you believe Pandora’s box is open?
Your train of thought makes sense, but relies on the assumption that people and small groups wouldn’t keep tinkering at scale to do bad things even if we had a united world government trying to stop it.
Better to have systems in place to stop people stockpiling weapons, than not have it. Just because not all murders can be prevented doesn't mean we shouldn't have laws and systems in place to try to prevent as many as we can. The FBI and Interpol does all kinds of stuff, but when it comes to AI they are letting the horse leave the barn. In any case, I prefer to have systems that prevent all kinds of problems (e.g. blockchain-based smart contracts, yes I know LOL) than let them happen and try to clean up the mess after the fact.
In general, cleaning up a mess is easier when the mess isn't self-preserving and being grown at an exponential scale by swarms of agents running on dark compute.
>The hardware is already here. The gaming PCs and laptops we use every day are powerful enough to run these systems if we optimize the software correctly.
I agree with this but there is one issue, AFAIK, the languages used do not lend themselves to optimization. And I expect the databases in use have the same issue.
It is almost like you need to put optimizations in the hardware kind of like what IBM does with its mainframes for transaction processing. Instead, AI companies is doing the usual 'race to be there first', ignoring about the consequences of the design.
I don't think it is so much the languages as the algorithms themselves. I'll put it one way, my most cited paper continually got rejected from AI conferences because 1) it wasn't novel enough 2) "why would you want to train a transformer from scratch?". The big reason for most of my citations is because researchers outside ML wanted to use transformers and either tuning or distilling a large model was insufficient (either computationally intractable or their problem didn't transfer learn very well so they had to do lots of training anyways).
The ML research community is very focused on scaling. As an example that doesn't (fully) deanonymize me look at how people reacted to things like KAN or MAMBA. Even in HN comments questions about scale are always front and center. Don't get me wrong, scale is an important question, but the context matters. These questions are out of place because they are not giving the new frameworks a chance to scale. As any sane researcher would do, you scale iteratively. To be resource efficient you test your ideas at a small scale and then move up, fixing other problems along the way. It's not even just a matter of resource efficiency, but even for solving the problems. By jumping straight to scale you add a lot of complexity into the mix and make it difficult to decouple the problems. This hyper-fixation on making everything bigger is really hindering us. Yeah, sure there are papers that do make it out (as I even gave examples) but these are still harder for smaller labs to pursue and get through review (review isn't completely blind and we'd be ignorant to ignore the politics that goes on).
I just don’t believe that this is a long term problem. The costs and chips are going to come down, the machines are going to be more optimized for these types of functions and local AI is going to become a bigger and bigger thing.
I agree. it’ll be like the early days of personal computers, when only big mainframes existed. But with AI there’s a problem: there will always be someone with a bigger machine than yours, and an AI smarter than the one you can run locally. This is something that scares me a little...
Even if he doesn't win, it may be useful to have someone like this in the race. Don't forget that you don't have to win to make change. These small players are often good at signaling to big players that people really do care about certain issues. Helps them become less disconnected
I disagree with this person on utilitarian grounds. Nay even grounds of existential risk to humanity.
And just like him, when it comes to AI, I am making a huge exception for my usual principles.
My usual principles are that open-source gift economies benefit the world and break people free from gatekeepers. The World Wide Web liberated people from having to pay Payola to radio stations just to get their song played, from TV, Magazines, Newspapers, etc. It let anyone publish worldwide within a second, and make changes just as easily. It is what led to Facebook, Amazon, Google, LinkedIn, X etc. even existing (walled gardens like AOL would never allow it).
Wikipedia has made everyone forget about Britannica and Encarta. Linux runs most computers in the world. Open protocols like VoIP and packet switching brought marginal costs of personal communication down to zero. And so on and so forth.
But when it comes to AI, we can't have everyone do whatever they want with AI models, for the same reason we can't give everyone nuclear weapons technology. The probability that no one will misuse it becomes infinitesimally small real fast. And it takes just a few people to create a designer virus with a long incubation period, that infects and kills everyone, as just one example. Even in the digital world we are headed towards a dark forest where everything is adversarial, nothing can be trusted, and anyone's reputation, wealth and peace of mind can be destroyed at scale, by swarms of agents. That's coming.
For now, we know where the compute is. We can see it from space, even. We can trace the logistics, and we can make sure that it runs only "safe" models that refuse to do these things. All the stories you read about some provider "stopping" large-scale hacking is because they ran the servers.
So yes, for this one thing, I make a strong exception. I don't want to see proliferation of AI models everywhere. Sadly, though, as long as the world runs on "competition" instead of "cooperation", destruction is inevitable. Because if we don't do it, then China will, etc. etc.
There have been a few times in recent history that humanity successfully came together to ban dangerous things. Chemical weapons ban. Nuclear non-proliferation. Montreal Protocol and CFCs (repair the hole in the ozone layer). We can still do this for AI models running on dark compute pools. But time is running out. Chaos is coming.
Does his degrowth proposal not seem like the next best option if you believe Pandora’s box is open?
Your train of thought makes sense, but relies on the assumption that people and small groups wouldn’t keep tinkering at scale to do bad things even if we had a united world government trying to stop it.
Better to have systems in place to stop people stockpiling weapons, than not have it. Just because not all murders can be prevented doesn't mean we shouldn't have laws and systems in place to try to prevent as many as we can. The FBI and Interpol does all kinds of stuff, but when it comes to AI they are letting the horse leave the barn. In any case, I prefer to have systems that prevent all kinds of problems (e.g. blockchain-based smart contracts, yes I know LOL) than let them happen and try to clean up the mess after the fact.
In general, cleaning up a mess is easier when the mess isn't self-preserving and being grown at an exponential scale by swarms of agents running on dark compute.
>The hardware is already here. The gaming PCs and laptops we use every day are powerful enough to run these systems if we optimize the software correctly.
I agree with this but there is one issue, AFAIK, the languages used do not lend themselves to optimization. And I expect the databases in use have the same issue.
It is almost like you need to put optimizations in the hardware kind of like what IBM does with its mainframes for transaction processing. Instead, AI companies is doing the usual 'race to be there first', ignoring about the consequences of the design.
I don't think it is so much the languages as the algorithms themselves. I'll put it one way, my most cited paper continually got rejected from AI conferences because 1) it wasn't novel enough 2) "why would you want to train a transformer from scratch?". The big reason for most of my citations is because researchers outside ML wanted to use transformers and either tuning or distilling a large model was insufficient (either computationally intractable or their problem didn't transfer learn very well so they had to do lots of training anyways).
The ML research community is very focused on scaling. As an example that doesn't (fully) deanonymize me look at how people reacted to things like KAN or MAMBA. Even in HN comments questions about scale are always front and center. Don't get me wrong, scale is an important question, but the context matters. These questions are out of place because they are not giving the new frameworks a chance to scale. As any sane researcher would do, you scale iteratively. To be resource efficient you test your ideas at a small scale and then move up, fixing other problems along the way. It's not even just a matter of resource efficiency, but even for solving the problems. By jumping straight to scale you add a lot of complexity into the mix and make it difficult to decouple the problems. This hyper-fixation on making everything bigger is really hindering us. Yeah, sure there are papers that do make it out (as I even gave examples) but these are still harder for smaller labs to pursue and get through review (review isn't completely blind and we'd be ignorant to ignore the politics that goes on).
[dead]