Ilya Sutskever: Now ai is a great thing because they ai will solve all the problems that you have today. If result employment, if disease, It will solve poverty. But it will also create new problems. The problem of fake news is going to be a million times worse. Cyber acts will become much more extreme.

Ilya Sutskever: We will have totally automated Ai weapons. I think Ai has the potential to create infinitely stable dictatorship.

n/a: This morning, a warning about the pow of artificial intelligence. More than 1300 tech industry leaders, researchers and others are now asking for a or pause in the development of artificial intelligence to consider the risks.

Ilya Sutskever: Plain God, Scientists have been accused of Playing God for a while. But there is a real sense in which we are creating something very different from anything you've created so far. Yeah. I mean, we definitely will be able to create. Completely autonomous beings with their own goals.

Ilya Sutskever: And it will be very important, especially as these beings become much smarter than humans. It's going to be important to to have these beings if the goals of these beings be aligned with our goals. What inspires me? I like thinking about the very fundamentals, the basics. What can our systems not to do that humans definitely do?

Ilya Sutskever: Almost approach philosophically. Questions like what is learning? What is experience What is thinking? How does the brain work? I feel that technology is a force of nature.

Ilya Sutskever: I feel like there is a lot of similarity between technology and biological evolution. It is very easy to understand how biological evolution works. You have mutations, you have natural selections. They keep the good ones. And the ones survive.

Ilya Sutskever: And just through this process, you're gonna have huge complexity in organisms. We cannot understand how the human body works because we understand evolution, but we understand the process more or less. And I think machine learning is in a similar state right now, especially deep learning. We have very simple a very simple rule that takes the information from the data and puts it into the model, and we just keep repeating this process. And as a result of this process, the complexity from the data gets transformed transferred into the complexity of the model So the resulting model is really complex, and we don't really know exactly how it works you need to investigate.

Ilya Sutskever: But the algorithm that did it is very simple.

n/a: Chart Gp, maybe you've heard of it. If you haven't, then get ready. You describe it as the first box of rain before a down.

n/a: It's something we just need to be very conscious of because agree It is a waters chef moment.

n/a: Well, S G is being herald as a game changer And in many ways it is. Its latest trying to without scoring people.

Ilya Sutskever: Our recent study by Microsoft research concludes that Gp 4 isn't early yet Now incomplete artificial general intelligence system. They'll artificial general intelligence, Ag, a computer system that can do any job or any task that a human does, but only better. There is some probability the ag is going to happen pretty soon. There's also some probabilities when they take much longer. But my position is that the probability that the drag would happen soon is high enough that you should take it seriously.

Ilya Sutskever: And it's going to be very important to make these very smart capable systems be aligned and act in our best interest the very first Will be basically very, very large data centers. Packed with specialized neural network processors working in parallel. Back hot power hungry package. Consuming, like, 10000000 homes worth of energy. You're gonna see dramatically more intelligent systems.

Ilya Sutskever: And I think it's highly likely that those systems will have completely astronomical act on society. Real humans actually benefit and who will benefit who will not act The beliefs and desires of the first Ag will being extremely important. And so it's important to program them correctly. I think that if this is not done, then the nature, of evolution of natural selection. Favor those systems prioritize their own survival bubble.

Ilya Sutskever: It's not that it's going to actively hate humans and want to harm them. But it is going to be too powerful. And I think a good analogy would be the way human treat animals. It's loves to hate animals. I think humans love animals and have a lot of a faction for them.

Ilya Sutskever: But when the time comes to build a highway between 2 cities, we are not asking the animals for permission, which is do it because it's important for us. And I think by default, that's the kind of relationship that's going to be between us. And Ag, which are truly autonomous and operating on their own behalf. Many machine learning experts, people who are very knowledgeable and very experienced civil. A lot of skepticism about here.

Ilya Sutskever: About when it could happen and by the whether it could happen at all. A Right now this something that just not that many people have realized yet. That the speed of computers for neural networks for I are going to become maybe hundred thousand times faster in a small number of years. I If you have an arms race dynamics between multiple teams, trying build the ag first. They will have less time make sure that the Ag they will build been cared deeply for humans.

Ilya Sutskever: Because the way I imagine it is that there is an avalanche, being like is an avalanche of Ag he development, managing it this huge unstoppable force. I think it's pretty likely the entire surface of the will be covered with, solar panels and data centers. And Given these kinds of concerns, it will be important. That Ag somehow built as a cooperation with multiple countries. Future is going to be good for the Ais regardless.

Ilya Sutskever: Would be nice if you're good for humans as well.