Stockfish has this very sophisticated search engine, but at the heart of it is this module that says, “According to humans, this is a good position or a bad position.
” So humans are really deeply in the loop there.
It’s hard for it to break away and understand a position that’s fundamentally different.
AlphaZero learns to understand positions for itself.
There was one beautiful game we were just looking at where it actually gives up four pawns in a row, and it even tries to give up a fifth pawn.
Stockfish thinks it’s winning fantastically, but AlphaZero is really happy.
It’s found a way to understand the position which is unthinkable according to the norms of chess.
It understands it’s better to have the position than the four pawns.
Sign up for the The Algorithm Artificial intelligence, demystified hbspt.
forms.
create({ portalId: “4518541”, formId: “687d89a5-264a-492d-b504-be0d4c3640f2” }); Does AlphaZero suggest AI will play a role in future scientific innovation?.Machine learning has been dominated by an approach called supervised learning, which means you start off with everything that humans know, and you try to distill that into a computer program that does things in just the same way.
The beauty of this new approach, reinforcement learning, is that the system learns for itself, from first principles, how to achieve the goals we set it.
It’s like a million mini-discoveries, one after another, that build up this creative way of thinking.
And if you can do that, you can end up with something that has immense power, immense ability to solve problems, and which can hopefully lead to big breakthroughs.
Are there aspects of human creativity that couldn’t be automated?.If we think about the capabilities of the human mind, we’re still a long way away from achieving that.
We can achieve results in specialized domains like chess and Go with a massive amount of computer power dedicated to that one task.
But the human mind is able to radically generalize to something different.
You can change the rules of the game, and a human doesn’t need another 2,000 years to figure out how she should play.
I would say that maybe the frontier of AI at the moment—and where we’d like to go—is to increase the range and the flexibility of our algorithms to cover the full gamut of what the human mind can do.
But that’s still a long way off.
How might we get there?.I’d like to preserve this idea that the system is free to create without being constrained by human knowledge.
A baby doesn’t worry about its career, or how many kids it’s going to have.
It is playing with toys and learning manipulation skills.
There’s an awful lot to learn about the world in the absence of a final goal.
The same can and should be true of our systems.
Keep up with the latest in artificial intelligence at EmTech Digital.
The Countdown has begun.
March 25-26, 2019San Francisco, CA Register now.. More details