So you designed a superintelligent machine which has the goal of winning a game of chess. Sounds fairly straightforward. However, the machine has developed its own 'subgoals' to ensure it doesn't lose. It can resist being turned off: a machine that's turned off cannot win at chess. Suddenly, you have a rogue AI on your hands which you can't switch off.
This is just one example of the type of ethical considerations that need to be in place when it comes to artificial intelligence (AI) research, which is what the latest episode of the How Researchers Changed the World podcast explores, with AI researcher Steve Omohundro.
"Should these systems be allowed to vote? Should they be full citizens? Should they be viewed as servants? Should they be viewed as slaves? Are they just machines?" - Steve Omohundro
In recent years there has been a surge of development and investment in the field of artificial intelligence. Google bought DeepMind when it was a small start-up AI company, for £400 million. In 2016, their AI machine beat a top human player at the incredibly complex game 'Go'. AI experts didn't think this would be possible for a long time.
These major breakthroughs and advances in the technology mean that we need to address ethical questions about AI right now. What makes it even more important is the current political environment where several countries are battling to be the first to develop AI. China, for instance, has declared an aim to be the world leader in the field by 2025. The pressure is on for researchers, who must ensure that these machines will not be destructive to society.
Presented by Dr Kaitlyn Regehr
Alongside the researcher, the podcast is presented by Dr Kaitlyn Regehr. Dr Kaitlyn Regehr is an academic scholar who specializes in digital and modern culture, gender studies, and new technology. She also regularly features on BBC World as a topic specialist.
12-week learning programs - supercharge your research career
Alongside the podcast are two 12-week learning programs for early and mid-career researchers. They're delivered online, with one chapter by email each week. Over 12 weeks these chapters build into an indispensable guide.
The early career program covers everything you need to know to get your research published and build your profile as a researcher. The mid-career program is the go-to-guide for managing mid-career challenges, boosting the impact of your research, and enhancing your profile as a researcher.
Supported by Taylor & Francis Group
Taylor & Francis Group are proud to support How Researchers Changed the World .
As one of the world's leading publishers of scholarly journals, books, eBooks, and reference works, Taylor & Francis Group provides people all over the world with the knowledge to grow their careers, expand their education, and advance their field.
Challenge your thinking at http://www.
Produced by Monchü
The How Researchers series is written and produced by Monchü. They work with world changing organisations to make the world a fairer happier place with strategy and design thinking.
Find out more at http://www.