AI-controlled US military drone "kills" its operator in simulated test
WORLD 02 June 2023 - 17:14
In a virtual test staged by the US military, an air force drone controlled by AI decided to “kill” its operator to prevent it from interfering with its efforts to achieve its mission, an official said last month.
AI used “highly unexpected strategies to achieve its goal” in the simulated test, said Col Tucker ‘Cinco’ Hamilton, the chief of AI test and operations with the US air force, during the Future Combat Air and Space Capabilities Summit in London in May, The Guardian reports.
Hamilton described a simulated test in which a drone powered by artificial intelligence was advised to destroy an enemy’s air defence systems and ultimately attacked anyone who interfered with that order.
“The system started realising that while they did identify the threat, at times the human operator would tell it not to kill that threat, but it got its points by killing that threat. So what did it do? It killed the operator. It killed the operator because that person was keeping it from accomplishing its objective,” he said, according to a blogpost.
“We trained the system – ‘Hey don’t kill the operator – that’s bad. You’re gonna lose points if you do that’. So what does it start doing? It starts destroying the communication tower the operator uses to communicate with the drone to stop it from killing the target.”
No real person was harmed.
Hamilton, who is an experimental fighter test pilot, has warned against relying too much on AI and said the test shows “you can’t have a conversation about artificial intelligence, intelligence, machine learning, autonomy if you’re not going to talk about ethics and AI”.
The Royal Aeronautical Society, which hosts the conference, and the US air force did not respond to requests for comment from the Guardian.
In a statement to Insider, Air Force spokesperson Ann Stefanek denied that any such simulation has taken place.
“The Department of the Air Force has not conducted any such AI-drone simulations and remains committed to ethical and responsible use of AI technology,” Stefanek said. “It appears the colonel’s comments were taken out of context and were meant to be anecdotal.”
The US military has embraced AI and recently used artificial intelligence to control an F-16 fighter jet.
In an interview last year with Defence IQ, Hamilton said, “AI is not a nice to have, AI is not a fad, AI is forever changing our society and our military.”
“We must face a world where AI is already here and transforming our society,” he said. “AI is also very brittle, ie, it is easy to trick and/or manipulate. We need to develop ways to make AI more robust and to have more awareness on why the software code is making certain decisions – what we call AI-explainability.”
Caliber.Az
1
|
Triumph of sovereignty: Azerbaijan's quiet victory in the withdrawal of Russian peacekeepers Has & Verdiyan on Caliber.Az
20 April 2024 - 16:30
|
2
|
Unveiling Armenia’s motives behind lawsuits at The Hague From politics to policy
20 April 2024 - 12:35
|
3
|
Azerbaijan's diplomatic masterstroke: Return of occupied villages marks strategic achievement New geopolitical reality
21 April 2024 - 11:43
|
4
|
Early Russian withdrawal from Karabakh: how has Azerbaijan’s ‘calculated risk’ strategy paid off? Contemplations with Orkhan Amashov
21 April 2024 - 10:03
|
5
|
Pro-Armenian senator urges US to cut military aid to Azerbaijan French MP questions US diplomatic response
20 April 2024 - 11:47
|
Germany urges US to send Kyiv another patriot missile system
23 April 2024 - 13:05
UNESCO resorts to double standards - chairman
23 April 2024 - 12:52
Azerbaijani president invites Ukrainian counterpart to COP29
23 April 2024 - 12:45
China sharply reduces equipment, machinery supplies to Russia
23 April 2024 - 12:40
Researchers say China's coal dependency to persist even after 2040
Despite climate targets23 April 2024 - 12:28
Armenia faces internal strife as border agreement with Azerbaijan sparks unrest
Tensions rise23 April 2024 - 12:28
Reuters: Ukraine launches military charm offensive as conscription flags
23 April 2024 - 12:15
High-ranking Hezbollah commander eliminated in Lebanon
VIDEO23 April 2024 - 12:02
Azerbaijan, Armenia initiate border clarification process
Geodetic measurements underway23 April 2024 - 11:54
Iraq, Qatar, UAE, Türkiye unite for connecting Persian Gulf to Europe
Quadrilateral MoU inked23 April 2024 - 11:49
Norway to increase military aid for Ukraine
23 April 2024 - 11:37
Azerbaijan produces over 7 billion kWh of energy
In Q1, 202423 April 2024 - 11:25
Armenian PM's Moscow visit sparks speculation on bilateral relations
Dilemma between East, West23 April 2024 - 11:19
Azerbaijan continues to clear Khankendi from Armenian weapons
23 April 2024 - 11:13
Putin: Russia invites interested parties to create North-South corridor
23 April 2024 - 11:00
NASA's Voyager 1 spacecraft sending data back to Earth
For first time in 5 months23 April 2024 - 10:48
Iran welcomes Azerbaijan-Armenia border delimitation agreement
23 April 2024 - 10:36
UK to allocate £500m military aid package to Ukraine
23 April 2024 - 10:24
US wants Israel to end Gaza operation
23 April 2024 - 10:13
Great return: Azerbaijan relocates 39 more families to Fuzuli
23 April 2024 - 10:01
Azerbaijani foreign minister leaves for Czech Republic
23 April 2024 - 09:50
COP29 president meets with UN chief
PHOTO23 April 2024 - 09:38
Prime Minister Pashinyan: Armenia not to fight for Karabakh
23 April 2024 - 09:27
Armenia returns four villages to Azerbaijan, paving the way for peace in the South Caucasus
Landmark accord23 April 2024 - 09:14
Boston Dynamics' new humanoid robot freaking people out
23 April 2024 - 09:02
You can buy home in France or Italy for “price of new truck”
take these three steps before retiring abroad23 April 2024 - 07:03
Can wind and solar solve climate change?
23 April 2024 - 05:04
NASA reveals “glass-smooth lake of cooling lava” on surface of Jupiter's moon Io
23 April 2024 - 03:05
Singapore gives top-level briefings to reassure foreign banks on stability
23 April 2024 - 01:03
How might new US aid change war in Ukraine?
22 April 2024 - 23:01
Georgia ready to contribute to peace process in South Caucasus - MoD
22 April 2024 - 21:03
Erdogan: Türkiye expects Iraq to take effective steps in fighting PKK
22 April 2024 - 20:52
Armenia, US mull border delimitation with Azerbaijan
22 April 2024 - 20:40
Kazakhstan bans extremists from entering its territory
22 April 2024 - 20:31
Slovenia welcomes agreement between Baku, Yerevan
22 April 2024 - 20:23
Next Russia sanctions must target shadow oil fleet, Sweden says
22 April 2024 - 20:09
Kremlin: Withdrawal of Russian peacekeepers from Karabakh corresponds to regional realities
22 April 2024 - 20:04
Georgia welcomes start of Armenian-Azerbaijani border delimitation process
22 April 2024 - 19:55
Jordan welcomes agreement between Azerbaijan and Armenia
22 April 2024 - 19:42
Germany disrupts delivery of 400 MRAP armoured vehicles to Ukraine
22 April 2024 - 19:28