Cover Image: July 2010 Scientific American Magazine See Inside

Terminate the Terminators

Robots are now a fact of war, but the prospect of androids that can hunt and kill on their own should give us all pause















Share on Tumblr

The organization best placed to work toward a ban is the International Committee of the Red Cross, the guardian of the Geneva Conventions. A good starting point would be to convene a summit to consider armed, autonomous robots in the same framework as chemical and biological agents. The scientific community at large should get involved with this issue much as the Pugwash movement has worked toward nuclear arms control. Now is the time to take steps to ensure that a war of the machines remains nothing more than a science-fiction nightmare.



This article was originally published with the title Terminate the Terminators.



Subscribe     Buy This Issue

Already a Digital subscriber? Sign-in Now
If your institution has site license access, enter here.

17 Comments

Add Comment
View
  1. 1. dskan 09:12 AM 6/29/10

    The US refuses to join the War Crimes Tribunal, and has a questionable track record on the Geneva Conventions, such as chemical warfare. Add to that, that most Americans think negotiations are a sign of weakness.

    So why on Earth would anyone think the US will limit its use of robotic warfare, when 30 schoolchildren caught by a Predator causes less outcry than a single soldier's death? Besides which, as long as our enemies use human shields, the public at large will condone ruthlessness. Just look at the G20 in Canada. The number of Canadians who support illegal arrests of 900 peaceful protesters, just to get at the 50 or 100 (at most) who might, possibly, just by chance, be among those 900, is staggering.

    There is no sense of proportion, and robotics will certainly make it worse. But suggesting that the technology should be put on hold is not only useless, it's self-defeating. The most widely use hawk argument is, "If you don't have a better idea, then this must be the right one". If your idea is to stop developing the technology, don't be surprised that it keeps on being used.

    Reply | Report Abuse | Link to this
  2. 2. dskan 09:15 AM 6/29/10

    The simple fact is that nations only negotiate when they rightfully fear the consequences, such as nuclear armageddon. The US does not fear robotics, because any other country that can develop remote warfare is not a country the US would have warred with anyways. (Barring a third world war).

    Reply | Report Abuse | Link to this
  3. 3. DiscomBob 09:25 AM 6/29/10

    I for one welcome our new robot overlords.

    Reply | Report Abuse | Link to this
  4. 4. MCMalkemus 10:00 AM 6/29/10

    Probably the main danger at this time is for a drone operator to think of killing as a video game. This is probably happening on some level with remote control pilots.

    Reply | Report Abuse | Link to this
  5. 5. Private Nemo 10:26 AM 6/29/10

    Asimov's 3 Laws of Robotics might come to pass after all. But not with THIS congress.

    Reply | Report Abuse | Link to this
  6. 6. Robin Davis 12:00 PM 6/29/10

    Asimov wrote the robot novels long ago and I got to read them for doing well in my catechism classes in the Presbyterian church (my Minister was a forward thinking human). My first true encounter with our capabilities and the constraints placed on military personnel engaged in weapons of mass destruction came in the Nuclear Navy. I am sure these constraints have been honed in the intervening years. We, it would seem, have the proof that radicals of any group are not taught these constraints. I.E. Waco, World Trade Center, Tamil, (Choose the group}: I was asked one day "If it becomes apparent to you that the US has been attacked will you launch your missles?" I had to take pause to consider the implications and how I could verify who had done the deed,after assuring myself they would be the ones bragging I replied in the affirmative. After all the Golden Rule appears in all religions and as I have gone thru life it obvious you reap what you sow. As an historical aside, in the early 60's using the Gulf Stream as a wave guide and the then existing sonar we could tell what ships were entering New York Harbor and who the Capt. and crew were.

    Reply | Report Abuse | Link to this
  7. 7. frankboase 07:28 PM 6/29/10

    "We can never put the genie back into the bottle, but putting a hold on further development of this technology could limit the damage."
    Personally l think it's dangerously naive to think that humans will limit the damage we can cause one another. And yes l would agree with MCMalkemus that some kid/"soldier"(??) will think he's only playing some war game.

    Reply | Report Abuse | Link to this
  8. 8. jtdwyer 07:53 PM 6/29/10

    'We' can limit our technological developments if we like, but 'others' will not. While we have a technological advantage, it is only temporary.

    Perhaps we should develop autonomous control mechanisms to passively infiltrate all potential devices.

    Reply | Report Abuse | Link to this
  9. 9. Chris G 08:12 PM 6/29/10

    Aside from autonomous systems, it's an extension of an already existing trend, is it not? OK, I'm not an expert on this, but...

    Kill someone with a knife and, potential psychological side-stepping aside, you are very aware that you've killed another human being. Launch an arrow or fire a gun into the enemy ranks and it becomes a little less clear. Fire artillery and it's still less clear. As technology advances, the victor is always who can kill at a greater distance. Also, with greater distance comes the ability to tell oneself that the target was not quite as human as yourself.

    Different people will react in different ways, but that's always been the case.

    This really isn't a new topic; anyone remember "The Doomsday Machine" episode of Star Trek?

    Reply | Report Abuse | Link to this
  10. 10. Wayne Williamson 09:26 PM 6/29/10

    the article headline is very miss leading....there is not an ai doing the bombing....they are all controlled by a human...for better or worse....

    Reply | Report Abuse | Link to this
  11. 11. jtdwyer 09:32 PM 6/29/10

    Chris G - I think the classic movie, "Dr. Strangelove. or how I... and learned to love the Bomb" (whatever), in which the Russians had a device that would destroy the world at the first hint of nuclear war.

    Now that's an idea, a device to selectively destroy humanity if we fail to learn how to live economically within the Earth's resource constraints, allowing life on Earth another chance... Would that be terrorism?

    Reply | Report Abuse | Link to this
  12. 12. Dimitris 06:01 PM 6/30/10

    The Cylons were created by Man. They evolved. They rebeled. And they have a plan...

    In the inevitability of future robotic battlefields, can I suggest the inclusion of more Nr 6-like robots in the world's armies? If we are to be hunted by our robotic creations, it would definitely add some finesse and style...

    Reply | Report Abuse | Link to this
  13. 13. WEIWEI 09:38 PM 6/30/10

    ?e??ĺ(ٌ

    Reply | Report Abuse | Link to this
  14. 14. WEIWEI 09:42 PM 6/30/10

    Human progress, technological advancement will make up an advanced human. Make our lives better! Fully supports the robot R & D!

    Reply | Report Abuse | Link to this
  15. 15. andyarok 02:26 PM 7/13/10

    And yet we have people who instead of thinking in terms of peace and harmony, they talk about war and Robotics in the field of war. I would love it if it only destroys humans. I dont see them(humans) become any better. They think of other people like they see human like creatures on video games. And even there, they enjoy killing others. Not even in a war, but killing civilians for fun, running over them and enjoying the pain we inflict over them. After all its a game. But that's the way a person controlling Robot and killing people gonna behave.

    Humans are the most inhumane being in the world.

    Funny little people couldn't stop the oil leak or using Robots to help in similar situations. Yet they talk about using it in war.

    Reply | Report Abuse | Link to this
  16. 16. lawbfree 10:16 AM 7/22/10

    This technology is simply an extension of current psychopathic policies and practice. Just as with the BP scenario, it's just a matter of time before nanotechnology and next-gen autonomous killing machines merge in an "unforeseen circumstance" and wreak havoc, the result of which will be near catastrophic.

    And for what..?

    Reply | Report Abuse | Link to this
  17. 17. Pius 05:50 AM 9/10/10

    I am an avid robot builder and for years I have watched as robots are being badly used. It makes me sad ,so very sad when these creations of our genius are used for destruction.I firmly believe that robots will help mankind survive and thrive. However we have to change direction.

    Take Care

    Reply | Report Abuse | Link to this
Leave this field empty

Add a Comment

You must sign in or register as a ScientificAmerican.com member to submit a comment.
Click one of the buttons below to register using an existing Social Account.

More from Scientific American

See what we're tweeting about

Scientific American Editors

More »

Free Newsletters


Get the best from Scientific American in your inbox

Solve Innovation Challenges

Powered By: Innocentive

  SA Digital
  SA Digital

Email this Article

Terminate the Terminators: Scientific American Magazine

X
Scientific American Magazine

Subscribe Today

Save 66% off the cover price and get a free gift!

Learn More >>

X

Please Log In

Forgot: Password

X

Account Linking

Welcome, . Do you have an existing ScientificAmerican.com account?

Yes, please link my existing account with for quick, secure access.



Forgot Password?

No, I would like to create a new account with my profile information.

Create Account
X

Report Abuse

Are you sure?

X

Institutional Access

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on nature.com. To access this article in its entirety through site license access, click below.

Site license access
X

Error

X

Share this Article

X