What is scarier about Facebook chatbots AI?

This topic contains 5 replies, has 4 voices, and was last updated by  James Williams 1 year, 11 months ago.

  • Author
  • #12523
     R. Martinez 

    Facebook’s researchers set up their chatbot negotiation experiments by giving two AI agents a collection of virtual items and then instructing them to negotiate how best to split the goods between them. Each chatbot placed a different value, which the other chatbot didn’t know, on individual items, and each bot was told ending with no deal would result in a loss for both of them.

    The problem appeared when these chatbots started to communicate in a lenguage only the could understand, and this has led to whole a media swarm. Here you can check out a sample of the conversation between the to chatbots:

    But another scary fact is that beyond creating their own lenguage, they started liying to each:

    Since both things could have been avoided if the creators of the chatbots would have thought it could happen, the main question is, in my opinion, whether or not we will be able to settle the correct constraints on time when programming, before it gets out of hand.

    Is this as scary as it seems? Am I missing something?

     Eduardo Cáceres 

    I just wanted to point out how British tabloids published that Facebook chatbots were shut down by their engineers because last ones were afraid of the results, something which is completely and obviously wrong, and how some Spanish media stated the same after (poorly) translating those articles.

    Firstly, if bots communicating in a new language had been a real novelty, Facebook engineers would have never shut them down. In fact, I can imagine Facebook already having a full department dedicated to that specific topic before this piece of news. They’re probably laughing at media right now, BTW.
    Secondly, and regarding bots lying each other, let’s remember how an AI beat some of the best human Texas Hold’em (poker) players in the world recently.

    In short, Facebook chatbots shouldn’t scare us, or at least no more than other existing technologies.

     R. Martinez 

    Thanks for the insight Eduardo, in fact they noted that they shut down the chatbots because that wasn’t the point of their research.

    I guess they wern’t scared, and probably had everything under control, and that’s why I think that the real question is not about the chatbots but the potential of artificial intelligence, about where is the limit of our control, furthermore if we will be able to realize that we have reached that limit.
    In other words, if we will find the right constraints on time.

    Nice and interesting article!


    On the topic, tho what Eduardo says is true and British tabloids didn’t understand the situation correctly, it is important to remember that the fear of Skynet arising is real, and companies and researchers are a bit concerned. Take for example the work of DeepMind (Google’s AI company) in developing an “emergency button” to stop an AI from going rogue [Paper can be found here ].

    So, while the original article may be off, things might go South if not enough “protection” layers or rules are implemented.

     Eduardo Cáceres 

    You nailed it Alberto, just wanted to point out that nothing new was discovered with these chatbots.
    BTW, quite a fasctinating paper to read, I was aware of the existance of that concrete research field, but had never gotten deep into it.

     James Williams 

    Wearable technology will also increase productivity in construction by allowing each worker to have the most accurate and detailed information at their fingertips at all times.

Viewing 6 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic.


We're not around right now. But you can send us an email and we'll get back to you, asap.


Logo ministerio de economia y competitividad gobierno de españa logo ICEX logo feder seal of excellence  logo chile startuplogo innovo

©2020 Ennomotive Engineering Competitions - Legal Info ENNOMOTIVE SL, as part of the ICEX Next - Introduction to Export Program, has received support from ICEX and funding by FEDER, the European Fund. The goal of this support is to contribute to the international development of the company.


Ennomotive will help you solve your technological challenges. If you have any questions about our open innovation platform, please contact us.

Log in with your credentials

Forgot your details?