This section is meant to give you an idea of what happens “behind the scenes” when you train an AI.  Essentially, the AI needs feedback on it’s performance and this is going to be provided by me (in this case).  In many real-life cases of this, programmers have figured out clever ways of having you provide feedback without giving it a second thought.

  • You can accept or correct a tag on facebook
  • You can choose to use the provided suggestion on your predictive text keyboard, or you can correct it

Wilbur was produced using the tools provided by API.ai.  These tools, like those of a few competing products, have made it relatively easy to design and maintain a chatbot or Virtual assistant and to train its AI. For example, when I log into my API.ai account, I am provided with a dashboard which allows me to do work on improving or updating my bot and its abilities, or to assist in it’s training.  In this case, I will focus on the training.

Training dashboard for Wilbur showing some of the training sessions completed by a few members of our group. Each line represents of particular interaction with a user and may contain several questions – the one that’s listed is just the first one.

 

Selecting one of these sessions brings up a screen where I can go through the results of those conversations and give Wilbur some feedback on whether he’s identifying the user’s main intention correctly.

Details of a conversation with a user, showing which “intent” Wilbur had identified. The arrows are pointing to the intents identified by the AI to help Wilbur decide how to respond.

As you can see, Wilbur has identified the intent correctly in a few cases (“NavigateSite”) and I confirmed that those were correct (green checkmarks).  In one case, API.ai’s own presets took over (red arrow), and in a few cases, Wilbur struggled.

To be fair, I hadn’t prepared him to answer questions about his personal life.  But, based on these questions, I created a new intent to help Wilbur better deal with questions about his origins.  I then assigned those questions to this new intent.

In this case, I’m able to “tell” Wilbur to treat this question (and similar others) as asking about his “Creator”.
Potential responses provided by Wilbur when the “Creator” intent is detected. (No, the chatbots do not come up with their responses “on-the-fly” – they simply choose one from the list).

 

Now, if Wilbur recognizes that a question is dealing with his origins, he has a few answers that he can choose from.


I plan to give updates on Wilbur’s progress throughout this week, so keep checking this space.

 

3 thoughts on “A Peek “Behind the Curtain”

  • March 22, 2017 at 2:30 am
    Permalink

    Thanks for the simple introduction to AI development.

    Reply
  • March 26, 2017 at 5:15 am
    Permalink

    A really interesting and ambitious project! Well done!

    Reply
    • March 26, 2017 at 6:12 am
      Permalink

      Thanks! 🙂

      Reply

Leave a Reply to Stefan Cancel reply

Your email address will not be published. Required fields are marked *

one + 19 =

This site uses Akismet to reduce spam. Learn how your comment data is processed.