Skip to main content
  1. Botium Support
  2. Test Data Wizard
  3. Humanification

Humanification of Test Sets

Humanification in Botium stands for simulation of human behaviour or habits. Read on to know more.

Why Humanification ?

BotiumScript is a scripted, pre-defined or pre-recorded conversation, which makes it is easy to verify the chatbot’s ability to follow a conversation flow. It is an important step to recognize the need for automation in this area. But in real world, you cannot expect human users to act like a computer script:
Note: For more information about the script, see BotiumScript.

  • typographic errors are introduced

  • different typing speeds

  • sausage finger syndrome

  • …

With Botium's Humanification layer it is possible to evaluate how your chatbot deals with typical human typing habits.
Tip: Humanification is an additional layer on your existing test cases in Botium. Our recommendation is to use your own, clean test cases for automated testing, and from time to time use the humanification layer to verify your chatbots ability to handle those common input situations.

Prerequisites

  • Clean Test Set
    Note: Its best not to use a test set that has already been humanified.

Step by Step Instructions

  1. Add Humanification Layer to Test Set:
    1. Navigate to Botium Tools & Settings > Test Data Wizard and select the Humanification Transformer

    2. Here you will see all available Test Sets that can be transformed, you can filter the list with the search box in the top right corner.

    3. Select a Test Set to continue.
    4. Chose one or more algorithms to apply from the list of Humanification Algorithms (see Available Algorithms for Humanification of Test Sets for more details)

    5. You can set a percentage of how many of the utterances will undergo the humanification by adjusting the slider bar or entering a percentage value in the box on the right.

    6. Give your test set a new name and click ADD HUMANIFICATION

      Note: This will create a clone of your test set, and apply the selected humanification algorithm(s). Note that all humanification algorithms will only be applied to utterances, not convo files.
  2. Evaluate Cloned Test Set: The test set has been cloned to a shared folder in your default folder location. It can be used as any other test set now.
    • Here is an example for a clean utterances list:

    • This is how the same utterance list looks with the humanification layer applied

    Note: If you want to apply additional humanification, you will have to repeat the process again.

Was this article helpful?

0 out of 0 found this helpful