Expand Utterances to Conversations and Incomprehension Utterances

There are cases where you are not really interested in asserting conversations with your bot. Maybe you are just interested in sending as much text as possible to the bot (for training purposes), or you just want to make sure the bot understands all of the given texts.

When you enable the Expand Utterances to Conversations option, all utterances in the test set are converted to simple 2-step conversations (text sent to bot, bot answer received). For example, you have these utterances file:

HELLO_UTT
hello
hi
what's up

Botium converts it into three convos:

#me
hello

#bot

#me
hi

#bot

#me
what's up

#bot

All three utterances are sent to the bot, and the answer is ignored.

If you want to make sure your bot actually understands what you sent, it is possible to specify the Incomprehension Utterances, the utterances your bot is returning in incomprehension cases.

For example, in addition to the HELLO_UTT above, you have an INCOMPREHENSION_UTT utterances list:

INCOMPREHENSION_UTT
Sorry, I don't understand
Can you please repeat ?
Please say it another way

Now, when you enter INCOMPREHENSION_UTT in the Incomprehension Utterances field, Botium converts the test set into these three convos:

#me
hello

#bot
!INCOMPREHENSION_UTT

#me
hi

#bot
!INCOMPREHENSION_UTT

#me
what's up

#bot
!INCOMPREHENSION_UTT

Now Botium makes sure that for every utterance from the HELLO_UTT list, the bot actually doesn’t return a “don’t understand”-like phrase.