In Botium, a test set is a collection of test cases. A test case is a single, multi-step conversation with your chatbot, which should respond in a way we expect it.
See Get Started with Testing Conversational AI to get more background information, but you don’t need it to finish this tutorial.
An intuitive way for creating a test case is by
-
having an actual chat with your chatbot and
-
saving this conversation transcript to be repeated in exactly the same way later
That’s what the live chat in Botium is for - click the Live Chat button to open a chat session with your chatbot:
-
Enter hi in the input field at the bottom and click the send button (or Enter)
-
You can now see the chatbot responding to your greeting
-
Click on the Save as Test Case button to save the conversation you just had as test case
-
Let’s create a new test set by entering First Steps Test Case in the input field …
-
… and First Steps Test Case as Test Case Name
-
… and finally click on OK
-
Now navigate to the test set record we just created by using the Test Sets menu and clicking on the First Steps Test Set in the list - again, you can use the filter on the top right.
-
Click on the Test Cases section to inspect the test case we just created
-
You can see now a single test case, the one we saved before. You can use the test case designer for inspecting and changing the conversation steps.
For software developers it might be interesting that all Botium test cases are actually backed by BotiumScript, a scripting language designed for defining test cases for conversational interfaces. The BotiumScript for our first test case looks like this:
First Steps Test Case
#me
hi
#bot
You said: hi-
The name of the test case is First Steps Test Case
-
As a starter, send the text hi to the chatbot
-
We expect the chatbot to answer with the text You said: hi - if the answer from the chatbot is different, the chatbot doesn’t behave as expected, and the test case is considered failed
Comments
0 comments
Please sign in to leave a comment.