Save a Live Chat as your First Test Set

In Botium, a test set is a collection of test cases. A test case is a single, multi-step conversation with your chatbot, which should respond in a way we expect it. An intuitive way for creating a test case is by having an actual chat with your chatbot and saving this conversation transcript to be repeated in exactly the same way later.

Tip: If you have just added your chatbot connection, you can enter Live Chat directly from the Chatbot Overview section, and skip directly to step 4.

1. Navigate Using the Left Pane: On the left navigation pane, head to Botium Tools & Settings > Chatbot Connections
2. Search for your Bot Connection: Use the search bar on the right of the page to find the bot connection you wish to create a test set for.
   
   
3. Open Live Chat: Open the Actions menu and select Live Chat. The actions menu is represented by a three-dot icon under the 'Actions' column on the far right of the screen.
   
   
4. Start the Conversation: Depending on your needs, you can start the conversation with your chatbot in a few different ways. After adding your interaction, click the send button (or press Enter).
   • Enter Text: Start a chat by entering hi in the input field at the bottom.
   • Record Voice: Start a chat by using the Record button to record your voice.
   • Upload Attachment: Start a chat by using the Upload Attachment option to upload files to the input field.

   
   
   

   Note: You can now see the chatbot responding to your greeting. Continue chatting with your bot if you wish to gather even more test data. After saving, this conversation will be added as a single test case to a new test set.
   
   This example demonstrates both text-based and audio-based user interactions.
5. Save the Conversation: Click the SAVE button when you are ready to save the test case.
6. Select Test Case: You now have the option to select the test set you would like to add the test case too, however, as the purpose of this task is to create a new Test Set, we will choose – Register new Test Set – from the dropdown menu, and then enter First Steps Chatbot - Test Set as the set name in the text field underneath.
7. Test Case Name: Enter First Steps Test Case as the test case name.
   Note: By default, test cases are named using the first message from the live chat, with the prefix TC. For example: TC hi
8. Choose a Project Type: For the purpose of this guide we will set this to Regression. This is referring to the Regression test type which can be found in the Test Suite.
   Note: In this example:

   • I have named my test set First Steps Chatbot - Test Set
   • I have named my test case First Steps Test Case
   • I have chosen Regression in the test type selection.

   
   
   
9. Save: To finish you can choose to SAVE CONVERSATION or SAVE CONVERSATION AND OPEN TEST SET.
   Tip: Both of these options will save your test case to your new test set but the latter will open the test set directly so you can continue to add more test cases.
10. Find Test Set Record: Now navigate to the test set record we just created by using the Test Sets menu and clicking on First Steps Chatbot - Test Set in the list - again, you can use the filter on the top right.
    Botium Tools & Settings > Test Sets > First Steps Chatbot - Test Set
    
    
11. Test Cases: Click on the Test Cases tab to inspect the test case we just created
    
    

Results: You can see now a single test case, the one we saved before. You can use the test case designer for inspecting and changing the conversation steps as you wish.

Tip: For software developers it might be interesting to note that all Botium test cases are actually backed by BotiumScript, a scripting language designed for defining test cases for conversational interfaces. The BotiumScript for our first test case looks like this and can be seen in the SOURCE EDITOR:

Example BotiumScript for Copy/Paste:

First Steps Test Case

#me
hi

#bot
You said: hi