Instead of annotating the test cases manually, Botium Box includes a Test Data Wizard to download the conversation model of an NLP provider and convert it to BotiumScript test cases. They can be used instantly by Botium Coach.
Using the Test Data Wizard
For each supported NLP engine there are different options. When using with Rasa, you first have to upload the Rasa training data file nlu.md to Botium.
Depending on the NLP engine, you can decide to:
-
Only import intent names and user examples as utterance lists (recommended for getting started)
-
Generate convo files with NLU intent asserters
-
Generate convo files with NLU intent and entity asserters
Pro Tip: Split Training Data by 80/20 into Training and Testing Data
In typical machine learning projects, there is the 80/20 rule: Use 80% of the available data for training, and 20% for testing. Botium Box includes a dataset splitter to divide a dataset into two pieces. Expand the Test Set Splitter section in the Test Data Wizard menu of the Botium dataset:
Here you can tell Botium the ratio to split the data as well as the names of the resulting Botium datasets. You should now use the 80% training data to re-train your NLP engine and use the 20% test data for testing. The Test Case Wizard in Botium Box helps to upload the training data to your NLP engine of choice - see Step 6: Training your NLU engine
Comments
0 comments
Please sign in to leave a comment.