Welcome to the Botium Knowledge Center

With Botium Box 2.6 we are introducing a totally new product “Botium Coach” for advanced NLU analytics. Around this new product we made a deeper integration with the chatbot engine providers to download and import training and test data based on their conversation model into Botium Box - and update the conversation model from the augmented data in Botium Box. We have 70+ predefined test sets in Botium Box and added options for translation, humanification, paraphrasing and test set splitting - tools needed by everyone working on chatbots.

Apart from that, we recently partnered with Perfectolabs to provide cloud-based E2E testing, we partnered with Artificial Solutions an their Teneo platform and Ubitec with their Ubitec Bot Framework.

• Tutorial: First Steps in Botium Box

• Get Started with Botium Coach

• Using Excel Sheets to Write Test Cases for Botium Box

• Tutorial: Analyze and Improve Performance of IBM Watson Assistant Skill

• Testing a Chatbot End-to-End with Perfecto and Botium

• Automated Testing and Monitoring for Alexa Skills with Botium Box

• Using Google Sheets with Botium Box

• Tutorial: Using Paraphrasing to Increase Conversational AI Test Coverage

• Merged several features and pull requests from our awesome community.

• Includes updates of our Botium Connectors for IBM Watson, Google Dialogflow, Amazon Lex, Alexa Skill Managements API and Rasa

Botium Box now includes Botium Coach providing tools and statistics for NLU/NLP analytics.

• Intent and entity confidence analytics

• Confusion Matrix with Precision/Recall analytics

• Confidence Threshold Optimizer

• Test/Training data augmentation, translation, paraphrasing

• … and many more, see Botium Coach / NLP Analytics and our new Website section

• Botium Box now includes 70+ predefined test sets for various domains in various languages

  • Smalltalk, Banking, Insurance, Travel, …

  • English, German, Spanish, Chinese …

• Our new Test Case Wizard can download conversation models from IBM Watson, QnAMaker, Rasa, Google Dialogflow, Amazon Lex and more to Botium Box to provide a kick-start into Botium Coach analytics and test data augmentation

• Test Case Wizard can update the conversation model in IBM Watson, QnAMaker, Rasa, Google Dialogflow, Amazon Lex and more with data from Botium Box

• The Transformation Wizard can now be used for test set humanification (see </how-to-guides/best-practices/best-practice-humanification-of-test-sets/?search_id=7d64c7da-1b2a-458d-a82e-a9d360458290>)

• The Transformation Wizard can translate your test set into other languages (currently: Google Translate - enter your Google credentials in the System Settings first)

• The Transformation Wizard can split your Botium Box data into training data and test set by random (select percentages)

• Botium Box does a static analysis of your test sets and points out any issues or possible troubles.

• Botium Box also analyzes your Excel sheets and Google sheets upfront.

• We partnered with Perforce to bring the Perfectolabs device cloud and smart reporting into Botium Box - see blog: Testing a Chatbot End-to-End with Perfecto and Botium

• Headless Chrome is now bundled with Botium Box

  
  
  

• Botium now supports simulation of HTML button clicks in addition to text input/output

To provide better overview Botium Box now shows a technology icon or a custom avatar for all of your registered chatbot connectors.

We heard your voices: As simple as BotiumScript is, for non-technical Botium Box users we now include a visual test case designer - and, to be honest, now we don’t want to go back to the text-based editor ourselves!

And you can immediately check the test case by sending it ad-hoc to your chatbot:

We made some huge progress regarding test case management.

• You can now use Google Sheets to write your test cases with same semantics as with our Excel file reader(Composing in Excel files) - see Using Google Sheets with Botium Box

• Botium Box now supports on-the-fly JSON structure conversions so you can use your own JSON files with Botium Box without prior transformations

• For short question/answer style test cases, Botium Box can now handle utterances lists as test cases

• On the Test Set Dashboard, Botium Box now gives a better overview of the contents of the test cases and utterances lists

  
  
  

• Botium Box can now import speficiations from the famous API testing tools Postman and Postwoman to make it easier to configure Botium for custom HTTP/JSON endpoints

• Botium Box Dashboard shows latest news, articles and tutorials from the Botium makers

• Botium Box now has dashboards for test projects, test sets and chatbots to show everything important on one screen

  • Test sessions attached to chatbots, test projects or test sets

  • Last test results in overview lists

  • Detail views with statistics

• And it makes most common actions available on one click

Botium Box includes tools to make voice app testing easy:

• Upload test case audio files to Botium Box with the File Browser

• Organize the audio files in media directories by test case

• Send all audio files for a test case to the chatbot connector with a single test script

  • Supported for Dialogflow, Lex, Directline and others

• Botium Box now includes a crontab-based scheduler for regularily running your test projects

• Notifications can be sent out via email or with our brand-new Zapier component!