Welcome to the Botium Knowledge Center

Now that Botium Box 2.0 was ready, we had the time to implement plenty of features you, the appreciated Botium community, asked for.

For testing voice apps we published an entirely new Open Source product called Botium Speech Processing, which is a free alternative to cloud services like Amazon Polly or Google Cloud Speech. It is a full-blown Speech-To-Text and Text-To-Speech service based on the best Open Source products and models available.

We are going more into the NLP analytics direction with our brand-new K-Fold Cross Validation Support, currently supported with Dialogflow, Wit.ai, Amazon Lex and more.

The Botium Box Live Chat features support for additional multimedia content delivered as standardivzed “Adaptive Cards” and Markdown.

We built a new connector for NLP.js and added plenty of conversation testing features to the existing connectors (such as HTTP/JSON endpoint polling to support asynchronous delivery models).

And on the infrastructure side, we optimized processing of large test sets with several ten thousands of test cases.

• Tutorial: Install Botium Box on AWS (or any other cloud service)

• Quality Metrics for NLU/Chatbot Training Data, Part 1: Confusion Matrix

• Tutorial: Benchmark Your Chatbot on Watson, Dialogflow, Wit.ai and more

• Full-Blown Open Source Speech Processing Server Available on Github

For testing voice apps, Speech-To-Text and Text-To-Speech processing is one of the basic building blocks. Botium Speech Processing combines the best Open Source speech processing tools in a single service and makes them accessible with a HTTP/JSON API.

Read on here.

• Retry functionality is now available for several operations, see Botium Wiki

• #433 Generic HTTP/JSON connector support for endpoint polling

• #432 New NLP asserter for entity content

• #435 Rate limiting to throttle chatbot traffic, useful for cloud-based APIs with limited access

• #436 Extended retry behaviour for asserters and logic hooks retry

• #437 Decompilation support for cards and carousels

• K-Fold Cross Validation Support

• We built a new Botium connector for NLP.js

  • K-Fold Cross Validation Support

• We updated our Websocket connector

  • BOT-968 added support for HTTP(S) proxy

• We updated our IBM Watson connector

  • Added

    • #15 Added support for corporate HTTP(S) proxies

    • #16 Added support for importing Watson entities to Botium convo files

    • #18 K-Fold Cross Validation Support

  • Changed

    • #17 Duplicate intent confidence check should be done with the INTENT_UNIQUE-Asserter

• We updated our Directline3 connector

  • BOT-972 Adaptive cards are now rendered in Botium Box Live Chat

• We updated our Wit.ai connector

  • K-Fold Cross Validation Support

• We updated our Dialogflow connector

  • K-Fold Cross Validation Support

• We updated our Amazon Lex connector

  • K-Fold Cross Validation Support

• We updated our Webdriver connector for testing on UI level

  • Breaking Changes

    • Switched to WebdriverIO v5, so scripting API changed

  • Added

    • #10 New profile for IBM Watson Assistant Preview Link testing

  • Changed

    • #9 Switched to WebdriverIO v5, with additional support for Shadow DOM

• We updated our Google Assistant connector

  • Added support for UI element assertions like buttons, pictures and carousel

• We updated our Alexa Voice Service connector

  • Added support for Botium Speech Processing as free alternative to cloud services

• BOT-970 Additionally supporting Cards (Carousels, Adaptive Cards, Hero Cards, …) in our “Save conversation as Test Case” designer

• BOT-972 Live Chat now supports Adaptive Cards and Markdown

• BOT-132 Option to check connectivity with cloud device providers like Saucelabs

• BOT-847 Syntax highlighting for Javascript hooks

• BOT-1006 We optimized some internals in Botium Box to support huge test sets with ten thousands of single test cases

• Only available in Botium Platform (enterprise plan)