Knowledge Overview
Getting started
-
Getting started with Botium
Start here if you are new to Botium. Botium Platform Introduction First steps Start here to begin collecting metrics from your Bot. Set up a Connector, create and edit a Test Case, create an Utterance List, create and execu...
-
Getting started with NLP Score Testing
Start here to begin testing your NLP model Set up a Connector, prepare Datasets for training and testing, create and edit a Test Case, create an Utterance List, execute a Test Project, and view your first Test Results...
-
Getting started with Advanced NLP Analytics (Previously QBox)
Start here to begin evaluating the quality of your NLP model. Test, analyze and benchmark your chatbot training data in minutes. Improve accuracy and increase the number of conversations your chatbot can reliably fulfil. Set ...
-
Getting started with Voice App Testing
Start here if you would like to begin with Voice App Testing. Botium supports all relevant Conversational AI technologies available, and upcoming technologies are added to the platform within weeks. There are more than 30 dif...
Chatbot Connections
-
Create a new Bot Connection
To begin testing you will need to connect to your chatbot technology. Here you will find the steps to help you do just that. There are more than 49 different Botium Connectors available right now, including several a...
-
Import Bot Connection
Import your bot configuration from a previously exported file. Navigate Using the Left Pane: On the left navigation pane, head to Botium Tools & Settings > Chatbot Connections Create new Chatbot: Open the 'Crea...
-
Update Bot Connection using the Import Function
Import a Botium.JSON file to update your existing bot connection. Warning: This process will overwrite your existing chatbot configuration! Navigate Using the Left Pane: On the left navigation pane, head to ...
-
Export Chatbot Connection
Export your chatbot configuration to update or share with others. Navigate Using the Left Pane: On the left navigation pane, head to Botium Tools & Settings > Chatbot Connections > Your Chatbot ...
-
Botium Connectors
The following connectors are available for Botium and can be used to test chatbots built using these technologies. See below for a list of connectors and how these work with Botium. Connector Name Connector Features ...
-
Selecting a Botium Connector
Botium supports pretty much every important chatbot technology out there. This article gives an overview of the what kind of test levels supported by Botium, and the strengths and weaknesses of each. Note: There are numerou...
Test Sets
-
Import Files to an Existing Test Set
Allows you to import individual test cases for easy organization and management. Navigate to Test Sets, and select the test set you wish to import your files too. Botium Tools & Settings > Test Sets > Your Test Set Sel...
-
Create a Test Set
In Botium, a test set is a collection of test cases. Continue reading to learn how to create a new test set. Tip: If you have already created a Test Set and you would like to add test cases to it, see Create a ...
-
Add a New Test Case
A test case is a single, multi-step conversation with your chatbot, which should respond in a way we expect it. Continue reading to learn how to add a test case to a test set. Note: To add a test case you will first need to...
-
Use Botium Crawler to Create a Test Set
Create and maintain regression test sets by mapping out all conversation flows in your chatbot using Botium Crawler. This powerful tool detects quick replies and buttons, simulates clicks on each option, and follows paths unt...
-
Run a First Test Session
So, we are connected to the chatbot and we recorded a first test case. Now let’s run our first test session. Note: This article is part of the Getting started with Botium set of articles. Navigate Usin...
-
Use the Test Case Designer to Extend your First Test Case
Our first test case covered exactly one possible greeting a user can send - hi - nothing else. Now let’s extend this test case with other possible greetings a real user might send to your chatbot like hello and good morning. In Boti...
Settings
-
Roles & Permissions
The Botium authorization system is based on roles and permissions. Here's how it works: Permissions are assigned to Roles. Users are assigned to Roles. Permissions are also assigned to API Keys for programmatic access. Role based se...
-
User Management
Users can be configured by authorized users under the Users & Permissions tab in the Botium Settings. Navigate to Botium Tools & Settings > Settings > Users & Permissions > Users Parent topic: Settings Create N...
-
Password Policies
If users have to choose a password, the policies can be configured in the Password Policy view which can be found under Botium Settings. Navigate to Botium Tools & Settings > Settings > Users & Permissions > Passw...
-
Add a New Provider Instance
This article will provide the steps needed to setup a provider instance for gathering advanced NLP analytics. These will be used to run your tests with Cyara Botium. Steps are given for the following providers - IBM Watson As...
-
Add a New Direct Connection
Navigate Using the Left Pane: Navigate to Test Suite > NLP > NLP Advanced Open Direct Connections: On the left navigation pane, head to NLP Advanced Settings > Settings >, select the D...
General
-
Recommended Articles
Here, you'll find a curated list of external articles authored by the creators of Botium. Their expert knowledge of the platform provides valuable insights and tips for optimizing your chatbot testing and exploring the full po...
-
Dashboard
Parent topic: General
-
Training Videos
Watch the series of videos here to gain insights into the Botium Platform. These guides are also embedded within the Botium User Guide but we've also collated them all into one handy reference page for your convenience. Botiu...
-
GDPR testing results
We are making enhancements to the reporting and analytics portion details of the GDPR test results. For a better understanding of how Cyara/Botium tests against GDPR: How does it work? Automated Test: Ask your chatbot que...
-
How to Configure a GCS Bucket for DialogFlow CX
Setup a Google Cloud Storage (GCS) bucket specifically for use with Dialogflow CX within the Botium framework The Dialogflow CX API limits file operations above 10MB. Above this limit, a Google Cloud Storage bucket is req...
-
Botium Namespaces
Botium Namespaces allow you to group Test Projects, Test Results, Test Sets, Chatbots, and Crawler Projects under a common namespace. This is particularly useful for testing multiple chatbot implementations across different b...
Technical Reference
-
Security Risk Assessment
This document outlines the security standards and pentesting activities performed at Botium. Please contact us for more detailed information. Parent topic: Technical Reference Security Strategy The focal points are: Continuous in-h...
-
Botium Architecture
This document describes the System Architecture and Tech Stack, including all involved components - proprietary ones, 3rd-Party and cloud services. Some of them are mandatory, some are optional. For the proprietary components, the te...
-
Authentication & Single Sign On
SAML2 Single Sign-On Authentication Note: Available for Botium version > = 1.13.2 For authentication with SAML2. You will need at least: The SAML SSO URL (Entry Point) The certificate provided by the identity prov...