Before starting your Botium journey, it is important to understand the concepts and the terminology that is used in Botium and how they relate to each other.
Chatbots
A Chatbot in Botium is a communication channel between Botium and your chatbot engine. By establishing this communication channel you enable Botium to talk to your chatbot and listen for responses.
A communication channel can be opened in many different ways, depending on your technology. In Botium, a technology for establishing a communication channel to your chatbot is called Botium Connector, and they are available for all relevant technologies out there, such as IBM Watson, Google Dialogflow, Amazon Lex or Microsoft LUIS, etc...
Have a look at the Botium Connectors list to view all currently supported chatbot technologies.
Test Suite
- NLP
- E2E
- FactCheck
- Regression
- Performance
- Security
- GDPR
Test Sets
Test Sets contain the data, scripts and other artifacts that represent your test cases. You can think of a test set as a folder where your test data lives.
Test Cases
A collection of one or more utterances (forming the user’s intent) and the expected bot replies.
Test Projects
Test cases are run by creating a project from the Test Suite and hitting the Start button. Within a Test Project you tell Botium:
-
which test sets you want to run (these contain the test cases)
-
on which chatbot channel
-
and when you want to run them
ATest Project is composed from:
- a project name
-
a chatbot to define the communication channel
-
one or more test sets, which are themselves containing the test cases
-
and a historic view of the finished test results and test cases
Test Results
A Test Result represents the outcome of a single test execution,
typically started within a test project. You can view the overall results and drill
down into individual test cases and specific conversation steps that may be causing
issues.
Other
Term | Definition |
---|---|
Connector | The communication channel between Botium and a Chatbot engine. We have over 55 different connectors. |
Utterance | User input (text or speech) from which the chatbot will derive the intent of the interaction. For example, "show me today's weather". |
Intent | The intention, goal, or objective of the user, derived from the user's utterance. For example, "showWeather". |
Convo / Partial Convo | A conversation (or part thereof) between a user and a bot. Usually plain text or utterances form the conversation. |