The article outlines the technologies supported by Botium for testing chatbots, along with available connectors and their features for advanced NLP analytics.
For more information on how these connectors work with Botium and a list of each of the
features available for each connector in the Botium platform, read the Botium Connectors
article.
Tip:
- If you are interested in building your own Custom HTTP(S)/JSON Connector to connect to Botium, you can read about using the Generic HTTP(S)/JSON Connector here.
- Also if you embed Botium in your CI/CD Pipeline, you can leverage additional automation for triggering tests and delivering results, read all about how to Integrate Botium in your CI/CD Pipeline here.
Note: Intent Incomprehension support of Rasa
depends on the Rasa Pipeline
For more information on NLP Quality Metrics and how these stats are calculated, read the reference material available here
| Technology | Advanced NLP Analytics | Intent Resolution | Intent Confidence Score | Alternate Intents | Intent Incomprehension | Entity Resolution | Entity Confidence Score | Download Conversation Model | Upload Conversation Model |
|---|---|---|---|---|---|---|---|---|---|
| Dialogflow ES/CX | ✓ | ✓ | ✓ | ⨉ | ✓ | ✓ | ⨉ | ✓ | ✓ |
| IBM Watson | ✓ | ✓ | ✓ | ✓ | ⨉ | ✓ | ⨉ | ✓ | ✓ |
| Microsoft LUIS | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| SAP Conversational AI | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ⨉ | ⨉ | |
| RASA | ✓ | ✓ | ✓ | ✓ | |||||
| Amazon Lex | ✓ | ✓ | ⨉ | ⨉ | ✓ | ✓ | ⨉ | ✓ | ✓ |
| Amazon Alexa Skills Management API | ✓ | ⨉ | ⨉ | ? | ✓ | ⨉ | ✓ | ✓ | |
| wit.ai | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ⨉ | ✓ | |
| QnA Maker | ⨉ | ✓ | ⨉ | ⨉ | ⨉ | ⨉ | ⨉ | ✓ | |
| NLP.js | ✓ | ✓ | ✓ | ✓ | ✓ | ⨉ | ⨉ | ⨉ | |
| Wipro Holmes | ✓ | ✓ | ⨉ | ⨉ | ⨉ | ⨉ | ⨉ | ||
| HTTP(S)/JSON Endpoints | ? | ? | ? | ? | ? | ? | ⨉ | ⨉ | |
| Websocket Endpoints | ? | ? | ? | ? | ? | ? | ⨉ | ⨉ | |
| Your Custom Connector | ? | ? | ? | ? | ? | ? | ? | ? |