Depending on the support within the chatbot provider, you can set up connectivity to multiple environments (development, UAT, production, etc.). Cyara/Botium supports testing at the API level for component testing and user interface testing for system tests (website, social, etc.), as well as voice testing if desired.
NLP
For NLP testing, you can conduct static analytics against a standard language model using your existing training data, accessed via an API. Existing training data can also be imported via file formats such as CSV, JSON, YAML, XLSM, and ZIP.
Botium
With Cyara/Botium, you can "improve" this data by using the AI Assisted Generator, Humanification Transformer, or Paraphraser, and then export it from Cyara/Botium and import it into your chatbot as the "New and Improved" version of the training data.
Live Testing
By connecting to your bot, you can conduct NLP testing and review dynamic results based on how your bot responds to the NLU test data.
Sample Static Test Set Results: These analytic reports compare data in a test set to a standard language model.