Skip to main content
  1. Botium Support
  2. General
  3. FAQ

What do the Botium Test results provide?

Each Test Result provides

  • Bot configuration information
  • Test Cases Used
  • Number Success
  • Number Failed
  • Duration of Test Run
  • Ability to quickly rerun the test session
  • Access to Test Cases to quickly view the associated test cases and their steps - viewing pass/fail results
  • Ability to download the results

NLP Analytics

The Training Progress shows several KPIs of the test session with regards to NLP analytics
  • Number of test cases, conversations steps, asserters
  • Predicted intents and entities
  • Precision/Recall/F1-Score
  • Number of expected vs predicted intents and entities
If there is a second test session selected for comparison, the trends from one test session to the next are also shown.

NLP/NLU Testing

For NLP/NLU Testing, Cyara/Botium provides several key insights:
  • Confusion Matrix / Precision / Recall / F1-Score
  • Entity Confidence Deviation
  • Entity Confidence Risks
  • Entity Utterance Distribution
  • Intent Confidence Deviation
  • Intent Confidence Distribution
  • Intent Confidence Risks
  • Intent Mismatch Probability
  • Intent Utterance Distribution
  • Training Progress
  • Confidence Threshold

Sample Test Results

  1. Regression:

  2. Performance:

  3. NLP:


    • and



  4. End2End Testing:

  5. Monitoring:

  6. Security:

Was this article helpful?

0 out of 0 found this helpful