Skip to main content
  1. Botium Support
  2. Test Suite
  3. NLP
  4. NLP Quality Metrics

Alerts / Attention

Whenever Botium identifies anything which requires attention it is shown in the Attention box. Among others, these conditions are:

  • Botium detected test cases where unexpected intents and/or entities have been recognized by the NLU engine
  • Botium wasn’t able to collect any data for a test case, so it was ignored. Usually this means that the NLU engine didn’t send any response at all
The Attention Box shows any alarming events Botium was able to identify. Issues with the CORRECTNESS of the test results will also be visualized here:

  • Predicted intent doesn’t match the expected intent

  • Entities have not been recognized

  • Test data is not suitable for analyzing with Botium

Clicking on the message shows the detailed records Botium identified as source of the problems.

In this case, there are 591 user examples for which the chatbot predicted an intent other than expected. In most cases this means that the training data for the NLU engine has to be refined further by adding more user examples to the expected intent, and maybe removing similar user examples from the incorrectly predicted intent (see Annotate and Augment NLP Training Dataset to learn more.

  • Botium wasn’t able to collect any data for a test case, so it was ignored. Usually this means that the NLU engine didn’t send any response at all

  • Botium detected test cases where unexpected intents and/or entities have been recognized by the NLU engine

Was this article helpful?

0 out of 0 found this helpful