In order to build trust with our Contextual AI product, Contextual Response Details in the Candidate Inbox enhances transparency regarding how messages are generated.

Use case

• Users who need a clear understanding of the rationale behind their AI Assistant's generated answers.

Candidate Inbox

When your AI Assistant provides a contextual response, a sparkle icon will appear next to your AI Assistant's avatar when the you hover over the message within the candidate’s conversation.

Click this icon to open the Contextual Response Details drawer. This drawer will include the following information:

1. Original Candidate Message – The message that the candidate sent.
2. Contextualized Message – The candidate’s message after it was refined.
3. Matched Content – The information retrieved from the Candidate Q&A (CMS) database. Hovering over its information icon will show a tooltip for additional context.
4. Relevancy Score – The percentage of how closely the content matches the query. Relevancy scores will be displayed in one of three colors, depending on their score:
   • 66-100% = Green
   • 34-65% = Yellow
   • 0-33% = Red
5. Contextual Response – The final response sent by your AI Assistant to the candidate.

NLP vs. contextual response

When your AI Assistant responds with an NLP response instead of an LLM response as a fallback, a grey sparkle icon will appear next to your AI Assistant's avatar in place of the blue sparkle icon when you hover over the message within the candidate’s conversation. You can open the Contextual Response Details drawer by clicking this icon.

• Note: An Error Occurred error message will display in the Matched Content section of this drawer when no content has matched to generate your AI Assisstant's response. 

Mobile experience

The mobile experience is similar to the web experience. However, one aspect that is different is the sparkle icon. This icon will be listed to the right of the contextual message when you hover over it rather than next to your assistant's avatar. You will then need to click the message in order to open the Contextual Response Details page.

When this page opens, you can click the information icon next to the Matched Content title to view additional context on the relevancy score.

Permissions

By default, only Paradox Admins, Company/Account Admins, and Franchise Owners have full access to the Contextual Response Details drawer.

Grant/restrict access

Update permissions for other user roles as needed.

• Contextual AI – This parent permission provides users access to all Contextual AI features.
  • Contextual Response Notes – This child permission provides users access to viewing the Contextual Response Details drawer within a conversation. This can be enabled for:
    • Candidates
    • Employees (if Employee Assistant is enabled)