Transcription

An overview of the Transcription and Live Caption features.

INC Public Preview Beta Feature

This feature is in PREVIEW and may not yet be available to all customers. Functionality, scope and design may change considerably.

The Transcription feature enables live captioning and voice transcription for calls. It uses Speech-to-Text (STT) technology for converting spoken words into written text. When enabled, the Transcription feature appears as a widget in My Sessions and within the Attendant Console sidebar.

Transcription shown in My Sessions “Companion” widget

INC Azure Billing Transcription

AZURE BILLING

The usage of the Transcription feature will cause additional monthly ACS costs. The costs are determined by Microsoft. Also see https://azure.microsoft.com/en-us/pricing/details/cognitive-services/speech-services/.

  • Before enabling the Transcription feature, get in touch with your Luware Customer Success specialist to discuss terms, usage scenarios and necessary setup procedures.
  • Please note that Nimbus and Transcription support does not cover pricing discussions or make recommendations based on Microsoft Azure infrastructure.
 

INC Transcription Preconditions

PRECONDITIONS

✅Related Admin Use Case: Refer to Use Case - Setting Up Transcription for detailed step-by-step instructions.

Nimbus service and user licensing

🔎Transcription features have service and user requirements. These requirements apply for either mid-session Live Caption or post-session Transcription / Summarization features.

Service requirements

Enterprise Routing Contact Center 

  • Prerequisite: Only Enterprise Routing or Contact Center services have the Companion tab and related Nimbus Features available to the service users.
  • Feature toggle: As Administrator/Team Owner you can enable single Companion features via Companion Service Settings.
  • Data display: To show the transcription data to Nimbus users, you also need to enable the “Companion” widget on the Extension Service Settings. Of course you can also opt to not show the transcription, instead just leveraging the data via the Nimbus Power Automate Connector. → More on this below.

User requirements

Companion 

  • License distribution: Your tenant needs to have sufficient available Companion licenses assigned in Licenses Tenant Settings. You can review and bulk-assign available licenses via License Management.
    💡If no or insufficient licenses are shown, get in touch with a Luware customer success partner to discuss terms and conditions.
  • Enable feature: Every Nimbus user requiring access to features described on this page needs to have a Companion license applied. This can be done by any Administrator in the General User Settings.
    ⮑ Once enabled, the My Sessions page will show a new “Companion” widget with (optionally) enabled features sorted into tabs.
 
 

Azure Speech Services

🔎Features described in the following use “Speech Services” hosted by Microsoft, supporting regions as specified by Microsoft AI services. The usage of the Transcription features and related APIs will cause additional monthly ACS costs outside of your Nimbus subscription.

Speech Services API Setup

 
 

Optional: Power Automate connector integration

🔎Optional step: The Nimbus Power Automate Connector can extract Transcription/Summarization data for implementing additional use cases. To achieve this, the following steps need to be performed by an administrator: 

  • You need to set up a Power Automate flow that uses the “Companion” Trigger Event to react to any ongoing transcription session event.
  • You then require the “Companion” Flow Action to capture the data for any further processing.

💡Some Use Case examples from our Knowledge Base:

 
 
 

Live Caption

Precondition: Transcription must be set up first to use Live Caption.

Live captions are audio transcriptions generated real-time during call sessions. When a call is accepted, a bot is invited to the call in order to start the audio transcription of the session. As a user, you see your spoken conversation with the caller in the Live Caption widget. Live Caption is only visible during ongoing calls, visible in either My Sessions as “Companion” widget and within the sidebar of Attendant Console .

Ongoing Live Captioning process in My Sessions
Transcript widget in My Sessions. If there is no transcript for a session, a message will be shown.

Transcription Saving

When the call session is ended, the live caption is saved as a transcript. If you have an ACW configured for the service, you get the following message while the transcript is being saved: "Your transcription is currently being processed and will be shown shortly"
⮑ Once the final transcription is processed, it appears in the Transcription widget.

The final transcript generation may take a moment

💡Good to know: 

 

Troubleshooting

INC Transcription Troubleshooting

Not seeing any transcripts in the Transcript widget can have several causes. The following table lists error messages and explains why they are shown.

Message 🤔 Why do I see the message?
No transcription is available for this interaction. There was no transcription generated for the selected conversation.
No transcription is available for this interaction. 
Task was not accepted.
The selected call was not accepted and therefore there is no transcribed conversation.

Transcription not available.

User Transcription License missing.

The user doesn't have a Transcription License assigned. Transcription Licenses can be assigned to users in Users > General User Settings > Licenses.

Known Limitations

INC Transcription Limitations

KNOWN TRANSCRIPTION LIMITATIONS

💡We are actively working on further improvements to remove or reduce the following limitations:

  • Transcription needs to be enabled in order to use Live Captioning and Summarization. Speech Recognizers are required for all features. 
  • Transcription data is not part of service/user transfers. Data is kept within the current customer/user session.
  • Transcription is currently only supported for inbound calls. Outbound Calls (i.e. Call On Behalf ) will not be transcribed.
 

DESIGN NOTES

  • Feature availability - Transcription relies on external services and APIs. When the feature is disabled or unavailable (e.g. throttling, settings or Microsoft service impediments) info messages are shown in the frontend UI widget. Nimbus task handling and user-customer interactions themselves are not affected by this and will continue normally.
  • Scope limitation: Only the transcription between the Nimbus user and the customer is kept. Third parties and call conference attendees are not part of the content transcribed.
  • Supervision As long as Supervisors remain in Listen or Whisper mode during a conversation, their voice is not being transcribed. Only during ”Barge In" they are part of the conversation and transcription is active.
  • Summarization items generated from the Transcription might be missing when there is not enough data to draw from.
 

Table of Contents