How to configure transcription in Plugin Framework

Introduction

The transcription feature allows transcribe conversion for customer voice/spoken dialogues in our Plugin Framework. Anywhere365 Dialogue Studio in combination with transcription, can be used to write the text to CRMCRM stands for Customer Relationship Management and is a method/technology for managing your external interactions and relationships with customers. Integrate Anywhere365 with your CRM client to show customer information alongside your inbound and outbound interactions. or a database.

 

Requirements

• Core v 8.0 or higher

• SharePoint TemplateSharePoint templates help you manage the settings of each UCC individually, as each UCC is organized via an own SharePoint site. The template is available on several platforms, such as SharePoint Server, Azure Server, and Office 365 SharePoint. 6.0 or higher

• Google Cloud, with "Cloud Speech-to-Text API" enabled and json credentials

 

​​Transcription in Plugin Framework

There are a few settings required t​o allow plugins to use transcription functionalities. First two optional settings can be set in the general SharePoint UCCUCC stands for Unified Contact Center and consists of a queue that can be handled by Agents. Each UCC has its own settings, interactive voice response questions and Agents with specific skills. Agents can be member of, or sign up to, one or more UCCs. Setting list and allow transcribed text to be written to the general UCC log file for developer debug reasons. The other settings are plugin specific and go into the "Plugin Settings" list. See table below.

Settings

Setting	​Description	​Example value
​EnableTranscriptLogging	​Enables the visibility of the transcripted text in the logs. This setting can impact privacy and should only be set to true for debugging purposes.	​True default: False
​EnableTranscriptIntermediateLogging	​Enables logging of intermediate results. Some transcriptors are able to provide incomplete results while listening. When this setting is set to True all intermediate results are written to the log. When set to False it will only log final messages. This setting only has effect when EnableTranscriptLogging is set to True.	​True default: False

 

Plugin Settings

Setting	​Description	​Example value	Scope
​PluginPath	​Full path to the dll of the transcriptor plugin.	C:\Program Files\Anywhere365\Core\uccplugins\Wsp.Anywhere365.SpeechToTextEngine.Impl.GoogleSpeech\Wsp.Anywhere365.SpeechToTextEngine.Impl.GoogleSpeech.dll	​Transcriptor​​​​

 

​​​Plugin specific settings

​​​​Google Speech

To setup Google Cloud follow this guide: https://cloud.google.com/speech-to-text/docs/quickstart-client-libraries​.

Make sure the "Cloud Speech-to-Text API" is enabled.

The following settings need to be added in the "pluginsettings" list.

​Setting​​	​Description	Scope
​GoogleCredentialJson	​​The plain text JSON of the credential. Do not enter the path to the file, but the content of the file.	Transcriptor

Proxy server with Google Speech

To use a proxy server with Google Speech you will need to add an Environment Variable to your system (not to user only). Add the variable http_proxy​ with the value http://proxyserver.local:8080 .

 

Transcription Recording

Introduction

The transcriptions can also be recorded in a text file.

 

Settings

Setting	Value	Description
UseTranscriptRecording	true	If true, transcript will be recorded

 

Location

The Recording will be stored at the same location as the audio recordings, Learn More

 

Data Format

In the example transcription below, you see that transcriptions have an "IsFinal" flag that indicates if the transcription has completed. Intermediate results are also logged. To determine the name or uri of the participant for which audio was transcribed, the TranscriptHistoryMessage.ParticipantId can be joined with the HistoryParticipant.Id.

{
"Version": "1.0",
"DialogueId": "f748e530-6955-47a6-b7da-0de1fe0d8ea3",
"HistoryParticipants": [
{
"Id": 0,
"ParticipantUri": "sipThe Session Initiation Protocol (SIP) is a protocol to make multimedia communication (audio, video and other data communication) possible and it is also used for Voice over IP (VoIP). SIP has similarities with other Internet protocols such as HTTP and SMTP.:ucctestuser1406@anywhere365.net",
"ParticipantDisplayName": "ucctestuser1406@anywhere365.net",
"ParticipantType": "Customer"
}
],
"ChatHistoryMessages": [],
"TranscriptHistoryMessages": [
{
"Language": "nl",
"Transcript": "Hello",
"IsFinal": false,
"ParticipantId": 0,
"Timestamp": "2020-01-06T11:38:34.8081659+01:00",
"Index": 0
},
{
"Language": "nl",
"Transcript": "Hello world",
"IsFinal": true,
"ParticipantId": 0,
"Timestamp": "2020-01-06T11:38:34.8236803+01:00",
"Index": 0
}
],
"TranslationHistoryMessages": []
}

 

---

Did you find this page helpful?

Yes No