PASTA logo

EN / JP

Visualize stress and claim
The Voice Emotion Recognition


Real time visualization of [ Anger ], [ Joy ], [ Normal ]
by [ The Voice Emotion Recognition ] technology using Panasonic patent

feeling mark Free trial in process

Patent technology provider:Panasonic Co., Ltd.

>> Try it! Free trial in process <<
Practical realization of [Emotion Recognition technology] moving forward

"Human emotion is invisible" - [Emotion Recognition technology] makes it possible. This technology reads the human emotion through facial expression, text, conversations, and voice. In recent years together with the voice recognition technology, practical realization of the emotion recognition technology by voice is moving forward like installing the emotion recognition technology into robot.

Robot


The emotion recognition by voice / conversations

Our emotion recognition technology determine the emotions by using voice / conversations.
The Voice Emotion Recognition technology is divided to [the language analysis type] and [the acoustic analysis type]. For [the language analysis type] which analyzes emotions through speech recognition of words had difficulty to determine emotions in cases of reading words expressing multiple emotions and containing multiple proper nouns, but our technology can read emotions without influences of those problems by using [the acoustic analysis type] based on the feature values of voice.

This enables to detect claims / complains which were difficult to determine by only [the language analysis type] and angry voices which were hard for speech recognition.


~Differences of language analysis and acoustic analysis~




Real time determination by just 1 second

The engine specification with energy saving and light operation can analyze conversation in almost real time. It can determine the emotions immediately (about 300ms) after voice input. (this is subject to change depending on the usage environment.)
For example, in call center when any claim (anger/stress) occurs which require the follow up by supervisor, this can correspond appropriately and smoothly without missing the timing.


~ Installation example 1. Call center (customer service) ~




Utilization as the feedback through data analysis

Other than the real time determination of emotions, it is also possible to analyze voice and conversations after the batch processing of them. Installing to internal interviews as an example, prevention of power harassment by checking if the interview was done appropriately through the feedback in human resource, and plan the decline of cancellation rate, the improvement of customer satisfaction rate, by analyzing customer conversations and emotion recognition together.


~ Installation example 2. Utilization at HR (power harassment prevention) ~


~ Installation example 3. Excavation of potential needs ~




Practical use scene of emotion recognition by voice/conversations

Our emotion recognition system has 2 type as [Real time determine] which visualizes emotions and [Batch processing determination] which analyze data later. Here we introduce appropriate use scenes (installation examples) of both types.


■[Real time determination] installation examples

Call center
Call center
Decline of cancellation rate through claim visualization

Customer service
Customer service
Customer satisfaction improvement through following up hidden stress

Robot / AI solutions
Robot / AI solutions
Enables conversations / responses with considerable emotions


■[Batch Processing determination] installation examples

Interviews and internal meetings
Interviews and internal meetings
Useful to power harassment which is difficult to aware

Personnel appraisal and assessment
Personnel appraisal and assessment
Usable of emotions as data materials

Customer needs (potential needs) excavation
Customer needs (potential needs) excavation
Link to potential needs by emotion analysis


Free trial of our Voice Emotion Recognition is available. Please feel free to apply and experience the Voice Emotion Recognition technology. The specification・user guide are also available to use.



Our 5 strengths of [Emotion Recognition]

1. Just 1 seconds! High speed processing

The engine specification with energy saving memory / light operation enables the analysis speed of voice recognition process with 10 seconds for 5 sound sources under PC specification of Intel Core i5 / 8GB memory. Real time processing can return the analysis results in about several hundreds mm/s.
※The processing time may differ depending on the processing terminal specification and sound source sampling rate.


2. No need of training data (reference data)

Unlike the language reference type used for conventional emotion recognition, our type using Panasonic patent technology is simple and light because it does not require training data in advance. With this, it is possible to perform from the point of installation.


3. Raspberry Pi execution is possible

Using the simple algorithm of emotion determination analyzing the voice features, and this enables to use low level specification terminal and Linux environment instead of using special expensive terminals.


4. Enables to combine with the voice recognition / expression emotion recognition technologies

Our Voice Emotion Recognition SDK is provided as 「Dynamic Link Library」. This application uses C++ interface, and can input voice data and acquire recognition results. (available of a few other language binding)
We provide SDK format of emotion recognition, so this can be used together with voice recognition engine, and face/expression emotion. By combing with other advanced technologies it can be used as one of AI solutions to acquire higher level and accurate results.


5. Using emotion values enable own tuning and AI solution!

In the specification of our Voice Emotion Recognition SDK, the emotion values are returned from voice data. Specifically, it can acquire the 「rough value)」 got through the emotion strength analysis using the straining condition of the voice codes and the  「soft value)」 got through voice softness analysis, and show each of them by 0〜1 values. the emotion determination can be done by using these analysis results.

<Examples of emotion determination>
◆ Joy : rough value >= 0.5 I soft value >= 0.5
◆ Anger : rough value >= 0.5 I soft value < 0.5
◆ Normal : rough value < 0.5




Comparison with other products

One of our Voice Emotion Recognition system features is recognition speed, easy of installation/flexibility of customization.
Regarding to the recognition, because its algorithm determines emotions by voice rough values and voice soft values, individual difference occurs hardly and secure the recognition accuracy regardless of languages, dialects.


~ Comparisons of the voice emotion recognition systems ~

Our emotion recognition SDKCompany ACompany SCompany L
Recognition algorithmLogic rule structureLogic rule structureLogic rule structureDatabase reference
real time recognition speedseveral hundred msWithin 1 second--
Recognition emotion typeAnger / Joy / Normal
Emotion Value
Anger / Joy
Sorrow / Excitement / Normal
Emotions
Ups & downs of the mood
Anger / Sorrow
Excitement / Happiness
Voice formatUncompressed PCMWAV formatWAV formatG711.1 uncompressed
MeritsUnderstand emotional components
Possible to install into various environments
Huge research results
Installation result to Pepper
Medical business holding
Possible to determine mood
Quantification of thoughts
Installations overseas
Other featuresUsing Panasonic patent technologiesSoftbank subsidiary from 2012Execute depression diagnosisNeed certain length of voice
Mixture of determination results of emotion / thoughts



Free trial

Currently 3 kinds of free trial are ready.
Please feel free to use by just filling out each trial form.
Normally it takes 3〜5 working days to provide. (Our inspection will be done for the applicaiton.)





Installation flow

Example of flow from contact to implementation. First, please examine how to use the emotion recognition technology, output image, and possibility of implementation. Please feel free to contact us for any question about the Voice Emotion Recognition in trial period. In case you think the implementation positively, we will move to the step of the conclusion of NDA or license contract. Before full-scale implemetation we are flexible to provide the development version license (admission-paid) after the trial, so please contact us.
※Please note that the development consulting is not provided.

free trial

free trial

NDA
(Provisional contract)

NDA (Provisional contract)

POC
(Test implementation)

POC (Test implementation)

Full-scale contract

Full-scale contract

Installation Development

Installation Development

Operation start

Operation start



Installation cost (price・fee)

The installation cost is defer depending on hot to use, equipment's, customize volume.
We will estimate the cost/fee based on hearings. Please contact us.



We are the members in charge of The Voice Emotion Recognition

We dig up and put together valuable technologies to strategically use the patent technologies/R&D results in the world, and we practically develop those technologies / results into SDK/API and provide licenses of them.


Toshikazu Ohno

Patent technology consultant
Toshikazu Ohno

CEO /
Incubator

Decipher R&D results of unused patents and incubate those technologies to meet your needs.

Takuma Yoshida

Patent technology engineer
Takuma Yoshida

Takuma Yoshida
Director CIO

Select technologies which require R&D in large enterprises, and execute setting up of the specification, researcher hearings for practical use.

Shinya Murakami

Patent technology engineer
Shinya Murakami

Application engineer

In addition to the applications, develop widely OS / middle ware / DB design/construction. Shinya developed the Voice Emotion Recognition.

Toshiaki Onda

Patent technology advisor
Toshiaki Onda

GVA Law Office, Lawyer /
Patent attorney

Provide legal advices from the viewpoints of both lawyer and patent attorney on the availability of patent utilization, risk management, and aspect of business.



PASTA LOGO









introduction results

Shamrock Records, Inc.
iPhone application[UD talk®]

Our [Emotion Recognition Technology] was installed into [UD talk®]which is the communication support application to materialize visualization of conversations.

UD talk®




Media publications

Below shows media publications. Please contact below for interviews.



Techable

Robotstart

IT Leaders

The Nikkan Kogyo Shimbun(The Daily Industrial News)


ServiceSafari

The Ibaraki Shimbun

WorkMaster



Contact / Installation cost estimation

Please fill out below form and send after agreeing to our privacy policy.



Contact here