The Sentiment Meter is an artificial intelligence (AI) solution conceived, developed and designed by Xpand IT and combines two components: gamification and artificial intelligence. It is a game of emotions in which, after the user fills in a small form, the software randomly selects an emotion that the user has to try to express to the best of their ability. After photographing this moment, the Sentiment Meter evaluates the user’s performance and gives the user a score. In fact, this game has turned out to be a real success, and it can be said that the Sentiment Meter is the perfect mix between gamification and artificial intelligence.
This game was born from the need to create something that would not only show Xpand IT’s technical abilities – from our new AI Solutions Centre – but also that would be able to entertain people coming to our stands in the countless events in which we take part. IDC Directions 2018 and Web Summit were the first conferences we took the Sentiment Meter to, and we can say that it did not go unnoticed. Here are some pictures of those moments:
The technology
The logic is very simple: the player spins the wheel of emotions, the computer selects an emotion/facial expression and the player simply has to express that emotion with his/her face. Finally, the interface scores to the player and he/she wins a prize. It seems quite simple; but, actually, what is behind this analysis of emotions is an intelligent algorithm from Microsoft: Azure Cognitive Services. In this case, we use the Face API, which allows processing and recognizing faces and identifies which emotion a person is expressing. This algorithm is fueled by each use and by the pictures taken all over the world.
The whole infrastructure is based on the cloud, in Azure. Some other Microsoft tools were also used, such as SignaIR, which manages interactions in real time between the screen that presents the game and the tablet that gives the commands to the person playing. Moreover, a .NET Core open source framework was used as the basis for this project, allowing for the development of web and cloud apps. The project’s front end was developed on the web with HTML, CSS and Javascript, also relying on some extensions, such as JQuery, Ajax and p5.js.
The team
This whole project would not have been possible without the teamwork of members from our Digital Xperience, UX/UI and Marketing teams, who were able to design and mastermind this solution: Francisco Correia, Senior Project Manager, and Ricardo Duarte, Developer, both from the Digital Xperience department; Marina Mendes, UX/UI Designer, and all the other members of the Marketing team who ensure its proper functioning during events.
These are the screens of the game:
The Sentiment Meter sets the direction for what it is possible to do today by using artificial intelligence and good ideas born in simple conversations!
With this project we were able to show that integrating Artificial Intelligence services can, even today, set the bar high, whether it concerns interactivity or decision-making.
We were able to bring the user closer to the interface by thinking in emotions and conveying them to technology in a fun and relaxed way.
Content and Digital Coordinator – Xpand IT
