Detecting Mood with a Smartphone

Often times mood can be an early indicator of physical or psychological ailments and side effects of medication and drugs. The innovation team at Bayer worked hand in hand with Lithios and the team at DxLabs to design and build a native iOS application designed to make tracking mood seamless and easy. Together we’ve built MeMood: A custom mood tracker that simply requires the user to open the app and talk about their day.

Platform

Native iOS and Android Applications

Roles

Product Strategy
UI/UX Product Design
Mobile Software Development

Deliverables

Discovery Documentation
UI/UX Product Design Library
Mobile Applications

The Challenge

The Bayer team challenged Lithios to create a live facial recognition and audio tracking tool to read-between-the-lines and decipher meaning into what a user's body is saying. Coupled with a custom pain intensity tracker, MeMood was created to analyze the facial and audio data to produce a daily mood report and summary.

Voice, Audio, and Emotion Analysis

The MeMood app uses the data from a users live facial stream and live audio stream as well as custom pain indicators to produce a comprehensive mood report. By analyzing mouth shape, vocal tone, and degree of pain, MeMood can help to label emotions. By simply looking and speaking, the app will calculate a score and report that is plotted on a custom emoji-calendar so that users can see their mood variances over time. Doctors in turn can identify early warning signs in patients in order to provide more accurate and timely treatment and save lives.

By selecting to develop a Native iOS app, we are able to tap directly into the internal microphone of the iPhone. The MeMood app asks users to simply open the app and talk about their day. The app then records the audio and processes the waves in the users voice via advanced audio-emotional analysis to produce a mood report.

Why Lithios?

Lithios and Bayer collaborated on the MeMood app to apply modern mobile technology to the future of wellness. Through this engagement, we helped Bayer realize their vision by designing and developing an iOS application to support users in tracking their mood and general mental health data points.