At a glance
Calm is a software company based in San Francisco that produces a leading meditation and sleep application, helping users improve their overall mental health and wellbeing.
Challenge
Calm was looking to enhance its customer experience through improving its personalised content recommendations.
Solution
Combining a vector database, LLMs, and a hybrid search approach to generate personalised recommendations.
Services used
- Amazon OpenSearch
- Amazon Bedrock
- AWS Lambda
- Amazon DynamoDB
Outcomes
- 100% of recommendations have explainability
- 25% more accurate recommendations
- 5 additional metadata properties for customisation
Business challenges
Improving personalisation of content recommendations
Calm recognised an opportunity to improve their personalised recommendations to customers and sought to evaluate the use of Large Language Models (LLMs) to enhance the personalisation of content and improve the user experience.
While Amazon Personalise was being used to assist with personalised recommendations, Calm wanted to increase performance and incorporate a layer of contextual awareness to the recommendation process. The goal was to leverage user data and content metadata to generate more relevant and engaging recommendations for their customers.
What our customers say
Hear directly from those who’ve experienced our services. Discover how we’ve made a difference for our clients.
Jonathan Hummel
“I think the work that Firemind has done has been brilliant and it just continued to improve with each iteration. I love that even just at first glance, you could tell there was an improvement in quality.”
Solution
Integrating LLMs for personalised recommendations
The Firemind team implemented a solution that leveraged a combination of a vector database, LLMs, and a hybrid search approach to generate personalised recommendations for Calm users. This solution was designed to enhance the personalisation of content recommendations, ultimately driving improved business outcomes for Calm.
A key aspect of the solution was the generation of detailed content descriptions using LLMs. By incorporating the transcript data and metadata associated with Calm‘s content catalogue, the team was able to create more nuanced and contextual descriptions of each item. This provided the LLMs with richer information to draw upon when matching content to user preferences and personas.
The final step of the solution involved the LLMs providing justifications for the recommended content. These explanations, addressed directly to the user, highlighted how the suggested items complemented their mood and persona. This added layer of transparency and personalisation was designed to enhance the user experience and drive greater engagement with the recommended content.
Personalised user profile
The solution utilised the user's recent engagement with Calm's content to tailor recommendations for individuals based on their preferences.
Generated detailed content description
By incorporating the transcript data and metadata associated with Calm's content catalogue, the team was able to create more nuanced and contextual descriptions of each item, providing the LLMs with richer information to draw upon when matching content to user profiles.
Of recommendations now come with explainability
The LLMs provided justifications for the recommended content, highlighting how the suggested items complemented the user’s mood and persona.
More accuracy for recommendations
The combination of personalised user profiles, detailed content descriptions, and the hybrid search approach led to a 25% improvement in the accuracy of the recommendations.
Added Value
The solution added 5 new metadata properties per recommendation, such as title, description, mood-based, sleep-based, and duration, enabling more customisations and personalisation.
Model Spotlight
Anthropic is an artificial intelligence research company based in the San Francisco Bay Area. Founded in 2021, the company focuses on developing safe and ethical AI systems, particularly AI assistants capable of open-ended dialogue and a wide range of tasks.
Anthropic has created notable models like Claude, and explores techniques such as ‘constitutional AI’ to imbue their AI with robust ethical principles. Led by a team of prominent AI researchers, Anthropic is positioning itself as an emerging leader in the field of beneficial AI development, working to ensure AI capabilities advance in alignment with human values.
Claude 3 Sonnet
We chose Claude 3 Sonnet for its ability to process and summarise large data, including Calm app transcripts. Its large content window generated detailed user profiles, crucial for Calm’s personalised recommendation engine. Claude 3 Sonnet’s efficient data management made it the preferred model, especially paired with Mistral, resulting in 100% explainable recommendations that improved transparency and trust.”
Have a play
Discover the Calm app
You can download the Calm app for both Google Play and the App store.
Get in touch
Want to learn more?
Seen a specific case study or insight and want to learn more? Or thinking about your next project? Drop us a message!