Multimodal application store for SberDevices

1. Overview

Sber creates many applications and gets even more from third-party developers to spread their digital ecosystem. Also, Sber created a family of virtual assistants 'Salute' to manage their hardware with voice and gestures. and SmartMarket — store for applications that use Salute features, so-called 'SmartApps'.

We conducted 20 interviews and used a JTBD framework to highlight core problems

3. Research & Insights

Our team consisting of three UIX designers was offered to find a way to attract new customers to SmartMarket and engage them in using virtual assistants, in other words — it is needed to create a brand new user experience

2. Goals

The solution we offer is to introduce virtual assistants which remember the preferences and choices of the user. Then, these assistants will offer their most relevant skills via internal ML search.
For example, if I order a meal in a food app, my virtual assistant will remind me to use this app or to make the order directly through him next time.

4. Solution

We found out that people do not know the abilities of virtual assistants and where to learn about them, also there is a problem finding application which does exactly what you needed

We conducted 12 UX-tests and made minor improvements in scenarios as a result.

7. UX-testing

6. Prototyping

For our proof of concept, we have chosen the mobile phone as the platform because it is the only thing that is with you throughout the day. We created a mobile prototype with 3 core scenarios: onboarding, creating a clock alarm with favorite music as a sound, and making an appointment in the scheduler

5. Metrics of success

We provided our research results and prototype with the slide deck and presented it to stakeholders

8. Results

We also drew some UI screens for TV and made some suggestions about the future of SmartMarket.

9. Next steps