Everyday Robots

First Multimodal UI for Managing Robots

Duration

Oct. 2023 - Dec. 2023

Role

Senior Product Designer

Team

1 Product Manager
1 Head of Design
1 UX Researcher

Context

Everyday Robots are designed to assist people with daily tasks by understanding context in human language. The current models still require additional learning to perform tasks effectively.

Therefore, two types of staff manage the robots: on-site and remote.

Problem

Our users—both onsite and remote staff—were using multiple off-the-shelf tools to manage robots, leading to numerous challenges and limitations.

  1. Cluttered Desktops: Staff desktops were cluttered with numerous tabs due to the use of multiple tools and constant task-switching.

  2. Inefficient Processes: Directing robots, editing routes, locating robots, and reporting bugs were all inefficient processes.

  3. Technical Expertise Needed: Tasks such as changing routes, filing bugs, and simple troubleshooting required coding skills.


This approach wasn't scalable and needed to be addressed to meet our business goals.

Discovery &
Alignment on Scope

Defining scope:
In collaboration with the PM and UX researcher, we analyzed the daily tasks of our two user types to identify areas for optimization and define the project scope.

Hybrid approach to user journey mapping:
We modified the conventional user journey map, combining it with a service map to create a hybrid approach.

This method connects two different user types through tasks, forming a service blueprint. By identifying users' needs, pain points, and opportunities, we facilitated productive feature discussions.

Designed multimodal UI to

Show robots’ status in one look

Set-up, Trouble shoot, Change the task in one space

Streamlined help and bug reporting

Operation summary for scalable impact

Robot Status Dashboard:

Show robots’ status in one look

The goal was to enhance scalability so that one person could manage multiple robots efficiently.

To achieve this, a comprehensive view of multiple robots' statuses was essential. Given that robots can be located in various spaces, managing those within a close radius was crucial for staff productivity. Therefore, we implemented filtering and sorting options.

Step-by-Step Guide:

Set-up, Trouble shoot, Change the task in one space

Setting up robots for work and troubleshooting involves multiple steps, with varying tools and methods depending on the tasks and issues. It's important to present this information in a comprehensive and user-friendly manner, especially for staff without a technical background.

Streamlined Help and Bug Reporting:

Enhancing Efficiency Without Technical Expertise

Current staff have remarked that filing bugs can be tedious, as they need to locate logs in developer tools and use the information to fill out the bug report.

After discussions with the product manager about what information can be automatically fetched, we developed these designs.

Data Analytics:

Operation summary for scalable impact

Although this feature wasn't part of the MVP version, it became clear that having this data would be crucial for both our team and the staff. As our project continues to develop, this information is essential for optimizing robot utilization and understanding patterns in current issues.

Design System

‘Recognizably Google, but distinctively Everyday Robots‘

I aimed to incorporate Google's design philosophy throughout our design while also maintaining a unique identity.

Thank you.