Backroom Augmented Reality

Between 2019 - 2020 I worked with a team of PM's and Engineers to evaluate and improve an inefficient inventory process. Our research led us to build an augmented reality experience that helps Walmart Associates complete the process 70% faster.

Backroom Augmented Reality

Between 2019 - 2020 I worked with a team of PM's and Engineers to evaluate and improve an inefficient inventory process. Our research led us to build an augmented reality experience that helps Walmart Associates complete the process 70% faster.

Backroom Augmented Reality

Between 2019 - 2020 I worked with a team of PM's and Engineers to evaluate and improve an inefficient inventory process. Our research led us to build an augmented reality experience that helps Walmart Associates complete the process 70% faster.

Discovery

Our team visited several stores and worked several shifts to grow our understanding of the problem area. Along the way, we interviewed many Store Associates, Home Office subject matter experts.

Interviews

We interviewed members of our client success team and some of our clients to gather insights.


We learned that we only had one client who was actively using Scheduling because the original feature was built to their requirements. Other clients were using different scheduling methods outside our platform that had additional features.

Service Design

I created a service and journey map from these experiences and interviews, which helped us see the big picture and identify the largest opportunities.

Define

Using our service journey map, we identified and prioritized the most important problems to solve. We prioritized a list of ~15 major problems based on level of impact, downstream effects (multiple problems could likely be solved by solving a single problem), and how quickly we thought a problem could be solved.

We prioritized shortening a lengthy process, and building trust that the system was giving accurate information.

Lengthy Process

Associates didn't have enough time to complete the process accurately, creating incorrect data.

Lengthy Process

Associates didn't have enough time to complete the process accurately, creating incorrect data.

Lengthy Process

Associates didn't have enough time to complete the process accurately, creating incorrect data.

Trust

Associates didn't trust the system to give them accurate instructions, leading to inaccurate results and lost time.

Trust

Associates didn't trust the system to give them accurate instructions, leading to inaccurate results and lost time.

Trust

Associates didn't trust the system to give them accurate instructions, leading to inaccurate results and lost time.

Problem Statement

As a Walmart Associate working in the backroom, I need a way to quickly record inventory counts. I also need to be able to trust that the system is giving me accurate results.

Design

Environment

Iterations

We prototyped different backroom and process configurations in multiple stores to design a shorter and more trustworthy process.

Iterations

We prototyped different backroom and process configurations in multiple stores to design a shorter and more trustworthy process.

Iterations

We prototyped different backroom and process configurations in multiple stores to design a shorter and more trustworthy process.

Solution

Ultimately we created an easier numbering system for backroom locations, including a way for AR devices to interact with backroom locations and inventory.

Solution

Ultimately we created an easier numbering system for backroom locations, including a way for AR devices to interact with backroom locations and inventory.

Solution

Ultimately we created an easier numbering system for backroom locations, including a way for AR devices to interact with backroom locations and inventory.

Technology

Iterations

We tried out various levels of technology (including removing existing technology). We also explored different technology solutions like RFID, AR, and other hardware implementations.

Iterations

We tried out various levels of technology (including removing existing technology). We also explored different technology solutions like RFID, AR, and other hardware implementations.

Iterations

We tried out various levels of technology (including removing existing technology). We also explored different technology solutions like RFID, AR, and other hardware implementations.

Solution

Removing the mobile devices turned a couple departments into chaos for a couple weeks. AR headsets were a cool idea, but ultimately too costly. We ultimately decided to build an AR experience built for the existing handheld device.

Solution

Removing the mobile devices turned a couple departments into chaos for a couple weeks. AR headsets were a cool idea, but ultimately too costly. We ultimately decided to build an AR experience built for the existing handheld device.

Solution

Removing the mobile devices turned a couple departments into chaos for a couple weeks. AR headsets were a cool idea, but ultimately too costly. We ultimately decided to build an AR experience built for the existing handheld device.

User Interface

Iterations

We had to achieve a balance of information density and minimalism. AR can be overwhelming to users, and it can be tricky to strike the right balance between too much and too little.

Iterations

We had to achieve a balance of information density and minimalism. AR can be overwhelming to users, and it can be tricky to strike the right balance between too much and too little.

Iterations

We had to achieve a balance of information density and minimalism. AR can be overwhelming to users, and it can be tricky to strike the right balance between too much and too little.

Solution

We used a thumb-sized marker to indicate that the device read a box label. These markers would indicate whether action was needed on the box or not, and whether it had been picked by the user. The user could long press on any marker to see more information about the item.

Solution

We used a thumb-sized marker to indicate that the device read a box label. These markers would indicate whether action was needed on the box or not, and whether it had been picked by the user. The user could long press on any marker to see more information about the item.

Solution

We used a thumb-sized marker to indicate that the device read a box label. These markers would indicate whether action was needed on the box or not, and whether it had been picked by the user. The user could long press on any marker to see more information about the item.

High Fidelity Iterations

I also do a lot of experimentation in Figma and other prototyping tools. I aim to always have some kind of artifact to show at project checkin's, design reviews, or other encounters with stakeholders. Having something for everyone to look at and critique frequently was instrumental to the success of this project.

Accessibility

There's a lot of data points involved with scheduling a project that a user needs to see to make informed decisions. Many users asked to see more color to make things like project priority or status stand out. We made sure to use color lightly and accessibly.

Deliver

Our solution cut the time to complete this process down by 70%. It makes Associate's jobs easier, and because we removed other error points the system is much more accurate and trusted to deliver correct information.

Our solution cut the time to complete this process down by 70%. It makes Associate's jobs easier, and because we removed other error points the system is much more accurate and trusted to deliver correct information.

Intro

Discover

Define

Design

Deliver