BRIEF

Extreme Logistics

So you’re a DSP, managing dozens of drivers, a fleet of sprinters, step vans, smartphones, scanners, safety vests, steel toe boots, and tons of HR documents on your employees; some digital, some paper. Each of your drivers deliver between 150 to 350 packages per day in dense cities, rural countrysides, and across state lines with varying traffic laws. You’re constantly training, onboarding and off-boarding roles for your ceaseless business.

Every six months or so, you get an email from Amazon’s compliance auditors, requesting data on five randomly chosen drivers. You have about two weeks to gather and submit the data, or risk indefinite termination of all operations. In the email, there’s a portal link to upload the set of documents for the selected drivers.

You are not aware of the accepted document formats, how to obtain them, when they will be reviewed, the criteria for their acceptance, nor how long the reviewing process will take. If you need help, your best option is to call another DSP who has passed their compliance audit before, and preferably within the past six months, because the rules may have changed. Good luck.

Compliance Dashboard  picture_as_pdf Audit Wizard  picture_as_pdf
Outline
  • Timeline
    September 2020 – May 2021
  • Employer
    Amazon, Last Mile / Atlanta, GA
Responsibilities / Tools
  • User Research / User Interviews
  • Usability Testing / Sketch, Adobe XD
  • Executive Buy-in / Quip, Keynote
  • Design System Accessibility / Meridian

AUDITING IN EXCEL

* Some business and individual names have been redacted to protect their identity.

On Amazon's side, compliance auditing is a strenuous, manual task done in Excel. This process can take weeks with only sparse email communication keeping DSPs in the loop on its progress. Through our DSP and auditor interviews, we decided both parties needed a compliance dashboard.

In the above screenshot, the DSP has technically earned a passing grade of 92.1%, but if the areas highlighted in yellow and (especially) red are not corrected before the next audit round, the DSP's business could be penalized. Each of these areas of improvement are document-related. Another concern was the use of only color to identify what needs attention. For a colorblind user, these important aspects of the audit report are virtually invisible without reading it in its entirety.

Also in the case above (and in most, as our research suggested), the I-9 forms for this DSP's drivers were incomplete. Using E-Verify to onboard these drivers could have flagged the incomplete sections beforehand, but its use is not required in the state of Massachussetts, where this DSP operates. Nuances like these may seem small, but were quite common flags during compliance audits.

COMPLIANCE DASHBOARD WIREFRAME

In the design below, widgets for an existing safety dashboard and scorecard were referenced for the compliance data points, however all colored text and data bars had to be darkened to pass accessibility color contrast standards. Arrow icons denote changes in points within tables so that important information doesn't rely on color alone to be conveyed.

COMPLIANCE DASHBOARD

Before creating the initial wireframes for this concept, we interviewed 13 DSPs on their compliance process pain points and ideas for improvements. We immediately detected a theme when at least four of our research participants requested a "compliance dashboard" by name.

Our interviewed DSPs overwhelmingly cited Amazon's lack of transparency during audit season as their reasoning for this specific design request. In short, they wanted an online portal where they could log in and proactively check their compliance status whenever they wanted. Importantly, this potential solution could send tailored automatic notifications, reducing the need to send one-off emails to auditors just to anxiously await a sometimes inadequate response. On Amazon's side, an audit wizard with a robust CMS could digitally walk a DSP through the entire auditing process, with necessary updates to guidelines and local laws ready to be pushed at will.

Along the transparency theme, the other main pain point was Amazon's lack of proactive training materials on how to pass a compliance audit with a healthy 90+ score. For some DSPs, they didn't even know about routine compliance checks until they received their first audit request email. DSPs had other ideas such as tracking driver's license expiration dates, tracking scheduled breaks taken and reported by drivers, and even the ability to request a mock audit to keep them on top of their game. DSPs like being proactive.

AUDITS DASHBOARD

Since auditing is such a regular, yet complex process (and I was designing this around tax season), we wanted to test an 'audit wizard' experience with DSPs. Comparing this concept to Intuit TurboTax made for an easy design initiative to explain and get stakeholder buy-in for. This was leveraged in the following designs to pull out parts of the overall document submission process into digestable steps.


The DSP would start by clicking "Begin audit submission."

AUDIT WIZARD

When testing these designs with DSPs, they always chose the longer route of submitting data with Amazon's guidance, regardless of how many audits they'd passed previously.

AUDIT WIZARD: I-9 FORMS

Since I-9 forms were the most common flag that tripped up DSPs, I designed the workflow to offer relevant form guidance while focusing on taking advantage of Amazon's machine learning tech to scan documents for errors. It was well-received by DSPs to stress the importance of streamlining and automating as much of the audit experience as possible.

AUDIT WIZARD: SUBMISSION SUCCESSFUL

AUDIT WIZARD: TRACK PROGRESS

01 / Being a DSP is Hard

Delivering packages does not stop and DSPs do not sleep. The last thing they have time for is digging up paper on drivers who may not even work there anymore.

02 / Being a Compliance Auditor is Hard

Pushing paper and data is for machines. Automating auditing allows Amazon compliance auditor to focus on helping DSPs rather than color coding cells in spreadsheets.

03 / Boring Stuff Can Have Cool Solutions

Compliance might as well be a dirty word. A routine albatross. But there was nothing boring about DSP and auditor enthusiam when we showed them the screens their ideas produced.