The world’s first Sign-Language to Voice application.
Case Study
Prototype

overview

The Product

ECCO is the world’s first Sign-Language to Voice application to combine Smart Ring Technology, Machine Learning and AI Voice Generation to give millions of people around a new tool to communicate.

Role

Product & UX/UI Designer from conception → delivery

The Problem

The majority of technological innovation surrounding Large Language Models (LLMs) and Natural Language Processing Models (NLPs) is focused on spoken or written language. This excludes the 70m+ sign language users or nearly 1% or the global population.

The Goal

ECCO’s system will lead the convergence of 3 emerging technologies to provide sign language users the ability to translate their signs-to-voice in real-time.

• Wearable Technology • Machine Learning (ML) • AI Voice Generation

Responsibilities

Foundational Research • Competitive Analysis • Interviews • Sketching • Lo-Fi Digital Wireframes • Lo-Fi Prototype • Lo-Fi Digital Prototype • Usability Studies • Hi-Fi Digital Wireframes • Hi-Fi Digital Prototype • Accessibility Considerations

user research

Summary

Analysis of the data collected from multiple interviews, cross-referenced with insights from empathy mapping, reaffirmed initial design assumptions while illuminating elements which had yet to be considered.

This process facilitated the continued emphasis on a User-Centered design by narrowing the scope and prioritizing key functions.

pain points

Accessibility

Challenges arising from a world in which its design often does not consider accessibility

Occupational Equity

Significant barriers to entry for many industries and professions

Video Capturing

Using cameras to capture signs can be intrusive and difficult in certain situations

user persona

competitive audit

Competitive Audit

initial designs

Sketches

Sketches were done to easily and quickly get a sense of the basic required flow. These sketches and the exercise itself provided an excellent opportunity to better understand both the main user flow and, more importantly--the user experience.

Lo-Fi Wireframes

Onboarding

An initial setup onboarding was included to establish a user’s personal size and range of motion. This information is compared to the system’s base line and adjusted for the specific user.

Lo-Fi Wireframes

Training

Training modules were included to identify the user’s Unique Signing Signature (USS). This information is also compared to the system’s base line and adjusted based on the results. When training is complete a system recognition test is conducted to determine the accuracy of the translations.

Lo-Fi Wireframes

Main

After completing the onboarding setup and training modules the user is brought to their Home screen. Here, users can quickly switch between voice profiles, create new voice profiles and access further training to help the system provide faster and more accurate translations.

lo-fi prototype

usability study

Summary

Usability studies were conducted resulting in valuable information gleaned from all testers. These studies helped in the progression from low-fidelity → high-fidelity by highlighting areas of the application that require improvement. Key items included information descriptions

Methodology

Usability studies were conducted resulting in valuable information gleaned from all testers. These studies helped in the progression from low-fidelity → high-fidelity by highlighting areas of the application that require improvement. Key items included information descriptions

PROCEDURE

Moderated
LOCATION

Remote
DATE & TIME

Sep. 9th - (9:00am - 9:00pm)
Sept. 10th (11am - 6pm)
RESEARCH CONDUCTION

All 5 participants will complete the outlined task on their own. Upon completion they will complete the SUS survey
TIMELINE • APPROX 30min

• 0-5 min - Introduction & Appreciation
• 5 min - 20 min - User task
• 20 min - 25 min - Questionnaire
• 25 min - 30 min - Appreciation & Incentives

themes & insights

Themes

• Users may not be aware of the ‘New’ or ‘Custom’ options
• Users are not provided adequate explanation of certain steps
• Some users did not intuitively understand ‘Home’ functions

Insights

• A simplified selection screen can be added for  voice profile selection
Learn More button can be included to supplement descriptions
Tour option can be added post-onboarding completion

mockups

hi-fi prototype

accessibility considerations

Summary

ECCO, at its core, is an accessibility driven application providing new methods of communication for the deaf and non-verbal community.

Deaf Community

ECCO allows people of the deaf community to seamlessly converse with the hearing enabled community

Non-Verbal Community

ECCO allows people of the non-verbal community to seamlessly converse with the hearing enabled community

Mobility / Dexterity

ECCO accounts for all body shapes, sizes and abilities. Limited mobility or dexterity is not a problem for ECCO :)

site map

responsive designs

takeaways

Impact

ECCO has the ability to provide millions of people a new tool for communication. Not just for the deaf/non-verbal community but for humanity at large.
Life-changing potential”

What I Learned

Considering accessibility benefits everyone. The more inclusive our technology and society becomes, the better life is for everyone! :)