Spotify Search
Using multi-modal inputs to create a more creative search experience.
"Search Reimagined" The search box is a piece of UI that became part of our standard digital lexicon over 20 years ago. Be creative in re-thinking how users could interact with a search experience.
How might we redesign the search UI for multi-modal inputs?
Mobile UI
UI/UX
Speculative Design
Locating Where to Search
In a brainstorming session with the team, we explored how we could apply our knowledge of search to craft a new, dynamic experience. I eventually focused on designing a creative, artistic, and emotive way to search for music on Spotify.
How might we redefine music search to allow a user’s creativity to guide their experience?
With this in mind, I crafted a flow where users could discover new music using a mix of image recognition and AI based on abstract drawings they created.
Refining the Concept
During another group session, I received valuable feedback on how to enhance the idea by incorporating AI to find album covers based on the user’s art. By using the phone’s camera, users could discover music through the world around them. This concept led me to develop two additional flows focused on using the camera as the primary method for searching for music.
Defining the Experience
After creating a low-fidelity click-through prototype to get a sense of the flow, I transitioned the project into ProtoPie for high-fidelity interactions. This allowed me to design and simulate each instance of drawing, capturing images through the camera, and scanning for music.
ProtoPie’s ability to create advanced interactions—such as multi-touch gestures, device sensors, and conditional logic—was crucial in bringing my ambitious flows to life. This enabled me to simulate a real application experience, adding depth and interactivity to the concept.
In the end, I successfully created a unique and creative search experience within Spotify, allowing users to enjoy a truly dynamic and engaging way to discover music. View the video below to see how all the pieces come together.