Users spent 3× longer in the 2D version. The 3D metaverse was pulling effort away from the core product.
Case study 1 · Product testing
Testing a new app with the people it was built for
The challenge
ZIYX had built a new version of their app. They needed to know if it worked for their target users. These were young people not in work, education or training, who hadn’t gone to university.
The app was built on guesses about how people would use it. That included a 3D metaverse, which was a big investment.
ZIYX needed three answers. Did the onboarding work? Did the core experience hold this audience? And was the metaverse worth building further?
What I did
I ran a survey with 1,200 people, all from the target group. They came through four email campaigns with partners. I found and secured two of those partners as part of the project.
I also interviewed 10 people about how they moved through the app.
The first round led to a full redesign of the onboarding. The 3D experience became a 2D questionnaire, laid out as a journey along a road. This gave users a sense of progress.
A second round then tested the new version.
The results
Users spent three times longer in the 2D version than the 3D version. Time spent and positive reviews both showed the simpler version was far more engaging.
The research led to a clear recommendation: drop the metaverse and focus on the core 2D experience. The metaverse was costly, and the basic experience hadn’t been tested yet.
The data made that case clearly. The work led to two new versions of the app.
“You showed us we were building far too much – users couldn’t engage with any of it until we had a really strong core to build on.”
