Usability Testing
Project: Ultimate Sackboy
Ultimate Sackboy, an endless runner game developed by Exient, is available on the Apple Store and Google Play. The game plunges players into the captivating universe of Sackboy, a renowned hero from PlayStation. Your mission is to guide the character through an exhilarating run, dodging obstacles and striving to reach the goal while earning valuable points. I had the delightful opportunity to contribute to the development of several features within this exciting game.
Details
01
Role
Product/UX Designer
02
Date
November 2020 – January 2022
03
Skills Used
Usability Testing
Survey Design
Qualitative Research
Observational Recording
Qualitative Documentation
Feedback Resolution
04
Tools Used
PlaytestCloud
Microsoft Excel
Microsoft PowerPoint
Confluence
The Challenge
How can we determine whether players grasp the fundamental game mechanics before launch? How do we ensure a seamless user experience?
The Solution
Conduct qualitative usability tests involving a select group of players at different stages of the development process.
01
The Process
Here I will only give an overview of one of the initial usability tests we’ve administered on this project.
In preparation for the usability test, I began by selecting a suitable sample of test users that closely align with our target audience and the identified market segment. These selections were made in accordance with the personas we had previously developed. The following where our criteria for the testers:
Each usability test was conducted using Playtest Cloud, a platform designed specifically for playtesting mobile games throughout various stages: prototyping, development, soft launch, and post-release. This platform records video footage of the entire gameplay session, providing visual insights into players’ interactions, including the specific areas of the screen they touched. Additionally, players provided real-time commentary as they played, and we received transcripts of their comments.
I then designed a survey to follow each playtest, delving directly into the key issues we aimed to look into, supplemented with relevant images for reference. By default, the survey was limited to 10 questions.
02
The Results
After wrapping up the playtests, I kicked things off by creating player profiles. This not only gave me a clear picture of our testers but also helped me put their results into context, considering their gaming experience levels and favorite genres.
I then gathered and analysed the survey results, looking at how each answer connected to their previous responses and those of other testers
Afterward, I took note of any extra verbal or behavioral observations while reviewing the video recordings. Each playtest session had a duration of 15 minutes.
Next, I categorised the primary issues that surfaced from both the gameplay recordings and the survey responses. These issues encompassed usability, game mechanics comprehension, and overall playability. Additionally, I made note of any direct positive and negative feedback provided by the testers.
03
The Deliverables
Finally, I compiled a report detailing the breakdown of all the findings along with potential solutions. I presented this report to the entire company, including our C-level executives, and several suggested improvements were implemented based on this report.
Here are a few excerpts from the report:
We carried out additional usability playtests during the later stages of the development phase, right up until the game’s official launch. Each test followed the same process, and if we had a larger team, I would have been thrilled to conduct even more frequent tests to guarantee the optimal user experience! 😄
More Projects
Creating a first time user experience
A UX designer & product person passionate about creating simple and innovative user experiences.