As part of a 10-week Microsoft-sponsored project, I collaborated with a team of three to conduct a usability study of Power BI’s newly introduced Compact View in the Metrics module.
This feature enables users to track KPIs in a condensed format. Our objective was to uncover usability issues that hinder productivity and propose actionable design recommendations to enhance the overall user experience.
ROLE
Usability Testing, Design Recommendations
TEAM
2 Design Analysts, 2 UX Researchers, 1 PM (Microsoft Team)
DURATION
10 weeks
KEY RESULTS
initial SUS score from 9 usability tests
increase in user engagement
reductions in number of clicks to customize column settings
Microsoft Power BI is a business intelligence tool for interactive data visualization, and part of the Microsoft Power Platform. Its Metrics feature lets users track and manage KPIs or goals in one place, promoting alignment and accountability across teams. The newly introduced Compact View presents these metrics in a condensed layout, enabling users to scan large volumes of KPIs more efficiently.
Compact view mode in Metrics feature
Final design with recommendations
To evaluate and improve the discoverability, findability, and readability of the Compact View in Power BI’s Metrics feature, considering users’ varying levels of experience with business analytics platforms.
1. Understand Product
2. Understand Requirements
3. Setting Project Scope
1. Usability Test Plan
2. Pilot Study
3. Update Usability Plan
1. Conduct Usability Tests
1. Test Analysis
2. Design Improvements
3. Stakeholder Presentation
After aligning with the Microsoft team to understand the product and its requirements, we collaborated internally and with the Microsoft Product Manager to identify the key features for usability testing and define the intended business outcomes.
✦ Improve user efficiency and workflow
✦ Boost adoption of Compact View
✦ Enhance overall user experience
✦ Evaluating the discoverability of 'Compact view'
✦ Evaluate the findability of the 'Edit mode'
✦ Understand user expectations for customization options in compact view.
Do the users know that a compact view mode exists and are they able to find it.
Assess whether users can easily locate and enter Edit Mode to modify column settings.
Identify effective design patterns that align with user expectations for customizing column settings.
Finding #1
✘ 5/8 participants couldn't locate Edit Mode as they focused only on the scorecard.
✘ 50% didn’t realize Edit Mode was required to edit columns.
✘ 1 participant was unsure which mode they were in.
Recommendation #1
Finding #2
✘ Participants had trouble finding the settings as they were nested.
✘ The top ‘Settings’ button was confusing and mistaken for column settings.
✔ Visual cues, like a small arrow near the column name, helped indicate hidden features.
Recommendation #2
Finding #3
✘ 87.5% completed the task in 39s, indicating low visual salience of Compact View.
✘ One participant found Compact and List icons identical and unclear.
✔ 50% said the word “View” helped locate Compact View.
✔ 3/8 found the location consistent with other tools.
Recommendation #3
The design recommendations improved the discoverability of key features like Edit Mode and Compact View, reducing user confusion and task time. Clearer labels, distinct icons, and better visual cues helped users navigate more efficiently and with greater confidence.
initial SUS score from 9 usability tests
increase in user engagement
reductions in number of clicks to customize column settings
I learned how to navigate diverse stakeholder priorities while working within the complexity of an enterprise product.
This study taught me to recognize and set aside my own assumptions, letting real user behavior guide design choices.
I would recruit more diverse set of demographics in the participant pool for better understanding the usability issues.
Having a more deeper understanding of the platform before conducting the usability tests would have helped facilitate more effective sessions and ask sharper questions.
Brewed with ☕ and 🦉 nights
