Tackling the challenge of remote testing on mobile devices

Emma Davis

Despite it being one of the more time consuming research methods, I’m a big advocate for moderated usability testing. 

There’s nothing quite like watching somebody try to use a service to really hammer home what that experience is like for them. Sometimes you can learn far more just by watching one person complete a task than you could ever hope to get from hundreds of survey responses.

Carrying out this kind of testing remotely has its challenges but this has got easier as more people get comfortable with using video meeting platforms like Zoom and using features like the camera and screen share. 

However, when you start testing on mobile devices, it adds a whole other level to that challenge! Not everything works quite the same and many of the video meeting features on mobile devices are not as robust as the desktop experience.

So, as part of Operation Continuous Improvement, I’ve been looking at ways we could improve how we carry out moderated testing on mobile devices. 

In theory, using Zoom to screen share from your mobile or tablet is easy enough, just by clicking a button in the app, but there are still a number of things to consider that are different to using a desktop or laptop.

For example, an automatic screen lock on a mobile can cause the screen sharing feature to crash and participants might want a heads up that their incoming notifications can be seen, so they can switch on ‘Do Not Disturb’ mode.

To help ensure we cover these points in any sessions we run, I’ve set up a run sheet specifically for this type of testing.

We’ve stress tested the method within the team, which included me carrying out Zoom calls with myself, between my laptop and mobile, trying to answer questions such as “How does the iPhone and Android experience differ?”, “What happens when you use the chat function?’” and “Can you log into a Zoom call with the same account on multiple devices?”.

But as any good researcher knows, the real proof comes from testing with users. I’m looking forward to seeing how this works with research participants when we get the opportunity to try it out in the new year. 

Related Case Studies

Alpha phase for the adult social care Workforce Development Fund, for Skills for Care

An alpha phase to explore possible improvements to the Workforce Development Fund claims process

Discovery on trainee information systems for the National School of Healthcare Science

We were appointed by the National School of Healthcare Science to conduct discovery research to help inform the procurement of…

More from the Author

Emma Davis

User researcher

Emma Davis 07/07/2022

My mentorship journey at Lagom

A blog by Yaqi Li I was…

Emma Davis 14/12/2021

Tackling the challenge of remote testing on mobile devices

Despite it being one of the more time consuming research…

Emma Davis 01/12/2021

Learning how to have effective conversations with vulnerable people (and why it’s important)

Recently I attended an online training day on conversations…