Evaluating digital health products
Sophia is a nurse working in a hospital. She wants to be able to recommend the best quitting smoking apps for her patients. But there are so many apps out there, and she doesn’t know which ones work.
There are now over 318,000 health apps available on the top app stories worldwide – with more than 200 apps being added each day (IQVIA, 2017). Public Health England recognised that cross the health sector there are lots of digital health products being developed, but we have little knowledge of whether they achieve their intended health outcomes. I’ve been working as the lead service and interaction designer in an agile, multidisciplinary team to design a service that supports digital teams to better evaluate their products.The Solution
We identified that teams may not have the expertise to carry out evaluation. As well as this, they may not have the support and the organisational culture they need to evaluation their products. To address this, we designed an evaluation service which includes an evaluation guide, training and a community to share knowledge and ask questions.An Accessible Evaluation Guide
The guide gives step-by-step instructions on how to carry out evaluation. I designed a coded a prototype to test the guide. A content designer and evaluation expert were brought on board to create the guide’s content. We carried out 6 rounds of usability testing to make the guide intuitive to people who are new to evaluation. Our accessibility audit and testing ensured that people with a variety of access needs can use it.Easy to Run Training
In collaboration with evaluation experts I created an evaluation training package, so that an evaluation novice can: learn about evaluation and carry out activities be better informed to commission evaluation Many teams participated in the evaluation training, their feedback allowed us to iterate the training. This way the training is understandable to users and ensures they learn the evaluation basics.The Team
Product Manager: Hasan Ali
Content Designer: Flora Death
Service and Interaction Designer: Charlotte Fountaine
Service Owner: Kassandra Karpathakis
Delivery Managers: Rosmari Mitova, Bobak Sadaat
Evaluation Expert: Henry Potts
User Researcher: Anya Zeitlin
The evaluation guide is available to all on GOV.UK. The training has been run with 15 teams across the health sector, with a positive response. This was one of the first digital products to be delivered at Public Health England Digital, trailblazing the use of design in the department.