Making Problem Solving Treatment (PST) Accessible
Problem
Our research showed that the quality of PST delivery suffered during the pandemic because of the prevalence of remote sessions. In fact evidence-based clinical interventions are often delivered with poor fidelity and abandoned by practitioners soon after training.
​
In response to these findings, we have worked with practitioners and clients to co-design an automated decision support tool supporting Problem Solving Treatment (PST) for depression.


Solution
We conceptualized PST-Aid is a web-based app that promotes practitioner–client collaboration in the use of PST for goal setting action planning, and educating.
Team Included
UX Designer, Clinical Psychologist, PCP, and the Co-Director of UW ALACRITY Center
​
My Role
User Research & Design Lead​​
Problem Solving Treatment (PST)
A brief, evidence-based approach that teaches and empowers patients to solve the here-and-now problems contributing to their depression and helps increase their self-efficacy and is:
​
-
Effective with the majority of patient populations.
-
Typically involves six to ten sessions, not open-ended, ongoing therapy.
-
The purpose is to teach the problem-solving technique to the patient so that they can use it on their own.​
-
Uses a worksheet each session that contains 7 stages.

7 Stages of PST
Identify the problem
Goal
setting
Brainstorm options
Weigh the
pros and cons
Select the
best option
Create an
action plan
Evaluate
the outcome

Problem
Our research showed that the quality of PST delivery suffered during the pandemic because of the prevalence of remote sessions.
Therapists were forced to fill out the worksheets on behalf of the patients during sessions:
-
Despite the understood priority of having the patient take the lead in filling out the forms.
-
This undermined the goal of preparing patients to continue using this problem solving method independently after they completed treatment.
Our online tool allows the worksheets to be filled out by multiple users in real time, regardless of their location.
DISCOVER PHASE
Understanding User Needs
-
We observed 9 clinicians new to PST undergoing training-as-usual.
-
We interviewed 9 experienced PST clinicians, and 2 PST trainers to understand where both clinicians and clients could use support.

Affinity Diagram
We used Affinity diagramming to identify themes and support needs for PST.

Timeline of Support Opportunities
We were able to examine PST from various angles, looking for opportunities; mapping out what goes on when and where.

Design Phase
We analyzed our insights and began capturing design requirements and brainstorming possible solutions for our tool.

Remote Co-Design Sessions
We set up two co-design sessions each with three experienced therapists we had previously interviewed about using PST. We facilitated a series of activities over a 90 min session.
​
This storyboard was shared to help explain the concept of a digital tool to support the successful delivery of PST.

Illustration by Emily Friedman
Co-Design Sessions
-
Because these were REMOTE co-design sessions, to make them more engaging we mailed the participants signs to hold up as we ran through a list of potential features.
-
Besides being more fun, by having them vote at the same time we were able to reduce the likelihood of the participants influencing each other’s answers.

​Alex Lopez, our UX Designer (top left), and I (center) in Co-design sessions
Build Phase
We built high fidelity working prototypes of both the desktop and mobile versions using Figma so that we could put it in front of both patients and therapists for their feedback and to refine the details

User Testing
The PST-Aid in action and some of the enthusiastic responses we got.
User Testing
We randomized 5 clinicians to PST Aid and 3 to PST training-as-usual, then evaluated and observed their therapy sessions.
We assessed:
-
PST usability and appropriateness for clinicians and their patients.
-
Adoption of PST by clinicians.
-
Depression severity after 9 weeks of treatment.
(PHQ-9 and GAD-7 assessments)

Study Results
-
PST Aid was found to be acceptable, with adequate usability.
-
Treatment Fidelity:
-
4/5 clinicians in the PST Aid group certified in 2 sessions (fastest possible);
-
only 1/3 PST-as-usual clinician was able to certify.
-
-
More practitioners in the PST-Aid group adopted PST after their certification, than those without the tool,
-
And patients from both groups showed reductions in their depression scores.
Positive Feedback
“I like that everything is there that you would want or need. I wish I had that!”
- Patient
“I really liked it. It had helpful reminders of what to do next, helpful prompts to be more thorough in each step… A lot easier to use than having to organize paper copies.”
- Therapist
“I think this is especially great for beginning therapist and patients being able to do it on their own. ”
- PST Trainer
Next Steps
To further redesign PST Aid by working with stakeholder groups from our partnering OCHIN health informatics network, we will:
-
Train 60 practitioners from 20–30 clinics in PST, and then randomly assign them training in PSTAid vs PST as Usual.
-
Recruit up to 350 clients with elevated depressive symptoms.
-
Conduct a hybrid type III effectiveness-implementation randomized clinical trial.