Methods
The study was conducted in a clinic setting that houses three separate practices: an internal medicine resident clinic, an internal medicine-paediatrics resident and faculty clinic, and an obstetrics-gynaecology clinic staffed by midlevel practitioners. The clinic serves a multiethnic community mostly insured through state-sponsored programme. The clinics share a clerical staff that consists of eight individuals. Each clinic has its own nursing staff. There are five medical assistants who are assigned to a single clinic but occasionally rotate between the clinics. There is a single phone number to reach the front desk of all of the clinics, and patient phone calls are directed to the appropriate clinic’s staff if there are medical questions or concerns. To refine our challenges further, an exploratory small-scale patient satisfaction survey (n=26) within the clinic in November 2016 revealed that patient satisfaction with their clinician was generally high but patients were dissatisfied with their interactions with the clinic by phone. Based on this feedback, our quality work focused on optimising the telephone triage system. In particular, our measurements included (1) if patients felt their questions were answered more frequently than prior, (2) if patients felt that appointments were easier to make than prior, (3) if questions were answered in <24 hours and (4) if these interventions resulted in decreased use of emergency services.
Further investigation into clinic workflow regarding patient telephone calls was performed as part of a quality improvement initiative in December 2016 to February 2017 (figure 1). These investigations included mapping phone call transfer patterns, shadowing operators using a training headset to understand operator workflow and soliciting direct input from doctors and clinic staff. Investigators learnt that the clinic has a live telephone system staffed by two bilingual (English/Spanish speaking) operators during business hours only. After an initial triage process, calls were transferred to other clinic staff as appropriate. Additionally, operators did most of the appointment scheduling, which was helpful for the workflow of other staff at the clinic check-in and check-out desks, but led to a long queue of patient callers who had to wait before reaching an operator.
Figure 1PDSA cycles. PDSA, plan, do, study, act.
Following the initial data gathering stage, the main challenges of the phone system were determined. The largest part of delay for patients calling the clinic was the wait time before speaking with an operator, and there were often large queues of patients (>10) waiting to speak with an operator. There was a high volume of incoming calls with one call every 2 min and 40 s during the time observed. The operator time was often spent scheduling appointments. The information from patients who left voicemails was recorded in composition books rather than in the electronic medical record (EMR).
To better characterise the patient experience and provide a baseline, a more comprehensive patient satisfaction survey was administered in English and Spanish (n=200) in March 2017. Assuming an effect size of 0.3, alpha of 0.05, and a power of 0.80, a total sample size of 290 participants were needed (145 in each group).9
The front desk clerical staff handed the satisfaction survey to the patients while were waiting for their appointments. Patients were asked via Likert scale about their experiences leaving messages for clinic staff, and whether they got their question answered when they called. They were also queried about ease of making appointments and whether they were treated with respect. Finally, they were asked if they had gone to an urgent care or emergency room because they were unable to get in touch with a provider at the clinic. No personal information was gathered as part of the survey in order to preserve anonymity, so it is unknown if any of these patients had participated in the exploratory survey.
From these data as well as the clinic workflow evaluation, a three-pronged intervention was developed: monthly quality and safety lunchtime meetings were initiated for the clinic staff, resident clinic schedules were ‘opened up’ further in advance to allow more appointments to be scheduled before patients left the clinic and all voicemail messages were required to be entered into the EMR. These interventions were chosen because they were hypothesised to improve the focus on quality and safety in the clinic, reduce the call volume to reduce the strain on call operators and the queue of waiting patients and increase the likelihood that the patient’s question would reach the appropriate person.
The design of the monthly quality and patient safety meetings had a unique feature: rotating monthly leadership. Clerical staff, medical assistants and nurses were encouraged to lead the meeting, share their perspectives and design solutions to concerns. The meetings were well-attended and staff members had significant pride in the shared achievements. The inclusion of all clerical staff, whose voices are not often heard in quality initiatives, engendered buy-in and ownership of the changes that were made from the meeting. This disrupted the traditional top-down management approach of many operational meetings.
A follow-up survey patient satisfaction survey was administered 1 year after the initial exploratory survey in November 2017, and ~6 months after the interventions were deployed. The survey included all questions from the baseline survey (n=215). The differences between responses between the two surveys were analysed using either Student’s t-test or χ2 test, depending on the number of possible responses. Statistical analyses were conducted using SAS V.9.4. The project was reviewed by the Yale Institutional Review Board and was granted an exemption.