Feedback

Providing Feedback is part of Talking about performance, the third “T’ in the “3T Teaching blueprint” (shown below).

 

“Talking about performance” is made up of two parts, feedback and evaluation. Feedback and evaluation are separated because they are different entities and they serve different purposes. This section focuses on Feedback. 

Feedback. What, Why, How

Below is the “What”, “Why”, & “How” of Feedback.  Each section provides more information about what feedback is, why it’s important and how to give feedback.

What is Feedback?

Feedback is the process in which an attending verbally informs his/her learner (student or resident) on their performance. It is often informal and done at high frequency, often multiple times during the day. It is also done at the end of the day. The purpose of feedback is to give information to the leaner so they can use it to correct mistakes and reinforce positive performance. Feedback is not tracked by GME or medical schools.

Why feedback is important.

Giving good feedback helps you, helps them (residents & students) and helps us (GME). Click below to find out more.

Global reasons for Feedback

 

The dynamics between the learner and the teacher behave like a system. The simple, yet effective, definition of a system is: 

The teacher and learner are elements, they inter-connect and they have a purpose. System scientists have shown that feedback is critical to the long term health of any system.

Feedback is how a system knows to re-calibrate and adjust its behavior. Without feedback, systems can show dangerous behavior that can lead to destructive consequences. Without feedback, a system will quickly fail.

 

How long would it take for something bad to happen in the situation depicted in the picture?
Common sense

We all know that it would not take very long for something bad to happen in the situation pictured.

Nobody would ever think of doing anything like this because it’s obviously dangerous and destructive. It’s important to understand that failing to provide feedback to residents and students can be just as dangerous as doing surgery without monitoring the vital signs. 

Feedback Helps You!

 

Correctly doing feedback is important to YOU for several reasons.

1. It builds attending-learner rapport.

2. It increases resident “buy in”. When residents “buy in” they more often give you 110% effort. This is because it lets them know that you truly care about their wellbeing and growth.

3. It increases resident attention to detail when taking care of your patients.

Improving attending-resident rapport and increasing resident “buy in” helps the resident become productive members of your health care team and increases delivery of great patient care.

Feedback Helps Them!

 

Feedback helps residents and students in the following ways

Feedback is the primary means in which a resident can gauge how he/she is progressing.

“A resident DOES NOT know if he/she is underperforming/over performing if YOU do not tell them”. 

 

Residents are essentially blind to how they are doing. What’s visible to the attendings is not visible to the residents. 

If the resident does not know what to continue doing, what to stop doing and what to start doing, he/she cannot grow.

It is also why the “lack of giving feedback” is one of the most common resident complaints about attendings.

How to give feedback

The content below details some methods of giving feedback as well as some common pearls and pitfalls. 

 

The “Sandwich” strategy

 

The “Sandwich” method is the traditional method for giving feedback to medical learners (students, residents, and fellows). It’s a directive method which involves the attending doctor directly telling the learner how he/she performed. The “sandwich” method architecture is as follows

  • Step 1: Provide the learner with feedback on something that they did well.
  • Step 2: Provide the learner with something constructive (i.e. negative feedback).
  • Step 3: Finish with providing the learner with more positive feedback.

Essentially, the sequence is positive feedback-negative feedback-positive feedback. The hope is that the sandwiching of the negative (constructive) points between the two positive points makes the feedback more palatable. In theory this makes sense, it includes an initial positive frame and a positive end effect. Which have been shown to create more positive feelings toward messages.

Unfortunately, in reality, most learners have found the “Sandwich” to be a painful, unfulfilling, experience. Learner’s are usually very familiar with the positive-negative-positive aspects of the “Sandwich” and they often ignore the positive aspects and only hear the negative feedback.

Many attendings also feel the “Sandwich” method is sub-optimal. Attendings often state that delivering feedback using the “Sandwich” method feels difficult, harmful and ineffective.

The “Ask-Tell-Ask” strategy

The “Ask-Tell-Ask” method is Dr. Stanley’s preferred method for giving feedback to medical learners (residents and medical students). This method uses a collaborative approach as opposed to the directive approach of used by the more traditional feedback methods (see “sandwich” approach above).

 

The “Ask-Tell-Ask” steps are outlined below

  • Step 1: The attending “Asks” the learner to reflect on his/her performance. This can be something the learner thinks he/she did well and/or something the learner thinks he/she could do better. Dr. Stanley likes to ask “Name one thing you thought you did well today and one thing you feel you could have done better”.
  • Step 2: The attending “Tells” the learner his/her thoughts about the learner’s performance. Learners tend to be more comfortable with the “Ask-Tell-Ask” method because it let’s them give input and contribute to the feedback discussion in a non-threatening manner. They are typically less defensive because they led the discussion.  A lot of attendings feel that the “Ask-Tell-Ask” approach feels safer, easier, and more beneficial when compared to the more traditional feedback methods.
  • Step 3: The attending “Asks” the learner to come up with a plan step to reinforce positive performance and to correct negative performance.

A lot of attendings feel that the “Ask-Tell-Ask” approach feels safer, easier, and more beneficial when compared to the more traditional feedback methods. 

Feedback Video

Feedback Pears & Pitfalls

 

AVOID VAGUE FEEDBACK

Feedback should be specific. Vague feedback such as “read more” or “work on your differentials” or “good job” are not very helpful.

The best feedback describes the specific event/situation with details and your reasoning. Specifically, the feedback should include

  • WHAT they did well/did not do well.
  • WHY they did it well/did not do it well.
  • HOW to reinforce strong work/work on the problem.

An example of effective feedback is

  • “You should read up on aortic dissection and pulmonary embolism because you seemed to have trouble differentiating these two conditions. You should focus on how each condition presents and how to differentiate the two conditions because the treatment for a PE can be lethal if given to a patient with an aortic dissection, so making the correct diagnosis is critical”

When giving feedback, at a minimum, you need to include specifically WHAT they did well/did not do well and WHY they did it well/did not do it well. This should refer to a specific event/instance.

When using the “Ask-Tell-Ask” method, learners often try to give vague answers during the “Ask” steps. It is important to only accept answers that refer to specific situations. The attending should always encourage the learner think of specific situations when reflecting on his/her performance.

RAPPORT

For feedback to be effective, rapport between the attending and the learner (medical student and/or resident) must exist. If the learner does not feel that the attending has his/her best interest in mind, the feedback will be rejected, regardless of the method used. It’s imperative for the attending to have the resident’s best interest in mind when giving feedback. This can’t be stressed enough.

TIMING MATTERS

The timing of the feedback can be important. A general rule is to praise in public and criticize in private. This is especially true when using the “Sandwich” method of feedback.

SIGNALING

During feedback sessions, it’s common for learners to fail to recognize they are getting feedback. It has to do with the learner’s level of signal-to-noise. As a rule, the clinical environment is unfamiliar to most learners (especially early learners) which means there is a lot of cognitive noise. This makes is tough for learners to pick up certain signals, feedback is no exception. This problem has an easy solution, simply tell the learner that you are “giving them feedback”. This primes them to pick up the “feedback signal” and it frames the entire discussion as a “feedback session”. This is especially important when using the “Ask-Tell-Ask” method for feedback.

Feedback Myths

Below are several myths that are commonly held regarding feedback and evaluation.

"I can't provide an accurate evaluation"

This is a commonly held attending misbelief.  The truth is, most attendings CAN provide accurate/quality resident evaluations.

In fact, the resident’s attending has the most situational awareness about the resident’s performance on shift. So the attending’s evaluation is actually the best source of information for the residency program.

Best Practice Strategy: Attendings can use a simple method to ensure that their evaluation is accurate and of quality. The method is as follows:  first, use the Ask-Tell-Ask feedback approach (see section on Feedback. How?) to safely provide feedback to the resident. Then use the information gained from the feedback to make the resident’s written evaluation.

 

"The resident will hate me"

Many attendings have “The resident will hate” fear when it comes to feedback and evaluation.  Coming soon will be a discussion on how to make this fear go away.

Cardiovascular ICU Selective/Elective


Teaching Chief: Kartheek Nagappala MD

Description: Advanced Cardiovascular Critical Care rotation will allow residents to further develop their skills, knowledge and attitudes obtained during their previous rotations, specifically expanding on their critical knowledge to patients that are post cardiac surgery, major vascular surgery, and critically ill due to compromise of their cardiovascular system. The rotation will involve 21-22 12-hour shifts, similar to the EM core ICU experience. 

Availability: Generally available year-round and will occasionally share the experience with an Anesthesia co-rotator.

Scheduling: Schedule to be made by the rotator with final schedule approval by the teaching chief

This will close in 0 seconds

Community Emergency Medicine Elective


(PGY-3 only)

Teaching Chief: Various (depending on location)

Description: This is an opportunity to experience medicine across the care spectrum in a completely different cultural, social, and economic environment. From learning how to deliver sustainable care in critical access areas of the world, to experiencing Emergency Medicine as it is practiced elsewhere, the possibilities are endless. Previous residents have set up unique experiences in Uruguay, Thailand, Vietnam, and Tchad. Prior to thinking about an international elective the resident should consider travel, safety, health (vaccinations etc.), and financial concerns. Dr. Sukhija can help you guide you with strategies to set up an experience as each one is highly individual. 

Availability: Variable

Scheduling: Variable

This will close in 0 seconds

Palliative Care Selective/Elective


Teaching Chief: Ryan Howard MD

Description: The Palliative Care Selective or Elective is a 2- or 4-week inpatient rotation designed to expose the rotator to all aspects of inpatient palliative care. Residents will work alongside the palliative director and/or the palliative fellow along with the interdisciplinary palliative team throughout the rotation. The goal is to provide either PGY2 or PGY3 residents with an immersive clinical experience to learn more about inpatient palliative services.

Availability: Generally year-round, those interested in applying to Palliative Fellowship get precedence on the rotation as space is limited

Scheduling: M-F, 8am-5pm, with call shifts if required/desired per Dr. Howard

This will close in 0 seconds

Intro and Advanced Pharmacology Selective/Elective


Teaching Chief: Chadi Kahwaji MD, PhD and Savannah Lail PharmD

Description: A 2 or 4-week rotation where the resident works and learns alongside the ED pharmacists on assigned shifts. The Pharmacology rotation is designed to provide training concerning the application of pharmacology knowledge, pharmaceutics, drug information, medication safety, communication skills, critical thinking, pathophysiology, and therapeutics to the care of patients in an emergency department setting. The advanced rotation is for those who have already had the introductory Pharmacology rotation experience.

Availability: Generally year-round, but must contact PharmD teaching chief prior to choosing the rotation to ensure availability. 

Scheduling: Variable shifts, 10-shifts per rotation, to be assigned by PharmD teaching chief

This will close in 0 seconds

Pulmonary and Ventilator Management Selective/Elective


Teaching Chief: Leland Beggs MD

Description: This is a 4-week rotation based in the ICU, CVICU and ED. Residents will work side-by-side with designated respiratory therapists as well as core faculty physicians. The goal of this rotation is to focus solely on vent management and non-invasive ventilation techniques in patients with a wide variety of disease processes. Residents will be expected to manage vent settings for intubated patients in the ED, ICU and CVICU. Residents on service should gain an in-depth understanding of the events surrounding intubation, including strategies in pre oxygenation as well as the various drugs used for RSI and post intubation sedation. In addition, they will learn when to initiate, and how to manage non-invasive ventilation.

Availability: Generally year-round

Scheduling: M-F, 6am-4pm

This will close in 0 seconds

Radiology Selective/Elective


(Two-week experience) 

Teaching Chief: Ashkan Shahkarami MD

Description: The two-week Radiology rotation will provide the resident with an opportunity to learn normal and abnormal radiographic anatomy, recognize radiographic findings of common diseases, understand the indications for commonly ordered imaging studies, and learn the appropriate use of IR procedures. The goal of the rotation is to help the resident become competent in the use of imaging in the evaluation and treatment of disease.

Availability: Generally year-round, but must contact teaching chief before choosing the rotation to ensure availability

Scheduling: M-F, 8am-4pm, or as adjusted by the Radiology attending

This will close in 0 seconds

Wilderness Medicine Selective/Elective


Teaching Chief: Various

Description: The one-week wilderness medicine selective is offered twice a year at Kaweah Health, usually once in the Spring and once in the Fall/Winter. If not available during the allocated selective/elective block, previous residents have participated in 4-week experiences in Utah and Redding, CA. Experiences are variable and depend on the chosen course, so for this one touch base with Dr. Sukhija to see what is feasible both locally and away.

Availability: Highly variable, see description above

Scheduling: Highly variable

This will close in 0 seconds

Emergency Medicine Admin Selective/Elective


Teaching Chief: Kona Seng DO and Khoa Tu MD

Description: This is 2-4-week rotation in conjunction with the Department of Emergency Medicine Medical Director. The purpose of the ED Administration rotation is to provide an understanding of the administrative components of EM clinical services and operations. This will allow early exposure to ED administration to determine if the resident is interested in the administration and business of emergency medicine. The EM residents will attend all assigned meetings and participate in administrative projects. 

Availability: Generally year-round, will share the rotation with the PGY3 on their core admin rotation

Scheduling: M-F, 9-5pm, or as adjusted by the teaching chiefs

This will close in 0 seconds

Patient and Physician Advocacy and Street Medicine Selective/Elective


Teaching Chief: Kunal Sukhija MD, Omar Guzman MD, Lori Winston MD

Description: The Advocacy 2- or 4-week rotation is designed to be a self-directed customizable experience that will provide immersion into various aspects of physician and patient advocacy. The resident will be able to participate in local, state-wide, and national (schedule permitting) advocacy efforts while simultaneously learning about effective strategies to engage community leaders, legislators, and the local constituency. The rotation will offer experiences in both the legislative and community advocacy (the latter will be based in the Street Medicine program). 

Availability: Generally year-round, however certain months tend to be better given the yearly CMA, AMA, CalACEP, ACEP schedules. Touch base with Dr. Sukhija prior to choosing this elective in order to ensure you can get the individualized experience you desire.

Scheduling: Highly variable depending on advocacy events and meetings, Street Medicine tends to hold its events on Friday

This will close in 0 seconds

Performance and Quality Improvement (PI/QI) Selective/Elective


Teaching Chief: Chadi Kahwaji MD, PhD

Description: The Performance Improvement (PI)/Quality Improvement (QI) selective rotation will provide exposure to ongoing PI and QI efforts at KDHCD and provide opportunities for the PGY2 or PGY3 EM resident to become involved in PI/QI projects on an individual, departmental, or institutional level. The resident will join the Emergency Medicine PI director in the regular duties of chart review, M&M conference coordination and presentations, and committee meeting attendance as appropriate. It also offers time for the resident to work on their PI/QI project as part of residency graduation requirements. 

Availability: Generally year-round

Scheduling: Variable depending on meetings and current on-going projects

This will close in 0 seconds

Public Health Elective (PGY3 only)


(PGY3 only)

Teaching Chief: Karen Haught MD MPH, Tulare County Public Health Director

Description: This is a 4-week rotation with the Tulare Public Health Department designed to expose the rotator to all aspects of public health. Residents will work alongside the Tulare Public Health Director and/or the epidemiologist throughout the rotation. The goal is to provide PGY3 residents exposure to the role of the local public health department in the community. Residents will be expected to work at the Tulare Public Health Department and contribute to a community health project of the resident’s choice.

Availability: Generally year-round, though an interested resident should first contact Dr. Haught prior to selecting this experience (Dr. Sukhija will help you with contact information)

Scheduling: M-F, 9-5, though historically it’s been less than this as independence is given to work on the resident’s chosen project

This will close in 0 seconds

Research Selective/Elective


Teaching Chief: Chris Patty DNP, Director of Research

Description: The goal of the resident research rotation (2 or 4 weeks) is to improve the resident’s understanding of how new knowledge is created and translated into practice.  At the end of the rotation, the resident will present a deliverable which demonstrates ACGME competencies in knowledge development and translation. Many residents choose this rotation in order to work on their chosen Scholarly Activity as part of residency graduation requirements. 

Availability: Generally year-round, the resident must contact the director of research 4-weeks prior to the rotation in order to state deliverables and set up the rotational requirements.

Scheduling: Variable, generally self-directed independent work

This will close in 0 seconds

Simulation and Education Selective/Elective


Teaching Chief: Kim Sokol MD

Description: This is a 4-week rotation includes developing simulation scenarios, teaching simulation-based educational sessions, and assisting in daily operations in the simulation center. The rotation’s purpose is to develop skills associated with teaching. The rotation will provide an introduction to simulation with multiple adjuncts such as high and low-fidelity mannequins, task trainers, and the use of standardized patients.  A basic understanding of simulation-based education and debriefing will be taught along with basic principles associated with adult education. The resident must choose teaching shifts as their clinical experience.

Availability: Generally year-round

Scheduling: Variable, to be determined with the teaching chief prior to the rotation start date

This will close in 0 seconds

Teaching Elective with Dr. Stanley


(PGY3 only)

Teaching Chief: Michael Stanley DO

Description: This 4-week rotation is a highly-desired advanced elective rotation for PGY3 EM residents. It is intended only for those residents who are serious about improving their ability to teach AND lead. This rotation is as much about leadership as it is about teaching because both utilize the same skill sets. Residents will gain knowledge in effective communication techniques while learning about the underlying psychology of teaching, learning, and leadership.

Availability: Generally year-round

Scheduling: 12 10-hour shifts to be scheduled in accordance with Dr. Stanley’s clinical schedule, along with didactics (also to be scheduled with Dr. Stanley prior to the start date). If Dr. Stanley has less than 12 shifts, then the remainder can be completed with either Dr. Oldroyd, Dr. Sokol, or Dr. Alexeeva.

This will close in 0 seconds

Advanced Ultrasound Selective/Elective


Teaching Chief: John Hipskind MD

Description: This 4-week rotation is designed to augment the resident’s diagnostic (and therapeutic) skills in relation to the ultrasound, and to explore more advanced US modalities such as TEE. The resident will gain experience with nerve blocks, enhanced approaches to the core EM ultrasound studies, and explore novel ways to use the ultrasound in the ED setting. They will work alongside the teaching chief as well as the ultrasound fellows.

Scheduling: The expectation is to be scanning daily M-F, with weekends off. Due to PGY1 EM rotators and the popularity of this selective/elective, there may be many residents on rotation, and thus scheduling must be in conjunction with Mia Zavinovich and Dr. Hipskind prior to the start of the rotation. 

This will close in 0 seconds

International & Global Medicine Elective


(PGY3 only)

Teaching Chief: Various (depending on location)

Description: This is an opportunity to experience medicine across the care spectrum in a completely different cultural, social, and economic environment. From learning how to deliver sustainable care in critical access areas of the world, to experiencing Emergency Medicine as it is practiced elsewhere, the possibilities are endless. Previous residents have set up unique experiences in Uruguay, Thailand, Vietnam, and Tchad. Prior to thinking about an international elective the resident should consider travel, safety, health (vaccinations etc.), and financial concerns. Dr. Sukhija can help you guide you with strategies to set up an experience as each one is highly individual. 

Availability: Variable

Scheduling: Variable

This will close in 0 seconds

Patient Callbacks and PBLI form


Patient callback instuctions - complete 12/block when you are on the emergency medicine service

PBLI form - complete 4/year to reflect & self-evaluate your patient care

This will close in 0 seconds