T. J. Olgers, N. Azizi, H. R. Bouma & J. C. ter Maaten

The Ultrasound Journal volume 12

Abstract

Background

Point-of-care Ultrasound (POCUS) is becoming an important diagnostic tool for internal medicine and ultrasound educational programs are being developed. An ultrasound course is often included in such a curriculum. We have performed a prospective observational questionnaire-based cohort study consisting of participants of a POCUS course for internal medicine in the Netherlands in a 2-year period. We investigated the usefulness of an ultrasound course and barriers participants encountered after the course.

Results

55 participants (49%) completed the pre-course questionnaire, 29 (26%) completed the post-course questionnaire, 11 participants (10%) finalized the third questionnaire. The number of participants who performs POCUS was almost doubled after the course (from 34.5 to 65.5%). Almost all participants felt insufficiently skilled before the course which declined to 34.4% after the course. The majority (N = 26 [89.7%]) stated that this 2-day ultrasound course was sufficient enough to perform POCUS in daily practice but also changed daily practice. The most important barriers withholding them from performing ultrasound are lack of experts for supervision, insufficient practice time and absence of an ultrasound machine.

Conclusions

This study shows that a 2-day hands-on ultrasound course seems a sufficient first step in an ultrasound curriculum for internal medicine physicians to obtain enough knowledge and skills to perform POCUS in clinical practice but it also changes clinical practice. However, there are barriers in the transfer to clinical practice that should be addressed which may improve curriculum designing.

Background

Point-of-care Ultrasound (POCUS) is an important diagnostic tool for medical decision making and resuscitation of patients used by many specialists around the world. The reliability of the POCUS exam is largely operator dependent and, therefore, requires a solid ultrasound training system [1].

For internal medicine, it is a relatively new skill and ultrasound curricula are being developed to ensure correct use of POCUS for safe patient care [2,3,4]. In ultrasound curriculum designing, the first step is choosing the core applications which are relevant for that specific specialty and providing the core knowledge of these applications [2, 5].

This first step is called the initial introduction and usually consists of taking an ultrasound course, ranging from several hours to several days. The second step is gaining experience, followed by the third step which is achieving competency. If the initial introduction is not followed by the next, the usefulness of a course is questionable. Gaining experience by practicing under supervision is necessary to become competent, as is taking driving lessons after learning how to control a car. In our previous research, we have already shown that one important barrier for internal medicine residents to perform POCUS is the lack of experts to provide supervision [6].

To investigate the impact of an ultrasound course and the barriers to clinical implementation of POCUS after the course, we have performed a questionnaire-based study among ultrasound course participants.

Methods

Since 2017, a 2-day ultrasound course specifically designed for internal medicine (DEUS course: Dutch Emergency UltraSound for internists) is being held 2–3 times a year.

This is one of the two largest ultrasound courses for internal medicine in the Netherlands. These two courses are similar in content, educational tools, practice time and participants and both courses have a theoretical and practical exam.

The number of participants in the DEUS course varies from 20 to a maximum of 24. We have invited all participants from 5 courses (N = 112), held in 2018 and 2019, to complete a questionnaire 1 week before the ultrasound course, 1–2 weeks after the ultrasound course, and 3 months after the course. The questionnaire included demographic data, questions about POCUS training and practice, and questions about the perceived usefulness and limitations.

The survey was distributed by the course secretary board using an online survey tool (http://www.thesistoolpro.com). Participants were only invited once. Missing data were excluded from analysis for that specific questionnaire and for the returned questionnaires descriptive statistics was used. Participants provided written informed consent to participate in this study. SPSS statistics 23 was used for descriptive statistics.

Results

55 participants (49%) completed the pre-course questionnaire, 29 (26%) completed the post-course questionnaire. Unfortunately, only 11 participants (10%) finalized the third questionnaire. Most participants were female (52.7%), and half of participants were aged between 30 and 39 (Table 1).

The majority were internal medicine residents (56.4%), and a significant amount were attending internists (41.8%). The participants perceived that ultrasound was used by internists in their hospital in the minority (38.2%) of hospitals, in contrast to ultrasound use by emergency physicians (83.6%). The experience and practice of POCUS before and after the ultrasound course is shown in Table 2.

Most participants indicated they have never performed any ultrasound in clinical practice prior to the course (65.5%), which decreased after the course (34.5%). If they have performed POCUS after the course, it was largely done under supervision. After the course, more participants use POCUS and the number of POCUS performed also increased. This effect seems to persist after 3 months, notwithstanding the low number of respondents. Strikingly, nearly all participants (98%) indicated they were insufficiently skilled to perform POCUS in their own situation, but after the course this number decreased to 34.4%.

Of all post-course respondents, the majority stated that this 2-day ultrasound course was sufficient enough to perform POCUS in daily practice (Table 2). The majority also experienced that this ultrasound course influenced their clinical practice for various reasons. The most mentioned were that they felt more secure about performing ultrasound and they practiced ultrasound more, they have a better understanding of the value of POCUS for clinical decision making and POCUS increased their confidence of fluid status assessment. After 3 months, despite the low number of respondents, these percentages are roughly the same. Finally we have asked them for perceived barriers for performing POCUS (Table 3).

This shows that lack of knowledge is substantially reduced by following this ultrasound course. A significant amount of participants do not have access to an ultrasound machine. The majority were not able to practice under supervision due to lack of experts (58.6%) and/or practice time (41.4%). These two were perceived as the most important barriers to use POCUS.

Discussion

We have shown that a 2-day hands-on ultrasound course is a solid first step in an ultrasound curriculum for internal medicine. Participants perceive they have sufficient knowledge and skills to perform POCUS in real practice, which is in line with the effect of other ultrasound courses and ultrasound curricula [7,8,9,10].

It should be noted that the number of post-course responders is lower as compared to pre-course responders, which possesses a high risk of bias. The second step in the curriculum, which is gaining experience, is difficult to fulfill if the conditions are not set properly. The largest remaining barriers in the Netherlands after following an ultrasound course, are lack of an ultrasound machine, lack of experts for supervision and lack of practice time.

These barriers for learning POCUS are also seen in other specialties [11]. It is essential that we create a learning and training environment that is safe for patient care with enough experts available for supervision. Skills including ultrasound skills may subside quickly if ultrasound is not performed on a regular basis, especially by novel sonographers [12,13,14]. This implies that before an ultrasound course is offered as a start for the ultrasound curriculum, the conditions should be optimized for participants to complete all necessary steps in achieving and maintaining competency and not only the initial introduction [15, 16].

For example in the Netherlands, POCUS has been made a mandatory skill for internal medicine residents by the Dutch Internal Medicine Federation (NIV). This obliged educators and hospitals to include ultrasound machines in their budget and to create focus groups for further development of POCUS educational programs. However, with increasing amounts of affordable handheld devices with good quality images, budget problems may become less of an issue. It required investing time and money to educate and train experts in the teaching hospitals for supervision of residents and to guarantee safe patient care. Addressing these issues are at least as important as sending staff or residents to an ultrasound course. In this way an ultrasound courses will not only be just a pleasant experience but a real start of an ultrasound curriculum.

Limitations

This survey has some potential limitations. The first questionnaire response rate was 49%, the post-course survey 26% and the 3-month response rate was only 10%. Most web-based data collection have a mean response rate of 27.6% [17].

The low response rate may have influenced the interpretation of the results. Especially the 3^rd questionnaire must be seen as indicative due to the low number of respondents. Theoretically, if all post-course non-responders represent participants that did not benefit from the course in terms of knowledge, the number of participants with insufficient knowledge may have only decreased from 60 to 51%, although this is very unlikely.

In addition, responders may be more enthusiastic about ultrasound and can have different ideas than non-responders. Furthermore, responders may feel more confident about their knowledge after a course than non-responders which may have influenced the low percentage of the barrier lack-of-knowledge.

Finally, participants may overestimate their own knowledge, a well-known psychological phenomena in unskilled participants called the Dunning–Kruger effect, although we do not know if this is applicable for our study population [18]. We think an ultrasound course might even have the opposite effect if participants have become more aware of their shortcomings (conscious incompetence) and underestimate their skills. We have shown an increase in their perceived knowledge.

How this course actually increase ultrasound skills was beyond the scope of this research as we only asked participants for their perceived skills. Half of the respondents were residents and half were attending physicians, there also was a variability in their corresponding internal subspecialties but selection bias cannot be excluded. We did not contact a subgroup of non-responders nor did we sent structured reminders to complete the survey which could have increased the response rate.

We omitted open questions on most topics so specific important issues not addressed in our questionnaire may be missed. This research represents the course participants perceived skills and knowledge but we did not test them afterwards for ultrasound skills. We only invited participants of one of the two ultrasound courses. These courses are very similar and faculty of both courses are also members of the Dutch taskforce developing the ultrasound curriculum in the Netherlands and some teach in both courses. We would expect the same results if we invited all participants.

Conclusion

This study shows that a 2-day hands-on ultrasound course is a sufficient first step in an ultrasound curriculum for internal medicine physicians.

However, the conditions should be optimized to prevent loss of this knowledge and skills so course participants can proceed to the necessary consecutive steps which are gaining experience and achieving competency.

The most important barriers to overcome are lack of experts for supervision and insufficient practice time, both problems should be addressed before attending an ultrasound course to increase the yield.

References

1. Bhagra A, Tierney DM, Sekiguchi H, Soni NJ (2016) Point-of-care ultrasonography for primary care physicians and general internists. Mayo Clin Proc 91:1811–1827 Article Google Scholar

2. Olgers TJ, Azizi N, Blans MJ, Bosch FH, Gans ROB, Ter Maaten JC (2019) Point-of-care Ultrasound (PoCUS) for the internist in Acute Medicine: a uniform curriculum. Neth J Med 77(5):168–176 PubMed CAS Google Scholar

3. Mellor TE, Junga Z, Ordway S, Hunter T, Shimeall WT, Krajnik S, Tibbs L, Mikita J, Zeman J, Clark P (2019) Not just hocus POCUS: implementation of a point of care ultrasound curriculum for internal medicine trainees at a large residency program. Mil Med 184(11–12):901–906 Article Google Scholar

4. LoPresti CM, Schnobrich DJ, Dversdal RK, Schembri F (2019) A road map for point-of-care ultrasound training in internal medicine residency. Ultrasound J. 11(1):10 Article Google Scholar

5. International federation for emergency medicine (IFEM) (2014) Point-of care ultrasound curriculum guidance [Internet]. https://www.ifem.cc/point-of-care-ultrasound-curriculum-guidances/. Accessed Apr 2020

6. Olgers TJ, Ter Maaten JC (2020) Point-of-care ultrasound curriculum for internal medicine residents: what do you desire? A national survey. BMC Med Educ 20(1):30 Article Google Scholar

7. Gasho CJ, Torralba KD, Chooljian DM, Cohen A, Dinh VA (2019) Impact of a lung ultrasound course for rheumatology specialists (IMPACT-2). Clin Exp Rheumatol 37(3):380–384 PubMed Google Scholar

8. Zawadka M, Graczyńska A, Janiszewska A, Ostrowski A, Michałowski M, Rykowski M, Andruszkiewicz P (2019) Lessons learned from a study of the integration of a point-of-care ultrasound course into the undergraduate medical school curriculum. Med Sci Monit 2(25):4104–4109 Article Google Scholar

9. Arienti V, Di Giulio R, Cogliati C, Accogli E, Aluigi L, Corazza G, Ultrasound SIMI Study Group (2014) Bedside ultrasonography (US), Echoscopy and US point of care as a new kind of stethoscope for Internal Medicine Departments: the training program of the Italian Internal Medicine Society (SIMI). Intern Emerg Med 9:805–814 Article Google Scholar

10. Dinh VA, Giri PC, Rathinavel I, Nguyen E, Hecht D, Dorotta I, Nguyen HB, Chrissian AA (2015) Impact of a 2-day critical care ultrasound course during fellowship training: a pilot study. Crit Care Res Pract 2015:675041 PubMed PubMed Central Google Scholar

11. Acuña J, Rubin M, Hahn B, Das D, Kapoor M, Adhikari S, Greenstein J (2020) Point-of-care ultrasound in United States pediatric emergency medicine fellowship programs: the current state of practice and training. Pediatr Emerg Care. https://doi.org/10.1097/PEC.0000000000001955

Article PubMed Google Scholar

12. Rhue AL, VanDerveer B (2018) Wilderness first responder: are skills soon forgotten? Wilderness Environ Med 29(1):132–137. https://doi.org/10.1016/j.wem.2017.11.005

Article PubMed Google Scholar

13. Kimura BJ, Sliman SM, Waalen J, Amundson SA, Shaw DJ (2016) Retention of ultrasound skills and training in “point-of-care” cardiac ultrasound. J Am Soc Echocardiogr 29(10):992–997 Article Google Scholar

14. Town JA, Bergl PA, Narang A, McConville JF (2016) Internal medicine residents’ retention of knowledge and skills in bedside ultrasound. J Grad Med Educ 8(4):553–557 Article Google Scholar

15. Løkkegaard T, Todsen T, Nayahangan LJ, Andersen CA, Jensen MB, Konge L (2020) Point-of-care ultrasound for general practitioners: a systematic needs assessment. Scand J Prim Health Care 38(1):3–11 Article Google Scholar

16. European Core Curriculum for Emergency Medicine (2017). https://eusem.org/images/ebeem/European-Core-Curriculum-for-EM-Version-1.2-April-2017-final-version-1.pdf. Accessed Apr 2020

 17. Blumenberg C, Barros AJD (2018) Response rate differences between web and alternative data collection methods for public health research: a systematic review of the literature. Int J Public Health 63(6):765–773 Article Google Scholar

18. Kruger J, Dunning D (1999) Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol 77(6):1121–1134. https://doi.org/10.1037//0022-3514.77.6.1121

Article PubMed CAS Google Scholar