21 May Feasibility of renal resistive index measurements performed by an intermediate and novice sonographer in a volunteer population
Abstract
Background
The Doppler-derived renal resistive index (RRI) is emerging as a promising bedside tool for assessing renal perfusion and risk of developing acute kidney injury in critically ill patients. It is not known what level of ultrasonography competence is needed to obtain reliable RRI values.
Objective
The aim of this study was to evaluate the feasibility of RRI measurements by an intermediate and novice sonographer in a volunteer population.
Methods
After a focused teaching session, an intermediate (resident), novice (medical student) and expert sonographer performed RRI measurements in 23 volunteers consecutively and blinded to the results of one another.
Intraclass correlation coefficients and Bland–Altman plots were used to evaluate interobserver reliability, bias and precision.
Results
Both non-experts were able to obtain RRI values in all volunteers. Median RRI in the population measured by the expert was 0.58 (interquartile range 0.52–0.62). The intraclass correlation coefficient was 0.96 (95% confidence interval 0.90–0.98) for the intermediate and expert, and 0.85 (95% confidence interval 0.69–0.94) for the novice and expert.
In relation to the measurements of the expert, both non-experts showed negligible bias (mean difference 0.002 [95% confidence interval − 0.005 to 0.009, p = 0.597] between intermediate and expert, mean difference 0.002 [95% confidence interval − 0.011 to 0.015, p = 0.752] between novice and expert) and clinically acceptable precision (95% limits of agreement − 0.031 to 0.035 for the intermediate, 95% limits of agreement − 0.056 to 0.060 for the novice).
Conclusions
RRI measurements by both an intermediate and novice sonographer in a volunteer population were reliable, accurate and precise after a brief course. RRI is easy to learn and feasible within the scope of point-of-care ultrasound.
Background
Point-of-care ultrasound (POCUS) is ultrasonography (US) performed at the bedside by the clinician, allowing real-time interpretation of the findings [1]. In the last decades, POCUS has become an integral part of clinical decision-making in the fields of emergency medicine, critical- and perioperative care.
The Doppler-derived renal resistive index (RRI) has emerged as a promising tool for assessing changes in renal perfusion in a wide range of clinical scenarios in critically ill patients [2,3,4]. RRI is an index derived from systolic and diastolic blood flow velocities of intrarenal arteries. Normal values are around 0.60 [5, 6] with 0.70 considered to be the upper normal threshold in adults [7].
Elevated RRI values have shown promise in early detection of acute kidney injury (AKI) in patients with shock [8,9,10,11], as well as in prognosticating intensive care unit (ICU) mortality [12]. Elevated postoperative RRI values seem to be predictive of AKI progression earlier than the conventional diagnostic criteria of oliguria and serum creatinine elevation in a broad range of major surgery [13,14,15,16,17,18,19]. The scope of application for RRI is expanding rapidly and the method has recently been proposed to be used in the bedside evaluation of venous congestion and fluid overload in ICU patients [20], as well as a precocious ICU monitoring tool for detecting progression and recovery from severe shock states [21].
To be clinically applicable within a POCUS protocol, RRI measurements need to be obtained by the clinician present at the bedside who may not always be an US expert. In previous studies, the examiners are described as either trained- [11, 13, 14, 17, 18, 20] or expert sonographers [8, 9, 12, 15].
In the only study comparing RRI measurements of non-expert sonographers to that of experts, interobserver reproducibility of RRI values was good after the non-experts had received a half-day course of renal Doppler [22]. These findings from centres with expertise in the RRI method have not been validated in other settings, and it is not known what specific level of US experience is needed to be able to perform RRI measurements at the bedside.
The aim of this study was to evaluate the feasibility of RRI measurements performed by two non-expert examiners, an intermediate and a novice, in a volunteer population after a focused teaching session of renal Doppler. In addition, we evaluated if there was any improvement in the agreement to an expert sonographer when the non-experts had gained practical experience from the first five examinations, hypothesizing a fast progression in the technique of obtaining RRI.
Materials and methods
Study population
The study involved 23 adult volunteers. The study complied with the Declaration of Helsinki and was approved by the Swedish Ethical Review Authority. Written informed consent was obtained before inclusion.
Education of examiners
All measurements and calculations were performed by three examiners of different US experience. The intermediate examiner (MR) was a resident in anaesthesia and intensive care, using US regularly in clinical practice but without any prior experience of renal Doppler. The novice examiner (NK) was a 4th year medical student with prior experience limited to basic theory of US. The expert examiner (KL) was a specialist in clinical physiology, performing US examinations daily with more than 20 years of experience of renal Doppler and RRI measurements. The two non-experts were taught Doppler evaluation of renal perfusion on two separate occasions of 3 h each by the expert. The sessions included a basic theoretical background of renal US and supervised practical training to locate the kidneys, identify the intrarenal vessels using colour-Doppler, and measuring and calculating the RRI.
Data collection
All examinations were performed at the Karolinska University Hospital between June and September 2019. The following variables were recorded from each volunteer: age, weight, height, heart rate, heart rhythm and resting blood pressure. Medical history and ongoing medications were recorded. Each volunteer was examined by all three examiners consecutively, the order of the examiners being random for every session. The examiners were blinded to the examinations and results of one another.
RRI measurement and calculation
In each volunteer, the same designated ultrasound device (GE Vivid S70N, v202CH, US) with a curvilinear probe (1.5–6.0 MHz) was used. The volunteer was positioned on their side and first a complete view of the kidney was obtained. Colour-Doppler was applied to visualize the global organization of intrarenal blood vessels. Pulsed wave Doppler at the smallest possible width between 2 and 5 mm was used to measure flow velocities in an interlobular- or arcuate artery in the upper, middle and lower pole of each kidney. If possible, the examiners obtained a reading with at least three consecutive similar-looking waveforms in each of the three poles for each kidney. RRI was calculated for each of the three poles as [(peak systolic velocity − end diastolic velocity)/peak systolic velocity]. These values were used to compute a total mean RRI (RRItotal), a mean RRI for the right kidney (RRIdx) and a mean RRI for the left kidney (RRIsin). If the examiners were unable to obtain a satisfactory measurement in one pole, the mean value was calculated using the measurements obtained. Our protocol for obtaining RRI is in line with previously described protocols [23].
Statistical analysis
Results are described as medians with interquartile range (IQR) and minimum/maximum values (min/max) for continuous variables, or numbers and percentages for categorical variables. Interobserver reliability was assessed calculating the intraclass correlation coefficient (ICC) and their 95% confidence intervals (CI) based on an individual measurement, consistency of agreement, 2-way mixed-effects model [24].
The values were interpreted using the Ko and Li classification system [25] where < 0.5 is poor reliability, 0.50–0.74 is moderate reliability, 0.75–0.89 is good reliability, and ≥ 0.90 is excellent reliability. The mean difference in RRI measurements between non-expert examiners relative to the expert was compared using paired t tests.
Bland–Altman plots were constructed plotting the difference of the paired measurements from respective non-expert and the expert (y-axis) against the mean of the two measurements (x-axis) [26]. Bias, reflecting systematic differences, was defined as the mean difference of the paired measurements [27]. Precision, reflecting random differences, was evaluated using the 95% limits of agreement (LoA) (mean difference ± 1.96 standard deviations [SD]) between paired measurements.
There is no previously agreed definition of acceptable precision for RRI measurements. We considered precision to be clinically acceptable when the percentage error from a proposed normal RRI value of 0.60 was no more than ± 10%, corresponding to an LoA of ± 0.06 for the non-expert examiners in relation to the results of the expert.
To evaluate any potential progression in the technique of obtaining RRI in the non-expert examiners, ICC, mean difference, and LoA were again generated after excluding the first five volunteers per examiner. Data analysis was performed using Stata version 15.1 (StataCorp, College Station, US).
Results
Population characteristics
Characteristics of the volunteers are described in Table 1. Two volunteers were being followed in primary care due to slightly increased serum creatinine levels. One volunteer had antihypertensive treatment. Another volunteer was found to have an asymptomatic hypermobile kidney and was referred to specialist care for follow-up.
RRI measurements
All examiners were able to obtain RRI values in all volunteers. Out of 138 possible kidney pole measurements, the intermediate was able to obtain 136 (99%), the novice 134 (97%) and the expert 138 measurements (100%). In all cases where a kidney pole measurement was missing, at least two kidney pole measurements per kidney could be recorded. Measured by the expert, the median RRItotal in the study population was 0.58 (IQR 0.52–0.62, min/max 0.46/0.65). All examiners measured RRI values < 0.70 in all volunteers. There was no apparent difference in RRI values obtained from the right or left kidney.
Comparison between non-experts and expert
For RRI means (RRItotal, RRIdx and RRIsin) ICC, mean difference between paired measurements, and LoA for respective non-expert in relation to the expert are presented in Table 2a. Interobserver reliability for the intermediate and expert examiners was excellent (ICC ≥ 0.90) for RRItotal and in the range of good to excellent (ICC ≥ 0.75) for RRIdx and RRIsin. For the novice and expert examiners, interobserver reliability was in the range of moderate to excellent (ICC ≥ 0.50) for all RRI means. There was no difference in any corresponding RRI means obtained by neither of the non-experts compared to the expert (p > 0.05 for all mean differences between paired measurements).
Bland–Altman plots for RRItotal are presented in Fig. 1. For both non-experts bias was negligible (mean difference 0.002 [95% CI − 0.005 to 0.009, p = 0.597] between intermediate and expert, mean difference 0.002 [95% CI − 0.011 to 0.015, p = 0.752] between novice and expert) and precision was clinically acceptable (LoA − 0.031 to 0.035 for the intermediate, LoA − 0.056 to 0.060 for the novice).
Author information
Affiliations
Mårten Renberg, Daniel Hertzberg, Claire Rimes-Stigare & Max Bell.
Mårten Renberg & Max Bell
Naima Kilhamn & Daniel Hertzberg.
Kent Lund.
Correspondence to Mårten Renberg.
References
1. Moore CL, Copel JA (2011) Point-of-care ultrasonography. N Engl J Med 364:749–757. https://doi.org/10.1056/NEJMra0909487
CAS– Article – PubMed – Google Scholar
2. Le Dorze M, Bougle A, Deruddre S, Duranteau J (2012) Renal Doppler ultrasound: a new tool to assess renal perfusion in critical illness. Shock 37:360–365. https://doi.org/10.1097/SHK.0b013e3182467156
Article – PubMed – Google Schola
3. Schnell D, Darmon M (2015) Bedside Doppler ultrasound for the assessment of renal perfusion in the ICU: advantages and limitations of the available techniques. Crit Ultrasound J 7:24. https://doi.org/10.1186/s13089-015-0024-6
Article – PubMed – Google Scholar
4. Di Nicolo P, Granata A (2019) Renal intraparenchymal resistive index: the ultrasonographic answer to many clinical questions. J Nephrol 32:527–538. https://doi.org/10.1007/s40620-018-00567-x
Article – PubMed – Google Scholar
5. Ponte B, Pruijm M, Ackermann D, Vuistiner P, Eisenberger U, Guessous I, Rousson V, Mohaupt MG, Alwan H, Ehret G, Pechere-Bertschi A, Paccaud F, Staessen JA, Vogt B, Burnier M, Martin PY, Bochud M (2014) Reference values and factors associated with renal resistive index in a family-based population study. Hypertension 63:136–142. https://doi.org/10.1161/hypertensionaha.113.02321
CAS – Article – PubMed – Google Scholar
6. Keogan MT, Kliewer MA, Hertzberg BS, DeLong DM, Tupler RH, Carroll BA (1996) Renal resistive indexes: variability in Doppler US measurement in a healthy population. Radiology 199:165–169. https://doi.org/10.1148/radiology.199.1.8633141
CAS – Article – PubMed – Google Scholar
7. Tublin ME, Bude RO, Platt JF (2003) Review. The resistive index in renal Doppler sonography: where do we stand? AJR Am J Roentgenol 180:885–892. https://doi.org/10.2214/ajr.180.4.1800885
Article – PubMed – Google Scholar
8. Lerolle N, Guerot E, Faisy C, Bornstain C, Diehl JL, Fagon JY (2006) Renal failure in septic shock: predictive value of Doppler-based renal arterial resistive index. Intensive Care Med 32:1553–1559. https://doi.org/10.1007/s00134-006-0360-x
Article – PubMed – Google Scholar
9. Schnell D, Deruddre S, Harrois A, Pottecher J, Cosson C, Adoui N, Benhamou D, Vicaut E, Azoulay E, Duranteau J (2012) Renal resistive index better predicts the occurrence of acute kidney injury than cystatin C. Shock 38:592–597. https://doi.org/10.1097/SHK.0b013e318271a39c
CAS – Article – PubMed – Google Scholar
10. Song J, Wu W, He Y, Lin S, Zhu D, Zhong M (2018) Value of the combination of renal resistance index and central venous pressure in the early prediction of sepsis-induced acute kidney injury. J Crit Care 45:204–208. https://doi.org/10.1016/j.jcrc.2018.03.016
Article – PubMed – Google Scholar
11. Haitsma Mulier JLG, Rozemeijer S, Rottgering JG, Spoelstra-de Man AME, Elbers PWG, Tuinman PR, de Waard MC, Oudemans-van Straaten HM (2018) Renal resistive index as an early predictor and discriminator of acute kidney injury in critically ill patients; a prospective observational cohort study. PLoS ONE 13:e0197967. https://doi.org/10.1371/journal.pone.0197967
CAS – Article – PubMed – PubMed Central – Google Scholar
12. Boddi M, Bonizzoli M, Chiostri M, Begliomini D, Molinaro A, Tadini Buoninsegni L, Gensini GF, Peris A (2016) Renal Resistive Index and mortality in critical patients with acute kidney injury. Eur J Clin Invest 46:242–251. https://doi.org/10.1111/eci.12590
Article – PubMed – Google Scholar
13. Bossard G, Bourgoin P, Corbeau JJ, Huntzinger J, Beydon L (2011) Early detection of postoperative acute kidney injury by Doppler renal resistive index in cardiac surgery with cardiopulmonary bypass. Br J Anaesth 107:891–898. https://doi.org/10.1093/bja/aer289
CAS – Article – PubMed – Google Scholar
14. Guinot PG, Bernard E, Abou Arab O, Badoux L, Diouf M, Zogheib E, Dupont H (2013) Doppler-based renal resistive index can assess progression of acute kidney injury in patients undergoing cardiac surgery. J Cardiothorac Vasc Anesth 27:890–896. https://doi.org/10.1053/j.jvca.2012.11.024
Article – PubMed – Google Scholar
15. Wu HB, Qin H, Ma WG, Zhao HL, Zheng J, Li JR, Sun LZ (2017) Can renal resistive index predict acute kidney injury after acute type A aortic dissection repair? Ann Thorac Surg 104:1583–1589. https://doi.org/10.1016/j.athoracsur.2017.03.057
Article – PubMed – Google Scholar
16. Kararmaz A, Arslantas MK, Aksu U, Ulugol H, Cinel I, Toraman F (2019) Evaluation of acute kidney injury with oxidative stress biomarkers and Renal Resistive Index after cardiac surgery. Acta Chir Belg. https://doi.org/10.1080/00015458.2019.1702371
Article – PubMed- Google Scholar
17. Marty P, Szatjnic S, Ferre F, Conil JM, Mayeur N, Fourcade O, Silva S, Minville V (2015) Doppler renal resistive index for early detection of acute kidney injury after major orthopaedic surgery: a prospective observational study. Eur J Anaesthesiol 32:37–43. https://doi.org/10.1097/eja.0000000000000120
Article – PubMed – Google Scholar
18. Marty P, Ferre F, Labaste F, Jacques L, Luzi A, Conil JM, Silva S, Minville V (2016) The Doppler renal resistive index for early detection of acute kidney injury after hip fracture. Anaesth Crit Care Pain Med 35:377–382. https://doi.org/10.1016/j.accpm.2015.12.013
Article – PubMed – Google Scholar
19. Giustiniano E, Meco M, Morenghi E, Ruggieri N, Cosseta D, Cirri S, Difrancesco O, Zito PC, Gollo Y, Raimondi F (2014) May Renal Resistive Index be an early predictive tool of postoperative complications in major surgery? Preliminary results. Biomed Res Int 2014:917985. https://doi.org/10.1155/2014/917985
Article – PubMed – Google Scholar
20. Beaubien-Souligny W, Benkreira A, Robillard P, Bouabdallaoui N, Chasse M, Desjardins G, Lamarche Y, White M, Bouchard J, Denault A (2018) Alterations in portal vein flow and intrarenal venous flow are associated with acute kidney injury after cardiac surgery: a prospective observational cohort study. J Am Heart Assoc 7:e009961. https://doi.org/10.1161/jaha.118.009961
Article – PubMed – PubMed Central – Google Scholar
21. Anile A, Ferrario S, Campanello L, Orban MA, Castiglione G (2019) Renal resistive index: a new reversible tool for the early diagnosis and evaluation of organ perfusion in critically ill patients: a case report. Ultrasound J 11:23. https://doi.org/10.1186/s13089-019-0138-3
Article – PubMed – PubMed Central – Google Scholar
22. Schnell D, Reynaud M, Venot M, Le Maho AL, Dinic M, Baulieu M, Ducos G, Terreaux J, Zeni F, Azoulay E, Meziani F, Duranteau J, Darmon M (2014) Resistive Index or color-Doppler semi-quantitative evaluation of renal perfusion by inexperienced physicians: results of a pilot study. Minerva Anestesiol 80:1273–1281
23. Schnell D, Darmon M (2012) Renal Doppler to assess renal perfusion in the critically ill: a reappraisal. Intensive Care Med 38:1751–1760. https://doi.org/10.1007/s00134-012-2692-z
Article – PubMed – Google Scholar
24. Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428. https://doi.org/10.1037//0033-2909.86.2.420
CAS – Article – PubMed – PubMed Central – Google Scholar
25. Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Article – PubMed – PubMed Central – Google Scholar
26. Bland JM, Altman DG (1995) Comparing methods of measurement: why plotting difference against standard method is misleading. Lancet 346:1085–1087. https://doi.org/10.1016/s0140-6736(95)91748-9
CAS – Article – PubMed – Google Scholar
27. Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8:135–160. https://doi.org/10.1177/096228029900800204
CAS – Article – PubMed – PubMed Central – Google Scholar
28. Dewitte A, Coquin J, Meyssignac B, Joannes-Boyau O, Fleureau C, Roze H, Ripoche J, Janvier G, Combe C, Ouattara A (2012) Doppler resistive index to reflect regulation of renal vascular tone during sepsis and acute kidney injury. Crit Care 16:R165. https://doi.org/10.1186/cc11517
Article – PubMed – PubMed Central – Google Scholar
29. Beloncle F, Rousseau N, Hamel JF, Donzeau A, Foucher AL, Custaud MA, Asfar P, Robert R, Lerolle N (2019) Determinants of Doppler-based renal resistive index in patients with septic shock: impact of hemodynamic parameters, acute kidney injury and predisposing factors. Ann Intensive Care 9:51. https://doi.org/10.1186/s13613-019-0525-8
Article – PubMed – PubMed Central – Google Scholar
30. Boddi M, Sacchi S, Lammel RM, Mohseni R, Serneri GG (1996) Age-related and vasomotor stimuli-induced changes in renal vascular resistance detected by Doppler ultrasound. Am J Hypertens 9:461–466. https://doi.org/10.1016/0895-7061(96)00027-1
CAS – Article – PubMed – Google Scholar
31. Mancini M, Daniele S, Raffio T, Liuzzi R, Sabbatini M, Cianciaruso B, Ferrara LA, Salvatore M (2005) Intra and interobserver variability of renal allograft ultrasound volume and resistive index measurements. Radiol Med 109:385–394
32. Bellos I, Pergialiotis V, Kontzoglou K (2019) Renal resistive index as predictor of acute kidney injury after major surgery: a systematic review and meta-analysis. J Crit Care 50:36–43. https://doi.org/10.1016/j.jcrc.2018.11.001
Article – PubMed – Google Scholar
33. Andersen GN, Viset A, Mjolstad OC, Salvesen O, Dalen H, Haugen BO (2014) Feasibility and accuracy of point-of-care pocket-size ultrasonography performed by medical students. BMC Med Educ 14:156. https://doi.org/10.1186/1472-6920-14-156
Article – PubMed – PubMed Central – Google Scholar
34. Steinmetz P, Oleskevich S, Lewis J (2016) Acquisition and long-term retention of bedside ultrasound skills in first-year medical students. J Ultrasound Med 35:1967–1975. https://doi.org/10.7863/ultra.15.09088
Article – PubMed – Google Scholar
35. Darmon M, Schortgen F, Vargas F, Liazydi A, Schlemmer B, Brun-Buisson C, Brochard L (2011) Diagnostic accuracy of Doppler renal resistive index for reversibility of acute kidney injury in critically ill patients. Intensive Care Med 37:68–76. https://doi.org/10.1007/s00134-010-2050-y
Article – PubMed – Google Scholar
36. Beaubien-Souligny W, Denault A, Robillard P, Desjardins G (2019) The role of point-of-care ultrasound monitoring in cardiac surgical patients with acute kidney injury. J Cardiothorac Vasc Anesth 33:2781–2796. https://doi.org/10.1053/j.jvca.2018.11.002
Article – PubMed – Google Scholar
37. Noble VE, Brown DF (2004) Renal ultrasound. Emerg Med Clin North Am 22:641–659. https://doi.org/10.1016/j.emc.2004.04.014
Article – PubMed – Google Scholar
38. Rud O, Moersler J, Peter J, Waliszewski P, Gilfrich C, Hauser H, Burger M, Fritsche HM, Wieland WF, Ahmed AM, Brookman-May S, May M (2012) Prospective evaluation of interobserver variability of the hydronephrosis index and the renal resistive index as sonographic examination methods for the evaluation of acute hydronephrosis. BJU Int 110:E350–E356. https://doi.org/10.1111/j.1464-410X.2012.11087.x
Article –PubMed – Google Scholar
39. Baumgartner I, Behrendt P, Rohner P, Baumgartner RW (1999) A validation study on the intraobserver and interobserver reproducibility of renal artery duplex ultrasound. Ultrasound Med Biol 25:225–231. https://doi.org/10.1016/s0301-5629(98)00142-2
CAS – Article –PubMed – Google Scholar
40. Hertzberg D, Ceder SL, Sartipy U, Lund K, Holzmann MJ (2017) Preoperative renal resistive index predicts risk of acute kidney injury in patients undergoing cardiac surgery. J Cardiothorac Vasc Anesth 31:847–852. https://doi.org/10.1053/j.jvca.2016.10.006
Article – PubMed – Google Scholar
41. Samoni S, Nalesso F, Meola M, Villa G, De Cal M, De Rosa S, Petrucci I, Brendolan A, Rosner MH, Ronco C (2016) Intra-Parenchymal Renal Resistive Index Variation (IRRIV) describes renal functional reserve (RFR): pilot study in healthy volunteers. Front Physiol 7:286. https://doi.org/10.3389/fphys.2016.00286
Sorry, the comment form is closed at this time.