Bartolotta, Sidoti Pinto, Cannella, Porrello, Taravella, Randazzo, and Taibbi: Focal liver lesions: interobserver and intraobserver agreement of three-dimensional contrast-enhanced ultrasound-assisted volume measurements



This study was conducted to assess the interobserver and intraobserver agreement of three-dimensional contrast-enhanced ultrasound (3D-CEUS) volume calculations of focal liver lesions (FLLs).


Thirty-nine patients (15 men and 24 women; mean age, 55.4 years) with 39 FLLs (mean size, 3.1±1.8 cm; size range, 1 to 8 cm) prospectively underwent 3D-CEUS. Four readers calculated the volume of each lesion in an independent and blinded fashion in two separate sessions by means of a semi-automatic, commercially available proprietary software. The differences in lesion volumes (cm3) among sessions and readers were assessed using the Mann-Whitney U test and the Kruskal-Wallis test. Bland-Altman analysis was also performed. Intraclass correlation coefficients (ICCs) with 95% confidence intervals (95% CIs) were calculated. The statistical significance level was set at P<0.05.


Among readers, there were no statistically significant differences in the first (P=0.953) and second (P=0.592) reading sessions for volume calculations of the 39 FLLs, with almost perfect inter-reader agreement (ICC values of the first reading session, 0.996; 95% CI, 0.992 to 0.998 and ICC value of the second reading session, 0.994; 95% CI, 0.990 to 0.997, respectively). For each of the four readers, there were no significant differences in volume calculations between the two sessions (P=0.503-0.924), and the intrareader agreement was almost perfect for each reader (R1: ICC, 0.995; 95% CI, 0.991 to 0.998; R2: ICC, 0.995; 95% CI, 0.988 to 0.997; R3: ICC, 0.996; 95% CI, 0.992 to 0.998; R4: ICC, 0.985; 95% CI, 0.971 to 0.992).


3D-CEUS volume calculations provided consistent measurements across different readers with almost perfect intrareader agreement.


Contrast-enhanced ultrasonography (CEUS) is a safe, robust, and cost-effective imaging modality for evaluating focal liver lesions (FLLs) by depicting tumor vascularity in real time [1-3].
Nevertheless, an inherent limitation of conventional two-dimensional CEUS (2D-CEUS) is its ability to visualize only the scanning plane, making it impossible to evaluate the vascularity of the entire lesion unless the ultrasound beam is swept across the lesion. In this regard, three-dimensional CEUS (3D-CEUS) has been shown to improve the evaluation of tumor vascularity in comparison to conventional 2D-CEUS [4-6]. Computed tomography (CT) can also display the spatial structure of FLLs, but 3D-CEUS makes it possible to evaluate the response repeatedly during short-term follow-up, without the use of ionizing radiation or potentially nephrotoxic contrast agents [7,8].
In particular, the dataset acquired by 3D-CEUS may be further processed by means of semi-automatic software, thereby allowing volume calculation and three-dimensional rendering, which have been demonstrated to improve the diagnosis, therapeutic monitoring, and follow-up of patients with liver cancer [9,10]. However, there is a lack of evidence about the reproducibility of 3D-CEUS volume calculations.
We undertook this study to investigate interobserver and intraobserver variability in volume calculations of FLLs by means of 3D-CEUS.

Materials and Methods

Patient Population

Institutional review board approval was obtained and full written informed consent was obtained for this prospective study (IRB #4/2019). Our study complied with the terms of the Declaration of Helsinki.
From February 2019 to August 2019, 39 patients (24 women and 15 men; mean age, 55.4±16 years; age range, 20 to 79 years) with 39 FLLs (mean size at baseline ultrasound, 3.1±1.8 cm; size range, 1 to 8 cm) prospectively underwent 3D-CEUS.
The inclusion criteria for the present study were as follows: (1) at least one FLL detectable at baseline ultrasound (in case of multiple lesions, the most suitable lesion for CEUS was chosen), and (2) a lesion depth no more than 12 cm. The exclusion criteria were as follows: (1) any major contraindication to ultrasound contrast agent administration (right-to-left shunt, pulmonary hypertension, or unstable cardiopulmonary conditions) and (2) lack of a reference standard for the final diagnosis.
Thirty of the 39 patients (77%) underwent CEUS for the characterization of a FLL detected but undetermined at baseline ultrasonography (US), whereas the remaining nine patients (23%) underwent CEUS for the assessment of a hepatocellular carcinoma (HCC) nodule 1 month after radiofrequency ablation (RFA).


Two experienced radiologists (with more than 10 years of experience in CEUS for liver imaging), who were aware of the patients’ clinical histories, performed US scanning by means of an iU22 unit (Philips Ultrasound, Bothell, WA, USA), provided with a C5-1 MHz convex array probe and Pulse Inversion imaging software. A baseline survey examination, including a color/power Doppler examination and spectral analysis, was performed. Once set, the US scan parameters, such as focal zone and time gain compensation, were not changed throughout the study. The ultrasound contrast agent used in the present study was sulfur hexafluoride (SonoVue, Bracco Imaging, Milan, Italy), which was injected intravenously as a 2.4-mL bolus followed by a 10-mL normal sterile saline flush using a 20- or 22-gauge peripheral intravenous cannula. A low frame rate (5 Hz) and a very low mechanical index (MI), ranging from 0.05 to 0.08, were used for real-time imaging. One focus was positioned below the level of the lesion.
Digital cineloops were registered during both baseline and postcontrast US in the arterial, hepatic venous, and extended hepatic venous or late phases (i.e., 5-40 seconds, 55-90 seconds and until 200-300 seconds from the beginning of the injection, respectively).


In the same session, with an interval at least of 15 minutes to allow for clearance of the previous contrast injection, the same radiologist who performed baseline ultrasound and 2D-CEUS also performed 3D-CEUS scanning using the same iU22 unit provided with a volumetric mechanical V6-2 MHz probe and Pulse Inversion imaging software. The specific inclusion criterion for 3D-CEUS was an FLL depth no more than 12 cm. Harmonic imaging was used and the image was optimized for size, tissue contrast, and resolution. Depending on the size and depth of each lesion, an appropriate sweep angle (angle range, 40° to 55°) was selected in order to encompass the entire lesion. SonoVue (Bracco Imaging) was then injected intravenously as a 4.8-mL bolus followed by a 10-mL normal sterile saline flush. For 3D-CEUS, a full bolus of 4.8 mL of sulfur hexafluoride was injected in order to compensate for some of the technical advantages of the C5-1 MHz probe over the V6-2 MHz probe, such as its operating frequency and PureWave crystals, which provide a better nominal penetration power for the C5-1 MHz probe. With suspended respiration, the 3D sweep was started and three volumetric datasets were acquired in the arterial, hepatic venous, and extended hepatic venous or late phases (i.e., 25-40 seconds, 60-90 seconds, and 200-300 seconds from the beginning of the injection, respectively). A very low MI, ranging from 0.06 to 0.08, was used and each volume acquisition lasted 2-4 seconds depending on the selected sweep angle, with a longer acquisition time for greater angles. Each examination lasted for about 5 minutes after the bolus injection.
All images and cineloops were digitally stored both as raw data in a PC-based workstation connected to the US units via a standard Ethernet link and sent to our picture archiving and communication system (Impax, Agfa-Gevaert, Milan, Italy).

Image Analysis

Four readers (three second-year radiology residents and one final-year radiology senior resident) independently and randomly reviewed the 3D-CEUS examinations off-line. The readers were not involved in the scanning and were blinded to the final diagnosis, as well as to the identity, clinical history, and any other imaging findings of the patients. Two consecutive interpretation sessions with a 7-day interval to avoid recall bias were held to complete the review process. First, the readers reviewed the entire exam and chose the best phase (i.e., arterial, hepatic venous, or late phase) to calculate lesion volume. The 3D volumes were calculated using a semi-automatic, commercially available proprietary software (QLAB, Philips Ultrasound) approved for clinical use and equipped with a volume rendering mode. This mode provides the capability of displaying the data set in three orthogonal planes. In order to better display the region of interest, readers were able to freely rotate and zoom the volume, as well as to choose the appropriate depth and adjust the degree of contrast. After defining and zooming in on the area of interest, the reader manually drew a line along the long axis of the lesion and the software automatically sectioned the lesion perpendicularly to the defined long axis, providing 15 slices (distance between the individual slice, 0.3 to 5.5 mm). Then the reader manually contoured the lesion slice by slice and when the latest contour was completed, the system automatically calculated the lesion volume in milliliters, also providing a 3D rendering.
For each lesion, the readers were asked to report the calculated volume and the time needed for a complete evaluation of each single 3D volumetric dataset, including defining, orienting, and zooming in on the area of interest. The QLAB software provides volume measurements in milliliters, while the International System of Units uses cubic centimeters. We converted the obtained values into cubic centimeters using the simple formula 1 mL=1 cm3. One week before starting the image analysis process, all the readers involved in this study attended a separate 5-hour training session and all readers had to evaluate 10 other FLLs (encompassing both benign and malignant masses, which were not included in the final study) individually and separately using QLAB.

Reference Standard

The final diagnosis was obtained by magnetic resonance imaging (MRI) with hepatocellular-specific gadolinium-based contrast agent in all 39 patients. MRI scans were performed on the same day as 3D-CEUS. Follow-up by means of both CT and/or MRI, laboratory data, and clinical assessments were also used to confirm the diagnosis. MRI was performed with a 1.5-T unit (Signa Excite HDXT, General Electric Healthcare, Milwaukee, WI, USA). The MRI protocol included pre-contrast axial breath-hold and respiratory-triggered T2-weighted fast spin echo sequences with and without fatsaturation, as well as unenhanced (in-phase and out-of-phase) T1-weighted and pre-contrast fat-saturated spoiled 3D gradient echo T1-weighted sequences. A triphasic dynamic contrast-enhanced study was obtained after the administration of an IV bolus of 0.1 mmol/kg of gadobenate dimeglumine (MultiHance, Bracco Imaging). The dynamic study was followed by a hepatocellular-specific phase obtained 2 hours after the injection of contrast material.

Statistical Analysis

Data were summarized as mean and standard deviation for continuous variables and as numbers and percentages for categorical variables. Differences in categorical variables were assessed using the Pearson chi-square or Fisher exact test. The differences in lesion volumes (cm3) in the two sessions and among readers were assessed using the Mann-Whitney U test and the Kruskal-Wallis test, respectively. Intraclass correlation coefficients (ICCs) with 95% confidence intervals (CIs) was calculated to assess the intrareader and inter-reader reliability among the four different readers, overall and for each lesion type. Inter-reader agreement was also evaluated according to the postcontrast phase, lesion localization, and size.
Agreement was categorized as poor (ICC, <0.00), slight (ICC, 0.00-0.20), fair (ICC, 0.21-0.40), moderate (ICC, 0.41-0.60), substantial (ICC, 0.61-0.80), or almost perfect (ICC, 0.81-1.00).
Bland-Altman analysis was performed to evaluate the magnitude to variation between readers and the two reading sessions. The averages of the differences and 95% limits of agreement (95% LOAs) were calculated.
The statistical significance level was set at P<0.05. The statistical analysis was conducted using SPSS version 20.0 (IBM Corp., Armonk, NY, USA) and MedCalc version 14.8 (MedCalc Software, Ostend, Belgium).


No adverse events were observed in our patients during or immediately after the injection of contrast agent. None of the 3D-CEUS examinations were considered inadequate for volumetric analysis.
According to the reference standard, 17 of the 39 FLLs (44%) were benign and 22 FLLs (56%) were malignant. Among the 17 benign lesions, one (3%) was hepatocellular adenoma (HCA), nine (23%) were focal nodular hyperplasia, six (15%) were hemangiomas, and one (3%) was a regenerative nodule. Among the 22 malignant lesions, six (15%) were HCC nodules, nine (23%) lesions were HCC nodules after RFA treatment, and seven (18%) were liver metastases (three from breast cancer, two from colon cancer, one from a gastrointestinal tumor, and one from gastric cancer).
Ten lesions were located in liver segment VI (25%), eight (20%) in segment VII, seven (18%) in segment IV, seven (18%) in segment V, five (13%) in segment VIII, one (3%) in segment III, and one (3%) in segment II.
Table 1 shows overall the intrareader and inter-reader agreement of the volume calculations. Overall, the calculated mean volume was 26.6±40.1 cm3 (volume range: 0.5-180 cm3), without significant differences (first session, P=0.953; second session, P=0.592) among different readers. The observed ICC for inter-reader agreement was 0.996 (95% CI, 0.992 to 0.998) for the first session and 0.994 (95% CI, 0.990 to 0.997) for the second session. For each of the four readers, there were no significant differences in volume calculations between the two session (P=0.503-0.924), while the intra-reader agreement ranged from 0.985 to 0.996. Bland-Altman plots showed that the mean difference between inter-reader measurements ranged from to -0.2 cm3 (95% LOA, 16.4 to -16.7 cm3) to -3.0 cm3 (95% LOA, 12.9 to -18.9 cm3) (Fig. 1). Specifically, the mean differences between the two sessions were 1.3, -2.5, -0.6, and 2.3 cm3 for readers 1, 2, 3, and 4, respectively (Fig. 2).
Tables 2 and 3 present details on volume calculations grouped according to lesion type (Fig. 3), with inter-reader and intrareader agreement, respectively. The observed ICC ranged from 0.976 to 0.999, corresponding to almost perfect inter-reader and intrareader agreement. Almost perfect inter-reader agreement was observed regardless of the postcontrast phase chosen for volume assessment (Table 4). For volume assessment, the four readers independently chose the arterial phase for 17 of the 39 FLLs (44%), the portal-venous phase for nine FLLs (23%), and the late phase for 13 FLLs (33%). A statistically significant tendency was observed for the lesions to be measured in the arterial phase (P=0.013).
The complete evaluation of a single 3D volumetric dataset, including defining and zooming in on the area of interest, contouring the lesion, and calculating the volume lasted on average 118±25.5 seconds (range, 75 to 150 seconds).


Since its introduction in clinical settings, 3D US has been widely used in gynecology, obstetrics, and cardiology, and in recent years, its use in liver imaging has also gained interest [11]. Nevertheless, volume rendering techniques cast "rays" through the 3D voxel-based volume and project the resulting image onto a 2D plane. In this situation, suboptimal results are obtained when there is not enough contrast between the examined structure and the adjacent tissues, such as in liver parenchyma [11]. The injection of microbubble-based contrast agents allows 3D-CEUS to overcome this limitation, paving the way for new applications of ultrasonography of the liver [4-6].
The availability of dedicated software for 3D-CEUS, such as QLAB, allows a precise assessment of the shape and volume of a liver mass [9,10]. In comparison with CT measurements of liver lesions, 3D-CEUS is readily available and does not rely on the use of ionizing radiation or potentially nephrotoxic contrast agents [7,8,12]. Furthermore, US is often the preferred imaging modality for guidance of loco-regional treatments, such as RFA [13]. In this setting, precise information about the shape and volume of a liver malignancy is crucial for optimizing tumor treatment in terms of type of needle electrode or the number of insertions [14,15]. Despite the potential importance of its role, the reproducibility of 3D-CEUS volume calculation still remains to be demonstrated. To our knowledge, this is the first study directly addressing the issue of the reproducibility of 3D-CEUS volume calculations.
In our study, the comparison of calculations of the volume of lesions among the four readers showed ICCs that were always above 0.994 and 0.985 for inter-reader and intrareader agreement, respectively. The practical interpretation of these results is almost perfect inter-reader agreement, without statistically significant differences between reading sessions. Interestingly enough, the readers involved in this study were not expert abdominal radiologists, but instead were radiology residents who had received only 5 hours of dedicated training. Hence, it might be hypothesized that, in the proper clinical setting, the specific process of volume calculation may be transferred to other professionals, thus sparing expensive medical time.
Our data showed almost perfect inter-reader agreement for all three postcontrast phases that were evaluated. This finding is of clinical relevance, since different postcontrast phases may provide useful information depending on the clinical scenario. The arterial phase is usually preferred for pre-treatment volume assessment of HCC or hypervascular metastases, whereas after loco-regional treatment of HCC, volume measurements in the late or portal-venous phase may be helpful in order to ensure that the entire HCC lesion has been included in the treated volume [9,14,15]. This may explain why the four readers independently chose the same phase to assess for each lesion. After RFA, the finding that the volume of the ablation zone is greater than the volume of the lesion does not itself guarantee complete ablation. Hence, a more precise assessment of treatment efficacy by means of imaging techniques such as CEUS, CT, or MRI is always needed. 3D-CEUS volume calculation might also allow an effective and early evaluation of antiangiogenic treatment of malignant tumors by encompassing the whole lesion and not only a section [16]. Of note, since shunts are not usually seen on CEUS, 3D-CEUS may allow for a more precise assessment of the true tumor volume in the arterial phase.
In our series we observed only one HCA. On CEUS, HCAs usually present a fast and centripetal arterial fill-in, followed by persistent enhancement in the extended portal-venous phase [17]. Nevertheless, the enhancement pattern may depend on the subtype of HCA, as well the presence of intralesional hemorrhage, necrosis, inflammation, and fat component [18]. The observed HCA was homogeneously, but slightly, hyperechoic in the arterial phase in comparison with the adjacent liver parenchyma. This may explain some discrepancy in our volume calculation. To a greater extent, if the FLL is isoechoic throughout the vascular phase, it may be difficult to obtain an accurate volume calculation.
Time consumption does not seem to represent a major limitation of the described 3D-CEUS technique, considering that in our experience a complete evaluation of each volumetric dataset lasted on average less than 2 minutes (mean, 118±25.5 seconds). This is another inherent advantage of the semi-automated nature of the software used in this study, whereas manual measurements made by radiologists are quite time-consuming.
This prospective study had some limitations. First, the patient population was relatively small. Second, we only included lesions suitable for 3D-CEUS, which may have led to selection bias, especially regarding deeply located lesions, which often are less suitable for CEUS. Nevertheless, this limitation did not affect the reproducibility assessment, at least when considering satisfactory 3D-CEUS examinations. Furthermore, in our study an intermittent imaging modality was used, whereas the introduction of novel technologies, such as new electronic matrix probes, allows real-time 3D volumetric evaluation of FLLs during the entire vascular phase [6].
In conclusion, 3D-CEUS assisted by semi-automatic software provided a fast and reproducible method to calculate the volume of FLLs, and this technique might be useful as an alternative to CT for pre- and post-treatment assessment of liver tumors.


Author Contributions

Conceptualization: Bartolotta TV, Taibbi A. Data acquisition: Sidoti Pinto A, Porrello G, Taravella R, Randazzo A. Data analysis or interpretation: Bartolotta TV, Cannella R. Drafting of the manuscript: Bartolotta TV. Critical revision of the manuscript: Bartolotta TV, Cannella R, Taibbi A. Approval of the final version of the manuscript: all authors.

Conflict of Interest

Tommaso Vincenzo Bartolotta serves as Editor for the Ultrasonography, but has no role in the decision to publish this article. All remaining authors have declared no conflicts of interest.


1. Ferraioli G, Meloni MF. Contrast-enhanced ultrasonography of the liver using SonoVue. Ultrasonography 2018;37:25–35.
crossref pmid pmc pdf
2. Bartolotta TV, Taibbi A, Midiri M, Lagalla R. Contrast-enhanced ultrasound of hepatocellular carcinoma: where do we stand? Ultrasonography 2019;38:200–214.
crossref pmid pmc pdf
3. Bartolotta TV, Taibbi A, Picone D, Anastasi A, Midiri M, Lagalla R. Detection of liver metastases in cancer patients with geographic fatty infiltration of the liver: the added value of contrast-enhanced sonography. Ultrasonography 2017;36:160–169.
crossref pmid pmc pdf
4. Dong FJ, Xu JF, Du D, Jiao Y, Zhang L, Li M, et al. 3D analysis is superior to 2D analysis for contrast-enhanced ultrasound in revealing vascularity in focal liver lesions: a retrospective analysis of 83 cases. Ultrasonics 2016;70:221–226.
crossref pmid
5. Luo W, Numata K, Morimoto M, Kondo M, Takebayashi S, Okada M, et al. Focal liver tumors: characterization with 3D perflubutane microbubble contrast agent-enhanced US versus 3D contrast-enhanced multidetector CT. Radiology 2009;251:287–295.
crossref pmid
6. Cao J, Dong Y, Fan P, Mao F, Wang W. Feasibility of dynamic three-dimensional contrast-enhanced ultrasound in focal liver lesions: image quality evaluation and correlation of quantification with two-dimensional contrast-enhanced ultrasound. Clin Hemorheol Microcirc 2019;72:305–316.
crossref pmid
7. Yan J, Schwartz LH, Zhao B. Semiautomatic segmentation of liver metastases on volumetric CT images. Med Phys 2015;42:6283–6293.
crossref pmid pmc
8. Yamamichi J, Kawaguchi Y, Otsuka T, Nakashita S, Mizobe H, Eguchi Y, et al. Assessment of tumor volume and density as a measure of the response of advanced hepatocellular carcinoma to sorafenib: application of automated measurements on computed tomography scans. JGH Open 2020;4:145–152.
crossref pmid pmc
9. Bartolotta TV, Taibbi A, Matranga D, Midiri M, Lagalla R. 3D versus 2D contrast-enhanced sonography in the evaluation of therapeutic response of hepatocellular carcinoma after locoregional therapies: preliminary findings. Radiol Med 2015;120:695–704.
crossref pmid pdf
10. Song Y, Cheng J, Zhang R. Contribution of 3-dimensional contrast-enhanced ultrasonography (CEUS) compared with 2-dimensional CEUS in the analysis of liver tumors. J Ultrasound Med 2018;37:1117–1128.
crossref pmid
11. Downey DB, Fenster A, Williams JC. Clinical utility of three-dimensional US. Radiographics 2000;20:559–571.
crossref pmid
12. Keil S, Behrendt FF, Stanzel S, Suhling M, Koch A, Bubenzer J, et al. Semi-automated measurement of hyperdense, hypodense and heterogeneous hepatic metastasis on standard MDCT slices. Comparison of semi-automated and manual measurement of RECIST and WHO criteria. Eur Radiol 2008;18:2456–2465.
crossref pmid pdf
13. Dodd GD 3rd, Soulen MC, Kane RA, Livraghi T, Lees WR, Yamashita Y, et al. Minimally invasive treatment of malignant hepatic tumors: at the threshold of a major breakthrough. Radiographics 2000;20:9–27.
crossref pmid
14. Cao J, Dong Y, Mao F, Wang W. Dynamic three-dimensional contrast-enhanced ultrasound to predict therapeutic response of radiofrequency ablation in hepatocellular carcinoma: preliminary findings. Biomed Res Int 2018;2018:6469703.
crossref pmid pmc pdf
15. Bartolotta TV, Taibbi A, Midiri M, De Maria M. Hepatocellular cancer response to radiofrequency tumor ablation: contrast-enhanced ultrasound. Abdom Imaging 2008;33:501–511.
crossref pmid pdf
16. Lassau N, Chebil M, Chami L, Bidault S, Girard E, Roche A. Dynamic contrast-enhanced ultrasonography (DCE-US): a new tool for the early evaluation of antiangiogenic treatment. Target Oncol 2010;5:53–58.
crossref pmid pdf
17. Bartolotta TV, Vernuccio F, Taibbi A, Lagalla R. Contrast-enhanced ultrasound in focal liver lesions: where do we stand? Semin Ultrasound CT MR 2016;37:573–586.
crossref pmid
18. Manichon AF, Bancel B, Durieux-Millon M, Ducerf C, Mabrut JY, Lepogam MA, et al. Hepatocellular adenoma: evaluation with contrast-enhanced ultrasound and MRI and correlation with pathologic and phenotypic classification in 26 lesions. HPB Surg 2012;2012:418745.
crossref pmid pmc pdf

Bland-Altman plot comparing inter-reader agreement (A-F) for volume measurements of lesions.

Fig. 1.

Bland-Altman plot comparing intrareader agreement (A-D) for volume measurements of lesions.

Fig. 2.

Focal nodular hyperplasia in a 29-year-old woman (segment VIII).

Three-dimensional contrast-enhanced ultrasound volumetric acquisition in the arterial phase (14 seconds after SonoVue injection) demonstrates a volume of 106.7 cm3.
Fig. 3.
Table 1.
Overall intrareader and inter-reader agreement of volume calculations of 39 focal liver lesions in two different reading sessions
Measurement (cm3) First session Second session P-value Intrareader ICC Bland-Altman analysis
Mean 95% LOA
Reader 1 26.1±40.0 24.7±37.8 0.795 0.995 (0.991 to 0.998) 1.3 11.6 to -8.9
Reader 2 27.1±41.9 29.6±45.0 0.503 0.995 (0.988 to 0.997) -2.5 9.0 to -14.0
Reader 3 25.8±38.6 26.3±40.8 0.924 0.996 (0.992 to 0.998) -0.6 9.3 to -10.4
Reader 4 27.3±42.9 25.1±36.8 0.873 0.985 (0.971 to 0.992) 2.3 21.3 to -16.7
P-value 0.953 0.592
Inter-reader ICC (95% CI) 0.996 (0.992 to 0.998) 0.994 (0.990 to 0.997)

Values are presented as mean±standard deviation unless otherwise indicated.

ICC, intraclass correlation coefficient; LOA, limits of agreement; CI, confidence interval.

Table 2.
Volume measurements (cm3) with inter-reader agreement according to the type of the focal liver lesion (n=39)
Lesion Reader 1
Reader 2
Reader 3
Reader 4
Mean volume ICC (95% CI)
First Second First Second First Second First Second
HCA (n=1) 151.0 153.0 173.0 180.0 130.0 138.0 175.0 130.0 151.5 ±21.4 NA
FNH (n=9) 28.8±35.9 29.3±38.4 28.8±39.8 32.0±43.9 29.0±37.4 28.5±38.9 27.0±36.3 27.3±35.4 28.8±36.4 0.998 (0.996-1.000)
Hemangioma (n=6) 14.2±24.7 12.3±19.2 12.3±18.9 15.3±23.2 14.1±23.8 14.4±22.7 14.4±24.7 15.0±25.0 13.9±21.1 0.998 (0.995-1.000)
RN (n=1) 1.1 1.3 2.9 1.6 1.6 2.1 1.3 1.6 1.8±0.7 NA
HCC (n=6) 23.6±28.3 22.1±25.4 26.0±30.8 27.5± 30.2 25.8±25.8 22.4±22.6 28.2±29.7 22.7±26.6 24.7±25.5 0.997 (0.992-1.000)
RFA-treated HCC (n=9) 19.7±39.0 17.4±32.3 19.6±32.5 17.0± 30.9 20.1±39.1 19.9±39.1 19.9±40.2 18.2±30.6 19.3±34.0 0.997 (0.994-0.999)
Metastasis (n=7) 29.1±47.9 29.1±49.6 31.2±50.6 31.5±52.4 31.8±54.3 33.0±56.6 30.7±50.4 30.3±49.3 30.8±48.0 0.999 (0.997-1.000)

Values are presented as mean±standard deviation.

ICC, intraclass correlation coefficient; CI, confidence interval; HCA, hepatocellular adenoma; NA, not available due to the low number of cases; FNH, focal nodular hyperplasia; RN, regenerative nodule; HCC, hepatocellular carcinoma; RFA, radiofrequency ablation.

Table 3.
Intrareader agreement between the two reading sessions according to the type of focal liver lesions
Lesion ICC (95% CI)
Reader 1 Reader 2 Reader 3 Reader 4
FNH (n=9) 0.998 (0.991-1.000) 0.996 (0.976-0.999) 0.999 (0.997-1.000) 0.994 (0.973-0.999)
Hemangioma (n=6) 0.983 (0.893-0.998) 0.984 (0.892-0.998) 0.999 (0.990-1.000) 0.999 (0.996-1.000)
RN (n=1) NA NA NA NA
HCC (n=6) 0.996 (0.978-0.999) 0.998 (0.986-1.000) 0.989 (0.891-0.999) 0.987 (0.556-0.998)
RFA-treated HCC (n=9) 0.990 (0.961-0.998) 0.987 (0.946-0.997) 0.985 (0.940-0.997) 0.976 (0.896-0.995)
Metastasis (n=7) 0.999 (0.995-1.000) 0.994 (0.964-0.999) 0.999 (0.997-1.000) 0.998 (0.989-1.000)

ICC, intraclass correlation coefficient; CI, confidence interval; HCA, hepatocellular adenoma; NA, not available due to the low number of cases; FNH, focal nodular hyperplasia; RN, regenerative nodule; HCC, hepatocellular carcinoma; RFA, radiofrequency ablation.

Table 4.
Inter-reader agreement according to the postcontrast phase selected for volume measurements
Postcontrast phase (number of lesions) First session ICC (95% CI) Second session ICC (95% CI)
Arterial (n=17) 0.995 (0.991-0.998) 0.993 (0.984-0.997)
Portal venous (n=9) 0.998 (0.996-1.000) 0.997 (0.993-0.999)
Late (n=13) 0.995 (0.989-0.998) 0.994 (0.985-0.998)

Inter-reader agreement was assessed using intraclass correlation coefficients (ICCs), with 95% confidence intervals (CIs).

Web of Science
We recommend
Editorial Office
A-304 Mapo Trapalace, 53 Mapo-daero, Mapo-gu, Seoul 04158, Korea
TEL : +82-2-763-5627   FAX : +82-2-763-6909   E-mail :
About |  Browse Articles |  Current Issue |  For Authors and Reviewers
Copyright © Korean Society of Ultrasound in Medicine.                 Developed in M2PI
Zoom in Close layer