Fusion imaging of real-time ultrasonography with CT or MRI for hepatic intervention

Article information

Ultrasonography. 2014;33(4):227-239

Publication date (electronic) : 2014 June 10

doi : https://doi.org/10.14366/usg.14021

Min Woo Lee

Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea

Correspondence to: Min Woo Lee, MD, Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81 Irwon-ro, Gangnam-gu, Seoul 135-710, Korea Tel. +82-2-3410-2548 Fax. +82-2-3410-0049 E-mail: leeminwoo0@gmail.com

Received 2014 April 21; Revised 2014 June 9; Accepted 2014 June 10.

Abstract

Introduction

Ultrasonography (US) has been widely used for interventional procedures for the liver due to a number of advantages: real-time capability, no radiation hazard, easy accessibility, and low cost [1,2]. When performing US-guided interventional procedures, the operators need to mentally register the reference data set (computed tomography [CT] or magnetic resonance [MR] images) and the working data set (real-time US images) [3]. However, this mental registration can be challenging when the liver cannot be scanned with orthogonal transverse, sagittal, or coronal planes, which are frequently used for the interpretation of CT or MR images in our daily practice. In addition, the deformation and displacement of the liver occurs by the breathing motion and heartbeats of patients. Moreover, a sonographic window of the liver is sometimes limited by the rib cage, colon, or omental fat surrounding the liver. Therefore, if erroneous mental registration occurs, this may lead to mistargeting during US-guided hepatic interventions [4].

Fusion imaging is a technique that fuses two different imaging modalities. In the field of hepatic intervention, real-time US is usually fused with other imaging modalities such as CT, MR, and positron emission tomography (PET)/CT. In our daily practice, challenging small target lesions are more frequently detected than before due to recent advances in CT and MR technology. Therefore, fusion imaging has gained considerable attention since it can help operators conduct interventional procedures with high confidence and accuracy for challenging target lesions [5,6]. In this article, an electromagnetic (EM) tracking-based fusion imaging technique and its current clinical application for the hepatic intervention is reviewed.

Electromagnetic Tracking-Based Image Fusion

For the fusion imaging technique, a variety of tracking methods are available, including optical, image-based, and EM tracking [3]. In general, optical tracking is most commonly utilized for surgical procedures and image-based tracking for vascular interventions. In contrast, EM tracking is most widely used for US-guided hepatic interventions. There are three components of the EM tracking-based fusion imaging technique: the magnetic field generator, position sensor, and position sensor unit. The magnetic field generator, which is located near the patient, creates a magnetic field, thereby inducing currents in the position sensor, which is mounted on the US transducer. As the US probe moves, the magnitude of the electrical current in the position sensor changes with respect to the magnetic field. With this information, the position sensor unit installed in the US machine calculates the exact location of the position sensor and thus, determines the direction and position of the US transducer [3,7]. This enables the side-by-side or overlay display of real-time US images and fused CT or MR images.

Image fusion by EM tracking can be performed by using either external fiducial markers or internal anatomic landmarks. When CT is performed with external fiducial markers attached to the body surface around a target organ, image fusion can be performed automatically between real-time US images and CT images. This is because the fiducial markers contain position sensor coils and are radio-opaque on CT images [8]. External MRI fiducial markers would also be helpful for accurate image fusion between real-time US and MR images. However, they are under development and are rarely available for EM tracking-based fusion imaging.

Image fusion can also be performed using the internal markers of patients. Internal markers refer to anatomic landmarks within a patient’s liver, such as focal hepatic lesions (i.e., cyst or calcification), bifurcation of the hepatic or portal vein, or liver configuration [9]. Despite several differences among various vendors, the basic concept of image fusion using internal markers is similar. The first step of image fusion using this method is uploading the data set to be fused with real-time US to the US machine. Then, image fusion is performed, which generally consists of plane and point registration. Plane registration is a process of finding the same plane on realtime US and uploaded CT or MR images. Any plane that clearly shows anatomic landmarks on both data sets can be used for plane registration. After plane registration, point registration is performed to match the two image data sets more accurately. This is usually performed by pointing out the same anatomic point near the target lesion between real-time US and CT or MR images, which can be repeated until optimal image fusion is obtained (Fig. 1). If a target lesion is already identified on real-time US before applying fusion imaging, image fusion can be performed very quickly using the following method: the image plane containing the target lesion is used for plane registration, and the target lesion itself is used for point registration by indicating the center of the lesion.

Fig. 1.

The process of image fusion between real-time ultrasonography (US) and magnetic resonance (MR) images by using internal markers.

A. Uploaded MR data are processed in the US machine and are displayed in the coronal plane (right figure) in the US monitor. The US image (left figure) is also scanned along the coronal plane that shows similar anatomic structures. Arrowheads indicate the right hepatic vein, and this vein was used as the anatomic landmark for plane registration. B. For the calibration of image fusion, point registration is performed by placing the cursor (cross marker) at the same anatomic structure. In this example, the bifurcation point of the inferior vena cava and the right hepatic vein was used for point registration. C. After plane and point registrations, the target lesion usually appears at a similar location of each image. Then, point registration is added by placing the cursor at the center (cross marker) of the tumor.

Instead of repeated point registrations, other vendors have a “rotate” or “drag” function to match the real-time US and uploaded CT or MR images, which is usually performed on the overlay display of the two data sets. There is also manual image fusion, which is performed by matching three internal markers on any image plane, including the oblique plane.

After the application of the fusion imaging technique, real-time US and fused CT or MR images appear side-by-side or overlaid on the US monitor. Therefore, the fused CT or MR image shows the same plane and moves synchronously with real-time US (Video clip 1). With the information of the fused CT or MR images, the location of the target lesion in relation to the perilesional anatomic landmark is easier to recognize on real-time US. Therefore, fusion imaging allows operators to detect a target lesion with poor sonographic conspicuity.

The time required for image fusion varies depending on the fusion imaging technologies and the level of experience of the operators. Since image fusion using internal markers may be cumbersome for beginners, automatic image fusion between real-time US and preprocedural CT or MR images would be helpful to simplify the overall workflow. Although prototype automatic image fusion by sweeping the liver volume has been introduced [10], clinical data for hepatic intervention with this automatic registration are rarely available. However, automatic registration is expected to be helpful for less experienced operators with respect to manual registration [11,12].

According to ex vivo experimental studies [13,14], the registration error between real-time US and CT images was within 3 mm, and the targeting error was also about 3 mm. Although these studies were performed in the explanted liver, the error seems to be acceptable.

Liver Application of Fusion Imaging

Many hepatic interventional procedures benefit from fusion imaging, enabling operators to conduct percutaneous interventional procedures for challenging target lesions that would otherwise not be possible [5,6,9,15-22]. For example, fusion imaging is useful for the percutaneous biopsy of a focal hepatic lesion that has poor conspicuity on B-mode US [6,23,24] (Figs. 2, 3). Using this technique, we can reduce the sampling error by an accurate localization of the target lesions.

Fig. 2.

Fusion imaging-guided biopsy of a focal hepatic lesion with poor sonographic conspicuity in a patient with pancreatic head cancer.

A. Hepatobiliary-phase magnetic resonance (MR) image shows a 6-mm focal hepatic lesion (arrow) in the liver. B. Percutaneous biopsy was performed to rule out metastasis. The lesion (arrow) can be identified with the use of fusion imaging even though it was invisible on B-mode ultrasonography. Biopsy revealed that it was a metastasis from pancreatic cancer.

Fig. 3.

Fusion imaging-guided biopsy of a focal hepatic lesion in a patient with hepatitis B virus carrier.

A. Precontrast T1-weighted magnetic resonance (MR) image shows an ill-defined lesion (arrow) with an iso-to-high signal intensity. B. The lesion (arrow) shows arterial enhancement. C. In the hepatobiliary phase, the lesion (arrow) shows a low signal intensity. D. Planning ultrasonography (US) for radiofrequency ablation (RFA) was performed since the lesion was diagnosed as a small hepatocellular carcinoma (HCC) on the MR images. On planning US with fusion imaging, the location (arrow) of the lesion on US was different from that on the fused MR image. In addition, since the signal intensity on the pre-contrast T1-weighted image was not consistent with that of the usual HCC, instead of RFA, percutaneous biopsy was performed; it revealed that the lesion was an eosinophilic abscess.

Fusion imaging also improves the conspicuity of hepatocellular carcinomas (HCCs) and the feasibility of percutaneous radiofrequency ablation (RFA) of HCCs not identifiable on B-mode US [9,18]. Therefore, it can reduce the number of RFA sessions for HCCs invisible on B-mode US [18]. Given that the detectability of HCCs depends on the tumor size [1,25], fusion imaging is likely to be more useful for small HCCs. This assumption was supported by a recent study where the detectability of HCCs smaller than 2 cm was much higher when using fusion imaging than when using conventional B-mode US, whereas for HCCs equal to or larger than 2 cm, this was not the case [5]. Fusion imaging is also useful in avoiding the mistargeting of HCC-ablating a pseudolesion, not the true lesion-by reducing the false-positive detection of small HCCs on B-mode US [5,22] (Fig. 4). Fusion imaging can also guide accurate overlapping ablations of HCCs on the basis of the fused CT or MR images (Fig. 5).

Fig. 4.

Fusion imaging-guided radiofrequency ablation (RFA) of a 1.2-cm hepatocellular carcinoma (HCC) with poor sonographic conspicuity in a patient with a hepatitis B virus carrier.

A. Arterial-phase T1-weighted magnetic resonance (MR) image shows a small enhancing tumor (arrow) in the right liver dome. B. On planning ultrasonography (US) before image fusion, a small echogenic lesion (arrow) was identified and was considered to be the HCC identified upon MRI. C. However, after image fusion, the index tumor (arrow) was located at a different site. Therefore, the lesion identified before image fusion was a pseudolesion. Percutaneous RFA was performed with confidence. D. Immediate post-RFA computed tomography scan shows that it was a technical success with a sufficient ablative margin (arrowheads). In this case, mistargeting was avoided by using the fusion imaging technique.

Fig. 5.

Fusion imaging-guided radiofrequency ablation (RFA) of a 3.1-cm hepatocellular carcinoma.

A. Arterial-phase T1-weighted magnetic resonance (MR) image shows an enhancing tumor (arrow) in the right lobe of the liver. B. The lesion (arrow) shows a low signal intensity in the hepatobiliary phase. C. Fusion imaging-guided RFA was performed. Residual unablated tumor (arrow) was identified intuitively on the basis of the fused MR images. D. The residual tumor was ablated by repositioning one electrode. A large echogenic zone (arrowheads) was made, which was sufficiently large to cover the entire tumor. E. Immediate post-RFA computed tomography scan shows that it was a technical success with a sufficient ablative margin (arrowheads).

However, not all small HCCs are visible on fusion imaging. The detection of small HCCs in a deep location in patients with liver cirrhosis is still challenging even with the guidance of fusion imaging. According to a recent study [9], out of 120 HCCs (mean tumor size, 1.0 cm; range, 0.5 to 2.2 cm), 82 HCCs (68.3%) were invisible even on fusion imaging. However, 31.7% (26/82) of the HCCs unidentifiable on fusion imaging could be ablated by inserting an electrode on the basis of peritumoral anatomic landmarks.

Fusion Imaging with Contrast-Enhanced US

Since contrast-enhanced ultrasonography (CEUS) is also useful for the guidance of percutaneous hepatic interventions [26-28], CEUS can be used in addition to fusion imaging if the target lesions have poor conspicuity even on fusion imaging (Figs. 6-8). When used simultaneously, CEUS is displayed with fusion imaging, not with B-mode US [29]. Among various US contrast agents, Sonazoid (perflubutane microbubbles; GE Healthcare, Oslo, Norway), offering both vascular and post-vascular phases, is effective in localizing small HCCs that have poor conspicuity on B-mode US [30,31].

Fig. 6.

Fusion imaging and contrast-enhanced ultrasonography (US)-guided radiofrequency ablation (RFA) of a 1-cm hepatocellular carcinoma (HCC) in a patient with a hepatitis B virus carrier.

A. Arterial-phase T1-weighted magnetic resonance (MR) image shows a subtle enhancing lesion (arrow) in segment 6 of the liver. B. The lesion (arrow) shows a low signal intensity in the hepatobiliary phase. C. Fusion imaging-guided RFA was performed. Due to the coarse echo texture of the liver, the index tumor was unidentifiable even on the US of fusion imaging where the tumor (arrow) was located in the fused MR image. D. Contrastenhanced US was added to the fusion imaging. In the arterial phase, an enhancing nodule (arrow) is identified. E. In the Kupffer phase, the lesion (arrow) is seen as a defect, confirming that the lesion is an HCC. F. Targeting was performed in the Kupffer phase. Arrowheads indicate the exposed tip of an electrode. G. Immediate post-RFA computed tomography scan shows that the tumor was completely covered by the ablation zone (arrowheads), suggestive of technical success.

Fig. 7.

Fusion imaging and contrast-enhanced ultrasonography (US)-guided radiofrequency ablation (RFA) of a subcentimetersized recurrent hepatocellular carcinoma (HCC) in a patient with a hepatitis B virus carrier. The patient had previously undergone percutaneous RFA of HCC.

A. In the magnetic resonance (MR) images (arterial phase, followed by portal phase, T2-weighted image, diffusion-weighted image, and hepatobiliary phase), the lesion (arrowheads) shows the typical imaging features of HCC. Although the size of the lesion was measured to 0.8 cm, it was regarded as a recurrent HCC since it was a new lesion, not seen in the previous computed tomography or MR images. B. To be certain, contrast-enhanced US was performed in addition to the fusion imaging. On the scout image, the lesion (arrow) was identified at the same location where the index tumor (arrow) was located on the fused MR image. C. In the arterial phase, the lesion (arrow) shows strong enhancement. D. In the Kupffer phase, the lesion (arrow) is seen as a defect, indicating that the lesion is an HCC. E. Immediate post-RFA computed tomography scan shows that the tumor was completely covered by the ablation zone (arrow), suggestive of technical success.

Fig. 8.

Fusion imaging and contrast-enhanced ultrasonography (CEUS)-guided radiofrequency ablation (RFA) of a 1.3-cm hepatocellular carcinoma (HCC) in a patient with a hepatitis B virus carrier.

A. Arterial-phase T1-weighted magnetic resonance (MR) image shows a small enhancing lesion (arrow) in the periphery of segment 6 of the liver. B. The lesion (arrow) shows a low signal intensity in the hepatobiliary phase. C. Fusion imaging-guided RFA was performed. On the US of the fusion imaging, a small low echoic lesion (arrow) was identified at the similar location (arrow) of the tumor on the fused MR image. D. However, to obviate the risk of mistargeting, CEUS was performed additionally. On CEUS, the lesion identified on fusion imaging (C) did not show arterial enhancement. True HCC was obscured by a rib shadow and was identified as a small enhancing lesion when the patient breathed in slightly when the liver was slightly shifting down (not shown here, Video clip 3). The lesion was targeted with the patient holding the breath after inhaling a small amount of air in the Kupffer phase when the index tumor (arrow) was seen as a defect. The arrowheads indicate the exposed tip of the electrode. E. Immediate post-RFA computed tomography scan shows that the tumor was completely covered by the ablation zone (arrowheads), suggestive of technical success. In this example, mistargeting was avoided by the use of CEUS in addition to fusion imaging.

The combined use of fusion imaging and CEUS has several advantages for localizing small HCCs with poor sonographic conspicuity. Most of all, the overall procedure time of CEUS-guided intervention can be reduced. With fusion imaging, the operator can estimate the location of the target lesion before contrast injection, making it easier to evaluate a nodule throughout the vascular phase. If the lesion shows arterial enhancement and a low echogenic defect during the postvascular phase, we do not have to re-inject Sonazoid to see the so-called defect-reperfusion imaging for HCC [32]. Therefore, the overall procedure time of CEUS-guided intervention would be substantially decreased if CEUS is combined with fusion imaging [33].

Image Fusion with 3-Dimensional US Images

Three-dimensional (3D) US can also be used as a reference data set and can be fused with real-time US. Unlike CT or MR images, which are obtained prior to the RFA procedure, 3D US images are obtained at the time of RFA procedures after electrode insertion. If 3D US is fused with real-time US, it can help the operator to monitor and control RFA procedures. On the basis of the fused 3D US, the operator can understand comprehensive 3D relationships of the index tumor, peritumoral anatomic landmarks, and electrodes inserted through the tumor. The information with respect to the location of the electrode in relation to the tumor makes electrode repositioning more convenient whenever it is needed (Video clip 2).

Electromagnetic Needle Tracking

Virtual needle tracking can be provided by the fusion imaging system with the use of the EM position sensor embedded in the distal tip of a needle or attached to the hilt of the needle [34,35]. Theoretically, the accuracy of virtual needle tracking depends on the location of the EM position sensor. A needle with a position sensor at the distal tip of the needle can provide a more accurate expected electrode path than that with a position sensor attached to the hilt of the needle because the needle can bend in the liver at the time of targeting [34,36]. This fact was supported by a study in which the virtual tracking error was less than 2 mm when the position sensor was located at the distal tip of the needle [34]. A virtual needle tracking system would be valuable for interventional procedures for challenging target lesions. For example, target lesions that cannot be reached by the usual in-plane approach would benefit from a needle tracking system that can allow operators to reach the target lesion with an out-of-plane approach [36,37]. In addition, large tumors requiring overlapping ablation would benefit from the needle tracking system since the virtual electrode tip appears within an echogenic cloud during the ablation procedures [35].

Limitation of Fusion Imaging

Since the usual reference data sets (CT, MRI, or PET/CT) are obtained with the patients in a breath-holding state, they contain static images. In comparison, a working data set (real-time US) is affected by tissue deformation due to the patient’s respiration and movement. In addition, the positioning of patients during a realtime US examination can differ from that during the acquisition of reference data sets. Moreover, most commercially available fusion imaging systems are based on rigid registration, which lacks compensating patient respiration and movement [7]. Hence, some degree of registration error is inevitable between real-time US and fused reference data sets. This assumption is supported by the results of a previous study [38] in which the mean maximum registration error between real-time US and fused CT images was 11.5 mm in patients with hepatic metastasis. To decrease the registration error, it would be better to perform image fusion when the respiratory status of a patient is the same as when the reference data set was acquired. For example, if the MR images to be fused with real-time US was obtained during the expiratory phase, image fusion should be performed during the same expiratory state of the patient.

In a recent study [39], mistargeting occurred in 1.3% (7/551) of the patients with HCCs even though fusion imaging was used for the guidance of RFA of HCCs. All patients who suffered from mistargeting were hepatitis B virus (HBV) carriers, and their tumors were mostly smaller than 1.5 cm and were located in the periphery of the liver. Given that liver cirrhosis caused by HBV is characterized by macronodular cirrhosis, which has numerous pseudolesions mimicking the target tumor on the US examination [4], caution should be taken during RFA procedures in patients who are HBV carriers. In addition, when the tumor is located in the periphery of the liver, it may not be possible to use large vessels as anatomic landmarks to locate the tumor. Moreover, liver deformation and displacement by the patient’s breathing motion may be more apparent in the peripheral than in the central liver [39]. Therefore, for these challenging cases with a small size and a peripheral location, CEUS can be combined with fusion imaging to obviate the risk of mistargeting (Fig. 8, Video clip 3).

In the EM tracking-based fusion imaging technique, increased magnetic field strength can increase the accuracy of image fusion. Hence, the magnetic field generator should be located near the region of interest and skin fiducials, which may restrict free device movement during the procedures. In addition, since magnetic field homogeneity is also crucial, any conductive object or magnetic substance should be located far away so as not to alter the magnetic field [3,40].

Future of Fusion Imaging

Since the manual fusion of real-time US and CT or MR images is difficult for beginners, most vendors are developing automatic image fusion methods. However, they need more improvements. First of all, the speed of image fusion and its accuracy should be improved further. In addition, the success rate of automatic image fusion should be enhanced. Furthermore, although automatic image fusion between real-time US and preprocedural CT images has been introduced by some vendors, it should also work with preprocedural MR images. In general, MR images are preferred as the reference data set over CT images due to the high contrast between the target lesions and the surrounding anatomic landmarks [22,41].

To overcome the limitations of EM tracking-based fusion imaging, respiratory gating or motion correction by the dynamic reference position sensor placed on the patient would be helpful in minimizing the registration error due to the movement of the patient or of the devices [3]. In addition, we hope that real-time non-rigid registration that can provide localized stretching and deformation of the fused CT or MR images [42] and thus, expected to compensate for liver deformation occurring on real-time US, will be available in the near future.

Summary

Fusion imaging is a technique that fuses the working data set and the reference data sets. With the fused reference data sets, fusion imaging is useful for localizing inconspicuous focal hepatic lesions on B-mode US. It can facilitate accurate interventional procedures such as RFA and biopsy even for challenging target lesions.

Supplementary Material

Article information Continued