Skip to main content

Advertisement

European Journal of Hybrid Imaging

EJNMMI Multimodality Journal

European Journal of Hybrid Imaging Cover Image
We’d like to understand how you use our websites in order to improve them. Register your interest.
Download PDF

Trends in oncologic hybrid imaging

European Journal of Hybrid Imaging volume 2, Article number: 1 (2018) Cite this article

Abstract

Hybrid imaging plays a central role in the diagnosis and management of a wide range of malignancies at all stages. In this article, we review the most pertinent historical developments, emerging clinical applications of novel radiotracers and imaging technologies, and potential implications for training and practice. This includes an overview of novel tracers for prostate, breast, and neuroendocrine tumors, assessment of tumor heterogeneity, the concept of image-guided ‘biologically relevant dosing’, and theranostic applications. Recent technological advancements, including time-of-flight PET, PET/MRI, and ‘one-minute whole-body PET’, are also covered. Finally, we discuss how these rapidly evolving applications might affect current training curricula and how imaging-derived big data could be harnessed to the benefit of our patients.

Background

In biology, a hybrid is defined as the offspring of different species, genera or varieties, resulting in an individual that not only combines the qualities of its parents but may exhibit improved qualities or functions, a phenomenon referred to as ‘hybrid vigor’. Similarly, the synergistic combination of anatomical imaging (e.g. computed tomography-CT, magnetic resonance imaging-MRI) and molecular imaging techniques (e.g. positron emission tomography-PET, single photon emission computed tomography-SPECT) can provide a more complete insight into biological processes within their macro-anatomical, often whole-body, environment. While combinations of these techniques have been applied in a broad range of medical disciplines (e.g. oncology, cardiology, neurology, psychiatry, pharmacology), this article focuses on hybrid imaging in oncology, where 18F–fluorodeoxyglucose (FDG)-PET/CT accounts for the majority of current applications. With recent and expected approvals of radiotracers, new developments in PET/CT technology, and increased use of PET/MRI, hybrid imaging is expected to cover much more diverse clinical roles in the near future. This review gives an overview of pertinent historical developments, emerging applications, and future trends.

Historical milestones

The evolution of hybrid imaging in oncology was driven by both technical and radiopharmaceutical developments (Fig. 1). As early as in 1972, the US Food and Drug Administration (FDA) approved the first positron-emitting radiotracer, 18F–sodium fluoride (18F–NaF), for bone scintigraphy using planar gamma camera imaging. This was before the first PET scanner became commercially available in 1978. With the commercial availability of self-shielded, low-energy cyclotrons for use in the hospital environment, and combined PET/CT scanners, the potential of PET imaging could be exploited clinically. Over the following nearly three decades, the few newly approved PET tracers were for non-oncologic indications; it was not until the year 2000 that 18F–FDG, which had first been administered to a human in 1976 and approved for neurologic studies in 1994, was broadly approved for imaging in patients with cancer. Since then, another seven PET tracers have been approved by the FDA, and additional approvals are expected for myocardial perfusion imaging and imaging of prostate cancer in the near future. This suggests that growth in the number of clinically available molecular imaging probes is accelerating. In Europe, less rigid regulatory provisions on radiopharmaceuticals have allowed for a more rapid transition of novel radiotracers into clinical care during the last years. The latest technical milestones were the market maturity of time-of-flight (TOF) PET systems (2006) and the FDA approval of the first PET/MRI system in 2011. The expanding number of hybrid imaging devices and molecular imaging probes has implications for clinical practice, staff training, image and data analysis, and the way we perform research and clinical studies in oncology.

Fig. 1
figure1

Timeline of Food and Drug Administration (FDA)-approvals of PET tracers and technical milestones, from 1972 to 2016. Abbreviations: NaF: Sodium fluoride, RbCl: Rubidium chloride, FDG: Fluorodeoxyglucose, PET: Positron Emission Tomography, CT: Computed Tomography, MRI: Magnetic Resonance Imaging, TOF: Time-of-Flight

Full size image

Novel tracers and applications

At this time, 18F–FDG remains the most thoroughly studied and most widely used tracer in oncologic hybrid imaging due to biological reasons, most importantly the Warburg effect, and technical/practical considerations, e.g., the possibility of on-site synthesis and the tracer’s favorable effective half-life. In the US, 18F–FDG has an established role for the initial staging, treatment response assessment, and restaging of a broad range of malignancies. In several countries outside of the US, imaging of prostate cancer with PSMA (prostate-specific membrane antigen) directed agents has become a standard examination for restaging of prostate cancer. While 18F–FDG and 68Ga- or 18F–PSMA ligands will most probably remain the workhorses for oncologic hybrid imaging in the foreseeable future, several other imaging probes are being developed and clinically tested, which are intended to cover clinical scenarios in which 18F–FDG and PSMA ligands do not provide sufficient precision in tumor characterization. While a detailed description of all these agents would be widely beyond the scope of this article, the following paragraphs introduce some of them and describe emerging applications of hybrid imaging.

Prostate cancer

Prostate cancers exhibit variable 18F–FDG avidity. While advanced castration-resistant metastatic disease typically shows intense FDG avidity which is similar to that seen in high-grade lymphomas, FDG uptake is typically low in low-grade prostate malignancies and at early clinical states of prostate cancer. Therefore, its clinical value is limited for initial staging and localization of metastases in the setting of biochemical recurrence after prostatectomy or radiation therapy (Liu et al., 2016). Several PET tracers targeting different molecular structures and processes have been developed as alternatives (Wibmer et al., 2016), and two of them, 11C–choline and 18F–Fluciclovine, have recently been approved by the FDA. In a prospective study directly comparing these two tracers in patients with biochemical relapse after prostatectomy, 18F–Fluciclovine was found to detect more recurrent or metastatic lesions than 11C–choline PET/CT (Nanni et al., 2016). The performance of both agents was dependent on prostate-specific antigen (PSA) levels, and in patients with a PSA level below 1 ng/mL, the detection rates were 14% for 11C–choline and 21% for 18F–Fluciclovine, indicating that there is still a need for more sensitive tracers.

Prostate-Specific Membrane Antigen (PSMA), another target for imaging tracers, is a transmembrane protein that is highly overexpressed in prostate cancer compared to normal prostate and non-prostatic tissues (Ristau et al., 2014). Several PSMA-directed radiolabeled agents have been developed, including monoclonal antibodies, antibody-fragments, minibodies, and more recently small molecules. During the last 5 years, small-molecule ligands for PSMA have shown exceptional sensitivity and specificity for detection of recurrent prostate cancer. On the basis of these data, PSMA PET/CT, as noted earlier, is now the de-facto clinical standard for restaging of patients with biochemical recurrence in many countries. For instance, in a retrospective analysis of 1007 patients undergoing PET/CT with a radiolabeled small molecule PSMA-ligand (i.e. 68Ga-PSMA-11) for the evaluation of recurrent prostate cancer, the detection rate in patients with PSA levels ≤1 ng/ml was reported to be 57% (Afshar-Oromieh et al., 2017). In another study of 48 patients with biochemical recurrence, 68Ga-PSMA PET detected 53 of 68 pathology-proven lymph node metastases, yielding an area of 0.878 (95% confidence interval: 0.819–0.937) under the receiver operator characteristic (ROC) curve in a field-based analysis (Rauscher et al., 2016). In a patient-based analysis of the same population, the area under the ROC curve for detection of lymph node metastases was 0.732 (95% confidence interval: 0.583–0.850). Some other PSMA-directed agents have not only been linked to positron-emitting isotopes for diagnostic purposes but also to α/β-emitters for radioisotope therapy, e.g., 177Lu (Baum et al., 2016). By linking both diagnostic and therapeutic isotopes to the same tracer (i.e., creating ‘theranostic’ agents), one can reliably predict the in-vivo binding of the therapeutic agent and achieve patient- and organ-tailored dose calculation. Recent retrospective European studies have demonstrated promising surrogate response rates for this kind of therapy (Rahbar et al., 2017; Brauer et al., 2017), and future randomized phase II/III trials are warranted to evaluate whether these will ultimately translate into survival benefits. A more detailed description and imaging example of this ‘theranostic’ concept is provided in the paragraph on neuroendocrine tumors later in this article.

18F–Fluorodehydrotestosterone (18F–FDHT) is a less widely used testosterone analogue binding the androgen receptor, whose activation is essential for the survival and proliferation of prostate cancer cells, and the central target of medical treatment of advanced and recurrent prostate cancer. Due to its specificity for this receptor, 18F–FDHT cannot only localize metastases but has also been used for in-vivo visualization of binding of androgen receptor-blocking therapeutic agents (Pandit-Taskar et al., 2016; Vargas et al., 2014). This allows for an early evaluation of drug binding and for adjusting the dose to an individual patient’s needs (Rathkopf et al., 2013). This concept of a patient-tailored ‘biologically relevant dose’ might revolutionize the dosing of anti-cancer drugs, away from the ‘maximum tolerated dose’ concept, which is based on side effects rather than drug efficacy. Another potential application of this tracer is as a predictive biomarker to assess the prospects of pharmacological blockade of the androgen receptor.

Breast cancer

Similar to prostate cancer, the FDG avidity of breast cancer is variable and depends on its histologic and biologic characteristics, where invasive ductal carcinomas, higher grade, and triple-negative tumors (i.e. tumors which lack estrogen receptors (ER), progesterone receptors (PR), and human epidermal growth factor receptors 2 (HER2) typically show more intense tracer uptake (Yoon et al., 2014). For diagnostic purposes, it is therefore essential to consider these factors when choosing the appropriate diagnostic tools. For patients with ER-positive, HER2-negative breast cancer, for example, the hybrid application of FDG-PET and CT was shown to reveal distant metastases that were not apparent on conventional imaging or surgical staging in up to 26% of cases (Ulaner et al., 2017). For lobular breast cancer, which is generally less FDG avid than ductal breast cancer, the CT component not only decreases the number of false positive PET findings but also detects non-FDG-avid metastases (Hogan et al., 2015). Due to this heterogenous FDG-avidity of breast cancer, alternative molecular imaging probes targeting receptor molecules have been developed and tested clinically. One of these is radiolabeled Trastuzumab, a monoclonal antibody targeting HER2 (Henry et al., 2017). This drug was approved for clinical use by the FDA in 1998 and is a mainstay of therapy of HER2-positive breast cancer. Of note, in up to 15% of patients with HER2-positive primary cancer, HER2-expression can be lost in metastatic foci (Priedigkeit et al., 2017; Paik et al., 2008). This cancer-evolutionary step renders HER2-directed therapy ineffective and might be one of the reasons for mixed responses to systemic therapies that are often encountered in patients with metastatic breast cancer (an example is shown in Fig. 2). As biopsy of metastases is affected by sampling bias and may miss this crucial intra-individual cancer heterogeneity (Mestel, 2017), HER2-directed hybrid imaging may identify a sub-group of patients in need for alternative treatment. Conversely, about 10–20% of patients with primary HER2-negative breast cancer develop HER2-positive metastases and might benefit from HER2-directed systemic therapy (Priedigkeit et al., 2017; Rossi et al., 2015). Also in this scenario, hybrid imaging can help to identify targets for biology-guided precision biopsy and select the appropriate therapy, as shown in a proof-of concept study where 89Zr-trastuzumab-PET/CT demonstrated metastases in 5 of 9 patients with primary HER2-negative metastatic breast cancer (an example is provided in Fig. 3) (Ulaner et al., 2016). Two of these patients had biopsy-proven HER2-positive metastases and responded to HER2-targeted therapy. However, the specificity of trastuzumab PET for HER2 overexpressing breast cancer and the relationship between trastuzumab uptake in-vivo and the immunohistochemistry staining results (which are the accepted standard for treatment with HER-directed therapies) need to be studied further (Ulaner et al., 2016; Ulaner et al., 2017).

Fig. 2
figure2

18F–FDG-PET/CTs in a patient with metastatic breast cancer before and after systemic therapy illustrating mixed treatment response. While an osseous cervical spine metastasis (green arrows) responded to treatment, several axillary lymph node metastases (red arrows) showed growth and increased FDG uptake. Mixed response to treatment is more commonly encountered in advanced, previously treated malignancies and hybrid imaging may help to prospectively identify patients in need for alternative treatment regimens

Full size image
Fig. 3
figure3

a 89Zr-Trastuzumab-PET/CT in a patient with HER2-negative primary breast cancer showing intense tracer uptake in a right supraclavicular lymph node metastasis. b Immunohistochemistry of the primary cancer proved HER2-negativity, while c biopsy and immunohistochemistry of the suspicious lymph node showed markedly HER2-positive metastatic disease. This patient responded to HER2-directed therapy. Adapted and reprinted with permission from Ulaner et al. J Nucl Med 2016;57:1523–1528

Full size image

18F–Fluoroestradiol (18F–FES) is a radiolabeled analogue of estradiol that can be used to image patients with estrogen receptor (ER)-positive breast cancer (Ulaner et al., 2016). As for HER2 expression, significant spatial and temporal inter-metastatic heterogeneity of ER-expression has been reported (Hoefnagel et al., 2013), substantiating the need for repeated whole-body assessment of ER-status by hybrid imaging. In a phase I trial of a novel ER-targeting therapeutic (i.e. GDC0810), 18F–FES was also used to monitor in-vivo drug binding and successfully assess the appropriate dose for subsequent phase II trials (Wang et al., 2016). An example of this concept is provided in Fig. 4. This shows that ‘biologically relevant dosing’, as assessed by hybrid imaging, might change the way future clinical oncologic drug trials are designed and conducted.

Fig. 4
figure4

In-vivo monitoring of drug-target-interaction with 18F–Fluoro-Estradiol (FES)-PET/CT in a patient with metastatic estrogen receptor-positive breast cancer being treated with an estrogen receptor-directed agent. The pre-therapy scan (top image) showed multiple chest wall metastases with avid tracer uptake. After initiation of the therapy (bottom image), tracer uptake resolved, while the size of the metastases did not change. It is important to recognize that these findings prove that the drug has hit its target but do not necessarily indicate treatment response. Retained tracer is seen in a central venous catheter on both studies

Full size image

18F–Fluciclovine, which has been approved by the FDA for imaging of patients with recurrent prostate cancer, has also been evaluated in patients with breast cancer. In a prospective clinical trial in patients with locally advanced breast cancer, tracer uptake was seen in 20 of 21 patients with pathologically-proven metastatic axillary lymph nodes and revealed unsuspected extra-axillary metastases in three (Ulaner et al., 2016). Of note, invasive lobular cancer showed higher tracer uptake on 18F–Fluciclovine than on 18F–FDG-PET/CT (Figure 5), while the converse was true for invasive ductal carcinoma (Ulaner et al., 2016). In a prospective clinical pilot trial of 24 females with newly diagnosed advanced invasive ductal and lobular breast cancer, changes in 18F–Fluciclovine uptake before and after neoadjuvant systemic therapy were strongly correlated with treatment response on pathology (Spearman ρ, 0.79, p < 0.001) (Ulaner et al., 2017), indicating a potential role in the non-invasive assessment of treatment response for this tracer.

Fig. 5
figure5

18F–Fluorodeoxyglucose (FDG)- and 18F–Fluciclovine-PET/CTs in a patient with locally advanced invasive lobular breast cancer. A right axillary lymph node metastasis (blue arrows) showed mild FDG uptake (SUV: 2.1) but more marked Fluciclovine uptake (SUV 5.4)

Full size image

Neuroendocrine Tumors (NET)

Well-differentiated NETs are typically not FDG avid and overexpress membrane receptors for somatostatin (Baumann et al., 2016). Different types of radiolabeled somatostatin analogues have been developed, including 111In-labled agents, and more recently PET-tracers, most of which contain a central 68Ga-labeled chelating agent (i.e. DOTA). PET/CT with 68Ga-DOTA-TATE was shown to outperform conventional imaging and SPECT/CT with 111In-pentetreotide (Sadowski et al., 2016), have a substantial impact on clinical decision making (Calais et al., 2017; Barrio et al., 2017), and was recently approved by the FDA for use in humans with neuroendocrine tumors. The same agent has also been labeled with 177Lu, a β-emitter for therapeutic purposes. While the 68Ga-labeled compound is being used for localization of cancer foci, it does also predict the uptake and bio-distribution of its 177Lu-labeled therapeutic ‘sister’ agent. This has two main implications. First, the diagnostic agent can be used to select patients with avid tumors who will most likely benefit from the radionuclide therapy. Secondly, it allows for the assessment of patient-specific bio-distribution and the calculation of organ doses which determine the maximum tolerable dose (Kairemo & Kangasmaki, 2013). The efficacy of this treatment has recently been demonstrated in a randomized phase III trial in patients with metastatic midgut NET, which showed that the addition of 177Lu-DOTA-TATE treatment to best supportive care resulted in a significantly higher response rate (18% vs. 3%, p < 0.001) and longer progression-free survival (65.2% vs. 10.8% at 20 months, p < 0.001) (Strosberg et al., 2017). An imaging example of this theranostic principle in a patient with metastatic NET is provided in Fig. 6.

Fig. 6
figure6

68Ga-DOTA-TATE-PET/CTs in a patient with metastatic neuroendocrine tumor before (top row) and after (bottom row) radionuclide therapy with 177Lu-DOTA-TATE. The pre-treatment diagnostic scan showed multiple avid liver metastases (arrows), implying that they would also bind the 177Lu-labelled therapeutic ‘sister agent’, therefore predicting the treatment response that was ultimately demonstrated on the post-therapeutic PET/CT. Physiologic splenic tracer uptake is seen on both studies

Full size image

Imaging devices

PET/CT

While the basic technical principle of PET (and PET/CT) has remained unchanged over the years, there are some more recent technical developments which have and probably will become available clinically and have been shown to enhance image quality and speed of data acquisitions. The first is Time-of-Flight (TOF)-PET, which aims to determine the location of annihilation events along the line of response (a schematic drawing of its principles is provided in Fig. 7). The principle of TOF-PET was realized in prototype scanners back in the 1980s (Yamamoto et al., 1982); however, only since the advent of newer detector materials such as lutetium oxyorthosilicate, faster electronics and iterative reconstruction algorithms has the clinical use of TOF-PET been broadly adopted (Vandenberghe et al., 2016). This technique improves the signal-to-noise ratio and thus image quality, especially in heavy patients, low-contrast lesions and areas deep in the body (El Fakhri et al., 2011). Computational strategies to tackle motion-related artifacts are another step towards higher image quality, especially in cases of pulmonary and hepatic lesions, in which tracer uptake is often underestimated due to patient breathing. Various methods for motion correction have been reported (Pepin et al., 2014; Kesner et al., 2016) and it would be beyond the scope of this article to describe all of them in detail. An underlying principle is, however, that motion is captured in the acquired PET data without the need for an external gaiting device (e.g. respiration belts) (Bouyeure-Petit et al., 2017).

Fig. 7
figure7

Schematic drawing of the basic principle of time-of-flight (TOF) PET. Annihilation events are marked as stars and the line of response as double-headed arrows. In conventional PET (non-TOF, yellow), the location of the annihilation event cannot be further located on the line of response and can only be deducted by reconstruction. In TOF PET (TOF, red), the time difference between the detection of both γ-rays is recorded, allowing for an estimation of the location of the annihilation event and resulting in a higher signal-to-noise ratio

Full size image

One-minute whole-body PET

Another emerging technology that might result in an unprecedented increase in the sensitivity of PET is ‘one-minute whole-body PET,’ which detects real-time radiotracer uptake at all metastatic tumor sites and organs of the body simultaneously. Current PET systems acquire images in only a 15–20 cm field of view, which renders them relatively insensitive, as more than 90% of the emitted radiation is not used to generate an image. As a result, whole-body PET studies are time consuming and associated with significant radiation exposure, especially when imaging is performed with antibodies that are labeled with long-lived radioisotopes. One-minute whole-body PET, which is being developed under the name “PET Explorer” by Simon Cherry’s PET imaging group at University of California, Davis, has a large axial field of view, which results in a more than 20-fold greater sensitivity than that of current PET/CT devices (Explorer: University of California Davis). Although this greater technical sensitivity does not directly translate into a 20-fold higher clinical sensitivity for pathologic imaging findings, the duration of a whole-body FDG PET scan with the “PET Explorer” could be reduced to 1 min as compared to 20 min with current systems. This improvement will not only make such scans much more convenient for patients but will also markedly reduce motion artifacts, especially those resulting from respiratory motion. As a consequence, the new scanner will make it possible to characterize smaller lesions with much higher reproducibility than is currently possible. The increased sensitivity can be used to acquire scans rapidly, i.e. within a single breath hold to minimize breathing artifacts or, alternatively, to reduce the patient-administered radioactivity 20-fold. The latter is especially compelling in pediatric patients and in studies involving long-lived radiopharmaceuticals (e.g. 89Zr), or where it is desired to conduct repeated longitudinal tumor tracking for response assessment. This new generation of PET scanners will also provide a unique capability to conduct a pharmaco-kinetic characterization of any drug able to be tagged with a positron emitter across the entire patient’s disease burden, providing new opportunities for studying and quantifying tumor heterogeneity. The very fast whole-body scans will allow extremely high patient throughput and consolidation of space and personnel. The major challenge for the marketability of this new generation of PET-scanners will be their economic viability in comparison to conventional imaging systems.

PET/MRI

There are currently two fully integrated commercially available clinical PET/MRI systems on the market and the first integrated PET/MRI was approved by the FDA in 2011. As of 2015, 70 institutions worldwide had at least one PET/MRI system in use, with oncologic imaging being by far the most common application (Fendler et al., 2016). The major advantages of PET/MRI over PET/CT are that it allows for truly simultaneous PET- and MRI-data acquisition and that it saves the patient from the ionizing radiation of the CT component of PET/CT. Compared to separate PET and MRI examinations, the simultaneous procedure could also save time and space and help to streamline a patient’s diagnostic workup. All of that comes at a price; not only is there the initial capital investment, but there are also specific technical challenges, and personnel need to be trained to operate the equipment (Chen & An, 2017). The true added value of simultaneous PET/MRI, as compared to PET/CT and MRI, remains to be determined. We hypothesize that the greatest potential for oncologic PET/MRI lies in organ systems for which MRI is already essential today and where CT offers only limited diagnostic value, e.g. brain tumors, gynecologic malignancies, prostate cancer. For example, Eiber and colleagues from the Technical University of Munich recently demonstrated that simultaneous 68Ga-PSMA PET/MRI improved localization of primary prostate cancer within the gland of 53 patients when compared to multiparametric MRI alone (areas under the ROC curves: 0.88 vs. 0.73, p < 0.001) (Eiber et al., 2016). Additionally, pediatric patients and cancer survivors on long-term surveillance will benefit from the reduced radiation dose of PET/MRI.

Education and training

The above described rapidly growing number of approved radiotracers and hybrid imaging modalities necessitates the adaption of training curricula for all types of involved staff. Radiochemists, radiopharmacists, and medical physicists will have to broaden their expertise and constantly adopt new skills as new imaging agents and modalities are approved by regulatory authorities. The training curricula of technologists will probably become more complex, especially with the wider distribution of PET/MRI systems. Also, the training of radiologists and nuclear medicine physicians will become more challenging due to the need to understand the physiology and biochemistry of multiple tracers as well as the complex physics of MRI signals. Another layer of complexity is added with the growing number of theranostic agents and the need for specific training, which is currently almost completely lacking in radiology training curricula. Nuclear medicine physicians will have to dedicate more of their training to MRI, which will be substantially more demanding than mastering CT. Both disciplines will have to intensify their education, training, and understanding of the biochemical and molecular mechanisms underlying these novel imaging techniques. Training a new generation of physicians proficient in both nuclear medicine and diagnostic radiology will be one of the greatest challenges of our time! Furthermore, sub-specialization in organ systems and tumor types will become even more important to provide high-quality and clinically meaningful reports while maintaining high throughput.

Data analysis

The growing number and complexity of hybrid imaging procedures and the rapidly growing amount of data produced pose several challenges but also open up appealing opportunities for the future. First, these examinations have to be read and reported, increasing the need for properly trained personnel. Second, this vast amount of data is a potentially very rich source of information that remains mostly untapped at this time. At MSKCC, several hundred megabytes of data are generated and stored per patient each year. It has also been estimated that 30% of the entire world’s stored data is in the health care industry (Huesch & Mosher, 2017). A large—and probably the most complex—portion of this data stems from medical imaging. While other data-rich industries, e.g. banking and insurance, invest major resources in big data analysis, health care providers, even academic centers, rarely have employees solely dedicated to data analysis. Such personnel and accompanying infrastructure, however, are needed for advanced analysis techniques, including but not limited to machine learning, artificial intelligence and sophisticated data engineering. The potential opportunities of such analyses are manifold. Algorithms could pre-scan imaging studies to identify anatomical landmarks (Ghayoor & Vaidya, 2017), recognize distinct patterns of normal tissue and common pathologies (Cicero et al., 2017; Summers, 2016), and may allow the physician to focus his or her attention on more complex findings or cases that the computer is not able to classify. In a recently published analysis on chest radiographs, for example, deep convolutional neural networks being trained and validated with studies of 857 patients were found to reliably detect and classify findings of pulmonary tuberculosis in a test population (areas under the ROC-curves of 0.97–0.98) (Lakhani & Sundaram, 2017). Another artificial neuronal network that was trained on 895 women’s mammograms was able to detect breast cancer in 251 test cases with similar accuracy as three radiologists (areas under the ROC-curves: 0.79–0.87 for humans, 0.82 for the network) (Becker et al., 2017). Of note, the radiologists’ readings were consistently less sensitive and more specific than the neural network in this study, indicating that this kind of image analysis could be particularly useful when incorporated into screening algorithms. These algorithms could also be trained to detect urgent imaging findings that require immediate attention, e.g. pneumothorax (Cai et al., 2009) and pulmonary embolism (Bouma et al., 2009), thereby increasing patient safety. Furthermore, feature extraction, machine learning and artificial intelligence/deep learning algorithms could identify findings and patterns that are imperceptible to human cognition, some of which might be clinically useful imaging biomarkers. In patients with mild cognitive impairment, for instance, a MRI-based machine learning algorithm was shown to identify individuals at risk for disease progression to Alzheimer’s disease (area under the ROC-curve of 0.77) (Moradi et al., 2015). Combining this imaging biomarker with clinical information (i.e. baseline cognitive performance, age) further increased the area under the ROC-curve to 0.90. This example demonstrates that imaging data and imaging-derived biomarkers should always be seen and analyzed in the context of a patient’s whole medical record, thereby increasing the chances of finding exploitable correlations.

Conclusion

Hybrid imaging has revolutionized the diagnosis of a wide range of malignancies at all stages and plays a major role in the modern management of patients with cancer. A growing number of radiotracers and technical advancements in the near future will further widen and strengthen its role as an in-vivo companion diagnostic. It will help to provide individualized patient care that takes into account the inter- and intra-individual, spatial and temporal heterogeneity of cancer, promoting the very realization of precision medicine. Theranostic agents will extend therapeutic options, particularly in patients with metastatic disease. Numerous obstacles remain to be overcome, most importantly that of providing the human resources and skills needed to excel in such a rapidly evolving and expanding field. The management and meaningful use of big imaging data and its linkage to other information sources is another challenge but also a huge opportunity for producing future discoveries that should lead to improved patient care and outcomes.

Abbreviations

CT:

Computed tomography-CT

ER:

Estrogen receptor

FDA:

Food and drug Administration

FDG:

18F–fluorodeoxyglucose

FDHT:

18F–Fluorodehydrotestosterone

FES:

18F–Fluoroestradiol

HER2:

Human epidermal growth factor receptor 2

MRI:

Magnetic resonance imaging

NaF:

18F–sodium fluoride

NET:

Neuroendocrine tumor

PET:

Positron emission tomography

PSA:

Prostate-specific antigen

PSMA:

Prostate-specific membrane antigen

ROC:

Receiver operator characteristic

SPECT:

Single photon emission computed tomography

TOF:

Time--of-flight

References

  1. Afshar-Oromieh A, Holland-Letz T, Giesel FL, Kratochwil C, Mier W, Haufe S et al (2017) Diagnostic performance of 68Ga-PSMA-11 (HBED-CC) PET/CT in patients with recurrent prostate cancer: evaluation in 1007 patients. Eur J Nucl Med Mol Imaging 44(8):1258–1268

  2. Barrio M, Czernin J, Fanti S, Ambrosini V, Binse I, Du L et al (2017) The impact of Somatostatin receptor-directed PET/CT on the Management of Patients with Neuroendocrine tumor: a systematic review and meta-analysis. J Nucl Med 58(5):756–761

  3. Baum RP, Kulkarni HR, Schuchardt C, Singh A, Wirtz M, Wiessalla S et al (2016) 177Lu-labeled prostate-specific membrane antigen Radioligand therapy of metastatic castration-resistant prostate cancer: safety and efficacy. J Nucl Med 57(7):1006–1013

  4. Baumann T, Rottenburger C, Nicolas G, Wild D (2016) Gastroenteropancreatic neuroendocrine tumours (GEP-NET) - imaging and staging. Best Pract Res Clin Endocrinol Metab 30(1):45–57

  5. Becker AS, Marcon M, Ghafoor S, Wurnig MC, Frauenfelder T, Boss A (2017) Deep learning in mammography: diagnostic accuracy of a multipurpose image analysis software in the detection of breast cancer. Investig Radiol 52(7):434–440

  6. Bouma H, Sonnemans JJ, Vilanova A, Gerritsen FA (2009) Automatic detection of pulmonary embolism in CTA images. IEEE Trans Med Imaging 28(8):1223–1230

  7. Bouyeure-Petit AC, Chastan M, Edet-Sanson A, Becker S, Thureau S, Houivet E et al (2017) Clinical respiratory motion correction software (reconstruct, register and averaged-RRA), for 18F-FDG-PET-CT: phantom validation, practical implications and patient evaluation. Br J Radiol 90(1070):20160549

  8. Brauer A, Grubert LS, Roll W, Schrader AJ, Schafers M, Bogemann M et al (2017) 177Lu-PSMA-617 radioligand therapy and outcome in patients with metastasized castration-resistant prostate cancer. Eur J Nucl Med Mol Imaging 44(10):1663–1670

  9. Cai W, Tabbara M, Takata N, Yoshida H, Harris GJ, Novelline RA et al (2009) MDCT for automated detection and measurement of pneumothoraces in trauma patients. AJR Am J Roentgenol 192(3):830–836

  10. Calais J, Czernin J, Eiber M, Fendler WP, Gartmann J, Heaney AP et al (2017) Most of the intended management changes after 68Ga-DOTATATE PET/CT are implemented. J Nucl Med 58(11):1793–1796

  11. Chen Y, An H (2017) Attenuation correction of PET/MR imaging. Magn Reson Imaging Clin N Am 25(2):245–255

  12. Cicero M, Bilbily A, Colak E, Dowdell T, Gray B, Perampaladas K et al (2017) Training and validating a deep Convolutional neural network for computer-aided detection and classification of abnormalities on frontal chest radiographs. Investig Radiol 52(5):281–287

  13. Eiber M, Weirich G, Holzapfel K, Souvatzoglou M, Haller B, Rauscher I et al (2016) Simultaneous 68Ga-PSMA HBED-CC PET/MRI improves the localization of primary prostate cancer. Eur Urol 70(5):829–836

  14. El Fakhri G, Surti S, Trott CM, Scheuermann J, Karp JS (2011) Improvement in lesion detection with whole-body oncologic time-of-flight PET. J Nucl Med 52(3):347–353

  15. Explorer: University of California Davis; [Available from: http://explorer.ucdavis.edu/. Accessed 22 Dec 2017

  16. Fendler WP, Czernin J, Herrmann K, Beyer T (2016) Variations in PET/MRI operations: results from an international survey among 39 active sites. J Nucl Med 57(12):2016–2021

  17. Ghayoor A, Vaidya JG (2017) Johnson HJ. Robust automated constellation-based landmark detection in human brain imaging. NeuroImage Epub ahead of print

  18. Henry KE, Ulaner GA, Lewis JS (2017) Human epidermal growth factor receptor 2-targeted PET/single- photon emission computed tomography imaging of breast cancer: noninvasive measurement of a biomarker integral to tumor treatment and prognosis. PET clinics 12(3):269–288

  19. Hoefnagel LD, van der Groep P, van de Vijver MJ, Boers JE, Wesseling P, Wesseling J et al (2013) Discordance in ERalpha, PR and HER2 receptor status across different distant breast cancer metastases within the same patient. Ann Oncol 24(12):3017–3023

  20. Hogan MP, Goldman DA, Dashevsky B, Riedl CC, Gonen M, Osborne JR et al (2015) Comparison of 18F-FDG PET/CT for systemic staging of newly diagnosed invasive lobular carcinoma versus invasive Ductal carcinoma. J Nucl Med 56(11):1674–1680

  21. Huesch MD, Mosher TJ. Using it or losing it? The case for data scientists inside health care NEJM catalyst 2017 [Available from: https://catalyst.nejm.org/case-data-scientists-inside-health-care/. Accessed 22 Dec 2017

  22. Kairemo K, Kangasmaki A (2013) 4D SPECT/CT acquisition for 3D dose calculation and dose planning in (177)Lu-peptide receptor radionuclide therapy: applications for clinical routine. Recent results in cancer research Fortschritte der Krebsforschung Progres dans les recherches sur le cancer 194:537–550

  23. Kesner AL, Chung JH, Lind KE, Kwak JJ, Lynch D, Burckhardt D et al (2016) Frequency based gating: an alternative, conformal, approach to 4D PET data utilization. Med Phys 43(3):1451–1461

  24. Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using Convolutional neural networks. Radiology 284(2):574–582

  25. Liu J, Chen Z, Wang T, Liu L, Zhao L, Guo G et al (2016) Influence of four radiotracers in PET/CT on diagnostic accuracy for prostate cancer: a Bivariate random-effects meta-analysis. Cell Physiol Biochem 39(2):467–480

  26. Mestel R (2017) Cancer: imaging with antibodies. Nature 543(7647):743–746

  27. Moradi E, Pepe A, Gaser C, Huttunen H, Tohka J (2015) Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects. NeuroImage 104:398–412

  28. Nanni C, Zanoni L, Pultrone C, Schiavina R, Brunocilla E, Lodi F et al (2016) (18)F-FACBC (anti1-amino-3-(18)F-fluorocyclobutane-1-carboxylic acid) versus (11)C-choline PET/CT in prostate cancer relapse: results of a prospective trial. Eur J Nucl Med Mol Imaging 43(9):1601–1610

  29. Paik S, Kim C, Wolmark N (2008) HER2 status and benefit from adjuvant trastuzumab in breast cancer. N Engl J Med 358(13):1409–1411

  30. Pandit-Taskar N, Veach DR, Fox JJ, Scher HI, Morris MJ, Larson SM (2016) Evaluation of castration-resistant prostate cancer with androgen receptor-Axis imaging. J Nucl Med 57(Suppl 3):73s–78s

  31. Pepin A, Daouk J, Bailly P, Hapdey S, Meyer ME (2014) Management of respiratory motion in PET/computed tomography: the state of the art. Nucl Med Commun 35(2):113–122

  32. Priedigkeit N, Hartmaier RJ, Chen Y, Vareslija D, Basudan A, Watters RJ et al (2017) Intrinsic subtype switching and acquired ERBB2/HER2 amplifications and mutations in breast cancer brain metastases. JAMA oncology 3(5):666–671

  33. Rahbar K, Ahmadzadehfar H, Kratochwil C, Haberkorn U, Schafers M, Essler M et al (2017) German multicenter study investigating 177Lu-PSMA-617 Radioligand therapy in advanced prostate cancer patients. J Nucl Med 58(1):85–90

  34. Rathkopf DE, Morris MJ, Fox JJ, Danila DC, Slovin SF, Hager JH et al (2013) Phase I study of ARN-509, a novel antiandrogen, in the treatment of castration-resistant prostate cancer. J Clin Oncol 31(28):3525–3530

  35. Rauscher I, Maurer T, Beer AJ, Graner FP, Haller B, Weirich G et al (2016) Value of 68Ga-PSMA HBED-CC PET for the assessment of lymph node metastases in prostate cancer patients with biochemical recurrence: comparison with histopathology after salvage Lymphadenectomy. J Nucl Med 57(11):1713–1719

  36. Ristau BT, O'Keefe DS, Bacich DJ (2014) The prostate-specific membrane antigen: lessons and current clinical implications from 20 years of research. Urol Oncol 32(3):272–279

  37. Rossi S, Basso M, Strippoli A, Dadduzio V, Cerchiaro E, Barile R et al (2015) Hormone receptor status and HER2 expression in primary breast cancer compared with synchronous Axillary metastases or recurrent metastatic disease. Clinical breast cancer 15(5):307–312

  38. Sadowski SM, Neychev V, Millo C, Shih J, Nilubol N, Herscovitch P et al (2016) Prospective study of 68Ga-DOTATATE positron emission tomography/computed tomography for detecting gastro-Entero-pancreatic Neuroendocrine tumors and unknown primary sites. J Clin Oncol 34(6):588–596

  39. Strosberg J, El-Haddad G, Wolin E, Hendifar A, Yao J, Chasen B et al (2017) Phase 3 trial of 177Lu-Dotatate for Midgut Neuroendocrine tumors. N Engl J Med 376(2):125–135

  40. Summers RM (2016) Progress in fully automated abdominal CT interpretation. AJR Am J Roentgenol 207(1):67–79

  41. Ulaner GA, Castillo R, Wills J, Gonen M, Goldman DA (2017) 18F-FDG-PET/CT for systemic staging of patients with newly diagnosed ER-positive and HER2-positive breast cancer. Eur J Nucl Med Mol Imaging 44(9):1420–1427

  42. Ulaner GA, Goldman DA, Corben A, Lyashchenko SK, Gonen M, Lewis JS et al (2017) Prospective clinical trial of 18F-Fluciclovine PET/CT for determining the response to Neoadjuvant therapy in invasive Ductal and invasive lobular breast cancers. J Nucl Med 58(7):1037–1042

  43. Ulaner GA, Goldman DA, Gonen M, Pham H, Castillo R, Lyashchenko SK et al (2016) Initial results of a prospective clinical trial of 18F-Fluciclovine PET/CT in newly diagnosed invasive Ductal and invasive lobular breast cancers. J Nucl Med 57(9):1350–1356

  44. Ulaner GA, Hyman DM, Lyashchenko SK, Lewis JS, Carrasquillo JA (2017) 89Zr-trastuzumab PET/CT for detection of HER2-positive metastases in patients with HER2-negative primary breast cancer. Clin Nucl Med 42(12):912–917

  45. Ulaner GA, Hyman DM, Ross DS, Corben A, Chandarlapaty S, Goldfarb S et al (2016) Detection of HER2-positive metastases in patients with HER2-negative primary breast cancer using 89Zr-Trastuzumab PET/CT. J Nucl Med 57(10):1523–1528

  46. Ulaner GA, Riedl CC, Dickler MN, Jhaveri K, Pandit-Taskar N, Weber W (2016) Molecular imaging of biomarkers in breast cancer. J Nucl Med 57 Suppl 1:53s–59s

  47. Vandenberghe S, Mikhaylova E, D'Hoe E, Mollet P, Karp JS (2016) Recent developments in time-of-flight PET. EJNMMI physics 3(1):3

  48. Vargas HA, Wassberg C, Fox JJ, Wibmer A, Goldman DA, Kuk D et al (2014) Bone metastases in castration-resistant prostate cancer: associations between morphologic CT patterns, glycolytic activity, and androgen receptor expression on PET and overall survival. Radiology 271(1):220–229

  49. Wang Y, Ayres KL, Goldman DA, Dickler MN, Bardia A, Mayer IA et al (2016) 18F–Fluoroestradiol PET/CT Measurement of Estrogen Receptor Suppression during a Phase I Trial of the Novel Estrogen Receptor-Targeted Therapeutic GDC-0810: Using an Imaging Biomarker to Guide Drug Dosage in Subsequent Trials. Clin Cancer Res 23(12):3053–3060

  50. Wibmer AG, Burger IA, Sala E, Hricak H, Weber WA, Vargas HA (2016) Molecular imaging of prostate cancer. Radiographics 36(1):142–159

  51. Yamamoto M, Ficke DC, Ter-Pogossian MM (1982) Experimental assessment of the gain achieved by the utilization of time-of-flight information in a positron emission Tomograph (super PETT I). IEEE Trans Med Imaging 1(3):187–192

  52. Yoon HJ, Kang KW, Chun IK, Cho N, Im SA, Jeong S et al (2014) Correlation of breast cancer subtypes, based on estrogen receptor, progesterone receptor, and HER2, with functional imaging parameters from (6)(8)Ga-RGD PET/CT and (1)(8)F-FDG PET/CT. Eur J Nucl Med Mol Imaging 41(8):1534–1543

Download references

Acknowledgments

The authors thank Ada Muellner, MSc, for reviewing and editing the manuscript.

Funding

Andreas G. Wibmer was supported by the Peter Michael Foundation.

Author information

Affiliations

  1. Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
    • Andreas G. Wibmer
    • , Hedvig Hricak
    • , Gary A. Ulaner
    •  & Wolfgang Weber
  2. Molecular Imaging and Therapy Service, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
    • Andreas G. Wibmer
    • , Gary A. Ulaner
    •  & Wolfgang Weber
Authors
  1. Andreas G. Wibmer
    View author publications
    You can also search for this author in
  2. Hedvig Hricak
    View author publications
    You can also search for this author in
  3. Gary A. Ulaner
    View author publications
    You can also search for this author in
  4. Wolfgang Weber
    View author publications
    You can also search for this author in

Contributions

AGW, WW: Drafting of manuscript; GAU, HH: Critical revision of manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Andreas G. Wibmer.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wibmer, A.G., Hricak, H., Ulaner, G.A. et al. Trends in oncologic hybrid imaging. European J Hybrid Imaging 2, 1 (2018). https://doi.org/10.1186/s41824-017-0019-6

Download citation

Keywords

  • Oncologic hybrid molecular imaging
  • Time-of-flight positron emission tomography computed tomography
  • One-minute whole-body PET explorer
  • 18F –Fluciclovine
  • 11C–choline
  • Prostate-specific membrane antigen
  • 18F–Fluorodehydrotestosterone
  • 89Zr-trastuzumab
  • 18F–Fluoroestradiol
  • 68Ga/ 177Lu -DOTA-TATE