Skip to main content

Does a 6-point scale approach to post-treatment 18F-FDG PET-CT allow to improve response assessment in head and neck squamous cell carcinoma? A multicenter study

Abstract

Purpose

Response assessment to definitive non-surgical treatment for head and neck squamous cell carcinoma (HNSCC) is centered on the role of 18F-fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET-CT) 12 weeks after treatment. The 5-point Hopkins score is the only qualitative system available for standardized reporting, albeit limited by suboptimal positive predictive value (PPV). The aim of our study was to explore the feasibility and assess the diagnostic accuracy of an experimental 6-point scale (“Cuneo score”).

Methods

We performed a retrospective, multicenter study on HNSCC patients who received a curatively-intended, radiation-based treatment. A centralized, independent qualitative evaluation of post-treatment FDG-PET/CT scans was undertaken by 3 experienced nuclear medicine physicians who were blinded to patients’ information, clinical data, and all other imaging examinations. Response to treatment was evaluated according to Hopkins, Cuneo, and Deauville criteria. The primary endpoint of the study was to evaluate the PPV of Cuneo score in assessing locoregional control (LRC). We also correlated semi-quantitative metabolic factors as included in PERCIST and EORTC criteria with disease outcome.

Results

Out of a total sample of 350 patients from 11 centers, 119 subjects (oropharynx, 57.1%; HPV negative, 73.1%) had baseline and post-treatment FDG-PET/CT scans fully compliant with EANM 1.0 guidelines and were therefore included in our analysis. At a median follow-up of 42 months (range 5-98), the median locoregional control was 35 months (95% CI, 32-43), with a 74.5% 3-year rate. Cuneo score had the highest diagnostic accuracy (76.5%), with a positive predictive value for primary tumor (Tref), nodal disease (Nref), and composite TNref of 42.9%, 100%, and 50%, respectively. A Cuneo score of 5-6 (indicative of residual disease) was associated with poor overall survival at multivariate analysis (HR 6.0; 95% CI, 1.88-19.18; p = 0.002). In addition, nodal progressive disease according to PERCIST criteria was associated with worse LRC (OR for LR failure, 5.65; 95% CI, 1.26-25.46; p = 0.024) and overall survival (OR for death, 4.81; 1.07-21.53; p = 0.04).

Conclusions

In the frame of a strictly blinded methodology for response assessment, the feasibility of Cuneo score was preliminarily validated. Prospective investigations are warranted to further evaluate its reproducibility and diagnostic accuracy.

Introduction

Head and neck squamous cell carcinoma (HNSCC) is the sixth most common non-skin cancer worldwide (Rettig & D’Souza, 2015). In over 60% of cases, a non-metastatic locally advanced disease is found at diagnosis. Since about 20 years (Pignon et al., 2000; Pignon et al., 2009), concurrent chemo-radiotherapy (CRT) is the non-surgical mainstay of treatment for unresectable disease and organ preservation purpose. Historically, a 5-year survival rate of about 50% has been reported (Carvalho et al., 2005; Bathia & Burtness, 2015). Response evaluation to CRT is of critical importance for HNSCC management. In this respect, it is commonly recognized that morphologic imaging modalities may be suboptimal (Bhatnagar et al., 2013), particularly due to fibrosis, edema, and inflammatory changes mainly induced by radiation (RT). In analogy to non-small cell lung cancer (Iravani et al., 2019) and Hodgkin lymphoma (HL) (Cheson et al., 2014), metabolic information provides undisputed benefit to aid treatment response assessment in HNSCC. In particular, level one evidence (Mehanna et al., 2016) supports the notion that surveillance based on a negative 18F-fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (FDG-PET/CT) acquired at a minimum of 12 weeks after CRT is non-inferior to an invasive strategy based on planned neck dissection in terms of long-term survival. The importance to apply standardized measures for FDG-PET/CT assessment has been highlighted by the widespread clinical use of Deauville criteria in HL management (Barrington & Kluge, 2017), whereby the metabolic pattern of interim response to chemotherapy (CHT) was demonstrated (Barrington et al., 2019) to be correlated with long-term outcome. In the setting of HNSCC, consistent qualitative evaluations in the post-treatment scenario are scarce. In this regard, the only recognized scoring system is represented by the “Hopkins criteria,” firstly introduced by Marcus et al. (Marcus et al., 2014). In a retrospective single-center study on 214 HNSCC patients treated at Johns Hopkins University in a time span of 13 years (2000-2013), the authors were able to show that a prespecified 5-point scale allowed to discriminate a complete versus an incomplete response to RT or CRT with a negative predictive value (NPV) and overall diagnostic accuracy of 91.1% and 86.9%, respectively. In a prospective, multicenter study (Van Den Wyngaert et al., 2017) focused on the standardized implementation and reporting of FDG-PET/CT acquired at 12 weeks after CRT, the use of Hopkins criteria yielded a NPV of 92.1%. Overall, the excellent diagnostic performance associated with a negative FDG-PET/CT scan is however counterbalanced by its suboptimal positive predictive value (PPV), an unresolved issue in head and neck oncology. To compensate for this known limitation, integrating metabolic information with clinical data and morphologic imaging is essential for proper response assessment and surveillance. In a meta-analysis (Gupta et al., 2011) on 2335 patients from 51 studies, a mean pooled PPV of 58.6% was obtained. A more recent meta-analysis (Helsen et al., 2018) from 20 studies (1293 subjects) yielded the same PPV (58%). In both Johns Hopkins retrospective experience (Marcus et al., 2014) and ECLYPS study (Van Den Wyngaert et al., 2017), a PPV of 71.1% and 62.5% was reported, respectively. In this perspective, the discriminative power of Hopkins score may be inherently limited. We hypothesized that the potential limitation of a 5-point scoring system such as the Hopkins criteria may be overcome by a more sensitive 6-point scale discriminating patients with complete, incomplete or equivocal response to treatment, identifying a threshold score of response for each of the 3 patterns. Ideally, it would be noteworthy to apply standardized diagnostic criteria able to minimize false negative but also false-positive results: a high PPV may allow to better address the common development of inflammatory reactions after RT and the slow nodal disease regression of HPV positive disease (Huang et al., 2013), factors known to impair the FDG-PET/CT evaluation 12 weeks after treatment in both the PET-NECK (Mehanna et al., 2016) and ECLYPS (Van Den Wyngaert et al., 2017) trials. The aim of our study was to test the reproducibility and evaluate the diagnostic accuracy of an experimental 6-point scale in assessing the response to curatively—intended treatment for HNSCC. In addition, we sought to investigate whether baseline semi-quantitative metabolic factors or their change after treatment (“delta”) as included in PERCIST (JH et al., 2016) and EORTC (Young et al., 1999) criteria correlated with disease outcome.

Methods

Design and setting of the study

We performed an observational, retrospective, multi-center study within the Italian Association of Radiotherapy and Clinical Oncology (AIRO). In order to overcome the potential limitations of retrospective assessments in the field of functional imaging, a rigorous centralized review of FDG-PET/CT scans was mandated per protocol and performed by 3 independent nuclear medicine physicians (AB, SM, VB). The study was approved by the local ethics committees of each participating center. Participating Nuclear Medicine centers needed to have clinical trial qualification released from the “Federazione Italiana Linfomi” (FIL) core lab (Chauvie et al., 2016).

Patients’ characteristics

Consecutive patients treated between 1/1/10 and 31/12/15 could be enrolled in our study. Performance status (PS) according to Eastern Cooperative Oncology Group (ECOG), smoking history and comorbidity profile according to Charlson comorbidity index (CCI) (Charlson et al., 1987) were recorded at HNSCC diagnosis. Patients with non-metastatic, histologically proven squamous cell carcinoma of the oropharynx, hypopharynx, larynx and nasopharynx, or undifferentiated nasopharyngeal carcinoma candidate to non-surgical treatment with curative intent could be included. Pending inclusion in the study, a baseline and post-treatment FDG-PET/CT examinations had to be available for each subject. By definition, the baseline scan had to be executed not before 8 weeks from the start of treatment (first day of RT or first cycle of induction CHT, if performed). The post-treatment scan had to be executed not before 10 weeks and no later than 6 months after the end of treatment (last RT fraction). Clinical stage was defined based on TNM/AJCC 7th edition. Human papilloma virus (HPV) status was not routinely available in all centers in the considered timeframe. HPV positivity was defined by a 70% diffuse nuclear staining detected by p16 immunohistochemistry, with additional HPV-DNA in situ hybridazation as confirmatory test in selected cases. A curatively intended treatment was defined as one of the following: RT alone; cisplatin-based concurrent CRT; cetuximab-based concurrent CRT; induction CHT followed by RT alone; induction CHT followed by concurrent CRT. Prior RT to the head and neck region and gross total excision of both primary and/or nodal disease before index treatment were not allowed. No upper age limit was defined.

FDG-PET/CT analysis

Only FDG-PET/CT scans performed according to EANM 1.0 procedure guidelines (Boellard et al., 2010) were evaluated. No contrast media for the CT component of FDG PET/CT examinations were used. Moreover, a strict criterion for uptake time was applied. In fact, only patients whose both baseline and post-treatment scans were acquired within the range of 60 + 10 min after FDG injection were ultimately included in our study (supplementary material).

An independent evaluation of all FDG-PET/CT images was undertaken by 3 experienced nuclear medicine physicians who were blinded to patients’ information, clinical data, and other imaging examinations. Anthropometric variables (weight, height, and sex) and selected technical parameters (administered activity of FDG per kilogram, plasma glucose level at time of scan, uptake time) were automatically provided for each case. A qualitative assessment of all post-treatment scans was performed in accordance with 2 standardized reporting systems, Hopkins and Deauville criteria. In addition, an experimental 6-point score (“Cuneo score” was tested (Table 1)). Deauville criteria were experimentally applied to HNSCC. The 3 scores were determined by each reviewer for the primary tumor (Tref) and nodal disease (Nref), respectively. A composite TNref score was also calculated, corresponding to the highest score reported. By definition, the diagnostic accuracy of the 3 qualitative scores was assessed on all those cases where an agreement of at least 2 of the 3 reviewers was found. To this end, a secondary revision of selected cases without initial agreement of at least 2 reviewers was allowed prior to the final analysis to rule out major discrepancies. Response according to PERCIST and EORTC criteria was also computed (supplementary material).

Table 1 Standardized reporting criteria used to assess FDG-PET/CT scans (Deauville, Hopkins, and Cuneo scores)

Statistical analysis

Inter-observer agreement was measured with the Krippendorff’s alpha coefficient at 3-time points: after a blinded review of a “training set” of 15 patients (phase 1), after a second review of the “training set” (phase 2), and after the revision of the whole cohort enrolled (phase 3). After feedback from phase 1, a meeting was held to discuss interpretation, and a detailed set of instructions for the review procedure was agreed and acted upon.

Response to treatment was assessed by local investigators in accordance with the RECIST 1.1 criteria (Therasse et al., 2000). Progression-free survival (PFS) was defined as the time from the last day of treatment to the date of the first of the following events: the first day when criteria for progressive disease (PD) are met; salvage surgery or elective neck dissection after 15 weeks from the last day of RT performed on the clinical or radiological evidence of progression; death for any cause. The type of first PFS event was selected among the following: local failure (i.e, primary tumor); regional failure (i.e, lymph nodes); simultaneous local and nodal failure; distant failure; second primary tumor. Loco-regional control (LRC) was defined as the time from the last day of treatment to the date of the first loco-regional event. Overall survival (OS) was defined as the time from the date of HNSCC diagnosis to death from any cause or last follow-up. LRC, PFS, and OS were estimated by the Kaplan-Meyer method. In order to evaluate whether specific patient, disease, and treatment features or FDG-PET/CT response pattern had a potential prognostic impact on outcome, Cox regression analysis was performed, by calculation of hazard ratios (HR) and corresponding 95% confidence intervals (CI 95%). A multivariate analysis was performed when multiple risk factors with a p value < 0.05 were identified in the univariate analysis. Median LRC, PFS, and OS and their estimates at 36 months were calculated with corresponding 95% CI. For each standardized qualitative score (Deauville, Hopkins, and Cuneo) applied to post-treatment scans, we calculated the diagnostic accuracy for Tref, Nref, and composite TNref. It was expressed in terms of sensitivity (SE), specificity (SP), PPV, NPV, and overall accuracy. The semi-quantitative metabolic parameters were expressed as delta value, defined as the difference of standardized uptake value corrected for body weight (SUV/bw) and for lean body mass (SUL) values between the baseline and post-treatment scans, for both Tref and Nref. Descriptive values are presented as mean (SD), median, range, and tertiles. Mann-Whitney test was used to evaluate the difference on selected mean delta values by specific outcomes (LRC, PFS, and OS). Categorical variables were also calculated according to median and tertiles values, respectively. The association between categorical delta values and the outcomes (LRC, PFS, and OS) was evaluated by simple cross-tables and appropriate chi-square test. Logistic models were also performed to confirm the possible association by odd ratios (OR) and 95% CI calculation. Chi-square test and logistic models were also used to evaluate the association between PERCIST (JH et al., 2016) and EORTC (Young et al., 1999) criteria and the outcomes (LRC, PFS, and OS). Differences were considered statistically significant at the level of p < 0.05. Statistical analyses were performed using the IBM SPSS Statistics software (Statistical Package for Social Science, version 22).

The primary endpoint of the study was to evaluate the PPV of Cuneo score in assessing LRC after treatment. The secondary endpoints were to evaluate the overall diagnostic accuracy of Cuneo, Deauville and Hopkins criteria in response assessment; the rate of interobserver agreement of Cuneo score assessed with Krippendorff’s alpha; the correlation of FDG-PET/CT semiquantitative body-weighted and lean-body mass parameters at baseline scans and their delta (percentage of change) with LRC, PFS, and OS; and the correlation of response assessment according to EORTC and PERCIST criteria with LRC, PFS, and OS. Considering a PPV of 71.1% with post-treatment FDG-PET/CT based on the work of Marcus et al. (Marcus et al., 2014), applying the experimental 6-point Cuneo score was hypothesized to yield a 20% increase. It was therefore assumed the null hypothesis (H0) that the PPV is 71.1% versus the alternative hypothesis (Ha) that the PPV is 85.3%. With a significance level α = 0.05 and a power of 0.90 when the PPV is 85.3%, the required sample size with this design was 81 patients.

Results

Patients’ characteristics and treatment outcome

Between Jan. 2010 and Dec. 2015, a total of 350 patients from 11 centers were included in our study. In view of the fact that the requested acquisition time of all PET scans should be 60 + 10 min. after injection, our final cohort consisted of 119 subjects. Patients’ characteristics are shown in Table 2. At diagnosis, the median age was 60 years (range 19-84), with most patients in good general conditions (ECOG PS of 0-1 in 96.6% of cases) and a baseline median age-adjusted CCI of 4. The most common primary site was oropharynx (57.1%): overall, most patients in our study had a locally advanced disease (91.5% with stage III-IV) and HPV negative status (73.1%). Primary treatment was heterogeneous, with concurrent CRT as prevalent modality (54.6%). No patients underwent a planned neck dissection. The mean time intervals from baseline PET execution to start of treatment and from its end to final PET execution were 3.1 and 16.6 weeks, respectively. At a median follow-up of 42 months (range 5-98), the median LRC, PFS, and OS were 35 (95% CI, 32-43), 33 (95% CI, 30-40), and 45.5 (95% CI, 39-51) months, respectively. The 3-year rates of LRC, PFS, and OS were 74.5%, 61.3%, and 82.2%, respectively (Fig. 1 and supplementary figures 1-2). Overall, 28/119 patients (23.5%) were censored for loco-regional recurrence.

Table 2 Patients’ disease and treatment characteristics
Fig. 1
figure 1

Loco-regional control (Kaplan-Meyer method)

FDG-PET/CT training phase

The application of Hopkins, Cuneo, and Deauville scores for post-treatment response assessment yielded different score distributions, as shown in Fig. 2. Regarding the interobserver agreement, the Krippendorff’s alpha values for Tref and Nref evaluated at the 3-time points of assessment are reported in Table 3.

Fig. 2
figure 2

Score distribution of FDG-PET/CT post-treatment scans according to used standardized reporting criteria (Deauville, Hopkins and Cuneo scores). Post-treatment scans classified as positive or negative for residual tumor (black and grey bars, respectively) based on composite TNref score

Table 3 Krippendorff’s alpha values for inter-observer agreement throughout 3 rounds of revision of post-treatment FDG-PET/CT scans for Tref (defined as the area with highest FDG uptake within the residual primary tumor) and Nref (defined as the residual lymph node with highest FDG uptake)

Accuracy of FDG-PET/CT-based qualitative scores

In light of the reported good interobserver agreement, we then assessed as primary endpoint the diagnostic accuracy of the 3 qualitative reporting scales to rule out loco-regional failure at post-treatment scan, primarily in terms of PPV (Table 4, supplementary table 1). The equivocal scores (3 and 4 according to Cuneo score and 3 according to Deauville score) were clustered at time of analysis with definite positive and negative findings in order to identify the best diagnostic threshold. Overall, Cuneo score no. 1 (with scores 3 and 4 clustered with 1 + 2, indicative of absence of disease) yielded the best PPV for all categories (Tref, Nref, and TNref of 42.9%, 100%, and 50%, respectively). In addition, it also had the highest TNref overall accuracy (76.5%), followed by Cuneo score no. 2 (score 3 clustered with 1 + 2, score 4 clustered with 5 + 6, indicative of persistent disease), Hopkins score, Deauville score no. 1 (score 3 clustered with 1 + 2, indicative of absence of disease), Cuneo score no. 3 (scores 3 and 4 clustered with 5 + 6, indicative of residual disease), and Deauville score no. 2 (score 3 clustered with 4 + 5, indicative of residual disease) with 68.1%, 68.1%, 68.1%, 61.3%, and 54.6%, respectively. Pictorial examples of Tref and Nref scoring with the 3 scales are shown in supplementary figures 3 and 4, respectively.

Table 4 Overall diagnostic accuracy using standardized reporting criteria (Deauville, Hopkins, and Cuneo scores)

Prognostic impact of FDG-PET/CT semi-quantitative parameters

In order to evaluate whether any change of semi-quantitative parameters over time could be of prognostic impact, delta values for Tref and Nref between baseline and post-treatment scans were correlated with LRC, PFS, and OS. For this purpose, 109 patients were analyzed, since 10 subjects were excluded due to the fact that the baseline FDG-PET/CT was performed during or at the completion of induction CHT. Patients with a SUVmax reduction for Nref in the second tertile had a lower risk of death compared to first and third tertiles (p = 0.046; OR for death, 0.27; 95% CI, 0.09-0.85, p = 0.025). All other variables (either as continuous or categorical) were not significantly associated with efficacy outcomes. When standardized semi-quantitative response assessments were applied, no correlation could be found between EORTC criteria and LRC, PFS, and OS, whereas nodal PD according to PERCIST criteria was associated with a higher risk of loco-regional failure (p = 0.026; OR for LR failure, 5.65; 95% CI, 1.26-25.46, p = 0.024) and death (p = 0.04; OR for death, 4.81; 1.07-21.53, p = 0.04).

At Cox regression univariate analysis, the use of induction (p = 0.035) and concurrent CHT (p = 0.0001) correlated with better OS, whereas a higher risk of death was found for patients with baseline PS 2 (p = 0.001). In addition, a Cuneo score of 5-6 was also indicative of poor prognosis (p = 0.0001), which retained statistical significance at multivariate analysis (HR 6.0; 95% CI, 1.88-19.18; p = 0.002). No correlation was observed in respect with CCI (< or ≥ 4), stage (IV vs others) and HPV status.

Discussion

Supported by high level of evidence (Mehanna et al., 2016), the use of FDG-PET/CT after definitive CRT is recommended for HNSCC; however, the lack of a validated interpretation system prevents from cross-comparisons among studies and accurate prognostication in clinical practice. In the present multicenter study, we preliminarily validated the use of Cuneo score, a 6-point qualitative scale by assessing its feasibility and inter-reader agreement and by demonstrating an improvement in PPV after CRT with respect to other score-based approaches previously proposed in this clinical setting. The clinical relevance of applying standardized qualitative criteria in treatment response assessment with FDG-PET/CT is epitomized by the widespread reproducibility and prognostic validity of Deauville score in HL (Kobe et al., 2018). In comparison to it, only limited data are thus far available for solid malignancies (Helsen et al., 2018; Scarsbrook et al., 2017; Huang et al., 2019). In this context, the Hopkins criteria represent the only proposed scoring system available for qualitative evaluation of post-treatment FDG-PET/CT in HNSCC. This 5-point scale is essentially based on the adoption of internal jugular vein (IJV) activity as blood-pool background reference. A well conducted prospective study (Van Den Wyngaert et al., 2017) showed that the application of Hopkins criteria allowed to obtain a lower rate of equivocal findings in comparison with non-standardized local read (1.6% vs 10.4%, p = .003), whereas the overall diagnostic accuracy was not improved (AUC of 0.78 and 0.73, respectively, p = .336). The available data (Marcus et al., 2014; Van Den Wyngaert et al., 2017) suggest that this scale may not be the best solution to address the inherently suboptimal PPV of FDG-PET/CT assessment in HNSCC. In this perspective, the rationale behind the design of the 6-tiered Cuneo score lied in replacing the activity of IJV as background reference with those of mediastinal blood pool (MBP) and liver and in comparing the FDG-avid spot with the local background. In case of residual uptake above the MBP, we envisaged to correlate the relationship between the focal uptake and local background with the liver activity, in order to take into account the known “contrast illusion effect” which may be particularly relevant in head and neck anatomy. Overall, we sought to design a scale with a more gradual shift in scoring based on the local background activity, aiming for a better clusterization of false positives compared with Hopkins criteria. Following a standardized concordance methodology widely adopted in HL scenario (Biggi et al., 2013), a good inter-reader agreement was achieved in our work. Despite its potentially high degree of complexity, the Cuneo score was prospectively shown to be feasible with adequate reproducibility. In addition, no difference was observed in terms of inter-reader agreement comparing Cuneo score with Hopkins and Deauville criteria. While Hopkins criteria were already externally validated in a single-center retrospective experience (Kendi et al., 2017) and ECLYPS study (Van Den Wyngaert et al., 2017) with excellent concordance, the experimental application of Deauville score to HNSCC response assessment is a peculiar finding of our work. Clearly, prospective studies are required to further confirm the reliability of Cuneo score for standardized reporting. As already mentioned, when the Cuneo score threshold differentiating absence and residual disease was set between scores 4 and 5 (CS no. 1), the highest PPV rates were obtained. In particular, achieving 100% nodal PPV is of extreme interest; in our opinion, this finding may lend support to the beneficial adoption of a 6-point scale essentially centered on the local background activity to rule out false-positive interpretations of irradiated lymph nodes, a critical issue for HNSCC. From a clinical perspective, the ability to discriminate with excellent accuracy the presence of residual nodal disease may allow the early implementation of salvage surgery, whereas the recognition of a false positive finding with high reliability may spare unnecessary morbidity avoiding a neck dissection. In contrast, the suboptimal PPV rate (42.9%) reported for primary tumor assessment underlines the importance of integrating two or more imaging modalities and clinical feedback for this specific purpose (Jentsch et al., 2015). Regarding NPV, the results obtained with Hopkins, Deauville, and Cuneo scores were similar, in the range of 80%, thus less than usually expected in this context. Since we did not limit our post-treatment evaluation to a 6-month timepoint, taking also into account that the mean time to loco-regional failure in our cohort was of 16 months and that 53% (15/28) of loco-regional recurrences occurred after 1 year from the end of RT, we think that the less than excellent NPV results reflect a time-dependent loss of accuracy to detect late relapses, a finding also shown in the ECLYPS study (Van Den Wyngaert et al., 2017). On top of excluding almost two-thirds of potential candidate patients from our retrospective analysis, our attempt to follow a rigorous centralized assessment implied that the 3 reviewers were blinded to all clinical data and could not examine computed tomography or magnetic resonance of any individual case, whenever performed. On the one hand aiming to increase the reviewers’ objectivity, on the other, we think that this was the main reason why all our qualitative interpretations underperformed in terms of PPV, particularly for Tref response assessment, falling short of what initially hypothesized. In other words, the strictly blinded review we performed could have contributed to skew our results towards worse overall accuracy, compared with what may be achieved in clinical practice. Additional limitations have to be acknowledged in the interpretation of our results. First, in spite of the outlined inclusion criteria, the retrospective nature of our study and the inherent clinical heterogeneity cannot be overlooked. Second, the HPV positive subgroup was much less represented that in the original paper by Marcus et al. (Marcus et al., 2014) (32 vs 123 patients, 26.9% vs 57.5% of the whole sample, respectively), thus restraining us from drawing correlations between the diagnostic performance of Cuneo score and the false positives related to the slow nodal clearance of HPV positive HNSCC. Third, the relatively low number of our sample and of loco-regional recurrences may limit the strength of our findings. Finally, no attempt was performed to correlate the post-treatment qualitative scores with nodal morphologic features (Wray et al., 2016) or radiation planning dosimetry (Morgan et al., 2019). When analyzing the semi-quantitative FDG-PET/CT variables and their delta values between pre- and post-treatment scans, no definitive conclusions can be drawn, except for the unfavorable prognostic impact of nodal progression according to PERCIST criteria. Notably, the significant correlation found between a Cuneo score indicative of persistent disease (5 and 6 according to Cuneo score no. 1) and poor OS reinforces the assumption that the application of standardized qualitative criteria may be well suited for clinical prognostication. Although our data need to be interpreted with caution in light of the peculiar methodology we followed, the results obtained by applying the Cuneo score after CRT in HNSCC are promising and deserve to be further investigated.

In conclusion, a standardized qualitative interpretation of FDG-PET/CT-based post-treatment assessment in HNSCC is still largely underrepresented in clinical practice. A 6-point scale such as the Cuneo score is feasible and may allow for better discrimination in respect to PPV, compared with the Hopkins criteria. To further elucidate its reproducibility and overall diagnostic accuracy, prospective studies are warranted.

Availability of data and materials

Not applicable

Abbreviations

AIRO:

Italian Association of Radiotherapy and Clinical Oncology

AUC:

Area under the curve

CCI:

Charlson comorbidity index

CHT:

Chemotherapy

CI:

Confidence intervals

CRT:

Chemo-radiotherapy

EANM:

European Association of Nuclear Medicine

ECOG:

Eastern Cooperative Oncology Group

FDG:

18F-fluorodeoxyglucose

FDG-PET/CT:

18F-fluorodeoxyglucose-positron emission tomography/computed tomography

FIL:

Federazione Italiana Linfomi

HL:

Hodgkin lymphoma

HNSCC:

Head and neck squamous cell carcinoma

HPV:

Human papilloma virus

HR:

Hazard ratio

IJV:

Internal jugular vein

LRC:

Loco-regional control

MBP:

Mediastinal blood pool

NPV:

Negative predictive value

OR:

Odd ratio

OS:

Ooverall survival

PS:

Performance status

PPV:

Positive predictive value

PFS:

Progression-free survival

PD:

Progressive disease

RT:

Radiation

SE:

Sensitivity

SP:

Specificity

References

  • Barrington SF, Kluge R (2017 Aug) FDG PET for therapy monitoring in Hodgkin and non-Hodgkin lymphomas. Eur J Nucl Med Mol Imaging. 44(Suppl 1):97–110. https://doi.org/10.1007/s00259-017-3690-8

    Article  PubMed  PubMed Central  Google Scholar 

  • Barrington SF, Phillips EH, Counsell N, Hancock B, Pettengell R, Johnson P et al (2019 Jul 10) Positron emission tomography score has greater prognostic significance than pretreatment risk stratification in early-stage Hodgkin lymphoma in the UK RAPID study. J Clin Oncol. 37(20):1732–1741. https://doi.org/10.1200/JCO.18.01799

    Article  CAS  PubMed  Google Scholar 

  • Bathia A, Burtness B (2015 Oct 10) Human papillomavirus-associated oropharyngeal cancer: defining risk groups and clinical trials. J Clin Oncol. 33(29):3243–3250. https://doi.org/10.1200/JCO.2015.61.2358

    Article  CAS  Google Scholar 

  • Bhatnagar P, Subesinghe M, Patel C, Prestwich R, Scarsbrook AF (2013 Nov-Dec) Functional imaging for radiation treatment planning, response assessment, and adaptive therapy in head and neck cancer. Radiographics. 33(7):1909–1929. https://doi.org/10.1148/rg.337125163

    Article  PubMed  Google Scholar 

  • Biggi A, Gallamini A, Chauvie S, Hutchings M, Kostakoglu L, Gregianin M et al (2013 May) International validation study for interim PET in ABVD-treated, advanced-stage hodgkin lymphoma: interpretation criteria and concordance rate among reviewers. J Nucl Med 54(5):683–690. https://doi.org/10.2967/jnumed.112.110890

    Article  CAS  PubMed  Google Scholar 

  • Boellard R, O’Doherty MG, Weber WA, Mottaghy FM, Lonsdale MN, Stroobants SG et al (2010 Jan) FDG PET and PET/CT: EANM procedure guidelines for tumour PET imaging: version 1.0. Eur J Nucl Med Mol Imaging 37(1):181–200. https://doi.org/10.1007/s00259-009-1297-4

    Article  Google Scholar 

  • Carvalho AL, Nishimoto IN, Califano JA, Kowalski LP (2005 May 1) Trends in incidence and prognosis for head and neck cancer in the United States: a site-specific analysis of the SEER database. Int J Cancer 114(5):806–816. https://doi.org/10.1002/ijc.20740

    Article  CAS  PubMed  Google Scholar 

  • Charlson ME, Pompei P, Ales KL, MacKenzie CR (1987) A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 40:373–383

    Article  CAS  Google Scholar 

  • Chauvie S, Bergesio F, Fioroni F, Brambilla M, Biggi A, Versari A et al (2016 May) The (68) Ge phantom-based FDG-PET site qualification program for clinical trials adopted by FIL (Italian Foundation on Lymphoma). Phys Med 32(5):651–656. https://doi.org/10.1016/j.ejmp.2016.04.004

    Article  PubMed  Google Scholar 

  • Cheson BD, Fisher RI, Barrington SF et al (2014) Recommendations for initial evaluation, staging, and response assessment of Hodgkin and non-Hodgkin lymphoma: the Lugano classification. J Clin Oncol 32:3059–3067

    Article  Google Scholar 

  • Gupta T, Master Z, Kannan S, Agarwal JP, Ghsoh-Laskar S, Rangarajan V et al (2011 Nov) Diagnostic performance of post-treatment FDG PET or FDG PET/CT imaging in head and neck cancer: a systematic review and meta-analysis. Eur J Nucl Med Mol Imaging. 38(11):2083–2095. https://doi.org/10.1007/s00259-011-1893-y

    Article  PubMed  Google Scholar 

  • Helsen N, Van Den Wyngaert T, Carp L, Stroobants S (2018 Jun) FDG-PET/CT for treatment response assessment in head and neck squamous cell carcinoma: a systematic review and meta-analysis of diagnostic performance. Eur J Nucl Med Mol Imaging. 45(6):1063–1071. https://doi.org/10.1007/s00259-018-3978-3

    Article  PubMed  Google Scholar 

  • Huang SH, O’Sullivan B, Xu W, Zhao H, Chen DD, Ringash J et al (2013) Temporal nodal regression and regional control after primary radiation therapy for N2-N3 head-and-neck cancer stratified by HPV status. Int J Radiat Oncol Biol Phys 87(5):1078–1085. https://doi.org/10.1016/j.ijrobp.2013.08.049

    Article  PubMed  Google Scholar 

  • Huang YC, Li SH, Lu HI, Hsu CC, Wang YM, Lin WC et al (2019 Jan 7) Post-chemoradiotherapy FDG PET with qualitative interpretation criteria for outcome stratification in esophageal squamous cell carcinoma. PloS One 14(1):e0210055. https://doi.org/10.1371/journal.pone.0210055

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Iravani A, Turgeon GA, Akhurst T, Callahan JW, Bressel M, Everitt SJ et al (2019 Jun 12) PET-detected pneumonitis following curative-intent chemoradiation in non-small cell lung cancer (NSCLC): recognizing patterns and assessing the impact on the predictive ability of FDG-PET/CT response assessment. Eur J Nucl Med Mol Imaging. https://doi.org/10.1007/s00259-019-04388-3

    Article  CAS  Google Scholar 

  • Jentsch C, Beuthien-Baumann B, Troost EG, Shakirin G (2015) Validation of functional imaging as a biomarker for radiation treatment response. Br J Radiol. 88(1051):20150014. https://doi.org/10.1259/bjr.20150014

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • JH O, Lodge MA, Wahl R (2016 Aug) Practical PERCIST: a simplified guide to PET response criteria in solid tumors 1.0. Radiology 280(2):576–584. https://doi.org/10.1148/radiol.2016142043

    Article  Google Scholar 

  • Kendi AT, Brandon D, Switchenko J, Wadsworth JT, El-Deiry MW, Saba NF et al (2017 Sep 1) Head and neck PET/CT therapy response interpretation criteria (Hopkins criteria) – external validation study. Am J Nucl Med Mol Imaging 7(4):174–180

    CAS  PubMed  PubMed Central  Google Scholar 

  • Kobe C, Goergen H, Baues C, Kuhnert G, Voltin CA, Zijlstra J et al (2018 Nov 22) Outcome-based interpretation of early interim PET in advanced-stage Hodgkin lymphoma. Blood 132(21):2273–2279. https://doi.org/10.1182/blood-2018-05-852129

    Article  CAS  PubMed  Google Scholar 

  • Marcus C, Ciarallo A, Tahari AK, Mena E, Koch W, Wahl RL et al (2014) Head and neck PET/CT: therapy response interpretation criteria (Hopkins criteria)-interreader reliability, accuracy, and survival outcomes. J Nucl Med 55:1411–1416. https://doi.org/10.2967/jnumed.113.136796

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Mehanna H, Wong WL, McConkey CC, Rahman JK, Robinson M, Hartley AG et al (2016) PET-CT surveillance versus neck dissection in advanced head and neck cancer. N Eng J Med 374(15):1444–1454. https://doi.org/10.1056/NEJMoa1514493

    Article  CAS  Google Scholar 

  • Morgan R, Chin BB, Lanning R (2019) Feasibility of rapid integrated radiation therapy planning with follow up FDG PET/CT to improveoverall treatment assessment in head and neck cancer. Am J Nucl Med Mol Imaging. 9(1):24–29

    CAS  PubMed  PubMed Central  Google Scholar 

  • Pignon JP, Bourhis J, Domenge C, Désigné L, On behalf of the MACH-NC Collaborative Group (2000) Chemotherapy added to locoregional treatment for head and neck squamous-cell carcinoma: three meta-analyses of updated individual data. Lancet 255:949–955

    Article  Google Scholar 

  • Pignon JP, le Maître A, Maillard E, Bourhis J (2009) Meta-analysis of chemotherapy in head and neck cancer (MACH-NC): an update on 93 randomised trials and 17,346 patients. Radiother Oncol 92:4–14. https://doi.org/10.1016/j.radonc.2009.04.014

    Article  PubMed  Google Scholar 

  • Rettig EM, D’Souza G (2015 Jul) Epidemiology of head and neck cancer. Surg Oncol Clin N Am. 24(3):379–396. https://doi.org/10.1016/j.soc.2015.03.001

    Article  PubMed  Google Scholar 

  • Scarsbrook A, Vaidyanathan S, Chowdhury F, Swift S, Cooper R, Patel C (2017 Apr) Efficacy of qualitative response assessment interpretation criteria at 18F-FDG PET-CT for predicting outcome in locally advanced cervical carcinoma treated with chemoradiotherapy. Eur J Nucl Med Mol Imaging 44(4):581–588. https://doi.org/10.1007/s00259-016-3537-8

    Article  CAS  PubMed  Google Scholar 

  • Therasse P, Arbuck SG, Eisenhauer EA, Wanders J, Kaplan RS, Rubinstein L et al (2000 Feb 2) New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst. 92(3):205–216

    Article  CAS  Google Scholar 

  • Van Den Wyngaert T, Helsen N, Carp L, Hakim S, Martens MJ, Hutsebaut I et al (2017 Oct 20) Fluorodeoxyglucose-positron emission tomography/computed tomography after concurrent chemoradiotherapy in locally advanced head-and-neck squamous cell cancer: the ECLYPS study. J Clin Oncol. 35(30):3458–3464. https://doi.org/10.1200/JCO.2017.73.5845

    Article  PubMed  Google Scholar 

  • Wray R, Sheikhbahaei S, Marcus C, Zan E, Ferraro R, Rahmim A et al (2016) Therapy response assessment and patient outcomes in head and neck squamous cell carcinoma: FDG PET Hopkins criteria versus residual neck node size and morphologic features. AJR Am J Roentgenol 207(3):641–647. https://doi.org/10.2214/AJR.15.15730

    Article  PubMed  Google Scholar 

  • Young H, Baum R, Cremerius U, Herholz K, Hoekstra O, Lammertsma AA et al (1999 Dec) Measurement of clinical and subclinical tumour response using [18F]-fluorodeoxyglucose and positron emission tomography: review and 1999 EORTC recommendations. European Organization for Research and Treatment of Cancer (EORTC) PET Study Group. Eur J Cancer 35(13):1773–1782

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The authors wish to thank the AIRO scientific committee (Professors Renzo Corvò, Domenico Genovesi, Pierfrancesco Franco, and Alicja Barbara Jereczek) for their valuable review of the manuscript.

Funding

None

Author information

Authors and Affiliations

Authors

Contributions

Conception and design of the study: PB, AM, AB; patient recruitment: all authors.

All authors contributed to the discussion of results and have read and approved the final manuscript.

Corresponding author

Correspondence to P. Bonomo.

Ethics declarations

Ethics approval and consent to participate

This study was approved by The “Comitato Etico Regionale per la Sperimentazione Clinica della Regione Toscana Sezione: AREA VASTA CENTRO” (approval number 1105_oss), and all patients gave written consent to participate.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: figure 1.

progression-free survival (Kaplan Meyer method)

Additional file 2: figure 2.

overall survival (Kaplan Meyer method)

Additional file 3: figure 3.

: fused FDG-PET/CT images of a 67-year old male with a T4aN3 oropharyngeal cancer: Tref assessment negative for residual tumor according to all scales

Additional file 4: figure 4.

fused FDG-PET/CT images of a 69-year old male with a T4aN2b laryngeal cancer: Nref assessment negative for residual tumor according to all scales

Additional file 5: table 1.

positive predictive value and corresponding 95% CI of composite TNref for specific scores. PPV: positive predictive value

Additional file 6: material.

FDG-PET/CT analysis

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bonomo, P., Merlotti, A., Morbelli, S. et al. Does a 6-point scale approach to post-treatment 18F-FDG PET-CT allow to improve response assessment in head and neck squamous cell carcinoma? A multicenter study. European J Hybrid Imaging 4, 8 (2020). https://doi.org/10.1186/s41824-020-00077-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41824-020-00077-9

Keywords