[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content
Download PDF

An updated PREDICT breast cancer prognostication and treatment benefit prediction model with independent validation

Breast Cancer Research volume 19, Article number: 58 (2017) Cite this article

Abstract

Background

PREDICT is a breast cancer prognostic and treatment benefit model implemented online. The overall fit of the model has been good in multiple independent case series, but PREDICT has been shown to underestimate breast cancer specific mortality in women diagnosed under the age of 40. Another limitation is the use of discrete categories for tumour size and node status resulting in ‘step’ changes in risk estimates on moving between categories. We have refitted the PREDICT prognostic model using the original cohort of cases from East Anglia with updated survival time in order to take into account age at diagnosis and to smooth out the survival function for tumour size and node status.

Methods

Multivariable Cox regression models were used to fit separate models for ER negative and ER positive disease. Continuous variables were fitted using fractional polynomials and a smoothed baseline hazard was obtained by regressing the baseline cumulative hazard for each patients against time using fractional polynomials. The fit of the prognostic models were then tested in three independent data sets that had also been used to validate the original version of PREDICT.

Results

In the model fitting data, after adjusting for other prognostic variables, there is an increase in risk of breast cancer specific mortality in younger and older patients with ER positive disease, with a substantial increase in risk for women diagnosed before the age of 35. In ER negative disease the risk increases slightly with age. The association between breast cancer specific mortality and both tumour size and number of positive nodes was non-linear with a more marked increase in risk with increasing size and increasing number of nodes in ER positive disease.

The overall calibration and discrimination of the new version of PREDICT (v2) was good and comparable to that of the previous version in both model development and validation data sets. However, the calibration of v2 improved over v1 in patients diagnosed under the age of 40.

Conclusions

The PREDICT v2 is an improved prognostication and treatment benefit model compared with v1. The online version should continue to aid clinical decision making in women with early breast cancer.

Background

The PREDICT breast cancer prognostication and treatment benefit prediction model (v1) was developed in 2010 [1] using data from the East Anglia Cancer Registration and Information Centre (ECRIC) for model fitting and data from the West Midlands Cancer Intelligence Unit for model validation [1]. PREDICT was implemented as a web-based tool for clinicians in January 2011 (www.predict.nhs.uk), and since then the use of the tool has increased steadily. In October 2016, the website was accessed over 20,000 times (Fig. 1a) from locations all over the world (Fig. 1b). The model is endorsed by the American Joint Committee on Cancer having met its criteria for inclusion of risk models for individualized prognosis in the practice of precision medicine [2] and is the only breast cancer prognostic model currently available online that has been endorsed by the American Joint Committee on Cancer [3].

Fig. 1
figure 1

Web access to the online version of PREDICT at www.predict.nhs.uk, January 2011–October 2016. a Access per month. b Access by city. Source: Google Analytics (Mountain View, CA, USA)

Full size image

The original model used tumour size in five categories (1–9 mm, 10–19 mm, 20–29 mm, 30–49 mm and 50 mm+), node status in five categories (0, 1, 2–4, 5–9 and 10+ positive nodes), tumour grade (1–3), oestrogen receptor (ER) status and mode of detection (clinical/screening) to estimate breast cancer-specific mortality at 5 and 10 years, as well as age to estimate non-breast cancer mortality at 5 and 10 years. The predicted benefit of adjuvant chemotherapy classified as first-, second- or third-generation and adjuvant hormone therapy was taken from the meta-analyses of the Early Breast Cancer Trialists Collaborative Group [4]. The model was subsequently validated in independent case series from British Columbia [5], The Netherlands [6, 7] and Malaysia [8], as well as two additional case series from the United Kingdom (the Prospective study of Outcomes in Sporadic and Hereditary breast cancer [POSH] study [9] and the Nottingham Breast Cancer Study [10]). Human epidermal growth factor receptor 2 (HER2) status (v1.2) and Ki67 status (v1.3) were also incorporated into the model, resulting in small improvements in discrimination of the model [10, 11].

Although the overall fit of the model has been good in multiple independent case series, PREDICT has been shown to underestimate breast cancer-specific mortality in women diagnosed under the age of 40 years, particularly those with ER-positive disease [9]. Another limitation of the model is the use of discrete categories for tumour size and node status, which result in ‘step’ changes in risk estimates on moving from one category to the next. For example, a woman with an 18-mm or 19-mm tumour will be predicted to have the same breast cancer-specific mortality if all the other prognostic factors are the same, whereas breast cancer-specific mortality for a 19-mm tumour will differ from that of women with a 20-mm tumour. We have therefore re-fitted the PREDICT prognostic model using the original cohort of cases from East Anglia with updated survival time to take into account age at diagnosis and to smooth out the survival function for tumour size and node status. The fit of the model has been tested in three independent data sets that have also been used to validate the original version of PREDICT.

Methods

Patient data

Model development data

The primary analysis was based on data from patients with invasive breast cancer diagnosed in East Anglia, UK, between 1999 and 2003 identified by ECRIC. ECRIC covered a catchment area population of approximately 5.5 million people and registers all malignant tumours occurring in people resident in East Anglia at the time of diagnosis. ECRIC also recorded prospectively demographic, pathologic, staging, general treatment and outcome information. Death certificate flagging through the Office for National Statistics provides the registries with notification of deaths. The lag times for this are a few weeks for cancer deaths and 2 months to 1 year for non-cancer deaths. In addition, ECRIC staff checked vital status by querying the National Health Service Strategic Tracing Service. Vital status was ascertained at the end of June 2013, and all analyses were censored on 31 December 2012 to allow for delay in reporting of vital status. Breast cancer-specific mortality was defined as deaths where breast cancer was listed as the cause of death on part 1a, 1b or 1c of the death certificate.

Information obtained from ECRIC included age at diagnosis, number of lymph nodes sampled and number of lymph nodes positive, tumour size, histological grade, ER status, mode of detection (screening vs. clinical), information on local therapy (wide local excision, mastectomy, radiotherapy), and type of adjuvant systemic therapy (chemotherapy, endocrine therapy, both). Exact chemotherapy regimens are unknown, but the majority of patients with breast cancer in the ECRIC population received first- or second-generation chemotherapy during this time period. Patients who did not undergo surgery, patients with incomplete local therapy (wide local excision without radiotherapy) and patients with fewer than four nodes excised with a diagnosis of node-negative disease were excluded from the analyses, leaving a study population of 5738 individuals. Of these 1977 (34%) had less than 10 years of potential follow-up.

Validation samples

From the Nottingham/Tenovus Breast Cancer Study (NTBCS), data were available for 2232 cases of invasive breast cancer treated in Nottingham from 1989 to 1998. Of these, 506 node-negative cases were excluded because of inadequate axillary node staging (fewer than four nodes sampled), leaving 1726 patients (ER-negative, n = 452; ER-positive, n = 1274) for the validation study. Outcome data were obtained on a prospective basis. Patients were followed at 3-month intervals initially, then at 6-month intervals, and then annually for a median period of 111 months (range 4–211 months). At death, the hospital notes are examined and deaths allocated to with/from breast cancer or to without known breast cancer. For those who were lost to follow-up, hospital notes were retrieved and checked. Vital status was ascertained at the end of October 2012. Breast cancer-specific mortality was defined as deaths where breast cancer was listed as the cause of death on part 1a, 1b or 1c of the death certificate. Breast cancer-specific survival was defined as the interval between the operation and death resulting from breast cancer, death being scored as an event, and patients who died as a result of other causes or were still alive were censored at the time of last follow-up.

For the Breast Cancer Outcome Study of Mutation Carriers (BCOS), data collection has been described previously [7]. In short, we used data from a hospital-based cohort of consecutive females diagnosed at <50 years of age with invasive breast cancer, identified through medical registries of participating hospitals or the Netherlands Cancer Registry. Patients diagnosed between 1990 and 2000 with unilateral stages I–III breast cancer without a previous cancer diagnosis (except non-melanoma skin cancer), for whom complete data on tumour size, nodal status, receipt of adjuvant systemic therapy, and follow-up were available, were included. Information about diagnosis and treatment (e.g., histological tumour grade, stage, adjuvant chemotherapy and endocrine systemic treatment; before about 2004 no trastuzumab was administered), ER and progesterone receptor status, HER2 and angiolymphatic invasion were gathered from original pathology reports and/or determined using reviews of whole slides and staining of tumours in tissue microarrays. Follow-up data were obtained from the medical registries from the participating hospitals and/or linkage with the Dutch municipal registry through the Netherlands Cancer Registry (last follow-up update in 2013).

The Prospective Study of Outcomes in Sporadic and Hereditary Breast Cancer (POSH) is a multicentre prospective observational cohort study of 2609 young women diagnosed with breast cancer in the United Kingdom between 2000 and 2008 [12]. Information obtained in the POSH cohort included age at diagnosis, histological grade, tumour size, number of positive lymph nodes, ER status, adjuvant chemotherapy, chemotherapy regimen and adjuvant hormone therapy. Outcome data were obtained through flagging with the Office for National Statistics. Vital status was ascertained at the end of June 2015, and all analyses were censored on 31 December 2014 to allow for delay in reporting of vital status. Breast cancer-specific mortality was defined as deaths where breast cancer was listed as the cause of death on part 1a, 1b or 1c of the death certificate. A total of 1374 of the participants (53%) had less than 10 years of potential follow-up. The validation studies were approved by the relevant research ethics committees, and all participants provided written informed consent.

Statistical methods

Separate models were derived for ER-positive and ER-negative breast cancer. The models were derived using Cox regression to estimate the coefficients associated with each risk factor. The non-linear risk relationships between continuous variables (age, tumour size and number of positive nodes) and breast cancer death were modelled using multivariable fractional polynomials [13]. The variables for the final models were selected by sequential backward elimination [14]. The effects of adjuvant chemotherapy and adjuvant hormone therapy were constrained to the effects reported for standard anthracycline-based chemotherapy and adjuvant tamoxifen from an updated analysis of the Early Breast Cancer Trialists Collaborative Group [15]. After fitting of the models, smoothed functions for baseline hazard of breast cancer-specific mortality were derived as follows. First, the baseline cumulative hazard was estimated for each patient. Then the logarithmic value of the baseline hazard was regressed against time using a univariate fractional polynomial function. The resulting functions were used to estimate the cumulative baseline hazard at 10 years.

A similar approach was used to model non-breast cancer mortality using Cox regression and multivariable fractional polynomials to obtain a function for other mortality with age. The smoothed baseline hazard function for non-breast-specific mortality was derived as described above.

Calculation of predicted mortality for validation sample

A prognostic index (PI) for each patient was calculated as the sum of the weighted prognostic factors where the weights were the β-coefficients from the Cox regression and the logarithmic HRs for the effects of adjuvant chemotherapy and hormone therapy from clinical trials. A non-breast cancer mortality index (MI) was calculated as the weighted prognostic factor for non-breast cancer mortality. The absolute risk of breast cancer death (HB) before time t, assuming no competing mortality, is estimated by the following formula:

$$ {\mathrm{H}}_{\mathrm{B}} = 1\ \hbox{-}\ \exp \left(\hbox{-} \exp \left(\mathrm{PI}\right)*{\mathrm{B}\mathrm{Sb}}_t\right) $$

and the equivalent formula for the cumulative risk of non-breast cancer mortality (HO) is:

$$ {\mathrm{H}}_{\mathrm{O}} = 1\ \hbox{-}\ \exp \left(\hbox{-} \exp \left(\mathrm{MI}\right)*{\mathrm{BSo}}_t\right) $$

where BSb t is the cumulative baseline hazard for breast cancer mortality at time t and BSo t is the cumulative baseline hazard for non-breast cancer mortality at time t.

These are competing risks, so the cumulative risk of breast cancer mortality at time t is

$$ \mathrm{R}\mathrm{b} = {\mathrm{H}}_{\mathrm{B}}*\left({1\ \hbox{--}\ \mathrm{H}}_{\mathrm{O}}\right) $$

and the cumulative risk of non-breast cancer mortality is

$$ \mathrm{R}\mathrm{o} = {\mathrm{H}}_{\mathrm{O}}*\left({1\ \hbox{--}\ \mathrm{H}}_{\mathrm{B}}\right) $$

We also estimated the 10-year predicted breast cancer-specific mortality and other mortality using the current online version of PREDICT (v1.3).

Model calibration was analysed as a comparison of the predicted mortality estimates from each model with the observed mortality. In addition to comparing calibration in the complete data set, we evaluated calibration within strata of other prognostic variables. We also evaluated calibration within quintiles of predicted mortality. A goodness-of-fit test was carried out by using a χ2 test based on the observed and predicted number of events within each quintile (5 df). Model discrimination was evaluated by calculating the AUC calculated for 10-year mortality. This is a measure of how well each version of the model identifies those patients with worse survival. The AUC is the probability that the predicted mortality of a randomly selected patient who died will be higher than the predicted mortality of a randomly selected survivor. Comparison between the new model and v1 was made using the method of DeLong [16]. A goodness-of-fit test was carried out by using a χ2 test based on the observed and predicted number of events in quintiles of predicted risk (5 df). All analyses were carried out using Stata version 14 software (StataCorp, College Station, TX, USA).

Results

The model fitting was carried out using data for 1020 women with ER-negative disease, 333 of whom had died as a result of breast cancer and 107 of whom had died as a result of other causes within 10 years of follow-up, as well as data for 4718 women with ER-positive breast cancer, 599 of whom had died as a result of breast cancer and 511 of whom had died as a result of other causes within 10 years of follow-up. Tumour size, number of positive nodes and tumour grade were significant prognostic factors for ER-negative disease in the Cox regression implemented within a multivariable fractional polynomial model. For ER-positive disease, age at diagnosis, tumour size, number of positive nodes, tumour grade and mode of detection were significant. The fractional polynomial functions and associated logarithmic HRs are shown in Table 1.

Table 1 Fractional polynomial functions and associated logarithmic HRs for age at diagnosis, tumour size, number of positive nodes, tumour grade and mode of detection by oestrogen receptor status
Full size table

The breast cancer-specific mortality HR functions for age at diagnosis, tumour size and number of positive nodes are shown in Fig. 2. In ER-positive disease, after adjusting for other prognostic variables, there is an increase in risk of breast cancer-specific mortality in younger and older patients, with a substantial increase in risk for women diagnosed before the age of 35 years. The association between breast cancer-specific mortality and both tumour size and number of positive nodes was non-linear, with a more marked increase in risk with increasing size and increasing number of nodes in ER-positive disease. The corresponding baseline survival functions are given by the following equations:

Fig. 2
figure 2

Breast cancer-specific mortality HR functions for age, tumour size and number of positive nodes derived from the model development data. ER-negative is indicated by red lines; ER-positive is indicated by blue lines. ER Oestrogen receptor

Full size image
$$ {\mathrm{BSb}}_{\mathrm{t}}\left(\mathrm{ER}\ \mathrm{negative}\right) = \hbox{-} 1.156 + 0.4707/{\mathrm{t}}^2\hbox{-}\ 3.514/\mathrm{t} $$
$$ {\mathrm{BSb}}_{\mathrm{t}}\left(\mathrm{ER}\ \mathrm{positive}\right) = 0.7424\ \hbox{-}\ 7.530/{\mathrm{t}}^{1/2}\hbox{-}\ 1.813* \ln \left(\mathrm{t}\right)/{\mathrm{t}}^{1/2} $$

The age-specific HRs for non-breast cancer mortality are shown in Fig. 3. The relevant baseline survival function is:

Fig. 3
figure 3

Age-specific HR for non-breast cancer mortality derived from the model development data. ER-negative is indicated by red lines; ER-positive is indicated by blue lines. ER Oestrogen receptor

Full size image
$$ {\mathrm{BSo}}_{\mathrm{t}}\left(\mathrm{non}\hbox{-} \mathrm{breast}\ \mathrm{mortality}\right) = \hbox{-} 6.053 + 1.080* \ln \left(\mathrm{t}\right) + 0.3255*{\mathrm{t}}^{1/2} $$

Model calibration

The observed and predicted numbers of deaths from breast cancer and deaths from other causes are shown in Table 2. While there was no significant differences in the observed and predicted numbers of breast cancer deaths for the model fitting data, NTBCS or BCOS, the predicted number of breast cancer deaths was slightly over-estimated for POSH (P = 0.018). The number of predicted deaths from other causes was significantly lower than that observed for NTBCS (P = 0.039) and significantly higher for POSH (P < 0.001).

Table 2 Observed and predicted (PREDICT v2) deaths, by cause of death and data set
Full size table

The observed and predicted (v1 and v2) breast cancer deaths in the model development data set by age at diagnosis, tumour size, nodes positive and tumour grade are shown in Table 3. Overall, the calibration of PREDICT v1 and v2 was good for ER-negative disease (observed breast cancer deaths 333 compared with 326 predicted by PREDICT v1 and 330 by PREDICT v2). PREDICT v1 overestimated the number of breast cancer deaths in women with ER-positive breast cancer by 13% (599 observed compared with 677 predicted, P = 0.003). However, the number of breast cancer deaths in younger women with ER-positive disease was underestimated, whereas that in older women was overestimated. In contrast, the calibration of PREDICT v2 was very good for ER-positive disease (626 predicted, P = 0.27).

Table 3 Observed and predicted breast cancer specific mortality at ten years in model fitting data set by estrogen receptor status, age at diagnosis, tumour size, nodes positive and tumour grade
Full size table

Table 4 shows the observed and predicted (v1 and v2) breast cancer deaths in the combined validation data sets by ER status, age at diagnosis, tumour size, nodes positive and tumour grade. The results by individual data set and ER status for age at diagnosis, tumour size, nodes positive and tumour grade are shown in Additional file 1: Tables S1–S4. PREDICT v1 over-estimated the number of breast cancer deaths in ER-negative cases by 11% (446 observed compared with 492 predicted, P = 0.034). This over-estimation was most notable in the larger tumours and in the high-grade tumours. In contrast, the calibration of PREDICT v2 in ER-negative cases was better (predicted 480, P = 0.12). The calibration of both PREDICT v1 and PREDICT v2 was good in ER-positive cases (observed breast cancer deaths 633 compared with 643 [P = 0.67] and 677 [P = 0.09] predicted by v1 and v2, respectively). However, as previously described, PREDICT v1 under-estimated breast cancer-specific mortality in women diagnosed with ER-positive disease diagnosed under 50 years of age. In contrast, PREDICT v2 slightly over-predicted the number of breast cancer deaths in women diagnosed under the age of 30 years (48 predicted vs. 34 observed, P = 0.047). Both PREDICT v1 and v2 tended to under-estimate breast cancer mortality in women with small ER-positive tumours and over-estimate mortality in women with larger ER-positive tumours.

Table 4 Observed and predicted breast cancer specific mortality at ten years in combined validation data sets by estrogen receptor status, age at diagnosis, tumour size, nodes positive and tumour grade
Full size table

Model discrimination

The PREDICT model discrimination by data set is shown in Table 5. The AUC in the model-fitting data was similar for PREDICT v1 and v2 for ER-negative disease (0.724 and 0.726, P = 0.67), whereas the AUC was slightly smaller for v1 than v2 in ER-positive disease (0.791 and 0.796, P = 0.028). The AUC values for PREDICT v1 and v2 were similar in the individual validation sets for both ER-negative and ER-positive disease, although in the combined validation data, PREDICT v2 performed slightly better for ER-positive disease than for ER-negative disease (AUC 0.760 vs. 0.750, P = 0.016).

Table 5 Comparison of discrimination (AUCs) of PREDICT v1 and PREDICT v2, by data set and oestrogen receptor status
Full size table

Goodness of fit

The observed and predicted breast cancer deaths by quintile of predicted risk for PREDICT v2 are shown in Fig. 4a for the model development data and in Fig. 4b for the validation data. The observed values differed significantly from the predicted for the ER-positive cases in the validation data (χ2 = 13.2, 5 df, P = 0.020), with a slight over-estimation in the highest risk quintile (325 deaths predicted vs. 293 observed).

Fig. 4
figure 4

Observed and predicted breast cancer deaths at 10 years by quintile of predicted risk. a Model development data. b Validation data. ER-negative is indicated by red lines; ER-positive is indicated by blue lines. ER Oestrogen receptor

Full size image

Discussion

We have refitted the prognostic model underlying the PREDICT breast cancer prognostication and treatment benefit tool using the original data used to develop the model with updated survival time data and using a sophisticated approach to modelling the data with multivariable fractional polynomial models in a Cox regression framework. The association between tumour size and node status with prognosis is, of course, well-established, but the difference in the shape of the non-linear associations in ER-positive and ER-negative disease has not previously been described. Similarly, multiple studies have reported an association of young age at diagnosis with a poor prognosis (e.g., [17,18,19,20,21]), but those studies that have used multivariable models have simply adjusted for ER status and as a result have not reported the notable difference in the age-specific relative hazards between ER-positive and ER-negative disease demonstrated by our analysis.

The calibration of the new model is better than that of the original model for breast cancer-specific mortality in the model development data set. In three independent validation data sets, the calibration of PREDICT v1 and v2 is similar, with v1 being slightly better for ER-positive disease and v2 being slightly better for ER-negative disease. There was little difference in the discrimination of PREDCIT v2 compared with v1 for ER-negative disease, but for ER-positive disease, v2 performed slightly better in both model-fitting and validation data sets.

Prediction of non-breast cancer deaths was excellent in the model development data set but not as good in the validation data sets. The under-prediction of non-breast cancer deaths in the NTBCS data set is likely to be partly due to the fact that this is a cohort diagnosed in the 1980s, when population death rates were higher than at the time the model development cohort was ascertained. Non-breast cancer mortality was also under-predicted in the BCOS case series, which was ascertained in the 1990s, although this under-prediction was not significant. Other mortality was significantly over-predicted in the POSH case series. Because this case series is almost contemporaneous with the model development cases, differences in population mortality rates are unlikely to be the explanation. However, the participation of eligible women in POSH is liable to be subject to a healthy cohort bias, with women with better general health being more likely to participate than those with poorer general health.

The PREDICT model was originally developed using data from patients treated in the United Kingdom between 1999 and 2003. Since then, there have been several advances in breast cancer treatment, including the introduction of sentinel node biopsy, intensity-modulated radiotherapy, targeted therapies such as trastuzumab, and taxane-based (third-generation) chemotherapy. As a result, the original model has been updated to include the prognostic effect of HER2 status and the benefit of trastuzumab. Although the majority of the model development cohort who received adjuvant chemotherapy were treated with second-generation regimens, the POSH validation cohort was diagnosed and treated during 2000–2007, and many were treated using taxane-based adjuvant chemotherapy.

Conclusions

In an era of precision oncology, accurate, well-validated models that predict patient outcomes are invaluable clinical tools. We have derived an improved version of the PREDICT prognostication and treatment benefit model to reduce some of the limitations of the original model. The new model has been validated in three independent data sets and performs well. It has been implemented online and will continue to aid clinical decision making in clinical practice.

Abbreviations

BCOS:

Breast Cancer Outcome Study of Mutation Carriers

ECRIC:

Eastern Cancer Registration and Information Centre

ER:

Oestrogen receptor

HER2:

Human epidermal growth factor receptor 2

MI:

Mortality index

NTBCS:

Nottingham/Tenovus Breast Cancer Study

PI:

Prognostic index

POSH:

Prospective study of Outcomes in Sporadic and Hereditary breast cancer

References

  1. Wishart GC, Azzato EM, Greenberg DC, Rashbass J, Kearins O, Lawrence G, et al. PREDICT: a new UK prognostic model that predicts survival following surgery for invasive breast cancer. Breast Cancer Res. 2010;12(1):R1. A published erratum appears in Breast Cancer Res. 2010;12(2):401.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Kattan MW, Hess KR, Amin MB, Lu Y, Moons KG, Gershenwald JE, et al. American Joint Committee on Cancer acceptance criteria for inclusion of risk models for individualized prognosis in the practice of precision medicine. CA Cancer J Clin. 2016;66(5):370–4.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Amin MB, Edge S, Greene F, Byrd DR, Brookland RK, Washington MK, et al. In: American Joint Committee on Cancer (AJCC), editor. AJCC cancer staging manual. 8th ed. New York: Springer; 2016.

    Google Scholar 

  4. Early Breast Cancer Trialists Collaborative Group. Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials. Lancet. 2005;365(9472):1687–717.

    Article  Google Scholar 

  5. Wishart GC, Bajdik CD, Azzato EM, Dicks E, Greenberg DC, Rashbass J, et al. A population-based validation of the prognostic model PREDICT for early breast cancer. Eur J Surg Oncol. 2011;37(5):411–7.

    Article  CAS  PubMed  Google Scholar 

  6. de Glas NA, Bastiaannet E, Engels CC, de Craen AJ, Putter H, van de Velde CJ, et al. Validity of the online PREDICT tool in older patients with breast cancer: a population-based study. Br J Cancer. 2016;114(4):395–400.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Engelhardt EG, van den Broek AJ, Linn SC, Wishart GC, Rutgers EJT, van de Velde AO, et al. Accuracy of the online prognostication tools PREDICT and Adjuvant! for early-stage breast cancer patients younger than 50 years. Eur J Cancer. 2017;78:37–44.

    Article  PubMed  Google Scholar 

  8. Wong HS, Subramaniam S, Alias Z, Taib NA, Ho GF, Ng CH, et al. The predictive accuracy of PREDICT: a personalized decision-making tool for Southeast Asian women with breast cancer. Medicine (Baltimore). 2015;94(8):e593.

    Article  Google Scholar 

  9. Maishman T, Copson E, Stanton L, Gerty S, Dicks E, Durcan L, Wishart GC, et al. An evaluation of the prognostic model PREDICT using the POSH cohort of women aged ≤40 years at breast cancer diagnosis. Br J Cancer. 2015;112(6):983–91.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Wishart GC, Rakha E, Green A, Ellis I, Ali HR, Provenzano E, et al. Inclusion of KI67 significantly improves performance of the PREDICT prognostication and prediction model for early breast cancer. BMC Cancer. 2014;14:908.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Wishart GC, Bajdik CD, Dicks E, Provenzano E, Schmidt MK, Sherman M, et al. PREDICT Plus: development and validation of a prognostic model for early breast cancer that includes HER2. Br J Cancer. 2012;107(5):800–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Copson E, Eccles B, Maishman T, Gerty S, Stanton L, Cutress RI, et al. Prospective observational study of breast cancer treatment outcomes for UK women aged 18–40 years at diagnosis: the POSH study. J Natl Cancer Inst. 2013;105(13):978–88.

    Article  CAS  PubMed  Google Scholar 

  13. Royston P, Ambler G, Sauerbrei W. The use of fractional polynomials to model continuous risk variables in epidemiology. Int J Epidemiol. 1999;28(5):964–74.

    Article  CAS  PubMed  Google Scholar 

  14. Sauerbrei W, Royston P, Binder H. Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Stat Med. 2007;26(30):5512–28.

    Article  PubMed  Google Scholar 

  15. Early Breast Cancer Trialists Collaborative Group. Comparisons between different polychemotherapy regimens for early breast cancer: meta-analyses of long-term outcome among 100,000 women in 123 randomised trials. Lancet. 2012;379(9814):432–44.

    Article  Google Scholar 

  16. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.

    Article  CAS  PubMed  Google Scholar 

  17. Fredholm H, Eaker S, Frisell J, Holmberg L, Fredriksson I, Lindman H. Breast cancer in young women: poor survival despite intensive treatment. PLoS One. 2009;4(11):e7695.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Gnerlich JL, Deshpande AD, Jeffe DB, Sweet A, White N, Margenthaler JA. Elevated breast cancer mortality in women younger than age 40 years compared with older women is attributed to poorer survival in early-stage disease. J Am Coll Surg. 2009;208(3):341–7.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Dobi A, Kelemen G, Kaizer L, Weiczner R, Thurzo L, Kahan Z. Breast cancer under 40 years of age: increasing number and worse prognosis. Pathol Oncol Res. 2011;17(2):425–8.

    Article  PubMed  Google Scholar 

  20. Brandt J, Garne JP, Tengrup I, Manjer J. Age at diagnosis in relation to survival following breast cancer: a cohort study. World J Surg Oncol. 2015;13:33.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Chen HL, Zhou MQ, Tian W, Meng KX, He HF. Effect of age on breast cancer patient prognoses: a population-based study using the SEER 18 database. PLoS One. 2016;11(10):e0165409.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank the patients who have participated in the constituent studies and the National Institute for Health Research Clinical Research Network for supporting patient recruitment (POSH).

Funding

The BCOS was funded by the Netherlands Cancer Institute (NKI2007-3839). Funding for the POSH study was provided by Cancer Research UK (C1275/A9896, C1275/A11699, and C1275/A15956) and Breast Cancer Now (2005Nov63). PDPP is supported by the National Institute for Health Research Biomedical Research Centre at the University of Cambridge.

Availability of data and materials

The data set used to build the model was obtained from ECRIC. These data are now held by Public Health England, and information on how to access these data can be found at http://ncin.org.uk/collecting_and_using_data/data_access. The NTBCS and POSH data sets used for validation are available from the author on request, and the Netherlands Cancer Institute data set is available from MJK. The Stata code used for the analysis of the cancer registry data and for the validation is available from the author on request, as is the PREDICT model implemented as a Stata.do file.

Authors’ contributions

FJCdR helped design the study, carried out the data analysis and helped draft the manuscript. GCW helped design the study and draft the manuscript. EMD helped in data analysis and web programming. DG and JR were responsible for the provision of the ECRIC data. MKS and AJvdB were responsible for provision of the BCOS data. IOE, AG and ER were responsible for provision of the NTBCS data. TM and DME were responsible for provision of the POSH data. PDPP helped design the study, carried out the data analysis and helped draft the manuscript. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The validation studies were approved by the relevant research ethics committees: BCOS was approved by Protocol Toetsings Commissie of the Netherlands Cancer Institute – Antoni van Leeuwenhoek (EV124, EV04-046, PTC05.319, and PTC09.168); NTBCS and POSH were approved by the UK National Multicentre Research Ethics Committee (MREC/00/6/69). All participants provided written informed consent.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

  1. Department of Gynaecology and Obstetrics, Ribeirao Preto Medical School, University of Sao Paulo, Sao Paulo, Brazil

    Francisco J. Candido dos Reis

  2. Faculty of Medical Science, Anglia Ruskin University, Cambridge, UK

    Gordon C. Wishart

  3. Department of Oncology, University of Cambridge, Cambridge, UK

    Ed M. Dicks & Paul D. P. Pharoah

  4. National Cancer Registration and Analysis Service, Public Health England, London, UK

    David Greenberg & Jem Rashbass

  5. Division of Molecular Pathology, Netherlands Cancer Institute, Amsterdam, The Netherlands

    Marjanka K. Schmidt & Alexandra J. van den Broek

  6. Division of Psychosocial Research and Epidemiology, Netherlands Cancer Institute, Amsterdam, The Netherlands

    Marjanka K. Schmidt & Alexandra J. van den Broek

  7. Division of Cancer and Stem Cells, School of Medicine, University of Nottingham and Nottingham University Hospitals NHS Trust, City Hospital, Nottingham, UK

    Ian O. Ellis, Andrew Green & Emad Rakha

  8. Cancer Sciences Academic Unit and Southampton Clinical Trials Unit, Faculty of Medicine, University of Southampton and University Hospital Southampton Foundation Trust, Southampton, UK

    Tom Maishman & Diana M. Eccles

Authors
  1. Francisco J. Candido dos Reis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gordon C. Wishart
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ed M. Dicks
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David Greenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jem Rashbass
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marjanka K. Schmidt
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Alexandra J. van den Broek
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Ian O. Ellis
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Andrew Green
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Emad Rakha
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Tom Maishman
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Diana M. Eccles
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Paul D. P. Pharoah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul D. P. Pharoah.

Additional file

Additional file 1:

The observed and predicted (PREDICT v1 and v2) events by individual data set and ER status for age at diagnosis (Table S1), tumour size (Table S2), nodes positive (Table S3) and tumour grade (Table S4). (XLSX 35 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Candido dos Reis, F.J., Wishart, G.C., Dicks, E.M. et al. An updated PREDICT breast cancer prognostication and treatment benefit prediction model with independent validation. Breast Cancer Res 19, 58 (2017). https://doi.org/10.1186/s13058-017-0852-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13058-017-0852-3

Keywords

Breast Cancer Research

ISSN: 1465-542X

Contact us