Author de Lemos JA, Lloyd-Jones DM.
Title Multiple biomarker panels for cardiovascular risk assessment
Full source N Engl J Med 2008;358:2172-4
Text

Guidelines for the assessment of cardiovascular risk remain focused squarely on established risk factors.1 Although it is known that tools based on these risk factors, such as the Framingham Risk Score, have a number of limitations when applied in clinical practice — performing reasonably well for groups but not necessarily for individuals and underestimating long-term risk among younger persons2 — it has proved surprisingly difficult to improve on established risk factors for the prediction of cardiovascular disease. Of the many strategies that have been proposed to improve risk stratification, the measurement of plasma biomarkers is particularly attractive as compared with alternatives such as cardiovascular imaging.

Numerous biomarkers have been proposed to have mechanistically plausible links to clinical cardiovascular disease, with many reported to identify people at an increased risk for future cardiovascular events independently of the presence of established risk factors. Typically, however, the risk increment captured by elevated levels of these markers is modest, and little improvement is seen in traditional measures of discrimination such as the C statistic or the area under the receiver-operating-characteristic curve. Much of the recent debate over emerging biomarkers focuses on the questions of how much incremental value is provided and what the best metrics are to quantify improvements in screening performance.3,4

One strategy that has been proposed to improve on the limitations of individual biomarkers is to combine multiple biomarkers into an integrated score or algorithm. However, an evaluation of 3209 participants from the Framingham Heart Study failed to validate this approach.5 Although persons with high biomarker scores had an increased risk of death as compared with those with low scores, the increment in the C statistic over the model with traditional risk factors was small. Similarly, in the Cardiovascular Health Study, which included 5808 older Americans, the addition of six novel biomarkers did not improve discrimination beyond established risk factors among subjects with or without chronic kidney disease.6 Thus, despite decades of research and the introduction of numerous candidate biomarkers and putative risk factors, risk prediction for cardiovascular disease in the population appears to have progressed only marginally.

An article in this issue of the Journal suggests that measurable progress with the use of biomarkers could be possible. Zethelius et al.7 report data from an evaluation of multiple biomarkers in a community cohort of elderly men. Among 1135 men with a mean age of 71 years at study entry (661 of whom were free of cardiovascular disease at baseline), troponin I, N-terminal pro–brain natriuretic peptide, cystatin C, and C-reactive protein were each associated with death from cardiovascular and all causes over a 10-year follow-up period after adjustment for established cardiac risk factors. When the markers were combined, the risk of death increased by a factor of more than 16 across categories that were defined by the number of biomarkers that were above prespecified threshold values, after adjustment for risk factors. It is particularly notable, given the advanced age of the study cohort, that only 26 deaths from cardiovascular causes occurred over 10 years among the 486 men who did not have an elevation in any of the biomarkers. The C statistic increased from 0.66 for the risk factor model alone to 0.77 when the four biomarkers were added and from 0.69 to 0.75, in the subgroup that was free of cardiovascular disease at baseline. Statistical measures of model calibration, risk reclassification, and global fit all supported the incremental value of the multiple biomarkers over established risk factors.

Why are the results of this study so strikingly different from those of previous studies? First, the biomarkers that were evaluated in the current study were better than those that were measured in previous studies. The authors included three markers that clearly reflect existing cardiac or renal damage. Cystatin C has emerged as a more accurate estimator of glomerular filtration rate than serum creatinine and demonstrates a linear association with cardiovascular disease.8 In population studies, N-terminal pro–brain natriuretic peptide is associated with multiple pathological cardiovascular phenotypes and predicts the risk of death and cardiac events.9,10 Perhaps the most intriguing marker included is troponin I, a marker of myocardial injury that is not intuitively attractive for population screening because of the low prevalence of elevated levels among healthy people. However, when detected in the general population, troponins are strongly associated with cardiac abnormalities such as left ventricular hypertrophy or systolic dysfunction and major risk factors such as renal insufficiency and diabetes.11 Troponins are highly specific for myocardial damage, and although current assays offer suboptimal sensitivity for population screening, sensitivity may be augmented by combining troponin with other biomarkers and will be further enhanced with the introduction of high-sensitivity troponin assays.12 In the present study, troponin I and N-terminal pro–brain natriuretic peptide appeared to contribute more than C-reactive protein and cystatin C to the multimarker panel.

A second important difference between the current study and previous studies is the restriction of the Zethelius study cohort to lean white men who were all the same age at study entry. The use of this restricted cohort may decrease the observed C statistic for established risk factors and inflate the increment in the C statistic over what would be expected in a more diverse cohort with a wider age range. This restriction mitigates the powerful influence of age in the established risk factor model; moreover, some established risk factors are less predictive of events from cardiovascular disease among older people. In addition to age, race, sex, and body composition also contribute in important ways to variability in the levels of C-reactive protein and N-terminal pro–brain natriuretic peptide,13,14 and the influence of these factors could not be evaluated in the homogeneous cohort that was studied. It will be critical to fully understand important noncardiac sources of variation in each biomarker under consideration as a screening test for cardiovascular disease, because the cardiac signal being screened for may be subtle among the asymptomatic target population.

Third, the inclusion of patients with prevalent cardiovascular disease distinguishes the present study from a pure evaluation of population screening. Among persons with prevalent cardiovascular disease, established risk factors are less powerful predictors of outcome than are markers of atherosclerosis burden and ventricular function, factors that were not considered in the present study. The data for those without prevalent cardiovascular disease in this study are of greatest interest for biomarker screening, since secondary approaches to prevention should be implemented aggressively among people with established cardiovascular disease regardless of biomarker levels.

A fourth issue relates to the statistical metrics that were used to evaluate the novel biomarkers. To their credit, Zethelius et al. use state-of-the-art tools to assess multiple measures of the predictive utility of their Cox-based models for the prediction of risk. If Cox models are to remain the statistical method of choice for risk prediction and discrimination, future authors should take note of the methods that are used here for comparing model fit, discrimination, calibration, and the degree of reclassification among models containing different sets of covariates. It remains uncertain, however, whether Cox models represent the best method for the prediction of risk. Increasingly sophisticated partitioning and neural-network methods may ultimately make Cox-based prediction obsolete; if discrimination can be rendered near-perfect, calibration and reclassification become moot.

A close examination of the data for participants without prevalent cardiovascular disease indicates that the addition of the four biomarkers to the established risk factors resulted in a total of 133 appropriate and 69 inappropriate reclassifications. However, the clinical implications of these reclassifications are not clear. We do not know whether any action should or could have been taken to prevent the deaths from cardiovascular disease that occurred.

The analysis of Zethelius et al. suggests that combining selected biomarkers of cardiac and renal disease may improve the assessment of risk by established risk factors, at least among this unique cohort of elderly men. These findings need to be validated in younger cohorts of men and women that include only patients who are free from cardiovascular disease and should be updated iteratively as newer, and better, biomarkers emerge from discovery research programs. Then, the hard work begins in determining what should be done differently on the basis of the test results and in what format this complex information should be presented to clinicians.

References

1) National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III). Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. Circulation 2002;106:3143-3421.
2) Lloyd-Jones DM, Leip EP, Larson MG, et al. Prediction of lifetime risk for cardiovascular disease by risk factor burden at 50 years of age. Circulation 2006;113:791-798.
3) Cook NR. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 2007;115:928-935.
4) Lloyd-Jones DM, Liu K, Tian L, Greenland P. Assessment of C-reactive protein in risk prediction for cardiovascular disease. Ann Intern Med 2006;145:35-42.
5) Wang TJ, Gona P, Larson MG, et al. Multiple biomarkers for the prediction of first major cardiovascular events and death. N Engl J Med 2006;355:2631-2639.
6) Shlipak MG, Fried LF, Cushman M, et al. Cardiovascular mortality risk in chronic kidney disease: comparison of traditional and novel risk factors. JAMA 2005;293:1737-1745.
7) Zethelius B, Berglund L, Sundström J, et al. Use of multiple biomarkers to improve the prediction of death from cardiovascular causes. N Engl J Med 2008;358:2107-2116.
8) Shlipak MG, Sarnak MJ, Katz R, et al. Cystatin C and the risk of death and cardiovascular events among elderly persons. N Engl J Med 2005;352:2049-2060.
9) Galasko G, Lahiri A, Barnes SC, Collinson P, Senior R. What is the normal range for N-terminal pro-brain natriuretic peptide? How well does this normal range screen for cardiovascular disease? Eur Heart J 2005;26:2269-2276.
10) Kistorp C, Raymond I, Pedersen F, Gustafsson F, Faber J, Hildebrandt P. N-terminal pro-brain natriuretic peptide, C-reactive protein, and urinary albumin levels as predictors of mortality and cardiovascular events in older adults. JAMA 2005;293:1609-1616.
11) Wallace TW, Abdullah SM, Drazner MH, et al. Prevalence and determinants of troponin T elevation in the general population. Circulation 2006;113:1958-1965.
12) Latini R, Masson S, Anand IS, et al. Prognostic value of very low plasma concentrations of troponin T in patients with stable chronic heart failure. Circulation 2007;116:1242-1249.
13) Khera A, McGuire DK, Murphy SA, et al. Race and gender differences in C-reactive protein levels. J Am Coll Cardiol 2005;46:464-469.
14) Chang AY, Abdullah SM, Jain T, et al. Associations among androgens, estrogens, and natriuretic peptides in young women: observations from the Dallas Heart Study. J Am Coll Cardiol 2007;49:109-116