May 08

Part 2: The Problem with Biomarkers >>> Mammography

Overall sensitivity is approximately 79% but is lower in younger women and in those with dense breast tissue. Overall specificity is approximately 90% and is lower in younger women and in those with dense breasts (see the Breast Cancer Surveillance Consortium).

“Without screening, approximately 30 of 1,000 women over age 40 can be expected to die from breast cancer. With regular mammography, six lives will be prolonged, so only 24 women will die of breast cancer. However, regular screening those 1,000 women will lead to more than 2,000 false positives results, and 150 women will receive unnecessary biopsies.”

“For every 2000 women getting regular mammographic screening, one will have her life prolonged, and 10 women will be diagnosed as breast cancer patients and treated unnecessarily.” (number needed to screen, with benefits and harms).

From Dominic Spinella, Ph.D., Head of Translational & Molecular Medicine, Pfizer BioTherapeutics (Biomarker World Copngress 2011, sponsored by CHI):

Population frequency is critical: The rarer the “true” frequency of an event or analyte is, the more likely that any “positive” call mode by an assay is a “false positive.”

May 06

BIOMARKER INFORMATICS – Ongoing Comparison of Commercial Databases

Just returned from a great meeting – Biomarker World Congress 2011, sponsored by Cambridge Healthtech Institute (CHI). This is one study I can share, since I am intimately involved with this project:

Aims: There are a variety of commercial, proprietary and open source databases that provide biomarker information for drug discovery, drug development and biotechnology applications. We performed a thorough research analysis of six (6) molecular biomarker databases, each containing from hundreds to over 40,000 biomarkers. The research strategy was to query a segment (N = 242 research scientists) of the user community about the utility and functionality of existing databases, and how adequate the user interface in the biomarker informatics database performed in terms of measures of usability and confidence.

Methods: The format of the five-level Likert item used in the study was summed responses that fell into one of these categories:
1. Strongly disagree
2. Disagree
3. Neither agree nor disagree
4. Agree
5. Strongly agree

Blinded analysis was also performed on all of the databases to determine the validity of biomarker descriptions contained in the six (6) databases, compared with the totality of research publications pertinent to a random sample query of individual biomarkers culled from every database. Validity was scored from 1-10, depending on the researchers’ comparison of the biomarker description to the published literature concerning the biomarker.

Results: Preliminary results showed the following-

(1) Utility and functionality:

Genomic biomarkers in drug development:

Patient stratification to separate responders from non-responders: 67% strongly agreed or agreed.
Stratification to exclude patients at risk for Adverse Drug Responses: 58% strongly agreed or agreed.
Enrichment of the responder population: 56% strongly agreed or agreed.

(2) Database usability and confidence:

Genomic and proteomic biomarkers:

The user interface provided clarity and usability: 74% strongly disagreed or disagreed. The user interface supported rapid comparison of biomarker with publication sources/references:
85% strongly disagreed or disagreed.
The user interface supported rapid comparison of similar biomarkers: 53% strongly disagreed or disagreed.

(3) Comparison of biomarker description to literature resources:

Although this part of the study is still being undertaken, preliminary data suggest that commercial platforms are much less reliable than proprietary or open-source databases. Recommendations are to address at least some minimal standards, such as those used by the Protein Information Resource (PIR) that includes curation and prioritization of biomarkers. In addition, usability needs to be more directly addressed using human factors-based user-centered design.

Preliminary Conclusions:
• The current generation of biomarker databases is not well engineered in terms of usability for the end-user.
• The majority of researchers felt that the user interface did not provide ease-of-use for normal biomarker-dependent scientific research.
• Preliminary data suggests that the current generation of biomarker databases lack scientific validity when compared to the totality of research publications addressing specific biomarkers.

May 01

Finally, some clinically-qualified Biomarkers in Psychiatry!

From Dr. Saphic-Mihajlovic, Department of Psychiatry, University of Illinois, Chicago, IL – from the poster, “Pharmacogenomic-Validated Treatment for Treatment Resistant OCD and MDD: A Case Study.” Using AssureRx Health’s test for CYP2D6, CYP2D19 and other biomarkers.

Apr 29

Biomarkers: Some Definitions

Biomarkers can provide molecular signatures of disease, or serve as measures of disease progress or the health of an individual. Biomarker discovery can result from the comparison of pathologic and normal states through differential gene expression and/or protein analysis. However, in cancer, the early promise of finding “qualified” tumor biomarkers has been an arduous process.

Here I offer some definitions that may be of use, based on the work of multiple investigators, including a recent publication from the Institute of Medicine that I highly recommend (“Evaluation of Biomarkers and Surrogate Endpoints in Chronic Disease”- free download at http://www.nap.edu/catalog.php?record_id=13038).

Some Definitions (some are paraphrased from the IOM report):

-Analytic Validation: “assessing an assay and its measurement performance characteristics, determining the range of conditions under which the assay will yield reproducible and accurate data”

-Biomarker: “a characteristic that is objectively measured and evaluated as an indicator of normal biologic processes, pathogenic processes, or pharmacological processes in response to an intervention.”

-Clinical Endpoint: “a characteristic or variable that reflects how a patient feels, functions or survives.”

-Fit-for-Purpose: Guided by the principle that an evaluation process is tailored to the degree of certainty required for the use proposed.

-Qualification (used to be called “validation”): “evidentiary process of linking a biomarker with biological processes and clinical endpoints.”

-Surrogate endpoint (used in drug development): “A biomarker intended to substitute for a clinical endpoint. A surrogate endpoint is expected to predict clinical benefit (or harm, or lack of benefit) based on epidemiologic, therapeutic, pathophysiologic or other scientific evidence.” Unfortunately, surrogate endpoints have not always matched clinical endpoints.

Apr 19

Comparison of Selected Commercial Biomarker Databases

As stated in the new NIH strategy on Biomedical Informatics and Information Technology – “8.3 The Central Role of Biomarkers in Translational Medicine: Advances in genomics, and more recently proteomics, have led to the development of target-validated biomarkers for early diagnosis of disease. Currently available molecular diagnostic technologies have been used to detect biomarkers of various diseases such as cancer, metabolic disorders, infections and diseases of the central nervous system. Some of the newly discovered biomarkers also form the basis of innovative molecular diagnostic tests. Those most relevant to personalized medicine may be pharmacogenetic tests. The advantage of applying biomarkers to early drug development is that they aid in preclinical and early clinical decisions such as dose ranging, definition of treatment regimen, or even a preview of efficacy. Later in the clinic, biomarkers are being used to facilitate patient stratification, selection and the description of surrogate endpoints. Information derived from biomarkers should result in a better understanding of preclinical and clinical data, which ultimately benefits patients and drug developers. As the promise of biomarkers is realized, they have become a routine component of drug development and companions to newly discovered therapies…”

Apr 11

Part 1: The Problem with Multiple Biomarkers

One of the major problems is that any given biomarker in a pool of biomarkers may have been derived by an experimental strategy that has over- or under-represented its relationship to the target outcome, be it a biological value or disease risk association. Thus, in the pool, its contribution to the significance of the larger pool may be distorted.

As stated by Andre et al (2011) – “The more hypotheses (that is, biomarker association with outcome) tested, the greater the risk of false-positive findings. These biases inflate the potential clinical validity and utility of published biomarkers while negative results often remain hidden.”

Some suggestions, paraphrased from Bleavins et al (2010)[although I did not include suggestions that I do not agree with]:

(1) Control for elevated false positive rates, especially when dealing with ‘omics’-data.
(2) Determine the power needed for a statistically significant outcome.
(3) Use the appropriate statistical tests (i.e., use ANOVA, not Students t-Test, when comparing means from different studies).
(4) Use appropriate controls and High Weight Elements (HWEs) when dealing with genetic association studies.
(5) If the data are not normally distributed, use parametric tests.
(6) When you need to infer cause and effect or to test agreement between different methods, use correlation analysis.
(7) Equate odds ratio and risk ratio without consideration of the outcome frequency.
(8) Use data to test correlation to outcomes, or as a test set for validation of algorithms, if they were already used earlier in the mathematical modeling of genomics data.

References:

Andre F., McShane, L.M., Michiels, S., Ransohoff, D.F., Altman, D.G., Reis-Filho, J.S., Hayes, D.F., Pusztai, L. Biomarker studies: a call for a comprehensive biomarker study registry. Nat Rev Clin Oncol. 2011 Mar;8(3):171-6.

Biomarkers in Drug Development: A Handbook of Practice, Application, and Strategy (2010) (Bleavins, M.R., Carini, C., Jurima-Romet, M. and Rahbari, R., Eds.) John Wiley & Sons.

Apr 07

The Need for Biomarkers of Traumatic Brain Injury (TBI)

Diagnostic imaging, including CT and MRI, can be used to detect brain damage. However, there is a need for a more simple and rapid test that could detect biomarker(s) in the blood following brain injury. From studies of transcriptional complexity, the brain expresses many more proteins than any organ in the body, and thus it should be possible to detect brain-specific proteins in the blood and cerebrospinal fluid that have been released from CNS neurons following traumatic damage.

The ultimate goal would be to develop a test that could be used by a medic in a combat trauma or civilian emergency setting. If the degree of brain trauma could be rapidly determined, then the triage process could be enhanced. Although neurologic testing employing differential diagnosis following traumatic injury can provide some information about a patient’s condition, there are many instances where the patient is non-responsive, and/or the degree of brain injury cannot be determined. Physicians frequently fail to diagnose brain injury in patients who have suffered head trauma but remain conscious. Also it sometimes can’t reliably determine whether a patient in a stupor has a brain injury, a stroke, or something else entirely. As a result, doctors may incorrectly prescribe treatment, or prescribe no treatment where it’s actually necessary.

One promising biomarker of severe TBI is the neuron-specific protein PGP 9.5, also known as UCH-L1, an ubiquitin carboxyl-terminal hydrolase. Pioneering work by researchers from Banyan Biomarkers, Inc. and their academic collaborators (Liu et al (2010)) showed that UCH-L1 levels were significantly elevated in both serum and CSF in a rodent model of traumatic brain injury. Scientists from BanyanBiomarkers also showed elevated levels of UCH L-1 in a small sample of human patients with TBI that seem to correlate with the amount of brain damage (Papa et al (2010)). On the basis of promising work performed by the company, the Department of Defense has funded them to further research on biomarkers of TBI.

Several outstanding questions remain to be answered. First, we need to have biomarker(s) that can resolve different degrees of brain damage in a very accurate manner. Second, we need to develop rapid therapeutic measures that can be initiated after brain damage – it has been known for decades that the adult brain has a tremendous capacity for regenerative healing after damage (Gage et al, 1989). Finally, we need to develop better automated quantitative methods for identifying thousands of biomarkers specific for TBI from the much larger pool of proteins that are expressed in the brain.

References:

Liu, M.C., Zheng, Akinyi, L., Oli, M.W., W.R, Larner, S.F., Kobeissy, F., Papa, L. Lu, X.-C., Dave, J.R., Tortella, F.C., Hayes, R.L. and Wang, K.K.W. (2010) Ubiquitin-C-Terminal Hydrolase as a Novel Biomarker for stroke and Traumatic Brain Injury in Rats. Eur. J. Neurosci. 31, 722–732.

Papa L, Akinyi L, Liu MC, Pineda JA, Tepas JJ 3rd, Oli MW, Zheng W, Robinson G, Robicsek SA, Gabrielli A, Heaton SC, Hannay HJ, Demery JA, Brophy GM, Layon J, Robertson CS, Hayes RL, Wang KK. (2010) Ubiquitin C-terminal hydrolase is a novel biomarker in humans for severe traumatic brain injury. Crit Care Med. Jan;38(1):138-44.

Higgins, G.A., Koh, S., Chen, K.S., and F.H. Gage (1989) Nerve growth factor (NGF) induction of NGF receptor gene expression and cholinergic neuronal hypertrophy in the basal forebrain of the adult rat. Neuron 3:247-256.

Apr 05

International Collaborations Identify 5 new genes that confer susceptibility to Late Onset Alzheimer’s Disease

Two studies, published in the latest edition of Nature Genetics, have identified 5 new common variants of genes encoding proteins that appear to be involved in conveying susceptibility to late onset Alzheimer’s disease (LOAD). Until recently, only four genes associated with late-onset Alzheimer’s have been confirmed. The gene for apolipoprotein E-e4, APOE-e4, identified over 15 years ago, has the largest effect on risk. Over the past two years, three additional genes have been identified, including CR1, CLU, and BIN1. The present study adds another four — MS4A, CD2AP, CD33, and EPHA1 — and contributes to identifying and confirming two other genes, BIN1 and ABCA7, thereby doubling the number of genes known to play a role in Alzheimer’s disease

Most cases of early-onset Alzheimer disease are also caused by gene mutations that are also inherited. Researchers have found that this form of the disorder can result from mutations in one of three genes: APP, PSEN1, or PSEN2. When any of these genes is altered, large amounts of a toxic protein fragment called amyloid beta peptide are produced in the brain. This peptide can build up in the brain to form clumps called amyloid plaques, which are characteristic of Alzheimer disease. A buildup of toxic amyloid beta peptide and amyloid plaques may lead to the death of nerve cells and the progressive signs and symptoms of this disorder.

The recent study, conducted by the Alzheimer’s Disease Genetics Consortium, reports genetic analysis of more than 11,000 people with Alzheimer’s disease and a nearly equal number of elderly people who have no symptoms of dementia. Three other consortia contributed confirming data from additional people, bringing the total number of people analyzed to over 54,000. The consortium also contributed to the identification of a fifth gene reported by other groups of investigators from the United States, the United Kingdom, France, and other European countries. The study is the result of a large collaborative effort with investigators from 44 universities and research institutions in the United States, led by Gerard Schellenberg at University of Pennsylvania.

“If we eradicate the affect of these 10 genes we could eradicate 60 per cent of Alzheimer’s disease,” said Professor Julie Williams from Cardiff University. Genetics is thought to account for between 60 and 79 per cent of the risk of developing Alzheimer’s disease.

From the publication of Hollingworth et al (2011) –

“Five of the recently identified Alzheimer’s disease susceptibility loci in CLU, CR1, ABCA7, CD33 and EPHA1 have putative functions in the immune system; PICALM, BIN1, CD33 and CD2AP are involved in processes at the cell membrane, including endocytosis, and APOE, CLU and ABCA7 are involved in lipid processing. It is conceivable that these processes would play strong roles in neurodegeneration and Amyloid beta peptide clearance from the brain. These findings therefore provide new impetus for focused studies aimed at understanding the pathogenesis of Alzheimer’s disease.”

References:

Hollingworth, P. et al (2011) Common variants at ABCA7, MS4A6A/MS4A4E, EPHA1, CD33 and CD2AP are associated with Alzheimer’s disease. Nature Genetics (2011) doi:10.1038/ng.803. Received 09 September 2010 Accepted 10 March 2011 Published online 03 April 2011.

Naj, A.C. et al (2011) Common variants at MS4A4/MS4A6E, CD2AP, CD33 and EPHA1 are associated with late-onset Alzheimer’s disease. Nature Genetics (2011) doi:10.1038/ng.801. Received 27 September 2010 Accepted 10 March 2011 Published online 03 April 2011

Mar 26

Biomarkers Provide Immense Value in Clinical Trials

The bulleted text is taken largely from a presentation by Dr. Felix W. Frueh, formerly Associate Director for Genomics Office of Clinical Pharmacology and Biopharmaceutics, CDER/FDA, and now Director of Research & Development, Medco Health Solutions.

For example, biomarkers are used widely in the development of oncology drugs. Cancer is recognized as a major cause of mortality the world over; accounting for 7.4 million (or 13%) of all deaths in 2004. The World Health Organization (WHO) estimates incidence of cancer to continue rising to reach an estimated 9.2 million deaths in 2015. The rising prevalence of the disease forms one of the major factors driving the growth of the use of cancer biomarkers in drug development and discovery. Biomarkers are chemical, physical, or biological parameters that can be used to indicate disease states. Cancer biomarkers facilitate high-speed, non-invasive cancer diagnosis; and enhance early cancer detection and screening. The demand for cancer biomarkers is also increasing because of their ability to trace the exact type of cancer and to target patient-specific molecular structure.

Exploratory Biomarkers:
• Lay groundwork for probable or known valid biomarkers
-Hypothesis generation
• Fill in gaps of uncertainty about disease targets, variability in drug response, animal – human bridges and new molecule selection
-Learn and improve success in future drug development programs
• Can be “de novo” or “sidebar” study embedded in (pivotal) clinical efficacy trials
-Biomarkers associated with clinical outcome

Target Product Profile:
• What’s the Benefit?
• Ideally: Statement of what to go to the market with (desired outcome)
• Can include, e.g. optimal labeling
• Provides grounds for discussion during pre pre-IND or IND phase, (or later)
• Important to revisit the profile characteristics over the period of development
• Genomic biomarkers provide good opportunity to create TPP-

Use Genomic Biomarker for:
• Stratification to separate responders from non non-responders
• Stratification to exclude patients at risk for AE
• Enrichment of responder population

Get:
• Increased chance of winning,
• In a shorter period of time,
• At less cost (decreased size of trial).

Figure #1 shows examples of the application of biomarkers to the drug discovery and development pipeline:

Jan 20

New Centers / Institutes at the NIH for Translational Science and Biomedical Informatics?

The legendary hydra was a monster that when you cut off one of its heads, 2 more grew back.

The “re-alignment” of programs at the National Center for Research Resources (NCRR) at the National Institutes of Health, which funded some programs in medical informatics such as the Biomedical Informatics Research Network (BIRN), has led to a proposed re-mapping of funded programs to at least 2 possible new Centers or Institutes: NCATS (National Center for Advancing Translational Science), which may harbor the CTSA programs, and an “Interim Infrastructure Unit” that will harbor the “Biomedical Informatics Research Network” (BIRN).

Since NCRR funded several medical informatics projects, it is now believed that one or another of these new entities will become the equivalent of a National Center for Biomedical Informatics Research and Computational Biology (“BearCub”). Of some interest, the National Library of Medicine, which houses some of the many NIH medical informatics projects, is not an intended recipient of any of NCRR’s translational science or biomedical informatics programs.

Older posts «