Health system databases support comparative studies, quality assessment, and regulatory decision-making

Key Points

The active drug safety surveillance system being established by FDA promises to do more than obtain timely adverse event information on marketed medicines. The process for creating FDA's Sentinel System through a partnership with multiple data holders and researchers provides a "national resource for evidence development," said Mark McClellan, former FDA commissioner and now director of the Engelberg Center for Health Care Reform at Brookings.

Parties involved in drug development, comparative effectiveness research (CER), and assessing the quality of care delivered by healthcare organizations are eyeing Sentinel and other data networks as valuable tools for assessing a broad range of biomedical and healthcare issues, including efforts to identify patients for clinical trials and to assess clinical research methods.

BROADER INFLUENCE

For example, the Department of Health and Human Services is building a multipayer claims database (MPCD) to support CER, as authorized and funded by the economic stimulus legislation of 2009. The plan is to build a "hybrid" system with a centralized component that will hold less-sensitive "core" administrative data on about 100 million individuals in Medicare and other health plans. In addition, the initiative will form a parallel distributed network component, similar to Sentinel, with partners holding additional patient information.

The HHS project also may incorporate data held by states that have established their own MPCDs, primarily as cost-control strategies. About a dozen state initiatives from Maine to Utah are analyzing eligibility and claims data to track the use of healthcare services and medical products, and to uncover fraud and waste.

A key feature of a distributed data system such as Sentinel is that patient health information remains with the data holders, an approach designed to ensure the privacy and security of personal health information. These systems currently tap into administrative and claims data, but the plan is to add clinical data in the future, at least for some patient cohorts. For now, Sentinel data holders may be asked to provide certain patient-level information if needed to confirm unclear findings, but that data would be stripped of direct patient identifiers before transmission.

Ultimately, a national interoperable electronic medical records system will feed patient-level information into all these information systems. With appropriate privacy protections, this will facilitate assessments of healthcare delivery, support biomedical research, and track medical care for many purposes. But because a comprehensive e-health system is still years away, HHS and FDA will continue to build systems that can assess particular healthcare issues through third-party data banks.

At the Brookings workshop, HHS Assistant Secretary for Policy and Evaluation Sherry Glied emphasized the need to coordinate the HHS MPCD project with Sentinel, and CDER Director Janet Woodcock similarly suggested that it's important to avoid "reinventing the wheel" with each initiative. Woodcock acknowledged that Sentinel is part of a broader effort to better use data to improve healthcare, and FDA, she said, "is willing to be a node" on these larger e-health information undertakings.

UnitedHealth Group Medical Affairs Chief Reed Tuckson echoed those remarks, noting that health plans are receiving hundreds of requests for data from federal, state, intra-state, and demonstration projects. Tuckson agreed that these data initiatives can help improve healthcare and product safety, but that standards and efficient governance systems are needed for these projects to work. "Data is expensive," he said, and meeting all the requests costs a lot of money.

FORMING A NETWORK

Establishing FDA's Sentinel System, which was required by the FDA Amendments Act of 2007 (FDAAA), is a complex undertaking that involves linking up diverse databases and establishing standard analytical methods to detect and assess signals of adverse drug events. As a prelude to a fully operational real-time Sentinel System, FDA has established a Mini-Sentinel pilot to test scientific methodologies for investigating specific drug use issues, explained Judy Racoosin, CDER's scientific lead for Sentinel. A Coordinating Center operated by Richard Platt of the Harvard Pilgrim Health Care Institute can send out queries to databases operated by Kaiser Permanente, Aetna, WellPoint, and the HMO Research Network, among others, and then evaluate resulting responses. FDA also has formed a drug surveillance collaboration with other federal agencies, including the Centers for Medicare & Medicaid Services, the Veterans Administration, and the Department of Defense, to query these health data banks on safety issues of mutual interest.

Over the past 3 years, the project has established basic principles and policies, including a Common Data Model and core safety surveillance methods. Researchers have examined which regression methods are applicable for sequential surveillance programs and have identified Health Outcomes of Interest (HOIs) that deserve evaluation. Because the Sentinel Initiative involves public health operations, as opposed to research, its query-and-analysis process can proceed without institutional review board approval.

This year, the Mini-Sentinel initiative is testing several protocols to see how well the system can evaluate emerging safety issues. One project will assess whether certain postmarketing regulatory initiatives, such as the Risk Evaluation and Mitigation Strategy (REMS), enhance the safe use of medicines. An active surveillance test is monitoring certain outcomes associated with rotavirus and human papillomavirus vaccines. And a study examining cardiovascular events in users of diabetes drugs will compare the incidence of myocardial infarction in patients prescribed saxagliptin (Onglyza, Bristol-Myers Squibb) to those taking other diabetes treatments.

REFINING METHODS

These studies will utilize some of the findings of the Observational Medical Outcomes Partnership (OMOP), a collaboration of FDA, pharmaceutical companies, and the Foundation for the National Institutes of Health (FNIH). OMOP research on how well different methods and data sources can identify valid safety signals has important implications for clinical research, as does its efforts to assess whether meaningful information can be gleaned from disparate observational data sources that use a wide variety of terminologies.

The program has identified ways to assess the strength of associations between drug exposure and specific adverse events, such as liver failure or bleeding. OMOP studies, moreover, are examining the impact of missing patient information and how well alternative study designs can deal with variations in patient demographics, comorbidities, and drug exposures.

OMOP's success in identifying methods and tools through an open, collaborative process has prompted the participants to extend the partnership beyond its initial 2-year timeframe. As it continues, the project will expand from drug safety issues to methods that could apply to medical devices and biologics, plus approaches for CER and healthcare quality measures.

COMMUNICATING RESULTS

As Sentinel moves forward, sponsors and researchers are looking at the broader implications of dealing with early drug safety signals in ways to avoid public misinformation and alarm. The Mini-Sentinel study on diabetes treatments and cardiac events, for example, raises questions about when and how FDA will make public any findings, noted GlaxoSmithKline General Counsel Daniel Troy at the Sentinel workshop. Even if FDA says it won't release early results prior to full analysis, outside lawyers, competitors, and policy-makers may try to compel disclosure, and that could lead to liability charges for failure to warn-targeting healthcare data holders as well as pharmaceutical companies.

CDER's Behrman acknowledged that liability is very much on the agency's mind because it could drive companies away from the Sentinel project. Realistic expectations about what an active drug surveillance system can do is important, said Troy. FDA needs to make it clear to the public that Sentinel signals are based on observational data that often is not sufficient to make informed judgments about medical safety issues; clarification of the value of clinical trial data versus observational studies is an OMOP objective.

The working hypothesis, said Woodcock, is that outcomes and drug characteristics that can be linked to adverse events can be identified. Demonstrating this requires data standardization and research on underlying drug safety issues, based on evidence that is both "reliable and robust."

Additional information on the FDA Sentinel Initiative is available at http://www.fda.gov/Safety/FDAsSentinelInitiative/ucm2007250.htm.