Archive for category healthcare value

Big Ideas for Big Data Analytics in Real-World Evidence: Insights from Dr. Rich Gliklich, CEO of OM1



Rich Gliklich, MD, CEO of OM1Dr. Patti Peeples, CEO of HealthEconomics.Com, sat down with Dr. Rich Gliklich, CEO of OM1, to discuss how big data analytics are changing the face of real world evidence (RWE). The mission of this Cambridge, Massachusetts digital health company is forward-thinking, like its leader: to solve the problem of determining and understanding the true results of healthcare and offer a more complete view of patient outcomes. By bringing together multiple data sources at the individual patient level to construct patient journeys, OM1 rapidly measures and forecasts patient outcomes, combining expertise in clinical research and informatics with big data technology and advanced data science to reinvent how real world evidence is generated and used.

HealthEcoOM1logonomics.Com asked Dr. Gliklich to shares his views on major transformational changes in evidence development and how these will drive a more personalized delivery of healthcare in the future.

[HE.Com] With the influx of big data, how do you think the pharmaceutical industry’s approach to real-world evidence should evolve? Are patient registries still relevant?

[RG]  Healthcare data is growing at an astounding rate. This creates both challenges and opportunities.  Pharma is being asked to demonstrate value to more and more stakeholders. We define Value as:  Value = Outcomes/Cost, and thus, Pharma will increasingly seek deeper clinical information and true outcomes to help demonstrate value and justify their prices.

To get to this critical evidence, they will need to turn to highly specialized capabilities and data for particular conditions, and they will need these data regularly updated, because the dynamics in the market change. For most organizations, it will be more cost-effective and timely to subscribe to sources that track and analyze these changes, than to build out the infrastructrure and acquire the data independently, such as from clinical trials and prospective patient registries.

The goals of patient registries are still relevant—from understanding the natural history of a disease to meeting a post market safety commitment.  But, big data plus advanced technologies creates alternative opportunities to meet those goals across many therapeutic categories and conditions, and to do so with very large patient numbers (orders of magnitude more patients vs registries), and at a fraction of the cost. data technology graphic

Click this image to see a larger version.

[HE.Com] Are there disease or therapeutic areas where using big data, as you’ve described, may be more effective? What types/level of disease and patient level data could we get to that is different than what we have access to today with traditional registries and trials?   

[RG] Conditions where comprehensive patient journeys can be readily captured through linking different data sources will be most amenable to using big data.  There are a number of conditions where this is the case, from airway to cardiovascular and immunologic diseases to name a few. And, the number of such conditions with comprehensive patient journeys using disparate data linking is growing every day. Beyond traditional clinical and laboratory data available through registries and trials, we are now able to collect more and more patient-generated data, cost information, socioeconomic data, mortality, and so on. In addition to a more thorough understanding of the patient experience, these approaches also have the advantage of collecting information on all patients. This removes some of the enrollment biases we see in both registries and trials. The graphic below demonstrates the large sample size that can be attained through linked data compared with the sample size from a typical prospective registry.

Linked Big Data in Healthcare

Click this image to see a larger version.


[HE.Com] Recently STAT News reported that Actemra® (tocilizumab) was responsible for hundreds of deaths and that the risks for life threatening complications were as high or higher than competing products. Could you comment on this finding, and is there a better way to look at this situation, using a big data perspective?

The STAT report was based on the FDA Adverse Event Reporting System.  The problem with those systems is that they are based on voluntary reporting and there is no denominator to actually determine the incidence of the events. This creates potential bias in reporting, since clinicians who are aware of a potential problem with a drug are then more likely to report events associated with it. Using big data, we can have a true denominator where the number of exposed patients and the number of events are both known, and these are derived from a combination of data sources.

In response to the STAT report, OM1 rapidly analyzed 120,000 patients on DMARDS (disease-modifying antirheumatic drugs) over the past 12 months to assess these findings in a more systematic and controlled analysis using big data. We did not find the same difference in event rates when patients carefully adjusted for comorbidities. Since the results are not yet published, I cannot go into details, but it demonstrates the power of using big data to respond rapidly to safety and other signals that may come up from time to time.

[HE.Com] How will payer needs for RWE evolve over the next 5 years, and what are the opportunities for service providers (pharma, researchers, data analytics companies) to address these future needs? 

As payers move towards value-based care, they need a deeper understanding of clinical outcomes beyond what is available in their own claims data sets. While the goal is to understand the clinical outcome, meaning the patient and provider-relevant impact of the treatment on the patient, the actual results today are tabulated from what transactions were billed for by the doctor or hospital.  As a result, these outcomes have generally focused on easily measured billing items such as hospitalizations, adverse event rates or complications of procedures.

But data derived from these sources lacks clinical depth and nuance. Critical questions are unanswered when using billing data for outcomes assessment. How serious was the hospitalization?  Did the patient return to normal functioning and well-being?  Did the underlying disease process improve or worsen as result of the treatment?  None of this is actually measurable in claims data. These shortcomings are leading payers and pharma to seek more clinically-focused RWE, and each will do it for their own purposes.  Payers will also increasingly partner with pharma to support value-based assessments and outcomes based contracts.

[HE.Com] How will patients’ use of big data evolve? Are there case studies of patient use that will become the norm for other disease states in the future?

Both patients, and providers on behalf of patients, will use big data to personalize healthcare.  Big data analytics that are focused on outcomes will support better decision-making for patients. As a result, patients will have the opportunity to better understand their own specific risks and benefits with respect to different therapies, as well as their likelihood to achieve both positive and negative outcomes. Let me give you a generalized example. In the future, a patient with rheumatoid arthritis will be able to know that for patients like them, 80% improved with drug A vs. 40% with drug B and these results were derived from broad big data rather than limited clinical trials. In this scenario, a typical patient will have much more information to make informed choices about their own or their loved one’s healthcare.

[HE.Com] What regulatory hurdles or opportunities do you see as they relate to big data, RWE, or related evidence dissemination?

Regulatory interest in big data and RWE is at an all time high as recent regulations such as the 21st Century Cures Act are driving regulators to consider RWE as a potential replacement for other forms of evidence generation around and post-approval.  In Section 505F of the Cures Act, it states, “The Secretary shall establish a program to evaluate the potential use of real world evidence (1) to help support approval of a new indication under section 505(e); and, (2) to help support or satisfy post-approval study requirements.” The program is to be implemented “within 2 years” and ‘real world evidence’ is defined as data “from sources other than clinical trials”. At the same time, some of these new paths to use RWE for these purposes are untested and there will certainly be some growing pains. Examples of such hurdles are seen in the work we do with outcomes-based contracting where issues regarding measurement outside of the label and Medicaid best price continue to create barriers.

As researchers, we are doing our part to facilitate better informed decisions for individual impact, using our intelligent data cloud to transform population data into precision health. And we’re trying to get deeper into clinical and patient data, more quickly. But there is much work to be done.

[HE.Com] Thank you, Rich. For more information on the work of Dr. Gliklich and colleagues in the area of RWE, view the recent on-demand webinars by clicking on the links below. 


Click the image to request access to the webinar.


Click the image to request access to the webinar.

Rich Gliklich, MD, CEO of OM1About Rich Gliklich, MD

Rich is the CEO of OM1, a healthcare technology company focused on understanding the patient journey and the true results of healthcare. Since 2014, Rich has been an XIR at General Catalyst, where he supports businesses in the healthcare industry. Prior to joining General Catalyst, Rich was President of the Outcome division of Quintiles, the largest provider of biopharmaceutical development and commercial outsourcing services, and he also served on its Executive Committee through its 2013 IPO.   Prior to Quintiles, Rich was Founder, CEO and Chairman of Outcome, a health information and services company that served more than 2,500 healthcare organizations and a majority of the global top 30 life sciences companies.  Rich led Outcome from its start as a spin-off from his Harvard affiliated research laboratory in 1998 through its acquisition by Quintiles in October 2011.  In addition to his experience as an entrepreneur and executive, Dr. Gliklich is well known in the areas of registries, outcomes and analytics.  He is senior editor of the landmark publication by the U.S. Agency for Healthcare Research and Quality (AHRQ) handbook “Registries for Evaluating Patient Outcomes: A User’s Guide” and the PI for the Outcomes Measures Framework, which focuses on standardization of outcomes measurement.  Rich has led several key national and international efforts focused on evaluating the safety, effectiveness, value and quality of healthcare.  Rich also holds several patents for both health outcomes systems and medical devices. Rich is a graduate of Yale University and Harvard Medical School and a former Charles A. Dana Scholar at the University of Pennsylvania. Rich is also a surgeon and the Leffenfeld Professor at Harvard Medical School.


If you or someone you know would like to be featured in the HealthEconomics.Com CEO Profiles Series, contact Dr. Patti Peeples, CEO of HealthEconomics.Com. 

, , , ,

No Comments

Drug Pricing Value Assessment Methods in the United States: The National Pharmaceutical Council Viewpoint

Swarali Tadwalker, MPH

Swarali Tadwalkar, MPH

Written by Swarali Tadwalkar, MPH, Guest Blogger and Research Intern at HealthEconomics.Com

Drug prices are the fastest-growing part of healthcare costs, and everyone – from patients, to physicians, policy-makers, and pharmaceutical companies – are grappling with price-setting and drug value assessment.

States like Massachusetts are leading the way with several initiatives, such as a state bill demanding price transparency and separately, a non-profit group who is developing price benchmark reports evaluating nationwide cost-effectiveness of newly launched drugs.  A few days ago, it was announced that the consumer advocacy group (Health Care for All) has helped draft a bill in Massachusetts that would force biopharma companies to justify drug prices by divulging expenditures on research, production, and marketing.  In late July, this tHEORetically Speaking blog reported on the Boston-based non-profit Institute of Clinical and Economic Review (ICER) announcement of the Emerging Therapy and Assessment Program (ETAP) framework.   The ETAP program – and several other value assessment frameworks in development or use – has stirred strong interest among the pharmaceutical and related policy research fraternity involved in assessing drug cost-effectiveness.

In order to understand a different perspective on the advantages and limitations that the ETAP framework offers, the National Pharmaceutical Council (NPC) has lent its outlook. NPC provides an important and broad perspective on pharmaceutical value assessment approaches, by virtue of its mission and research agenda, as a health policy research organization dedicated to the advancement of good evidence and science, and to fostering an environment in the United States that supports medical innovation. While its member companies represent biopharmaceutical manufacturers, NPC seeks to include independent experts and it is not a lobbying organization.  As such, their point of view offers additional insight into the dialogue about drug price and value.  Dr. Robert (Bobby) Dubois, Chief Science Officer and Executive Vice President of NPC sat down with Dr. Patti Peeples to discuss Drug Value Frameworks, ETAP, and NPC’s research agenda for comparative effectiveness.

Patti PeeplesPatti Peeples, RPh, PhD

CEO and Founder, HealthEconomics.Com 

Principal Researcher at HE Institute




 Robert W. Dubois, MD, PhDRobert W. Dubois, MD, PhD

Chief Science Officer & Executive Vice President

National Pharmaceutical Council




PP: NPC has been involved for decades in quality and outcomes issue, as well more recently in comparative effectiveness and the value of pharmaceuticals.  Please describe some of NPC’s initiatives.

RD: For 60 years, NPC has been involved in various aspects of health policy and research to provide insight into key issues related to pharmaceutical use and value. We have had a particular focus on comparative effectiveness, which not only involves comparing clinical effectiveness but also the value comparisons across different therapeutic options like surgery vs. medication, surgery vs. chiropractic therapy or drug vs. drug, or any other combination. This provides a broader perspective on the types of healthcare interventions and their associated value. Additionally, we seek to take a more holistic view of healthcare, by looking at the dynamics associated with the changing reimbursement environment as well as changes happening at the provider level (such as paid bonuses for quality performance). All of these factors are important in the value assessment of healthcare interventions.

But, value goes beyond whether the payment system for service is appropriate or not.  It goes beyond whether the provider is meeting quality standards. As you mentioned, drug prices are getting significant attention. NPC is focused on helping people understand those drug prices in a broader context. One of our current projects evaluates the lifetime cost and benefits of a drug, over the branded period as well as generic period, spanning over 20-30 years.

Another aspect of value that NPC is involved in has to do with the fact that there is a disconnect between who is paying the economic bill and who is reaping the economic benefits. A lot of the drugs are being paid for by Medicaid or commercial insurance, yet Medicare is the likely recipient of the positive consequences (like in the case of Hepatitis C drugs, avoided transplant of livers or liver cancers or hospitalizations). This is another limitation of our healthcare system, and we want to improve the methods whereby we look not only at costs (and price) but also assess where and when the payoffs occur, and who is receiving them.

libraryVisit the National Pharmaceutical Council Research Library here.

PP: You served on the ICER value framework committee for developing these pricing benchmark reports.  Can you describe NPC’s involvement, and your thoughts on the process and the framework that is now being put to use?

RD: ICER has engaged a diverse group to help think through the framework and provide guidance. In addition to participating on an advisory committee, my staff and I have had a substantial number of conversations with ICER and its principals (Dr. Steve Pearson and others), which I believe have been influential in framing the evolution of the group and ETAP. In terms of these contributions, I want to divide my thoughts into some broad areas with series of subpoints.

First, I’d like to say a few words about the positive work of Steve Pearson and his team from ICER.  He has been working on this and related areas for a significant amount of time, and he wants to get input from many key groups. Although his matrix is primarily focused on payers and how payers might value drugs, he also -in the long run-wants to initiate a dialogue around the characteristics of value, especially between payers and the biopharmaceutical industry. This would help everyone understand the possible perspectives on value and the evidence required to support that value. The broad stakeholder input he has received, welcomed, and encouraged is really important.

Second, the ICER/ETAP framework is transparent, and is not very subjective (thus, it is more objective) and it has comprehensive criteria and Likert scale elements that make it very clear how an individual is viewing things. This is very important.

Third, unlike some of the other existing frameworks, the ETAP framework is a multi-attribute one. There are several other frameworks or methodologies that are receiving a great deal of attention, including the ASCO Value Framework,  The American College of Cardiology/American Heart Association Cost/Value Methodology, Memorial Sloan Kettering DrugAbacus, Premera Blue Cross value-based drug formulary, Blue Cross/Blue Shield multi-tiered formulary, National Comprehensive Care Network (NCCN) Value Pathways, among others.  I think the ETAP framework considers the most elements in its analysis, and cost-effectiveness is calculated over a 2-year and lifetime horizon, which is good.  The clinical care value consideration is very well defined and has gone through a lot of vetting. Other value frameworks (like ACC/AHA) are very simplified, single metric cost-effectiveness calculators over a one-year time horizon, and I believe this has notable limitations.

However, in terms of areas of potential improvement for the ETAP framework, there are a few. The health system value assessment for the ETAP analysis is built around affordability.  Although this assessment has evolved immensely, I don’t think it has been vetted enough. It moved from originally being an arbitrary metric to one that is now based on GDP (gross domestic product), GDP growth, and how much growth should be consumed by drugs. It is modelled around the WHO (World Health Organization) framework and this aspect could certainly be beneficial. But, we need further assessment.

Another area of concern specifically is that I believe the ETAP framework conflates the term “value” with “affordability”, and while some think this may be semantics, I think it’s important.  The “clinical care value” part of ETAP assesses this metric this through cost-effectiveness and I believe it is appropriate in how it is configured. However, when the framework looks at affordability or budget impact, it terms this “value.” So, I believe that it really isn’t value but it is affordability and this happens to be confusing or misleading for people.

Why is use of the term value vs. affordability relevant? For example, Harvoni® is used to treat Hepatitis C; it has been shown to be cost-effective and has a high clinical care value in the ICER framework. However, due to the significant number of people who could benefit, it has a considerable budget impact in the short-term. Just because it has a considerable budget impact doesn’t mean it has low value. Therefore, most health economists would say it is a very valuable drug, but it is expensive for the society, collectively. We would prefer if the terms were changed and it was called budget impact. When you say a treatment has a low value, people tend to focus on price. However, when you say it has a high value but the budget impact is substantial, you open all sorts of possibilities and opportunities and change the dialogue.

Next is the quantitative issue. When the ICER framework looks at affordability, budget-impact and health system value, they are looking only at one- to two-year horizons. They are saying this is the expenditure, but the benefits may be five years later. If they say it is too much of a budget impact, it broadens the window to look at cost and benefits over 5 or 10 years.  It’s important to have an appropriate time horizon for all assessments.

PP: Do you think that the ETAP assessments of short- and long-term cost-effectiveness, affordability, and budget impact will affect the pharmaceutical industry’s use of discounts, rebates and copay coupons because it won’t be considered in this ETAP benchmark analysis?  In other words, will they price drugs more consistently across customer groups and curtail the use of these customer-centric strategies?

RD: Although the ETAP framework is gaining traction, it is not in widespread use yet. The ETAP framework will have an influence here, and possibly outside of the US, but it won’t be an immediate, direct all-encompassing impact because it’s one of many frameworks. If the ETAP framework says that an oncologic agent has high or low value but the ASCO Value assessment finds the opposite, neither of them is necessarily likely to win the debate.

PP: What do you think is going to be the biggest and the most near term impact of the ETAP framework?

RD: I think that with or without ETAP framework we are moving into an era where value is the centerpiece of discussion. It’s not price, but value. The ETAP framework addresses the price along with all the other elements. If we can move from a very narrow, short-sighted view of drug cost, to something which is broader, multi-dimensional, and has a multi-year time horizon, it would be a good shift of dialogue. I do believe that we will see more of these value frameworks taking hold in decision-making. Now, whether it takes the Premera approach of determining primary tiers, whether it is embedded in clinical pathways developed by NCCN or whether it is a specific cost-effectiveness metric, or maybe all of the above, this means value will embedded in our reimbursement system at an increasing rate.

PP: I am intrigued by your earlier statement about the conflation of value with affordability. Is that something you are spending little bit time on from NPC’s perspective?

RD:  If you look at all the other frameworks, confusion doesn’t occur. The ETAP framework is the only one that formally raises the issue of affordability. All the other ones look at an individual drug, or an individual patient, and they don’t multiply the impact across a population.  The ETAP framework does, and this has raised this very important issue on a larger scale. Although it doesn’t take away the issue, it frames it slightly differently. Affordability is very important but it doesn’t immediately mean prices need to change.

PP:  What are some potential solutions to the affordability issue for drugs? 

RD: There are many solutions to the problem. One is long-term financing. If you say that Hepatitis C treatment is quite costly in the near term, but has benefits in the long term, the problem has a life-long impact. The fact that it’s front-loaded raises attention. Aggregate spending is different from paying it over a time. This is going to be critically important as gene therapy hits the market because one injection is potentially going to cure certain inherited blindness or inherited anemia and therefore, it will have a different price tag and very likely, it will be cost-effective but the costs will be front-loaded. There will be policy exploration to level out costs so they don’t blow the budget.

Another solution is really to say that they are all one-time costs, but we—as a society—want to handle these near-term costs if we are willing to have a cure for many of these diseases. This means we will potentially pay for many treatments/cures in a short period of time, but we all want this because we are avoiding long-term care that wouldn’t occur. This may require a one-time additional expenditure by the federal government, by employers or by individuals.

Another way could be by employing performance-based payments. In this case, payment will be based on the benefit received by the patient.

Another way focuses on low-value services.  These low-value services are rampant within our environment. Sometimes we end up with extraneous medication from  a doctor or a surgery that is not really necessary or beneficial. We need to consider all of these elements and package them up to use appropriately. We possibly would be able to save all the money we need for these other, efficacious valuable treatments.

PP: How are your member groups in the biopharmaceutical industry reacting to the various Value Frameworks and Benchmarking approaches?

RD: Well, we have an active exploration under way of the various frameworks that are out there and as I mentioned, there are some frameworks which are too narrow and some that are much broader; they all have some limitations. The ETAP framework, I think is the broadest and has the most strengths but it needs maybe about 20-25% refinement. I think this refinement will be very important to do to make it the best available.

Innovative drugs need to demonstrate value and our members want to make sure that value assessment is broad enough. As a simple example, let’s look at the ASCO value assessment: they will come up with a measure of incremental efficacy or benefits and it would be a single assessment based upon a single study and they are only going to look at median survival. If two drugs have the same median survival time but one has a much greater chance of long-term survival, the assessment won’t show that difference.  Some patients would prefer the potential for long-term survival, but they won’t have the information to make that choice.  That is a problem.  We, as a professional discipline, need to ensure this is understood, the limitation addressed, and make sure that, at the end of day, everything patients care about will be adequately recognized, evaluated and included in the value assessment. That is one of the areas that this young field of US value assessment needs to address. PP: To your point above, it seems that we are having these discussions of value at the provider and policy level.  To what extent are patients currently part of any of these groups involved in developing value frameworks, or is the patient perspective included in any of the resulting outputs?

RD: It is good news that ASCO’s value framework is targeted to the patient.  The ETAP metric is much more targeted towards the payer but they have the limitation I just mentioned. This is a very young field. Health outcomes research is a young field, value assessment is a young field, yet cost-effectiveness has been around for a while.  But broadening it to thinking about value is brand new. I can only hope that the field and all of us will push hard to keep improving the methods that are used. I think we can get there but we just aren’t there yet.

For more information on National Pharmaceutical Council, visit here.  For more on the ETAP Framework, visit ICER.


, , , , , , ,

No Comments