Skip to main content

The role of drug regulatory authorities and health technology assessment agencies in shaping incentives for antibiotic R&D: a qualitative study

Abstract

Background

Few antibiotics have entered the market in recent years despite the need for new treatment options. Some of the challenges of bringing new antibiotics to market are linked to the marketing authorization and health technology assessment (HTA) processes. Research shows great variation in geographic availability of new antibiotics, suggesting that market introduction of new antibiotics is unpredictable. We aimed to investigate regulatory authorities’ and HTA agencies’ role in developing non-financial incentives to stimulate antibiotic research and development (R&D).

Methods

We conducted individual, semi-structured, stakeholder interviews. Participants were recruited from regulatory authorities (EMA and FDA) and HTA agencies in Europe. Participants had to be experienced with assessment of antibiotics. The data were analyzed using a deductive and inductive approach to develop codes and identify key themes. Data were analyzed using thematic analysis including the constant comparison method to define concepts, and rival thinking to identify alternative explanations.

Results

We found that (1) interpretation of key concepts guiding the understanding of what type of antibiotics are needed vary (2) lack of a shared approach on how to deal with limited clinical data in the marketing authorization and HTA processes is causing barriers to getting new antibiotics to market (3) necessary adaptations to the marketing authorization process causes uncertainties that transmit to other key stakeholders involved in delivering antibiotics to patients.

Conclusions

A shared understanding of limited clinical data and how to deal with this issue is needed amongst stakeholders involved in antibiotic R&D, marketing authorization, and market introduction to ensure antibiotics reach the market before resistance levels are out of control. Regulatory authorities and HTA agencies could play an active role in aligning the view of what constitutes an unmet medical need, and direct new economic models towards stimulating greater diversity in the antibiotic armamentarium.

Background

Antibiotic resistance has increased the need for new antibiotics to combat bacteria that no longer respond to treatment, but bringing new drugs to market has proven difficult [1]. Antibiotic treatment courses usually have a short duration, are scientifically challenging to develop, and as resistance develops, risk becoming ineffective [2,3,4]. The current economic model directly links return of investment to unit sales, and incentivizes companies to maximize sales [5]. At the same time, interventions are put in place to reduce the use of antibiotics to slow down antibiotic resistance. Ultimately, the financial return on developing new antibiotics is considered too low by the pharmaceutical industry, and many companies have exited the field [3]. To attract companies to reinvest in antibiotic R&D new financial and non-financial incentives are needed [3,4,5,6,7].

Some of the non-financial incentives considered to influence innovation are linked to the process of marketing authorization, as well as pricing and public reimbursement. Designing clinical trial programs have proven difficult, both due to scientific challenges as well as differences between countries and regions regarding the regulatory requirements on the design of clinical trials included in the marketing authorization application for new antibiotics [8,9,10]. Regulatory authorities have sought to address these challenges by strengthening the collaboration between them as well as with industry, and by developing guidelines for antibiotics addressing areas of important need [11,12,13,14,15,16,17,18,19]. Regulatory authorities have a high concordance when approving antibiotics and have become more harmonized with respect to approval time, but differences are still seen concerning target indications and decisions to conduct priority review/accelerated assessment [20,21,22,23,24,25,26,27,28].

After marketing authorization, pricing and reimbursement schemes are decided through national processes that, among others, involve the use of health technology assessments (HTA). HTAs are generally understood as multidisciplinary, systematic and transparent processes for determining the value (e.g., cost-effectiveness) of a health technology [29], and are used by governments and public and private health insurance schemes to inform reimbursement decisions. In contrast to how other drugs are evaluated, there are specific challenges that are unique to antibiotics [30]. This includes measuring the public health value of antibiotics, since antibiotics not only helps the patient receiving the medication but prevents the infection from spreading to other people, as well as enabling other types of treatments and procedures, such as chemotherapy and surgery. Use of HTA to inform reimbursement decisions is increasing and represent a financial factor that is likely to influence innovation of antibiotics [31,32,33,34,35], yet little is known about HTA agencies response to the challenges linked to making new effective antibiotics available.

Research shows a great variation in geographic availability and considerable lag-time between regions in the uptake of new antibiotics [36]. This suggests that there are challenges in the marketing authorization and HTA processes that makes market introduction of new antibiotics unpredictable. This could create uncertainty among innovators about how their product will be valued by healthcare systems. While most of the literature pertaining to incentivizing antibiotic R&D has focused on the role of new financial incentives and payment models, there is an increasing interest in regulatory authorities and HTA agencies role in stimulating innovation of antibiotics targeting unmet needs, including resistant bacteria [12, 26, 35, 37,38,39].

This study aimed to answer the question if and in what way regulatory authorities and HTA agencies can contribute to the attempts to stimulate antibiotic R&D, primarily through non-financial incentives. We investigate this question by exploring the collective experiences with assessing and valuing antibiotics and explore the perceptions of those working in regulatory authorities and HTA agencies. We identify barriers and facilitators to antibiotic R&D and market introduction unique to the processes managed by regulatory authorities and HTA agencies, and potential barriers and facilitators resulting from the interaction between these two. Finally, we explore potential strategies for getting new antibiotics to market.

Methods

Study design

To answer the research question, this study used a qualitative study design involving semi-structured interviews with experts from regulatory authorities and national HTA agencies. The COREQ checklist was used to ensure explicit and comprehensive reporting of study design characteristics (Additional file 1) [40]. The design of the study, development of the interview guide, recruitment strategy, and analysis of results were informed by a document review exploring the use of the terms unmet medical need, novelty/novel drugs and innovation by EMA, FDA and WHO (Table 1), a literature review and previous research by the research team on the market introduction of new antibiotics [36]. The purpose of the literature review was to determine the primary theoretical perspectives guiding interpretation of the qualitative data and was conducted for published articles on PubMed and Google scholar using combinations of the following search terms: “regulatory approval”, “marketing authorization”, “market introduction”, “HTA”, “antibiotics”, “antimicrobials”, generic and original names of antibiotics approved during the past 20 years. Previous research by the research team included analysis of sales data and a document review of EMA and FDA approval documents and summaries of product characteristics (SPCs) of new antibiotics approved between 1999 and 2014 [36, 41, 42].

Table 1 Definitions and use of key concepts in major normative institutions

Theoretical perspectives—the concepts of novelty and unmet medical need

To mitigate the impact of resistance it is desirable that new antibiotics work in different ways than already marketed antibiotics. WHO defines innovation in antibiotic R&D as no cross-resistance to existing antibiotics, new chemical class, new target, or new mechanism of action [43]. In addition, WHO has listed the pathogens that pose the greatest threat to public health and, therefore, should be prioritized in antibiotic R&D [44]. These pathogens were identified using a multicriteria decision analysis including the following criteria: mortality, health-care burden, community burden, prevalence of resistance, 10-year trend of resistance, transmissibility, preventability in the community setting, preventability in the health-care setting, treatability, and state of the pipeline [44]. The EMA and FDA have developed pathways to enable the approval of new antibiotics targeting serious or life-threatening infections and unmet medical needs, including the use of limited clinical data. In this work, EMA and FDA refer to, but do not always define, innovation, novelty/novel drugs, and unmet medical need [13,14,15, 17, 19, 45,46,47,48,49,50,51,52]. Table 1 provides a summary of how these concepts were defined and discussed by EMA, FDA and WHO. Key insight from the literature review was that stakeholders involved in drug R&D and market introduction including regulatory authorities, HTA agencies, patients, payers, and industry use multiple criteria to assess unmet medical need [37, 53]. These can be divided into three categories: adequacy of alternative treatments, disease burden, and population size, but with no alignment on how to measure these criteria [37, 53]. Ultimately, unmet medical need and novelty, which reflect the value of an antibiotic, represent broad, unspecific terms. When analyzing the qualitative data, the key concepts novelty and unmet medical need guided our attention. Specifically, we examined how interviewees from regulatory authorities and HTA agencies interpreted these concepts and described their application in assessing and evaluating new antibiotics. Our analysis aimed to gain a deeper understanding of how these key concepts were used in the context of antibiotic development and approval processes. We paid close attention to the nuances of interviewees' descriptions, as well as any commonalities or divergences in their interpretations. By doing so, we sought to identify patterns and insights that could inform future efforts to improve antibiotic development and regulation.

Interview guide

We developed a semi-structured interview guide with open-ended questions (Additional file 2). The interview guide consisted of 17 questions sorted under five main topics, informed by the theoretical perspectives described above: (1) factors of importance when antibiotics are evaluated: (2) changes in the perspective of what an antibiotic is: (3) perception of novelty and need: (4) barriers to get novel antibiotics to market: and (5) interventions to improve antibiotics R&D, assessment and approval to assure effective antibiotics reach the market. The interview guide was evaluated and adjusted after a pilot interview. Adaptations were made to the guide to assure that the questions were relevant for the participants depending on which stakeholder group they represented.

Study recruitment and interviews

Participants for semi-structured interviews were recruited from regulatory authorities (EMA and FDA), and HTA agencies in Europe. Participants had to be experienced with assessment of antibiotics and work in institutions that held responsibility for marketing authorization and assessment of benefit/risk or assessments of value. Individuals were identified through regulatory networks and internet searches of relevant agencies and contacted using emails presenting the research team, background and aim of the study. A total of 46 emails directed at agencies assessing drugs for national use (including HTA) and 36 emails directed at medical agencies linked to the EMA network were sent to recruit participants fulfilling the criteria stated above. Participants were asked to recommend relevant candidates for additional interviews to enable snowball sampling [54]. Suggested individuals were discussed within the research team and added if perceived valuable for the data collection process. Written or oral consent to participate in the study, including whether the participant was comfortable with the interview being audiotaped, was obtained before the interview.

Interviews were conducted over telephone or skype, between December 2017 and June 2019, and were audiotaped. The median length of the interviews was 86 min (52–151 min). Participants received an overview of the topics to be discussed prior to the interview, and each interview began with an introduction of the study and primary investigator CK. CK conducted and led the primary analysis of the interviews, which were transcribed and anonymized before analysis. Participants were contacted by email if clarifications were needed after the interview. Several different techniques were used to strengthen trustworthiness and rigor, including a secondary independent analysis of the interviews by HSB and LM, and two consensus sessions, where CK, HSB and LM discussed the findings. Saturation was determined after constantly comparing experiences and responses of the participants against each other and by appraising the richness of experiences shared by participants [55]. We used deductive and inductive reasoning when conducting thematic analysis and developed themes explaining organizational processes related to the assessment and approval of new antibiotics. We analyzed the qualitative data applying the five-cycle phase described by Yin [54], which includes: (1) compiling, (2) disassembling, (3) reassembling, (4) interpreting, and (5) concluding. An iterative strategy was used, moving between steps (2)–(4) to allow for a continuous re-assessment of analytical codes, concepts, and themes. Our application of thematic analysis [56] involved the constant comparison method known from grounded theory to define concepts, rival thinking to identify alternative explanations for the observed patterns in the data [57], and identification of divergent views to challenge generalization [58]. The coding of qualitative data was done in NVivo 12 [59]. Findings were shared with respondents for commenting and validation and to strengthen trustworthiness of the findings.

Results

Overview

The study included 19 participants. One interview included three participants and another two participants from the same agency. Three participants provided written responses. Together the participants represented 11 countries in Northern, Western, Southern and Central Europe, and the US. The participants representing regulatory authorities had a background in clinical medicine, biology, or pharmacology, while representatives from HTA agencies had a background in clinical medicine, pharmacology, and health economics. One participant had previous experience working in pharmaceutical industry. The participants had two to over 20-years experience working with evaluation of antibiotics. Participants working with marketing authorization in the EMA were often linked to national agencies, either as an employee and working as a rapporteur/co-rapporteur for the EMA, or by having worked for the national agency before transferring to the EMA. Moreover, several HTA agencies that were approached in the recruitment process responded that they so far had no experience in assessing new antibiotics. Sixteen of the 19 participants, therefore, had experience working with marketing authorization as well as HTA, or only with marketing authorization, while three participants had solely worked with HTA of antibiotics. The thematic analysis comprised five themes: (1) uncertainties and disagreements regarding to what extent the marketing authorization process can and should be adapted; (2) increased risk of irresponsible use of antibiotics; (3) the increasing population-level spread of resistant strains means that benefit/risk assessment of new antibiotics will vary over time; (4) adjustments to regulatory requirements for antibiotics misaligned with evidence needs for determining value with HTAs; and (5) different interpretations of “novelty” and “need” translates to differing views on what kinds of antibiotics are urgently needed, see Table 2 for major themes and corresponding qualitative codes. Overall, participants agreed that the main barrier getting new antibiotics to market is lack of economic incentives and did not consider the marketing authorization or HTA processes as major barriers to get new antibiotics to market.

Table 2 Major themes and corresponding qualitative codes

Main findings

  1. 1.

    Uncertainties and disagreements regarding to what extent the marketing authorization process can and should be adapted

Participants from regulatory authorities described that past challenges in marketing authorization of antibiotics, such as authorities asking for site-specific studies, different endpoints and non-inferiority margins, had largely been addressed. The challenges antibiotic resistance creates for evidence generation and assessment of new antibiotics was now the main concern. Interviewees highlighted the difficulty recruiting enough patients in clinical trials due to low prevalence of target pathogens and assessing the submitted documentation when based on scarce clinical data. In response to this challenge, new guidelines highlighting the use of pharmacokinetic/pharmacodynamic (PK/PD) data has been introduced as a main strategy for addressing limited clinical trial data.

Interviewees considered these adaptations a necessity; however, some expressed concerns over their use: “the lack of PK/PD markers is becoming more and more an issue”, “PK/PD targets are not that well defined “and “…many [assessors] are uncomfortable using PK/PD data…”. With respect to how much regulatory authorities can adapt to further facilitate marketing authorization of antibiotics, interviewees expressed views across the spectrum. Most interviewees expressed that regulatory authorities have reached a point, where they cannot make further adjustments and still uphold a good standard. In contrast, one interviewee pointed out that adaptations to the authorization systems will have to continue to meet the need for new antibiotics “I think we will have to become more creative when it comes to what expectations you have on the clinical side”. One participant suggested the use of alternative data sources to compensate for limited clinical trial data, “most countries have nowadays electronic records, we can transfer data from electronic patient records to clinical trial files”. At the other end of the spectrum another interviewee questioned adapting the regulatory process “You can say that you don't ask for anything irrational, but I think it is a totally wrong concept that you should reduce requirements to get more product in one or another field”.

  1. 2.

    Increased risk of irresponsible use of antibiotics

A second challenge, related to approving antibiotics based on limited data, was the risk that the antibiotic will be used irresponsibly once it enters the market. New antibiotics, targeting an unmet need, should only be used when there are no other options to avoid development of resistance but also given the limited availability of safety data. For example, one interviewee voiced a concern that companies might attempt to get a product approved for an indication considered an unmet medical need, but then encourage off-label use for other susceptible infections with higher prevalence to be able to generate return on investment. “The risk is that these drugs might also be very effective for treating the more regular UTI’s or skin infections …and will be used in the field that way, because there has been a publication or has been a study that says it has been effective in this indication …whilst we don’t have the data to support that”. However, another participant commented that such alternative use may simply reflect reasonable clinical judgement: “the use of a new drug depends on multiple factors including level of resistance and patient population, so the final use of the drug can differ from what was intended, and this might not be wrong but simply mirror the development of the situation… clinicians will use what they need.”

  1. 3.

    The increasing population-level spread of resistant strains means that benefit/risk assessment of new antibiotics will vary over time

Interviewees expressed different views about whether antibiotics approved with limited clinical data presented an increased safety risk. One group of participants held the view that approval under such circumstances entails accepting an increased safety risk. This view was based on two arguments. First, that this would lead to safety issues going unnoticed prior to marketing authorization. Second, that these safety issues will likely continue to go unnoticed post-approval, given that new antibiotics will be kept as a last-line treatment option and that evidence about these drugs would take time to accumulate. In contrast, another group of interviewees argued that if resistant strains continue to reduce antibiotic effectiveness, and if treatment options for these strains continue to be lacking, it would be possible for a new antibiotic to have a positive benefit/risk profile even if this comes with additional safety risks compared to existing therapy. As one participant stated “benefit/risk is not an equation, it is a judgement.” Another interviewee reflected “if you wait to conduct clinical trials until you have a population that is big enough you’ve waited too long. You’ve allowed the resistant strain to spread… It is important to not make it too difficult.” Accordingly, marketing authorization of an antibiotic at a point in time when spread is limited may increase the risk of adverse events for individual patients, while marketing authorization of an antibiotic at a point in time when clinical data is available increases the risk for the population at large in the form of pandemics. Participants representing regulatory authorities emphasised that approval based on limited clinical data is clearly communicated in the summary of product characteristics (SPC), e.g., that the antibiotic should be used only in situations where there are no other options. By following these recommendations physicians minimize safety risks. Participants representing regulatory authorities were also clear about the fact that marketing authorization will not be given unless clinical data is sufficient to assess benefit and safety risks.

  1. 4.

    Adjustments to regulatory requirements for antibiotics misaligned with evidence needs for determining value with HTAs

Representatives from regulatory authorities perceived that HTA in some cases risk becoming a barrier to bringing new antibiotics targeting unmet medical needs to market. Regulatory authorities are increasingly accepting limited clinical trial data in the authorization process. In contrast, HTA agencies conventionally ask for additional or different data, such as data proving superiority or data on a specific patient group, to determine the value of a new antibiotic. In the absence of these data, the product risk failing the criteria for public reimbursement and the company would be discouraged from marketing the drug. Representatives from regulatory authorities saw the need for HTA agencies to adapt to the changes implemented in the marketing authorization process, including perception of unmet need, and developing approaches to manage limited clinical data, described under the first theme.

Participants experienced with HTA acknowledged that companies could be asked to collect additional data for the HTA than what was considered satisfactory for the marketing authorization process. However, this was not considered a major problem, since a valuable antibiotic would receive a positive assessment regardless of limited clinical data, since in the case of a new antibiotic, claiming to target an unmet need, there would be no available treatment that would offer a more cost-effective alternative. Moreover, representatives from HTA agencies argued that due to health care budgets and the European pricing system, which keeps antibiotic prices relatively low, the chances for companies to generate return on investment for new antibiotics are small regardless of the value determined using HTA.

It should be noted that the experience with using HTAs for assessing the value of antibiotics was limited. Many representatives from national agencies responsible for drug assessment expressed during the recruitment process that they either do not conduct HTAs for antibiotics, that HTA is only conducted if a company requests it, or that they are in the early process of setting up HTAs. A partial explanation for this limited experience is that few new antibiotics have been developed in recent years. While regulatory authorities have developed guidelines to address antibiotic resistance, representatives from HTA agencies did not report any similar initiatives in their field. Instead, representatives from HTA agencies mentioned the need to continue the work to harmonize HTA between European countries to assure that the additional data collected by a company can inform assessment of value in multiple jurisdictions. A challenge in this process was how to choose a comparator for a new antibiotic that would work for multiple countries. Compared to other types of drugs, the different levels of antibiotic resistance across countries, as well as antibiotic treatment guidelines, present a unique challenge for harmonized post-approval evidence generation and value assessment.

  1. 5.

    Different interpretations of ‘novelty’ and ‘need’ translates to differing views on what kinds of antibiotics are urgently needed

‘Novelty’ and ‘ unmet medical need’ are key concepts guiding the understanding of what kind of antibiotics are needed [60]. Interviewees held different interpretations of the concepts of ‘novelty’ and ‘unmet medical need’. Most participants defined ‘novelty’ as ‘new in class’—meaning the first antibiotic in a new class. However, some argued that being ‘new in class’ is insufficient if the goal is to combat antibiotic resistance. These interviewees argued that ‘novelty’ must entail discovering antibiotics with no known resistance mechanisms against the compound. Others argued that novelty could entail discovering a new bacterial target or formulation that would create new treatment options. One participant divided ‘novelty’ into three groups: “I would describe novelty in these three areas; new mechanism of action, niche indications (targeting a specific resistant strain), and targeting indications where the available antibiotics are no longer, at least in certain geographical areas, working”.

The concept of an antibiotic targeting a public health need, often termed ‘unmet medical need’, was seen to differ between regions and over time due to differences in disease prevalence and different needs in different patient groups. Respondents found it difficult to know when an unmet need had been filled. For example, one interviewee expressed: “is it an unmet need if only a subpopulation of 50 people need the drug, what about a 1000 people?…There will always be benefit to some patients.” Another key perspective was whether to emphasize benefits to individual patients or benefits to society at large, since this has implications for which antibiotics that should be developed. One interviewee expressed: “Benefit to society, benefit to patients, who are we developing for? The great masses or patients in hospitals?” Accordingly, a globally uniform understanding of what constitutes antibiotics targeting an unmet medical need was not deemed possible.

Crucial to generating public health value is controlling the spread of antibiotic resistance. Accordingly, another interviewee expressed that “antibiotics of a public health value are antibiotics that reduce resistance, either new ones with a new mechanism of action or old, small-spectrum antibiotics”. Reflecting further, the interviewee added: “I don’t think broad-spectrum antibiotics would be the answer to the global health problem, but we need it as well.” Such an understanding implies that judicious use of antibiotics with new mechanisms of action or of narrow-spectrum antibiotics are most important to public health, and that broad-spectrum antibiotics, although being of great importance for individual patient, should be restricted given that they are strong drivers of antibiotic resistance.

Interviewees reflected on how the multiple understandings of unmet medical need could be translated to which antibiotics should be incentivized for development, and that there is a need for a broad armamentarium. It will not be enough focusing on the current gaps in antibiotic treatments; instead, there is a need for a “tool kit” to be able to stay ahead of antibiotic resistance. To this end, respondents from both regulatory authorities and HTA agencies suggested continued efforts to increase communication with companies, including scientific advice at an early stage, to guide development towards unmet medical needs. However, this was considered to have limited impact, since companies have the final say over target pathogen and indication and may choose to not comply with the advice given.

Discussion

This study aimed to answer if and in what way regulatory authorities and HTA agencies can contribute to bringing new antibiotics to market, primarily through non-financial incentives, by examining the perspectives of regulatory authorities and HTA agencies in ongoing efforts to motivate R&D of antibiotics. We found that (1) interpretation of key concepts guiding the understanding of what type of antibiotics are needed vary (2) lack of a shared approach on how to deal with limited clinical data in the marketing authorization and HTA processes is causing barriers to getting new antibiotics to market (3) necessary adaptations to the regulatory authorization process causes uncertainties that transmit to other key stakeholders involved in delivering antibiotics to patients. However, participant did not consider themselves to be in a position to have a major impact on antibiotic R&D, given that lack of financial incentives was perceived as the major barrier. They suggested continued and increased discussion with the pharmaceutical industry to guide development towards unmet medical needs as their way of contributing to a diverse and effective antibiotic armamentarium.

Our study identified that the interpretation of key concepts guiding antibiotic R&D—'novelty’ and ‘unmet medical need’—differed widely. This is in line with other research showing that the definition of unmet medical need, used as a synonym to ‘public health need’ by our respondents, differs between stakeholders including regulatory authorities, HTA agencies, industry, payers, health care professionals and patients [37]. This varied understanding of novelty and unmet medical need may reflect the need for diversity in the antibiotic armamentarium, highlighting that it is not only the value of an individual antibiotic that needs to be taken into consideration when incentivizing antibiotic R&D, but the value generated by the entire antibiotic arsenal. Nevertheless, it creates a challenge for policy makers tasked with developing incentives to stimulate antibiotic R&D. Much attention is currently given pull incentives, which are financial payments made at the end of the R&D pipeline designed to primarily incentivize big pharmaceutical companies to reinvest in antibiotics [3,4,5,6,7]. Their impact will depend on a general agreement amongst decision makers on which criteria makes an antibiotic eligible for an incentive, and a design that allows the combined effect of multiple incentives to generate diversity in the armamentarium. To achieve this goal there needs to be a shared understanding between policy makers developing these financial incentives, stakeholders evaluating new antibiotics, and industry on which characteristics constitutes value in an antibiotic. Second, these incentives need to be implemented together with systems for continuous monitoring of new unmet needs and communication when needs have been met. Regulatory authorities and HTA agencies could play an important role informing this process, since their evaluations of new antibiotics heavily influence the value.

Marketing authorization of antibiotics based on limited clinical data, made possible by changes to regulatory requirements, introduces uncertainties regarding the properties of the drug as well as its value [61]. These uncertainties reside within regulatory authorities, which is expected, since the need for strategies to combat antibiotic resistance will likely be never ending and must adapt over time. However, these uncertainties also seem to transmit to key stakeholders—HTA agencies, payers, health care professionals—involved in delivering antibiotics to patients, who may not agree on the value of a particular antibiotic based on the available data. The misalignment between the regulatory authorities and HTA agencies in generating evidence to assess new antibiotics when data are limited highlights this problem. In the current situation HTA agencies have varied influence on antibiotic prices across Europe depending on the country. However, the use of HTA is increasing, efforts are under way to harmonize the HTA processes across Europe, and new economic incentives increasing the return on investment for new antibiotics are being promoted. Accordingly, the HTA process will likely play an important role in assuring funds are allocated in a way that strengthens the antibiotic armamentarium. In addition, there have been concerns that limited clinical data could lead to HTAs, and in extension pricing and reimbursement decisions, varying between countries which would undermine the development of pooled funding to finance new economic models to stimulate antibiotic R&D [61]. Therefore, to reduce misalignment between the marketing authorization and HTA processes there is a need for increased collaboration between regulatory authorities and HTA agencies on how to deal with limited clinical data and the development of a shared understanding of what constituted an unmet medical need.

Another example of how uncertainty generated from limited clinical data transmit to other stakeholder is a greater responsibility put on clinicians to manage the use of new antibiotics if data on specific patient groups is not available. In addition, these antibiotics will be considered last line treatments which puts additional responsibility on clinicians to avoid unnecessary use. This is supported by research showing that approval based on limited clinical data has been linked to increased safety risks leading to safety actions as well as increased off-label use [11, 38, 62]. Since antibiotics can be prescribed by any physician, regardless of specialization, and in some cases over the counter, the medical community needs to take an active approach to the adaptations made to the regulatory authorization process and develop strategies to assure new antibiotics are used in a safe and responsible way.

Clinical data for new antibiotics will likely continue to be difficult to generate in a timely fashion with respect to country-level reimbursement decisions. At the same time, countries will increasingly need new antibiotics in response to increasing resistance, which is why interventions to stimulate antibiotic R&D is urgently needed. Developing a shared understanding of what constitutes unmet medical need and how to measure value of new antibiotics are important features of this process [37]. A starting point for this work could be the criteria used in the development of the WHO priority pathogen list [44], or the list of factors suggested to be added to the HTA process of new antibiotics to capture the true public health value of new antibiotics [35]. Both these lists of factors aim to identify characteristics that makes the antibiotic valuable to patients and society. A selection of them could make up a shared base for evaluating a drug’s value. Regulatory authorities and HTA agencies may play a key role in aligning the view of what constitutes an unmet medical need and assure that antibiotics’ full value to health care systems is recognized in the reimbursement process [35], thereby directing new economic models to motivate diversity in the antibiotic armamentarium.

This study has a number of strengths and limitations. Our research group has experience in multiple fields including clinical medicine, drug monitoring and responsible use, public health, regulatory approval, quantitative and qualitative research which has enriched the discussions and understanding of the findings. While all members of the team have experience working in international collaborations, the authors originate from and work in the Nordics. None of the authors have experience working in the pharmaceutical industry. These factors likely influence our views of what potential barriers and facilitators to antibiotic R&D and market introduction may be. We struggled to recruit participants experienced with HTA of antibiotics. This is explained by the fact that few antibiotics have been developed in recent years, and that many countries do not conduct HTA routinely for new antibiotics. Stronger representation from participants solely working in HTA would likely have enriched the data and possibly revealed other aspects not identified in the data we gathered. However, the participants included in the study are well-experienced in antibiotic evaluation and associated with strong and solid medical agencies in Europe and the US. It would have been valuable to add regulatory authorities and HTA agencies from other countries outside of the US and Europe, but this was not possible due to limited resources. For example, inclusion of participants from PMDA in Japan could have offered an interesting aspect to our data, since antibiotics developed in Asia (mainly Japan) are subjected to initial assessment in Japan and in many cases struggle to gain access to markets outside of Asia. Given that the field of antibiotic approval and assessment is small, with few individuals specialized in antibiotics, we were not able to disclose specific agencies and countries and at the same time uphold anonymity of the study participants. While the purpose of this research was not to examine differences between countries, information regarding country setting would have allowed for more in-depth analysis of primarily the challenges and facilitators linked to HTA. Early on it also became clear that participants were not willing to discuss specific antibiotics for the same reason. However, we do not believe that this renders our findings or conclusions invalid. The interviews were conducted over 18 months. Given that much is happening in the regulatory and HTA areas, views could have differed between groups not due to actual differences of opinion but changes in perspectives over time. Additional research is needed to further explore the development and implementation of HTA, for antibiotics, including the implications of current efforts to harmonize the HTA processes in Europe [63]. Finally, exploring the views of the pharmaceutical industry regarding the value of efforts by regulatory authorities and HTA agencies to stimulate antibiotic R&D would be an interesting expansion of research on their role in this domain.

Conclusions

A shared understanding of limited clinical data and how to deal with this issue is needed amongst stakeholders involved in antibiotic R&D and market introduction to ensure antibiotics reach the market before resistance levels are out of control. Regulatory authorities and HTA agencies, while not considering themselves able to impact antibiotic R&D, could play a more active role in aligning the view of what constitutes an unmet medical need and direct new economic models towards stimulating greater diversity in the antibiotic armamentarium.

References

  1. Wellcome Trust. The growing crisis in antibiotic R&D: opportunities for G20 member action to support sustainable innovation 2020. https://wellcome.org/sites/default/files/the-growing-crisis-for-antibiotic-r-and-d.pdf. Accessed 28 May 2022.

  2. World Health Organization. 2020 Antibacterial agents in clinical and preclinical development: an overview and analysis. Geneva. Licence: CC BY-NC-SA 3.0 IGO; 2021.

  3. Renwick M, Mossialos E. What are the economic barriers of antibiotic R&D and how can we overcome them? Expert Opin Drug Discov. 2018;13(10):889–92.

    Article  PubMed  Google Scholar 

  4. Luepke KH, Suda KJ, Boucher H, Russo RL, Bonney MW, Hunt TD, et al. Past, present, and future of antibacterial economics: increasing bacterial resistance, limited antibiotic pipeline, and societal implications. Pharmacotherapy J Hum Pharmacol Drug Therapy. 2017;37(1):71–84.

    Article  Google Scholar 

  5. DRIVE-AB. Revitalizing the antibiotic pipeline - Stimulating innovation while driving sustainable use and global access. 2018. http://drive-ab.eu/wp-content/uploads/2018/01/CHHJ5467-Drive-AB-Main-Report-180319-WEB.pdf. Accessed 25 May 2021.

  6. Renwick MJ, Brogan DM, Mossialos E. A systematic review and critical assessment of incentive strategies for discovery and development of novel antibiotics. J Antibiot. 2016;69(2):73–88.

    Article  CAS  Google Scholar 

  7. O'Neill J. Tackling drug-resistant infections globally: final report and recommendations. 2016.

  8. CIDRAP- Center for Infectious Disease Research and Policy. Plazomicin for tough infections: a tale of 2 clinical trials 2019. www.cidrap.umn.edu/news-perspective/2019/02/plazomicin-tough-infections-tale-2-clinical-trials.

  9. Nambiar S, Laessig K, Toerner J, Farley J, Cox E. Antibacterial drug development: challenges, recent developments, and future considerations. Clin Pharmacol Ther. 2014;96(2):147–9.

    Article  CAS  PubMed  Google Scholar 

  10. Nambiar S, Cavaleri M, Sato J. Achieving regulatory alignment for anti-infective clinical trials. ACS Infect Dis. 2020;6(6):1308–10.

    Article  CAS  PubMed  Google Scholar 

  11. Sinha MS, Kesselheim AS. Regulatory incentives for antibiotic drug development: a review of recent proposals. Bioorgan Med Chem. 2016;24(24):6446–51.

    Article  CAS  Google Scholar 

  12. McAuslane N, Liberti L, Connelly P. The confluence of accelerated regulatory and health technology assessment access pathways. Clin Pharmacol Ther. 2019;105(4):935–42.

    Article  PubMed  Google Scholar 

  13. European Medicines Agency. Guideline on the use of pharmacokinetics and pharmacodynamics in the development of antimicrobial medicinal products. Document EMA/CHMP/594085/. 2016.

  14. European Medicines Agency. Addendum to the guideline on the evaluation of medicinal products indicated for treatment of bacterial infections. Document EMA/CHMP/351889/. 2013.

  15. European Medicines Agency. Guideline on the evaluation of medicinal products indicated for treatment of bacterial infections. CPMP/EWP/558/95 rev 2. 2011.

  16. Food and Drug Administration. Qualified infectious disease product designation—questions and answers guidance for industry: Food and Drug Administration, U.S. Department of Health and Human Services 2018. https://www.fda.gov/media/148480/download. Accessed 25 May 2021.

  17. Food and Drug Administration. Antibacterial therapies for patients with an unmet medical need for the treatment of serious bacterial diseases guidance for industry: U.S. Department of Health and Human Services; 2014. https://www.fda.gov/media/86250/download. Accessed 25 May 2021.

  18. Food and Drug Administration. Establishing a list of qualifying pathogens under the Food and Drug Administration Safety and Innovation Act. Final rule. Fed Reg. 2014;79(108):32464–81.

    Google Scholar 

  19. Food and Drug Administration. Limited population pathway for antibacterial and antifungal drugs guidance for industry. 2018. https://www.fda.gov/media/113729/download. Accessed 25 May 2021.

  20. Kashoki M, Hanaizi Z, Yordanova S, Veselý R, Bouygues C, Llinares J, et al. A comparison of EMA and FDA decisions for new drug marketing applications 2014–2016: concordance, discordance, and why. Clin Pharmacol Ther. 2020;107(1):195–202.

    Article  PubMed  Google Scholar 

  21. Hirako M, McAuslane N, Salek S, Anderson C, Walker S. A comparison of the drug review process at five international regulatory agencies. Drug Inf J: DIJ/Drug Inf Assoc. 2007;41(3):291–308.

    Article  Google Scholar 

  22. Rawson NS. Time required for approval of new drugs in Canada, Australia, Sweden, the United Kingdom and the United States in 1996–1998. CMAJ. 2000;162(4):501–4.

    CAS  PubMed  PubMed Central  Google Scholar 

  23. Rawson NS. Canadian, European and United States new drug approval times now relatively similar. Regul Toxicol Pharmacol. 2018;96:121–6.

    Article  PubMed  Google Scholar 

  24. Joppi R, Bertele V, Vannini T, Garattini S, Banzi R. Food and Drug Administration vs European Medicines Agency: review times and clinical evidence on novel drugs at the time of approval. Br J Clin Pharmacol. 2020;86(1):170–4.

    Article  PubMed  Google Scholar 

  25. Alqahtani S, Seoane-Vazquez E, Rodriguez-Monguio R, Eguale T. Priority review drugs approved by the FDA and the EMA: time for international regulatory harmonization of pharmaceuticals? Pharmacoepidemiol Drug Saf. 2015;24(7):709–15.

    Article  PubMed  Google Scholar 

  26. Boucaud-Maitre D, Altman J-J. Do the EMA accelerated assessment procedure and the FDA priority review ensure a therapeutic added value? 2006–2015: a cohort study. Eur J Clin Pharmacol. 2016;72(10):1275–81.

    Article  CAS  PubMed  Google Scholar 

  27. Downing NS, Aminawung JA, Shah ND, Braunstein JB, Krumholz HM, Ross JS. Regulatory review of novel therapeutics—comparison of three regulatory agencies. N Engl J Med. 2012;366(24):2284–93.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Dörr P, Wadworth A, Wang T, McAuslane N, Liberti L. An analysis of regulatory timing and outcomes for new drug applications submitted to Swissmedic: comparison with the US Food and Drug Administration and the European Medicines Agency. Ther Innov Regul Sci Regul Sci. 2016;50(6):734–42.

    Article  Google Scholar 

  29. The International Network of Agencies for Health Technology Assessment. HTA glossary. http://htaglossary.net/health+technology+assessment. Accessed 25 May 2021.

  30. Schaffer SK, West P, Towse A, Henshall C, Mestre-Ferrandiz J, Masterton R, et al. Assessing the value of new antibiotics: additional elements of value for health technology assessment decisions. London: The Office of Health Economics; 2017.

    Google Scholar 

  31. Zentner A, Velasco-Garrido M, Busse R. Methods for the comparative evaluation of pharmaceuticals. GMS Health Technology Assessment. 2005;1.

  32. Angelis A, Lange A, Kanavos P. Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries. Eur J Health Econ. 2018;19(1):123–52.

    Article  PubMed  Google Scholar 

  33. Neri M, Hampson G, Henshall C, Towse A. HTA and payment mechanisms for new drugs to tackle AMR. 2019.

  34. Vogler S, Paris V, Ferrario A, Wirtz VJ, de Joncheere K, Schneider P, et al. How can pricing and reimbursement policies improve affordable access to medicines? Lessons learned from European countries. Appl Health Econ Health Policy. 2017;15(3):307–21.

    Article  PubMed  Google Scholar 

  35. Colson AR, Morton A, Årdal C, Chalkidou K, Davies SC, Garrison LP, et al. Antimicrobial resistance: is health technology assessment part of the solution or part of the problem? Value in Health. 2021.

  36. Kållberg C, Årdal C, Salvesen Blix H, Klein E, Martinez EM, Lindbæk M, et al. Introduction and geographic availability of new antibiotics approved between 1999 and 2014. PLoS ONE. 2018;13(10): e0205166.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Vreman RA, Heikkinen I, Schuurman A, Sapede C, Garcia JL, Hedberg N, et al. Unmet medical need: an introduction to definitions and stakeholder perceptions. Value Health. 2019;22(11):1275–82.

    Article  PubMed  Google Scholar 

  38. Boucher HW, Ambrose PG, Chambers H, Ebright RH, Jezek A, Murray BE, et al. White paper: developing antimicrobial drugs for resistant pathogens, narrow-spectrum indications, and unmet needs. J Infect Dis. 2017;216(2):228–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Morton A, Colson A, Leporowski A, Trett A, Bhatti T, Laxminarayan R. How should the value attributes of novel antibiotics be considered in reimbursement decision making? MDM Policy Pract. 2019;4(2):2381468319892237.

    PubMed  PubMed Central  Google Scholar 

  40. Tong A, Sainsbury P, Craig JJIjfqihc. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. 2007;19(6):349–57.

  41. European Medicines Agency. Medicines. https://www.ema.europa.eu/en/medicines. Accessed 4 Oct 2022.

  42. Food and Drug Administration. Drugs@FDA: FDA Approved Drug Product. https://www.accessdata.fda.gov/scripts/cder/daf/index.cfm. Accessed 4 Oct 2022.

  43. World Health Organization. Antibacterial agents in clinical development: an analysis of the antibacterial clinical development pipeline, including tuberculosis. World Health Organization; 2017.

  44. Tacconelli E, Carrara E, Savoldi A, Harbarth S, Mendelson M, Monnet DL, et al. Discovery, research, and development of new antibiotics: the WHO priority list of antibiotic-resistant bacteria and tuberculosis. Lancet Infect Dis. 2018;18(3):318–27.

    Article  PubMed  Google Scholar 

  45. Food and Drug Administration. Guidance for industry expedited programs for serious conditions–drugs and biologics: Food and Drug Administration, U.S. Department of Health and Human Services; 2014. https://www.fda.gov/media/86377/download.

  46. European Medicines Agency London. PRIME: priority medicines. https://www.ema.europa.eu/en/human-regulatory/research-development/prime-priority-medicines. Accessed 25 May 2021.

  47. European Medicines Agency. Final report on the adaptive pathways pilot. European Medicines Agency London, UK; 2016.

  48. European Medicines Agency. Fast track routes for medicines that address unmet medical needs 2015. https://www.ema.europa.eu/en/news/fast-track-routes-medicines-address-unmet-medical-needs. Accessed 2 Mar 2023.

  49. Food and Drug Administration. Compilation of CDER New Molecular Entity (NME) Drug and New Biologic Approvals—Data Dictionary 2023. https://www.fda.gov/media/135308/download. Accessed 3 Mar 2023.

  50. European Medicines Agency. Innovative medicine 2023. https://www.ema.europa.eu/en/glossary/innovative-medicine. Accessed 5 Mar 2023.

  51. Food and Drug Administration. Novel Drug Approvals for 2022 2023. https://www.fda.gov/drugs/new-drugs-fda-cders-new-molecular-entities-and-new-therapeutic-biological-products/novel-drug-approvals-2022. Accessed 5 Mar 2023.

  52. European Medicines Agency. Veterinary regulatory 2023. https://www.ema.europa.eu/en/veterinary-regulatory/research-development/scientific-guidelines/novel-therapies. Accessed 5 Mar 2023.

  53. Nicod E. Why do health technology assessment coverage recommendations for the same drugs differ across settings? Applying a mixed methods framework to systematically compare orphan drug decisions in four European countries. Eur J Health Econ. 2017;18(6):715–30.

    Article  PubMed  Google Scholar 

  54. Yin RK. Qualitative research from start to finish. New York: Guilford Publications; 2015.

    Google Scholar 

  55. Fusch PI, Ness LR. Are we there yet? Data saturation in qualitative research. Qualitative Rep. 2015;20(9):1408.

    Google Scholar 

  56. Braun V, Clarke VJQrip. Using thematic analysis in psychology. 2006;3(2):77-101

  57. Cassell C, Symon G. Essential guide to qualitative methods in organizational research. Thousand Oaks: Sage; 2004.

    Book  Google Scholar 

  58. Bazeley P. Analysing qualitative data: more than ‘identifying themes.’ Malay J Qual Res. 2009;2(2):6–22.

    Google Scholar 

  59. NVivo qualitative data analysis software, version 12.: QSR International Pty Ltd.; 2018 https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home.

  60. Theuretzbacher U. Antibiotic innovation for future public health needs. Clin Microbiol Infect. 2017;23(10):713–7.

    Article  CAS  PubMed  Google Scholar 

  61. Vella Bonanno P, Ermisch M, Godman B, Martin AP, Van Den Bergh J, Bezmelnitsyna L, et al. Adaptive pathways: possible next steps for payers in preparation for their potential implementation. Front Pharmacol. 2017;8:497.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Wallach JD, Ross JS, Naci H. The US Food and Drug Administration’s expedited approval programs: evidentiary standards, regulatory trade-offs, and potential improvements. Clin Trials. 2018;15(3):219–29.

    Article  PubMed  Google Scholar 

  63. European Commission. EUnetHTA 2023. https://www.eunethta.eu/about-eunethta/. Accessed 8 Mar 2023.

Download references

Acknowledgements

We would like to thank the participants of this study, as well as people who shared information about antibiotic assessment during the recruitment process. Reflexivity analysis: CK works as a clinical doctor at the urgent care centre in Oslo. She is currently doing a PhD at the Norwegian Institute of Public Health (NIPH), supervised by HSB. Her work focuses on market introduction of antibiotics. HSB has a background and PhD in clinical pharmacy and pharmacotherapy. She currently works as a senior researcher at NIPH and professor at the University of Oslo (UiO). Her work primarily focuses on drug statistics, antibiotic use, and antibiotic classification. LM has a background in clinical pharmacy and pharmacotherapy and has worked at the Norwegian medicines agency and functioned as a clinical assessor, alternate member of CHMP, and member of the Infectious Disease Working Party at the EMA. She currently works as an associate professor at the section for pharmacology and pharmaceutical biosciences at the UiO. UG has a background and PhD in clinical medicine. He currently works as a senior researcher at the department for global health at the NIPH primarily conducting research on health policy and global health governance, including R&D and access to medicines.

Funding

Open access fee was covered by a membership agreement the Norwegian Institute of Public Health (NIPH) have with BioMed Central. This research is part of the PhD program at the Faculty of Medicine at the University of Oslo, conducted at the NIPH within the project DRIVE-AB. DRIVE-AB was supported by the IMI Joint Undertaking under the DRIVE-AB grant agreement number 115618, the resources of which are composed of financial contribution from the European Union’s 7th Framework Programme and the European Federation of Pharmaceutical Industries and Associations companies’ in-kind contribution. The funding organizations did not participate in design of the study, collection, analysis, interpretation of data, or in writing the final article.

Author information

Authors and Affiliations

Authors

Contributions

CK, HSB, LM designed the study and developed the interview guide. CK sent out the invitation to participate in the study based on lists of potential participants discussed within the research group. CK conducted the primary analyzes. UG supported the process by overseeing the use of method and by giving guidance. HSB and LM conducted a secondary independent analyzes. Finding were discussed within the research group. CK drafted the article. HSB, LM and UG commented on the draft and contributed to the writing. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Cecilia Kållberg.

Ethics declarations

Ethics approval and consent to participate

This research proposal was submitted to the Norwegian Centre for Research Data (NSD), and the Norwegian Regional Committees for medical and health research ethics (REC) was approached, but the research was not considered in need of approval. Written or oral consent to participate in the study, including whether the participant was comfortable with the interview being audiotaped, was obtained before the interview from all participants.

Competing interests

The authors declare that they do not have any competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Consolidated criteria for reporting qualitative studies (COREQ): 32-item checklist.

Additional file 2.

Interview guide for semi-structured stakeholder interviews.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kållberg, C., Mathiesen, L., Gopinathan, U. et al. The role of drug regulatory authorities and health technology assessment agencies in shaping incentives for antibiotic R&D: a qualitative study. J of Pharm Policy and Pract 16, 53 (2023). https://doi.org/10.1186/s40545-023-00556-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40545-023-00556-x

Keywords