Economic Evaluation: A Thorough Guide to Assessing Value in Health and Public Policy

Economic Evaluation: A Thorough Guide to Assessing Value in Health and Public Policy

Pre

Introduction to Economic Evaluation

Economic evaluation is the systematic process of comparing the costs and consequences of two or more alternatives to determine which option provides the best value for money. In public policy, health care, and social programmes, decisions are rarely made in a vacuum. Budgets are finite, needs are diverse, and stakeholders expect interventions to deliver meaningful benefit without imposing unsustainable costs. The core aim of the economic evaluation framework is to equip decision makers with transparent, comparable evidence that helps prioritise investments, maximise social welfare, and reduce waste.

At its heart, economic evaluation blends economics, clinical outcomes and practical realities. It asks questions such as: What resources are required to implement an intervention? What benefits will the population receive, and how can those benefits be measured and valued? What is the best use of scarce funds given alternative uses of those funds? By answering these questions, the economic evaluation process supports consistent, defendable choices across programmes and time horizons.

Why Carry Out an Economic Evaluation?

Public sector organisations face competing demands: improving health, growing prosperity, and reducing health inequalities. An economic evaluation helps clarify whether a programme delivers enough impact to justify its costs, relative to other possible investments. It also supports pricing decisions, reimbursement strategies, and the prioritisation of limited resources in a fair and transparent manner.

Key reasons to undertake an economic evaluation include:

  • Demonstrating value for money to funders, clinicians and communities.
  • Providing a framework for comparing diverse interventions on a common scale.
  • Informing policy design and project selection, including the scale-up of successful initiatives.
  • Identifying drivers of cost and benefit, to guide efficiency improvements and innovation.

Key Methods in Economic Evaluation

There are several distinct approaches within the field of economic evaluation, each with its own focus and application. The choice of method depends on the decision problem, the perspective taken, and the nature of costs and outcomes.

Cost-Effectiveness Analysis (CEA)

In a cost-effectiveness analysis, costs are measured in monetary terms while outcomes are measured in natural units (such as life-years gained, cases avoided, or days of illness prevented). The result is usually a ratio that expresses the additional cost per unit of health outcome achieved. CEA is particularly useful when the objective is to improve a specific health endpoint and when comparators offer similar outcomes on different scales.

Cost-Utility Analysis (CUA)

The cost-utility analysis extends CEA by incorporating patient preferences over different health states. Outcomes are typically expressed as quality-adjusted life years (QALYs) or disability-adjusted life years (DALYs). This approach allows comparisons across very different interventions because the outcome is standardised into a common unit of wellbeing. CUA is widely used in health technology assessment and reimbursement decisions in many health systems.

Cost-Benefit Analysis (CBA)

In a cost-benefit analysis, both costs and benefits are monetised. This enables a straightforward calculation of net social benefit or net present value. CBAs can compare programmes across sectors (for example health versus education) but require careful valuation of intangible benefits and might entail ethical concerns about monetising certain health outcomes.

Cost-Minimisation Analysis (CMA)

When two or more interventions yield equivalent outcomes, a cost-minimisation analysis focuses solely on costs to identify the least costly option. CMA is appropriate only when equivalence of health effects is established with satisfactory certainty.

Budget Impact Analysis (BIA)

The budget impact analysis estimates the financial consequences of adopting a new intervention within a specific budget context and time horizon. While not a substitute for value-for-money assessment, BIA provides crucial information for budgeting, affordability planning and implementation logistics.

The Economic Evaluation Framework: Perspective and Time Horizon

Two foundational choices shape any economic evaluation: the perspective and the time horizon.

Perspective

The perspective determines which costs and benefits are included. Common perspectives include the healthcare payer, the healthcare system, the patient, and society as a whole. A economic evaluation from a societal perspective will incorporate indirect costs such as productivity losses or gains, informal care, and broader social impacts. Conversely, a payer or provider perspective focuses on direct medical costs and health outcomes. The chosen perspective influences both the data collected and the interpretation of value for money.

Time Horizon

The time horizon should be long enough to capture all relevant costs and outcomes. Short horizons risk underestimating long-term benefits or costs, especially for chronic conditions or preventive interventions. A lifetime horizon is common for many health technology assessments, while short horizons may be appropriate for acute treatments or programme pilots. In all cases, discounting future costs and benefits is standard practice to reflect time preference.

Measuring Costs and Outcomes: What to Include and How to Value Them

Accurate measurement is essential in any economic evaluation. Costs are grouped into categories and outcomes must be defined with clarity and relevance to stakeholders.

Costs: Direct, Indirect, and Intangible

Direct costs include resources consumed directly by the intervention (staff time, equipment, medications, consumables). Indirect costs capture productivity effects, such as hours of work lost due to illness or gained from recovery. Intangible costs address pain, suffering, or decreases in wellbeing, which can be difficult to quantify but are increasingly recognised in comprehensive assessments. Depending on the perspective, some of these costs are included or excluded. In society-wide economic evaluations, indirect costs often carry substantial weight.

Outcomes: Clinical, Quality of Life, and Utility

Outcomes may be clinical endpoints (disease progression, survival), patient-reported outcomes, or measures of quality of life. In economic evaluation, converting outcomes into a common metric like QALYs or patient utilities facilitates cross-intervention comparisons. The choice of outcome measure should reflect the decision problem and stakeholder preferences, not merely data availability.

Discounting and Time Preference in the Economic Evaluation

Future costs and benefits are worth less than immediate ones because of time preference and opportunity costs. In the UK, standard practice is to discount both costs and health outcomes at a common rate, with sensitivity analyses exploring alternative rates. Typical approaches apply rates such as 3.5% per year, though alternatives like 1.5% are used in sensitivity analyses. The goal is to ensure that conclusions remain robust under reasonable variations in time preference and to acknowledge the uncertainty inherent in forecasting far into the future.

Modelling Techniques in Economic Evaluation

To compare alternatives over extended time horizons or across complex pathways, analysts use modelling techniques to simulate outcomes and costs when direct data are incomplete or impractical to observe fully.

Decision Trees

Decision trees map possible intervention pathways as branches with associated probabilities, costs, and outcomes. They are well suited to short- to medium-term analyses where events do not recur in time or cycles are limited.

Markov Models

Markov models capture chronic processes with recurring events by categorising health states and simulating transitions over discrete time cycles. These models are powerful for chronic diseases and long-term interventions where state transitions matter for costs and outcomes.

Microsimulation

Microsimulation models simulate individual-level trajectories, allowing heterogeneity in patient characteristics and more nuanced capture of variability across populations. They are particularly valuable for tailoring decisions to subgroups or personalised medicine scenarios.

Data Sources and Quality in Economic Evaluation

High-quality data underpin credible economic evaluation results. Sources include randomised controlled trials, observational studies, registries, administrative data, and expert opinion when necessary. Some strategies to strengthen data quality include:

  • Systematic literature reviews to identify relevant evidence.
  • Meta-analyses to synthesise results across studies.
  • Transparency in data sources, assumptions, and limitations.
  • Justified value mappings for converting clinical outcomes to utility or monetary terms.

Dealing with Uncertainty in Economic Evaluation

Uncertainty is intrinsic to any economic evaluation. Analysts must explore how results change when key inputs vary. Two central approaches are:

  • Deterministic sensitivity analysis: Varies one or two parameters at a time to observe effect on outcomes.
  • Probabilistic sensitivity analysis: Assigns probability distributions to uncertain parameters and runs many simulations to produce a confidence envelope around results.

Additionally, value-of-information analyses can help determine which data would most improve decision confidence, guiding future research priorities. Transparent communication of uncertainty—through acceptability curves, confidence intervals, and scenario analyses—is essential for credible policy guidance.

Reporting and Interpretation: Making Results Useful to Decision Makers

Clear reporting is as important as methodological rigour in economic evaluation. Stakeholders require not only the estimated value-for-money but also the assumptions, data sources, perspective, and limitations used to derive results. The CHEERS (Consolidated Health Economic Evaluation Reporting Standards) checklist is widely used to promote consistency and completeness in reporting, covering study design, data sources, modelling methods, results, and limitations.

Interpreting results involves more than calculating a ratio. Decision makers should consider the broader policy context, equity implications, implementation feasibility, budget impact, and ethical considerations. A favourable economic evaluation outcome does not automatically compel adoption if there are significant practical barriers or inequitable effects. Conversely, a modest cost per unit of benefit may be compelling when the population impact is large or the organisation must stretch scarce resources further.

Economic Evaluation in the UK and Europe: Policy Context

In the United Kingdom and much of Europe, the adepts of economic evaluation play a central role in determining technology adoption and funding. National bodies such as NICE consider cost-effectiveness thresholds alongside clinical effectiveness, equity, and system impact. Local authorities and hospital trusts may perform supplementary analyses to inform commissioning, prioritisation, and service design. The evolving policy landscape emphasises real-world effectiveness, patient-centred outcomes, and value-for-money across a broad range of sectors beyond health, including social care and public health initiatives.

Practical Steps to Conduct an Economic Evaluation

For teams new to this discipline, a practical, structured approach helps ensure comprehensiveness and clarity. Consider the following steps as a scaffold for an economic evaluation project:

  • Define the decision problem, including the intervention, comparator, target population, and perspective.
  • Set the time horizon and discount rates consistent with guidelines and stakeholder expectations.
  • Identify and measure costs and outcomes, selecting appropriate data sources and ensuring comparability.
  • Choose the modelling approach (decision tree, Markov model, or microsimulation) aligned with the complexity of the problem.
  • Populate the model with credible data, calibrate assumptions, and test internal consistency.
  • Conduct deterministic and probabilistic sensitivity analyses to probe uncertainty.
  • Present results with full transparency, including confidence intervals or acceptability curves and scenario analyses.
  • Interpret findings in light of policy goals, equity considerations, and implementation feasibility.

Common Pitfalls and Ethical Considerations

Economic evaluation is not free from challenges. Common pitfalls include underestimating indirect costs, over-reliance on a single data source, or framing that favours a particular intervention. Ethical considerations arise when monetising health outcomes or when cost-effectiveness thresholds may conflict with equity objectives. A robust economic evaluation acknowledges trade-offs, is explicit about assumptions, and favours transparent, defensible decision-making over simple numerics.

Case Studies: Illustrative Examples of Economic Evaluation in Practice

Vaccination Programme Evaluation

A national vaccination programme may be assessed through a cost-effectiveness analysis and a cost-utility analysis to establish value for money and population health impact. By modelling disease averted, hospitalisations prevented, and quality-of-life gains, policymakers weigh programme costs against long-term savings. The societal perspective can capture productivity benefits from healthier populations, strengthening the case for broad uptake and early implementation.

Chronic Disease Management: A Diabetes Care Pathway

Evaluating a diabetes care pathway might combine a Markov model with QALY outcomes to compare standard care versus an enhanced integrated approach. The analysis would consider medication costs, monitoring, educational support, and hospital admissions, alongside long-term complications. Sensitivity analyses would explore variations in adherence, price fluctuations for drugs, and different discount rates to reflect uncertainty in real-world practice.

Public Health Intervention: Smoking Cessation Services

Economic evaluation of smoking cessation services often demonstrates substantial cost savings through averted cardiovascular events and reduced hospital stays. A combination of CEA and BIA helps quantify the health gains and budgetary implications for local authorities. Equity considerations may prioritise programmes that demonstrably reach high-risk populations, ensuring that value-for-money translates into meaningful public health gains across communities.

Conclusion: The Value of Rigorous Economic Evaluation

Economic evaluation is a powerful tool for guiding resource allocation in health and public policy. By systematically weighing costs and consequences, it clarifies value for money, supports transparent decision-making, and helps ensure that scarce resources deliver maximal benefit. Whether through CEA, CUA, CMA, CBA, or BIA, the economic evaluation process brings structure, comparability and accountability to policy design. As health systems and social programmes navigate increasingly complex challenges, robust, well-communicated economic evaluation remains essential for advancing patient welfare, fiscal responsibility, and equitable outcomes across society.