LogoLogo
- BACK TO THE GFMD WEBSITE+ SUBSCRIBE TO THE GFMD IMPACT NEWSLETTER
  • Welcome to GFMD IMPACT
  • Learning meetings
    • 2025
      • From crisis to opportunity: reimagining media development in the MENA region (Apr. 2025)
        • Meeting Agenda
        • Literature Review
          • Lebanon
          • Palestine
          • Syria
          • MENA region
          • Frameworks, Guidelines and Recommendations
      • Connecting the dots: How to use existing mechanisms to protect media freedom online? (Jan. 2025)
    • 2024
      • GFMD Levant Regional Meeting on Media Support (Dec. 2024)
        • Mapping report
        • Key Recommendations
        • Meeting Agenda
        • Literature Review
          • Lebanon
          • Palestine
          • Syria
          • MENA region
          • Frameworks, Guidelines and Recommendations
      • Post-Summit of the Future Updates and Upcoming Opportunities (Nov. 2024)
      • UNDP–GFMD-SFCG Webinar: Media actors and the (de)construction of the ‘other’ (Oct. 2024)
        • Key insights from the meeting
        • Speakers
        • Literature review
      • Advocating for public interest media and journalism (Aug.-Sept.2024)
        • Donor Workshop: Donor Support for Locally Led Journalism and Media Advocacy (Sept. 2024)
          • Meeting agenda
        • Learning Call: Coordinating policy and advocacy working groups (Aug.2024)
          • Meeting agenda
        • Literature review
      • GFMD Regional Meeting for the wider European region (May 2024)
        • Mapping report
        • Meeting report
        • Meeting agenda
        • Literature review
      • GFMD Latin America & Caribbean Summit (May 2024)
        • Meeting report
        • Literature Review & Case Studies
      • Journalism Cloud Alliance Inaugural Meeting (Apr. 2024)
        • Meeting agenda
        • Speakers
        • Literature Review
        • Press release
      • PRIMED (Feb. - Mar. 2024)
        • Key takeaways
        • Workshop 1
          • Meeting agenda
          • Speakers
          • Literature review & case studies
        • Workshop 2
          • Meeting agenda
          • Speakers
          • Literature review & case studies
        • Workshop 3
          • Meeting agenda
          • Literature review & case studies
    • 2023
      • MENA regional meeting (Nov. 2023)
        • Lit review & case studies
        • Meeting report
      • National Journalism Funds (July 2023)
        • Lit' review & case studies
      • Philanthropy for Ukraine (Apr. '23)
      • Summit for Democracy (March. '23)
        • Media Freedom Cohort: key outcomes and findings
        • Thriving media for resilient democracies
        • Media viability in crisis
        • Other Summit for Democracy Events
      • National consultations on Media Viability (Jan.- Feb. '23)
        • Lebanon
        • Tunisia
        • Namibia
    • 2022
      • Challenges and perspectives for media support programs (Nov. '22)
      • World News Media Congress: Media Viability (Sept. '22)
        • Meeting Report
      • Investing in the future of independent journalism (Sept. '22)
        • Investing in independent media to strengthen democracy
        • Exploring new funding models: thinking brave and bold
        • Editorial sustainability: on ownership and media capture
        • Investing in people
        • Agenda
      • IAMCR 2022 (July '22)
      • World Press Freedom Day (Uruguay, May '22)
        • Principles for effective media assistance
        • Safety of journalists in Ukraine
      • Principles for effective mediadev Belgrade (April '22)
        • Coordination and local perspective
        • Suggestions for improving the support
        • Building digital competences
        • Positive examples
      • MFC Global Conference for Media Freedom (9 Feb. '22)
        • Sustainability & viability
          • How is sustainability defined and measured?
          • Cross-cutting themes
          • Achieving sustainability and viability
          • Initiatives to support media sustainability: an overview for donors and policy
          • Literature review
          • Meeting agenda
        • Renewing the principles for effective media support
          • Process of renewing the principles, development and pathways to implementation
          • Three pillars identified in the consultative process so far
          • Donor perspective- improved partnership
          • Improvements that would benefit the principles process
          • Moving forward with the Principles for Effective Media Development
        • Participation in other MFC events
      • Principles for effective mediadev (Jan. '22)
    • 2021
      • Theories of change & impact measurement (March '21)
        • Meeting agenda
        • Case studies
          • Theories of change in media and governance programmes
          • PRIMED - Protecting Independent Media for Effective Development
          • Measuring the impact of investigative reporting
        • Introduction to GFMD IMPACT
        • Feedback
      • Disinformation - Media support (June '21)
        • Introduction (efficacy of MediaDev responses)
        • 1. Identification responses
        • 2. Responses aimed at producers and distributors
        • 3. Impacting production and distribution mechanisms
        • 4. Supporting the target audiences of disinformation campaigns
        • 5. Evaluating counter-disinformation programmes
          • The Challenges of Evaluating Countering Disinformation Programs: A Working Paper (June 2021)
          • Tips for evaluators
        • 6. Research on disinformation
        • Literature review
        • Feedback
        • Meeting agenda
      • Principles for effective mediadev (Dec. '21)
        • In quotes - What should the principles look like?
        • Feedback
  • Resource centre
  • Activities & services
    • OECD Development Co-operation Principles for Relevant and Effective Support to Media and the Information Environment
    • Help desk
      • Report: Informing the Initial Priorities of IFPIM
      • Literature review on pooled funds
        • IFPIM
    • Learning meetings
  • Policy & Learning Meetings
    • Workshop on Encryption and Media Freedom (June '23)
      • Workshop Report
      • Resources
    • Gender Equality in Media Regulation (May '22)
      • Meeting Report
      • Literature Review
  • RESOURCES
    • Latest data, trends and issues facing journalism and media
    • Guides for donors & funders
    • Declarations
      • Events w/recommendations
    • Policy briefs, working papers & primers
      • Disinformation
      • Gender Equality
      • MediaDev effectiveness
      • Sustainability & viability
      • ... by donors & funders
      • + how to produce a policy brief
    • Academic studies & papers
      • AI, regulation, legislation & design of platforms
      • Disinformation
        • Support to journalism
        • Media & information literacy and fact-checking
      • Ethics & independence
      • Evaluation
      • Gender Equality
      • Investigative journalism
        • Collaborative journalism
      • Journalism, democracy & governance
      • Journalism training
      • MediaDev effectiveness
      • Sustainability & viability
      • Thematic reporting
    • Research & reports
      • AI, regulation, legislation & design of platforms
      • Disinformation
        • Support to journalism
        • Media & information literacy and fact-checking
      • Ethics & independence
      • Evaluation
      • Exiled media
      • Gender Equality in Media Development
      • Investigative journalism
      • Investment & innovation
      • Journalism, democracy & governance
      • Journalism training
      • MediaDev effectiveness
      • Media in fragile contexts
      • Sustainability & viability
        • Business models & start-ups
        • Support for Ukranian Media
      • Thematic reporting
    • Case studies
      • Disinformation
      • Gender Equality
      • Impact measurement, evaluation & learning
        • PRIMED learning questions
        • Measuring social impact
      • Investigative journalism
      • Investment & innovation
      • Research Programmes
      • Sustainability & viability
    • Articles
      • AI, regulation, legislation & design of platforms
      • Data & indicators
      • Ethics & independence
      • Disinformation
        • Support to journalism
        • Media & information literacy and fact-checking
        • Gendered disinformation
      • Gender Equality
      • Investigative journalism
      • Journalism, democracy & governance
      • MediaDev effectiveness
      • Media in fragile contexts
      • Sustainability & viability
        • Business models and start-ups
        • Support for Ukrainian Media
      • Thematic reporting
    • Podcasts
      • Sustainability & viability
    • Evaluation & impact reports
      • Disinformation
      • Emergency & crisis funding
      • Media & information literacy
    • Indicators
    • Data sources
    • Learning tools, interactive maps and applications
    • Glossary
    • Independent Media in Exile
  • OPPORTUNITIES
    • Calls for papers & submissions
    • Events
  • GFMD IMPACT BACKGROUND
    • Consultation (2019)
      • Recipient Perceptions of Media Development Assistance: A GFMD Study (Jan. 2019)
      • Donor feedback on GFMD’s concept for a media development policy Hub - (Sept. 2019)
    • Co-design (2020-2021)
    • Related projects and initiatives
      • Ariadne
      • BBC Media Action research and insight
      • CAMECO
      • CIMA
        • CIMA - Putting Research to Work: Scholars and Practitioners Discuss Greater Collaboration (2016)
      • Civitates
      • Communication Initiative
      • Council of Foundations
      • Dafne
      • Forum Media and Development - FoME (Germany)
      • Global Partnership for Effective Development Co-operation
      • Human Rights Funders Network
      • Humanitarian Journalism
      • Journalism Funders Forum
      • Media Impact Funders
      • Media Impact Project
      • Network for European Foundations (NEF)
      • OECD - DAC Network on Governance (GovNet)
      • Government agencies
  • SUBSCRIBE TO:
    • MediaDev Insider (GFMD IMPACT's newsletter)
    • GFMD's LinkedIn newsletter
  • ABOUT
    • About GFMD IMPACT & FAQs
    • Give feedback
    • GFMD IMPACT regional coordinators
    • GFMD IMPACT pool of consultants
    • About GFMD
    • GFMD coordination
    • GFMD homepage
Powered by GitBook
On this page
  • THE CASE STUDY
  • Literature review
  • Recommendations
  • BREAKOUT GROUP DISCUSSION
  • Summary
  • Benefits of using theories of change
  • Using theories of change with 'result chains'
  • Limits of 'result chains'
  • Unrealistic expectations
  • Macro and micro Theories of Change
  • Why donors use theories of change
  • Research collaboration
  • Operationalise the use of theories of change
  • Indicators for impact evaluation
  • References and recommended reading:

Was this helpful?

Export as PDF
  1. Learning meetings
  2. 2021
  3. Theories of change & impact measurement (March '21)
  4. Case studies

Theories of change in media and governance programmes

THE CASE STUDY

The Swiss Agency for Development and Cooperation (SDC) commissioned research into the use of theories of change in media and governance programmes after a survey of SDC staff who manage media projects showed that measuring effectiveness in media support, building proper M & E systems, and setting realistic expectations was a broadly shared challenge.

Fondation Hirondelle, which began integrating theories of change related to governance into their strategic and project programming around 2017 at the behest of donors, reported that they benefited from participating in the study as it helped identify the gaps, assumptions and factors beyond the scope of working with journalists and newsroom. This evidence helped them become more realistic about what impact is possible in the field of content production and what are reasonable expectations of donors.

The research reviewed:

  • 56 programme documents on media and governance (communication for development programmes were excluded) provided by SDC, Fondation Hirondelle, Free Press Unlimited, BBC Media Action and DW Academy

  • 140 academic journal articles on the empirical studies on media effects

The aims of the research were:

  • To see if there are similar patterns in the theories of change used in international media support.

  • To understand the building blocks for media support in the field of governance.

  • To establish an overview of the research evidence of what actually works in media support, specifically in resource-poor and fragile contexts.

The full report is available to read here:

The Use of Theories of Change in Media and Governance Programmes (2019)

The main findings from the study were:

  1. While all media projects use theories of change, they are mostly a repetition of the logframe.

  2. Media projects should formulate more detailed theories of change, perhaps by using result chains.

Literature review

The study's literature review found only a handful of studies that use reliable methods to measure impact.

These studies found that media development programmes produced very limited evidence of impact in terms of governance, with the exception of some case studies looking at high-profile pieces of investigative journalism.

The study found that it was possible to measure the effect of news exposure on political interest but found no evidence that increased interest led to better governance.

Recommendations

Among other recommendations, the study proposes that the media development sector should look at increased usage of the result chains model as this can help identify what works in the field and what does not.

BREAKOUT GROUP DISCUSSION

Summary

There was broad recognition of media contribution to democratic and societal change albeit in the very long term.

It was also acknowledged that empirically proving a causal relationship between media support and democratic and governance indicators - even with a perfect evaluation and learning process on a project and programmatic level - is a difficult task and may only be possible when taking a much longer view.

Benefits of using theories of change

Some academics felt that expansive theories of change can help policymakers to think about systems in more holistic ways as it considers:

“Who is involved? Who makes change? Who do they collaborate with? Who are the people who are against the change? And so thinking about the context and systems of thinking and people-centred ways.”

Theories of change can also be adaptive and incorporate contribution analysis to understand how much a programme contributed to change.

Using theories of change with 'result chains'

It was suggested that donors should -- while considering the concerns about how and whose theories of change are used -- think more about using 'result chains' to complement theories of change.

  • The more detailed the theory of change is, the more realistic and relevant to the situation on the ground it has the potential to be.

  • More detailed theories of change that incorporate 'result chains' are especially important since evidence on what really works in media development is currently limited.

  • To be effective, theories of change and 'result chains' should be developed in genuine partnership with organisations that will implement, contribute to or benefit from the programmes.

Limits of 'result chains'

While there was a strong case made for focusing on 'result chains' in order to better understand and measure impact, there were words of caution about focusing on measuring impact solely in a linear, cause-and-effect, way. It was noted that a lot of change and a lot of the most important work is not predictable from the outset of a project.

Unrealistic expectations

Some media development practitioners reported that:

  • They did not feel able to be frank with donors about how big a crisis independent journalism is facing and how hard their work has become. This has led to committing to unrealistic goals in order to access funding.

  • As a consequence of "shooting for the moon" in order to get funding, change processes are sometimes oversimplified to suit the results frameworks of donors and other aid management formats.

  • As well as a frank dialogue about what is really achievable, practitioners also urged donors to take a longer-term view.

Macro and micro Theories of Change

  • There is no “one-size-fits-all” theory of change for media programmes.

  • Some researchers in the group expressed scepticism about how appropriate general theories of change are for small and short-term media development projects.

  • Putting a burden of proof for a societal theory of change to individual media support projects was seen as unrealistic.

  • Donors were advised to avoid having too big expectations when it comes to the impact of media support on governance.

Why donors use theories of change

As well as the benefits of using theories of change noted above, it was recognised that many donors - especially those accountable to the public/taxpayers - will continue to use theories of change as they need to demonstrate how media support is contributing to society and in democratic life to justify support for media development.

This highlights the need for greater understanding between donors, media development practitioners and researchers of their different perspectives about the challenges facing the sector and the choices that we are making based on those different assessments of the problems.

Research collaboration

Operationalise the use of theories of change

There was considerable enthusiasm for more collaborative research with donors and implementers on how to operationalise the use of theories of change in a way that reflects the complex realities of media support.

One suggestion was to look to create different families of theories of change similar to USAID's conflict management and mitigation office manual, which offers different theories of change for different projects in different settings.

Indicators for impact evaluation

There was an interest expressed in working to standardise indicators for impact evaluation across the sector to allow for comparisons and learning from other projects. It was suggested that a critical review of output, outcome and impact level indicators could allow for some of the standardisation to happen.

Some members of the group thought that such attempts might be premature and the sector has some way to go to reach the threshold of common standards and still has a great diversity of strategies and approaches with lots of unspoken assumptions about how change happens in newsrooms and media systems.

References and recommended reading:

  • The Use of Theories of Change in Media and Governance Programmes (2019)

PreviousCase studiesNextPRIMED - Protecting Independent Media for Effective Development

Last updated 1 year ago

Was this helpful?

The role of media in creating inclusive, just and peaceful societies - Guidelines for SDC media assistance (2020)
Page cover image