Promoted to be the “gold standard” of evaluation, counterfactual evaluation is on the rise.
This is one of the many findings from the new fteval cooperative study jointly conducted by SME Research Austria, Joanneum Research, and WPZ Research.
Counterfactual evaluations look at points A and B in time to see how policy interventions have had an effect. Their appeal is quantification – a number in the end to legitimise their findings.
What happens when we ignore what is between A and B? What impact could counterfactual evaluations have? And what wishes do we further have for this method and the evaluation community?
In this REvaluation podcast episode, we talk with Jakob Kofler from KMU Forschung Austria (SME Research Austria) about methods, conclusions, and recommendations.
Resources:
- The study (in German): Chancen & Grenzen kontrafaktischer Wirkungsanalysen für die österreichische FTI-Politik – eine Situationsanalyse – fteval repository
- Training in Vienna on 23 November 2026 (in German): Trainingsangebot: Kontrafaktische Wirkungsanalysen in österreichischen FTI-Evaluationen – fteval
- SIP talk with the Austrian Council on counterfactual evaluations on 19 October 2026, in German: https://forwit.at/sip-talk/kausalanalysen-in-der-oesterreichischen-fti-evaluierung/
- Kausalanalysen in der österreichischen FTI-Evaluierung – FORWIT (in German)
- Related previous podcast episode: Folge #8 – Das AMDC: Für verknüpfte Mikrodaten ziehen wir alle Register – fteval (in German)
- Subscription Newsletter – fteval (EN) & Newsletter – fteval (DE)
Music: Urbana-Metronica (wooh-yeah mix) (ft. Morusque, Jeris, CSoul, Alex Beroza) by spinningmerkaba http://ccmixter.org/people/jlbrock44; SouljaUnit Remix of DeadRobot Music’s Surfy via https://freesound.org/people/SouljaUnit/sounds/640175/
Photo: Johnny Be Good