Year: 2020
Type: editorial
Abstract: Traffic is increasing across evaluation's interdisciplinary boundary with political science.This is unsurprising.Evaluation is now well-institutionalised within policy systems, and evaluation itself having migrated from projects to programmes nowadays increasingly investigates policies or even strategies.This issue begins with four articles that sit squarely on this boundary.They are followed by four further articles that take a methodologically rigorous -and theoretically informed -approach to qualitative evaluation.Niklas Andreas Andersen argues that research into the institutionalisation of evaluation in different evaluation systems moves our attention away from the traditional focus on 'evaluation use' in discrete evaluations.Andersen's study of active labour market policies in Denmark 'aims to empirically examine whether and how the distinct features of evaluation systems also mark new forms of evaluation use and influence'.Evaluation systems, promoted as a topic of research interest by Leeuw and Furubo in Evaluation 14 (2), 2008, is one theoretical startingpoint for Andersen.Another is Peter Dahler Larsen's notions of 'constitutive effects'.According to the author, the institutionalisation of evaluation within government goes beyond support for the 'instrumental uses' of evaluation.The way evaluation is woven into policy systems 'come to structure the language and interactions of policymaking'.Andersen argues this is not without risk in particular when evaluation is used to strengthen technical assessments of policy 'downplaying the open deliberation on goals and values, which is also a central and necessary component of policymaking'.Shushu Chen and Ian Henry set out to 'unpack the complexity' when evaluating Olympic impacts by focusing on 'legacy claims', one of the main justifications for the enormous upfront investments that all Olympic host countries must make, despite uncertain benefits.Evaluating 'big events' and their consequence has become more common in recent years -exemplified by McCartney, Hanlon and Bond's ideas of how the 2014 Glasgow Commonwealth Games should be evaluated, and Busetti and Dente's evaluation of Expo Milano 2015 (see Evaluation 19 (1) and 23 (3), respectively).Chen and Henry observe that most assessments of Olympic legacy 'only attempt to tell us whether or not impacts and legacies have been created [. ...] but not how those impacts were generated, by whom or/and in what circumstances'.The authors rely on 'theory-based' evaluation thinking and 'Process Tracing' (PT) methods (Busetti and Dente also relied on PT).As is often the case in evaluation, it is only after theoretical and methodological innovation that it becomes possible to take on new 'evaluation objects'.According to Chen and Henry, it is 'theoretical rather than more complex methodological efforts [that] are most needed'.Guillaume Fontaine provides another example of traffic across the policy/evaluation frontier.The methodological and ontological arguments in this article are not for the faint-hearted!943311E VI0010.
Source: Evaluation
Author: Elliot Stern
Language: Spanish
Subfield: Public Administration
Field: Social Sciences
Domain: Social Sciences
Open Access status: bronze
OpenAlex ID: W4242999495
