Work

What does a great meta-analysis look like?

Year: 2011
Type: editorial
Abstract: In the first issue of Organizational Psychology Review, Daan van Knippenberg stated that I would be elaborating on the issue of what makes a good meta-analysis (van Knippenberg, 2011).Given this call to action (or one could say burden of responsibility), I have taken it upon myself to pull together some thoughts on what I believe authors should be striving for in producing meta-analyses, as well as trying to provide a roadmap for authors who are considering submitting a meta-analysis to OPR.What I will not be doing is providing a treatise on the mechanics of conducting a metaanalysis, as there are a multitude of books, articles, and other training materials that do a better job than I could ever hope to do. Meta-analyses: Not your grandfather's review papersWhenever I read a new article employing meta-analytic techniques, I am amazed at the whiz-bang gizmos and the newfangled statistical processes being employed.This reminds me in many ways of watching movies that are promoted as having the best, most realistic special effects ever seen in the history of the world!My purpose in watching a movie is not to be awed by what a group of people were able to create on a computer, but to instead enjoy the story.If I notice the special effects, my belief is that the director is not doing his/her job.The same goes for a meta-analysis: the purpose of a meta-analysis is not to promote the cool new techniques you used, but to tell a story.As an aside, this applies to any paper that involves statistics, not just meta-analyses.What authors (and reviewers) often forget is that a meta-analysis is at its core a review paper.When Glass (1976) first introduced the ''analysis of analyses,'' he was trying to address an explosion on research in the education field.He believed that scholars were failing to integrate all of this research in traditional qualitative reviews, which had fallen into a rut of producing ''verbal synopses of studies [that] are strung out in dizzying lists'' (p.4).He put this rather succinctly:We face an abundance of information.Our problem is to find the knowledge in the
Language: English
Open Access status: bronze
OpenAlex ID: W2157724266
Cites: 13
Cited by: 50
Related to: 9