Evaluation practices in the selection of ground-breaking research proposals, Working Paper

Luukkonen, Terttu and Stampfer, Michael and Strassnig, Michael (2015) Evaluation practices in the selection of ground-breaking research proposals, Working Paper. Working Paper. Wien.

[thumbnail of Luukkonen_Stampfer_Strassnig_Evaluation_groundbreaking_research_working_paper(1).pdf]

Download (579kB) | Preview


Eval practices in research proposals

Abstract (english)

The review empirically examines the proposal selection practices of seven funding organisations in schemes that explicitly aim to support ground-breaking research and focuses on the organisational practices of these funding organisations in their attempts to overcome the limitations and criticisms of conservatism in peer review, as copiously argued in debates on peer review. The review uses data from the websites of the relevant organisations and interviews with programme officers of each scheme and draws on the data that previous studies collected on some of these schemes. The paper notes that, with one exception, the schemes use peer review but attempt to apply it in a manner to overcome some of its limitations by using specific evaluation criteria, designing panel composition, requiring sketch research plans and emphasising both ideas and people. Simultaneously, the applied procedures are somewhat elaborate and, in most cases, involve several phases. Furthermore, they are consensual and, thus, introduce elements that can hinder the selection of ground-breaking ideas. There is limited data on outcomes, but some of these data indicate that such schemes can succeed in promoting innovative and/or high-impact research.

Subjects: Studies on Evaluation
Number of Pages: 26
Uncontrolled Keywords: peer review, proposal evaluation, ground-breaking research, funding organisations, European Research Council Expert Group for Programme Monitoring and Evaluation
Identification Number: 10.22163/fteval.2018.292
Date Deposited: 16 Nov 2018 08:24
URI: https://repository.fteval.at/id/eprint/335

Actions (login required)

View Item View Item