Research should be evaluated in new ways

In the academic world, we often discuss the topic of research quality. But quality does not exist independently of the way in which we, more or less arbitrarily, choose to evaluate research. The criteria and indicators we use can shape both research practice and the incentives under which researchers work.

That is why research evaluation is not merely a technical discussion about measurement methods. It is also a question of what kind of research we actually want.

For many years, the world of research has relied on bibliometric indicators, that is, publications, citations and journal impact factors, as measures of research quality. However, although these indicators may have had their merits and may have provided an overview and common standards in the international and competitive world of research, they only tell one part of the story.

The value of research from a broader perspective

 Research can create value in many ways: for example, through collaboration across disciplines and sectors, through innovation and by contributing in one way or another to the development of society. At SDU, research is developed into practical solutions to specific challenges in collaboration with businesses, public authorities and civil society.

Nevertheless, in many cases these contributions do not feature prominently in the way in which we evaluate research. By measuring primarily what is easiest to count, we risk overlooking that which is more difficult to quantify but which is equally important to acquire the full picture.

As a result, in recent years there has been an increasing international focus on efforts to develop more accurate methods for evaluating research from a holistic perspective.

What do we want to reward?

 I believe that our evaluation methods should better support the view that the broad impact of research – including contributions to innovation and collaboration that create value for society – should be taken into account in discussions of research quality. This is because it is also a question of what kind of research culture we wish to promote at SDU.

If SDU is serious about its ambitions regarding innovation, collaboration and societal value, we must also have the courage to engage in dialogue and adjust the ways in which we evaluate research in various contexts.

CoARA points ahead

And at SDU, work is already underway. Last year, the Executive Board approved the University’s action plan for CoARA, the Coalition for Advancing Research Assessment. CoARA is a collaboration between universities, research organisations and foundations which is working to develop more nuanced and responsible ways of evaluating research.

The aim is not to do away with quantitative indicators but to supplement them with broader assessments of research contributions.

On 13 May, the University Library will host a theme day on CoARA and the research evaluation of the future, which constitutes a further step towards achieving this aim. I hope that many of you will join the discussion about how we evaluate research, as this also concerns the direction of the University as a whole.