Panel 3. Towards Standardisation, Harmonisation and Integration of Data from Heterogeneous Sources for Funding and Evaluation Purposes


Thursday, 3rd of September, 9.00 – 10.30, Auditorium.

A detailed description can be downloaded here.

Chair. Wolfgang Glänzel, KU Leuven.

  • Wolfgang Glänzel, KU Leuven, Data collection and Use in Research Funding and Performing Organisations. General Outlines and First Results of a Project Launched by Science Europe. Download pdf.
  • Sophie Biesenbender, iFQ, Berlin, Standardising Research Information in the German Science System – The Development of a Research Core Dataset.
  • Gunnar Sivertsen, NIFU Norway, The integration of bibliographic data, institutional information systems and national data sources for the purpose of funding and evaluation. The latest developments in the Scandinavian countries.Download pdf
  • Cinzia Daraio, Ontology project, DIAG Sapienza University of Rome, An ontology of Multi-Dimensional Research Assessment for integrating heterogeneous scholarly data sources. Download pdf

Funding and performing organisations and other entities use data from heterogeneous sources for evaluating research performance or allocating funding. Data on research and technology output, scientific personnel and research projects that are collected and obtained using various approaches including centralised and decentralised, top-down and bottom-up, open and propriety data. Furthermore money for financing research, innovation and technological development is spent at various levels, ranging from supranational organisations over governments down to the regional and local, intra-institutional level. Appropriate quality of these data, compatibility, interchangeability as well as their connectability with related data is increasingly a need and necessary criterion. Well-definition, suitability for indicator building and reporting and the various application purposes are the determinants in the process of standardisation, harmonisation and integration. But this is also the reason why full compatibility cannot be imposed and complete concordance of structures cannot be granted.

For this session we have collected four contributions that will report a European initiative and national efforts (within Europe) in data standardisation and integration. Different approaches are outlined that will hopefully show new perspectives and plot roadmaps of these processes but might also point to challenges, caveats and possible limitations. We also hope that the presentations will inspire, even provoke a broad discussion about this necessary but difficult path laying ahead.

The first contribution by a task group launched by Science Europe within the working group Research Policy and Programme Evaluation reports on the first results of a survey on “Data collection and use in research funding and performing organisations”. This is followed by a report on standardisation of research information within the framework of German federal standardisation project for research information. The third contribution using the example of Scandinavia is focussed on the aspect of data integration in the context of national current research information systems. The last presentation finally introduces the Italian ontology project that aims at providing the groundwork, platform and tool for the efficient integration of heterogeneous data for the purpose of research assessment.

The presentations are followed by a broad panel discussion with the participation of the speakers and the attendees of this special session.