Integrating Microdata, Paradata, Metadata and Administrative Data in Quantitative Social Science Research-Scilight

Research on European Social Issues

Research article

Integrating Microdata, Paradata, Metadata and Administrative Data in Quantitative Social Science Research

Downloads

https://doi.org/10.54963/resi.v1i1.1051
Linardis, A., & Moscha, A. (2025). Integrating Microdata, Paradata, Metadata and Administrative Data in Quantitative Social Science Research. Research on European Social Issues, 1(1), 1–20. https://doi.org/10.54963/resi.v1i1.1051
Volume 1 Issue 1 (2025)
Copyright (c) 2025 Apostolos Linardis ,Anna Moscha
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors

  • Apostolos Linardis

    Institute of Social Research, National Centre for Social Research, Athens 10552, Greece
  • Anna Moscha

    Computer Center, National Technical University of Athens, Athens 17773, Greece

Received: 17 March 2025; Revised: 5 April 2025; Accepted: 21 April 2025; Published: 1 May 2025

Integrating survey microdata with auxiliary sources—such as administrative records, metadata, and paradata—significantly enhances the analytical potential of quantitative social science research. This article examines the methodological frameworks of three major international surveys: the EU Gender-Based Violence (EU-GBV) survey, the European Social Survey (ESS), and the Programme for the International Assessment of Adult Competencies (PIAAC). By analyzing their approaches to data collection, management, dissemination and integration, we explore how microdata, paradata, metadata, and administrative records are structured, utilized, and aligned with the principles of FAIR (Findable, Accessible, Interoperable, and Reusable) and Open Data. Our comparative analysis highlights key differences in data accessibility, interoperability, and technological infrastructure, reflecting variations in methodological design and institutional priorities. Metadata emerges as a crucial element for ensuring data transparency, documentation, and reusability, while paradata plays a vital role in monitoring microdata quality and optimizing fieldwork procedures. Administrative data, in turn, provide valuable macro-level insights that support multi-level analyses and a more comprehensive understanding of complex social phenomena. Furthermore, we discuss the role of research infrastructures and international organizations in fostering standardized frameworks for data integration. By synthesizing these insights, this study contributes to ongoing discussions on best practices for managing and integrating complex datasets in social science research. Ultimately, we argue that strengthening these integration efforts can enhance the comparability, transparency, and efficiency of international survey methodologies.

Keywords:

Gender Based Violence (GBV) European Social Survey (ESS) Programme for the International Assessment of Adult Competencies (PIAAC) Data Management FAIR Data Open Data

References

  1. Bryman, A. Social research methods, 5th ed.; Oxford University Press: Oxford, UK, 2016; 197-282.
  2. Babbie, E.R. The practice of social research, 15th ed.; Cengage AU: Southbank, VIC, Australia, 2020; 228-288.
  3. Open Data Handbook---What is open data? Available online: https://opendatahandbook.org/guide/en/what-is-open-data/ (accessed on 31 January 2025).
  4. Go FAIR- FAIR Principles. Available online: https://www.go-fair.org/fair-principles/ (accessed on 31 January 2025).
  5. Wilkinson, M.D. ; Dumontier, M. ; Aalbersberg, I.J.; et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci. Data 2016, 3, 1–9. DOI: https://doi.org/10.1038/sdata.2016.18
  6. Kallas, J.; Linardis, A.A. Documentation Model for Comparative Research Based on Harmonization Strategies. IASSIST Q. 2008, 32, 12. DOI: https://doi.org/10.29173/iq652
  7. European Social Survey. Available online: https://www.europeansocialsurvey.org/ (accessed on 31 January 2025).
  8. SHARE. Available online: https://share-eric.eu/ (accessed on 31 January 2025).
  9. ESFRI Roadmap 2021. Strategy Report on Research Infrastructures. Available online: https://roadmap2021.esfri.eu/ (accessed on 31 January 2025).
  10. Eurostat. Methodological manual for the EU survey on gender-based violence against women and other forms of inter-personal violence (EU-GBV), 2021. Available online: https://ec.europa.eu/eurostat/web/products-manuals-and-guidelines/-/ks-gq-21-009 (accessed on 31 January 2025).
  11. Eurostat. Code of Practice–revised edition 2017, 2017. Available online: https://ec.europa.eu/eurostat/web/products-catalogues/-/ks-02-18-142 (accessed on 31 January 2025).
  12. Hellenic Statistical Authority. Guide for the Entities of the Hellenic Statistical System on the Implementation of the Code of Practice for European Statistics, 2018. Available online: https://www.statistics.gr/documents/20181/1196143/Odigos_ELSS_1_0.pdf/ (accessed on 31 January 2025).
  13. Linardis, A.; Maravelakis, P.; Fragoulis, G. Data collection methods using digital questionnaires and survey methodology. Management of online, in-person and telephone data and surveys with Limesurvey and SPSS. Kallipos, Open Academic Publications: Athens,Greece, 2023; 83-88. DOI: http://dx.doi.org/10.57713/kallipos-381
  14. Biffignandi, S.; Bethlehem, J. Handbook of web surveys, 2nd ed.; John Wiley & Sons: Hoboken,NJ, USA, 2021; 237-320.
  15. Microdata-EU survey on gender-based violence. Available online: https://ec.europa.eu/eurostat/web/microdata/gender-based-violence (accessed on 31/01/2025)
  16. European Statistical System Metadata Handler (ESS-MH) user guide. Available online: https://cros.ec.europa.eu/book-page/ess-metadata-handler-ess-mh-user-guide (accessed on 31 January 2025).
  17. Gender based violence against women (GBV), Reference Metadata in Single Integrated Metadata Structure (SIMS), Compiling agency: Eurostat, the statistical office of the European Union. Available online: https://ec.europa.eu/eurostat/cache/metadata/en/gbv_sims.htm (accessed on 31 January 2025).
  18. EIGE, Gender Equality Index 2015 - Measuring gender equality in the European Union 2005-2012. Available online: https://eige.europa.eu/sites/default/files/documents/mh0415169enn.pdf (accessed on 31 January 2025).
  19. ESS Methodology. Available online: https://www.europeansocialsurvey.org/methodology/ess-methodology/survey-specification (accessed on 31 January 2025).
  20. GESIS – Survey Quality Predictor. Available online: https://sqp.gesis.org/ (accessed on 31 January 2025).
  21. ESS - Modes of Data Collection - The ESS move to Self-Completion data collection. Available online: https://europeansocialsurvey.org/methodology/methodological-research/modes-data-collection (accessed on 31 January 2025).
  22. ESS round 11 (2023) source questionnaire. Available online: https://stessrelpubprodwe.blob.core.windows.net/data/round11/fieldwork/source/ESS11%20Source%20Questionnaires.pdf (accessed on 31 January 2025).
  23. CENTERDATA - DataCTRL survey tool suite. Available online: https://en.centerdata.nl/werkvelden-2/datactrl-survey-tool-suite (accessed on 31 January 2025).
  24. ESS11 2023 Data Protocol. Available online: https://stessrelpubprodwe.blob.core.windows.net/data/round11/fieldwork/source/ESS11_data_protocol_e01_5.pdf (accessed on 31 January 2025).
  25. ESS – Data Portal. Available online: https://www.europeansocialsurvey.org/data-portal (accessed on 31/01/2025)
  26. ESS11 - data from Contact forms, edition 2.0. Available online: https://ess.sikt.no/en/datafile/065b75fc-67c7-4f24-9c55-5a42fb6a2a21 (accessed on 31 January 2025).
  27. ESS - Data Portal. Available online: https://ess.sikt.no/en/ (accessed on 31 January 2025).
  28. ESS11 - data from Interviewer's questionnaire, edition 2.0. Available online: https://ess.sikt.no/en/datafile/0c3f5fda-4fe0-42f2-b4c8-4ef093c0508f (accessed on 31 January 2025).
  29. Data Documentation Initiative (DDI). Available online: https://ddialliance.org/ (accessed on 31 January 2025).
  30. ESS Multilevel Data. Available online: https://ess.sikt.no/en/series/50ebb530-c72e-4002-a7bf-5581e3fdfe21 (accessed on 31 January 2025).
  31. ESS Round 12 Survey Specification for ESS ERIC Member, Observer and Guest Countries. Available online: https://www.europeansocialsurvey.org/sites/default/files/2024-04/ESS012_projection_specification_v2.pdf (accessed on 31/01/2025)
  32. Survey weights in the ESS. Available online: https://www.europeansocialsurvey.org/methodology/ess-methodology/data-processing-and-archiving/weighting (accessed on 31 January 2025).
  33. EOSC Future – SP9. Available online: https://ess.sikt.no/en/series/a1f81168-b864-4838-9701-39bbc6087e30 (accessed on 31 January 2025).
  34. PIAAC Technical Standards and Guidelines June 2014. Available online: https://www.oecd.org/content/dam/oecd/en/about/programmes/edu/piaac/technical-standards-and-guidelines/cycle-1/Cycle_1_PIAAC_Technical_Standards_and_Guidelines_June2014.pdf/_jcr_content/renditions/original./Cycle_1_PIAAC_Technical_Standards_and_Guidelines_June2014.pdf (accessed on 31 January 2025).
  35. Cycle 2 PIAAC Technical Standards and Guidelines. Available online: https://www.oecd.org/content/dam/oecd/en/about/programmes/edu/piaac/technical-standards-and-guidelines/cycle-2/PIAAC_CY2_Technical_Standards_and_Guidelines.pdf/_jcr_content/renditions/original./PIAAC_CY2_Technical_Standards_and_Guidelines.pdf (accessed on 31 January 2025).
  36. PIAAC 1st Cycle Database – Questionnaires. Available online: https://www.oecd.org/en/data/datasets/piaac-1st-cycle-database.html#questionnaires (accessed on 31 January 2025).
  37. PIAAC 1st Cycle Database. Available online: https://www.oecd.org/en/data/datasets/piaac-1st-cycle-database.html (accessed on 31 January 2025).
  38. PIAAC 2nd Cycle Database. Available online: https://www.oecd.org/en/data/datasets/piaac-2nd-cycle-database.html (accessed on 31 January 2025).
  39. PIAAC PUF Users Data Collection. Available online: https://survey.oecd.org/index.php?r=survey/index&sid=424913&lang=en (accessed on 31 January 2025).
  40. PIAAC – Tools for data analysis. Available online: https://www.oecd.org/en/about/programmes/piaac/piaac-data.html#tools (accessed on 31 January 2025).
  41. PIAAC – Data Explorer. Available online: https://piaacdataexplorer.oecd.org/ide/idepiaac/ (accessed on 31 January 2025).
  42. PIAAC – Log Data Analyzer. Available online: https://piaac-logdata.tba-hosting.de/download/ (accessed on 31 January 2025).
  43. GESIS Programme for the International Assessment of Adult Competencies (PIAAC), log files. Available online: https://search.gesis.org/research_data/ZA6712 (accessed on 31 January 2025).
  44. Survey of Adult Skills (PIAAC). Available online: https://www.oecd.org/en/about/programmes/piaac.html (accessed on 31 January 2025).
  45. PIAAC Methodology and manuals- Technical reports. Available online: https://www.oecd.org/en/about/programmes/piaac/piaac-data.html#manuals (accessed on 31 January 2025).
  46. Nordic Network for Lifelong Learning - Access to PIAAC data. Available online: https://nvl.org/artikler/access-to-piaac-data/ (accessed on 31 January 2025).
  47. Gregory, A.; Wackerow, J.; Orten, H. Reuse and Reproducibility: Describing Cross-Domain Research Data in the Science Project Climate Neutral and Smart Cities. ARPHA Preprints 2023, 4, e115047.
  48. F-UJI Automated FAIR Data Assessment Tool. Available online: https://www.f-uji.net/index.php (accessed on 31 January 2025).
  49. Eurostat Database. Available online: https://ec.europa.eu/eurostat/web/main/data/database (accessed on 31 January 2025).
  50. Howison, J.; Wiggins, A.; Crowston, K.G. Validity issues in the use of social network analysis with digital trace data. J. Assoc. Inf. Syst. 2011, 12, 767–797. DOI: https://doi.org/10.17705/1jais.00282
  51. Stier, S.; Breuer, J.; Siegers, P.; et al. Integrating survey data and digital trace data: Key issues in developing an emerging field. Soc. Sci. Comput. Rev. 2020, 38, 503–516. DOI: https://doi.org/10.1177/0894439319843669