Skip to main content

Research Repository

Advanced Search

Outputs (125)

Using the five safes to structure economic evaluations of data governance (2024)
Journal Article
Ritchie, F., & Whittard, D. (2024). Using the five safes to structure economic evaluations of data governance. Data & Policy, 6, Article e16

As the world has become more digitally-dependent, questions of data governance such as ethics, institutional arrangements and statistical protection measures have increased in significance. Understanding the economic contribution of investments in da... Read More about Using the five safes to structure economic evaluations of data governance.

The inadvertently revealing statistic: A systemic gap in statistical training? (2024)
Journal Article
Derrick, B., Green, E., Ritchie, F., Smith, J., & White, P. (2024). The inadvertently revealing statistic: A systemic gap in statistical training?. Significance, 21(1), 24-27. https://doi.org/10.1093/jrssig/qmae009

While concerns around data privacy are well-known, there's a lack of awareness and training when it comes to the confidentiality risk of published statistics, argue Ben Derrick, Elizabeth Green, Felix Ritchie, Jim Smith, Paul White

Machine learning models in trusted research environments - Understanding operational risks (2023)
Journal Article
Ritchie, F., Tilbrook, A., Cole, C., Jefferson, E., Krueger, S., Mansouri-Benssassi, E., …Smith, J. (2023). Machine learning models in trusted research environments - Understanding operational risks. International Journal of Population Data Science, 8(1), Article 2165. https://doi.org/10.23889/ijpds.v8i1.2165

IntroductionTrusted research environments (TREs) provide secure access to very sensitive data for research. All TREs operate manual checks on outputs to ensure there is no residual disclosure risk. Machine learning (ML) models require very large amou... Read More about Machine learning models in trusted research environments - Understanding operational risks.

Using pedagogical and psychological insights to train analysts using confidential data (2023)
Journal Article
Green, E., & Ritchie, F. (2023). Using pedagogical and psychological insights to train analysts using confidential data. Journal of Privacy and Confidentiality, 13(2), https://doi.org/10.29012/jpc.842

With researchers increasingly gaining access to confidentiality data through restricted environments, interest has grown in the training of those researchers to protect confidentiality and to use the secure facility effectively. Researcher training,... Read More about Using pedagogical and psychological insights to train analysts using confidential data.

The present and future of the Five Safes framework (2023)
Journal Article
Green, E., & Ritchie, F. (2023). The present and future of the Five Safes framework. Journal of Privacy and Confidentiality, 13(2), https://doi.org/10.29012/jpc.831

The Five Safes has become the default framework for confidential data governance across multiple sectors and countries. Since its inception in 2003, the approach has influenced data management in many ways, particularly in the public sector. As it ha... Read More about The present and future of the Five Safes framework.

SACRO guide to statistical output checking (2023)
Other
Ritchie, F., Green, E., Smith, J., Tilbrook, A., & White, P. (2023). SACRO guide to statistical output checking. [web]

This guide for output SDC is the first report from the SACRO project. It covers, theory of output SDC, including the new statbarns model, practicalities, operational considerations, and FAQs for output checking teams.

Research data governance in low-and middle-income countries (2023)
Report
Ferrer Breda, P., Green, E., Kendal, C., & Ritchie, F. (2023). Research data governance in low-and middle-income countries. Bristol: UWE

Research and policy development on the governance of confidential research data is dominated by the work of academics and government agencies based in high-income countries (HICs). This leaves three quarters of the world’s population faced with a cor... Read More about Research data governance in low-and middle-income countries.

Disclosure control issues in complex medical data (2023)
Presentation / Conference
Green, E., Ritchie, F., Smith, J., Western, D., & White, P. (2023, September). Disclosure control issues in complex medical data. Paper presented at UNECE/Eurostat Expert Group on Statisticial Data Confidentiality, Wiesbaden

The covid19 pandemic assisted the acceleration of routine access to medical records for research. In the UK platforms including OpenSafely and NHSDigital, alongside emerging hospital trust based Trusted Research Environments (TREs), demonstrate the u... Read More about Disclosure control issues in complex medical data.

Towards a comprehensive theory and practice of output SDC (2023)
Presentation / Conference
Derrick, B., Green, E., Ritchie, F., & White, P. (2023, September). Towards a comprehensive theory and practice of output SDC. Paper presented at UNECE/Eurostat Expert Group on Statisticial Data Confidentiality, Wiesbaden

In 2000, the statistical disclosure control of outputs (OSDC) was largely limited to models of table protection developed by and intended for national statistical institutes (NSIs), as a particular branch of general SDC theory. However, in this centu... Read More about Towards a comprehensive theory and practice of output SDC.

Research data governance in low- and middle-income countries (2023)
Presentation / Conference
Ferrer Breda, P., Green, E., & Ritchie, F. (2023, September). Research data governance in low- and middle-income countries. Paper presented at UNECE/Eurostat Expert Group on Statisticial Data Confidentiality, Wiesbaden

Research and policy development on the governance of confidential research data is dominated by the work of academics and government agencies based in high-income countries (HICs). This leaves three quarters of the world’s population faced with a cor... Read More about Research data governance in low- and middle-income countries.

SACRO: Semi-Automated Checking Of Research Outputs (2023)
Presentation / Conference
Smith, J., Preen, R., Albashir, M., Ritchie, F., Green, E., Davy, S., …Bacon, S. (2023, September). SACRO: Semi-Automated Checking Of Research Outputs. Paper presented at UNECE Expert meeting on Statistical Data Confidentiality, Wiesbaden, Germany

Output checking can require significant resources, acting as a barrier to scaling up the research use of confidential data. We report on a project, SACRO, that is developing a general-purpose, semi-automatic output checking systems that works across... Read More about SACRO: Semi-Automated Checking Of Research Outputs.

The perils of pre-filling: Lessons from the UK's Annual Survey of Hours and Earning microdata (2023)
Journal Article
Whittard, D., Ritchie, F., Phan, V., Bryson, A., Forth, J., Stokes, L., & Singleton, C. (2023). The perils of pre-filling: Lessons from the UK's Annual Survey of Hours and Earning microdata. Statistical Journal of the IAOS, 39(3), 661-677. https://doi.org/10.3233/SJI-230013

The role of the National Statistical Institution (NSI) is changing, with many now making microdata available to researchers through secure research environments This provides NSIs with an opportunity to benefit from the methodological input from rese... Read More about The perils of pre-filling: Lessons from the UK's Annual Survey of Hours and Earning microdata.

Disclosure control of machine learning models from trusted research environments (TRE): New challenges and opportunities (2023)
Journal Article
Mansouri-Benssassi, E., Rogers, S., Reel, S., Malone, M., Smith, J., Ritchie, F., & Jefferson, E. (2023). Disclosure control of machine learning models from trusted research environments (TRE): New challenges and opportunities. Heliyon, 9(4), Article e15143. https://doi.org/10.1016/j.heliyon.2023.e15143

Introduction: Artificial intelligence (AI) applications in healthcare and medicine have increased in recent years. To enable access to personal data, Trusted Research Environments (TREs) (otherwise known as Safe Havens) provide safe and secure enviro... Read More about Disclosure control of machine learning models from trusted research environments (TRE): New challenges and opportunities.

Data use externatilies: Report to department for digital, culture, media and sport by Belmana with the University of the West of England (2022)
Report
Vaze, P., Ioramshvili, C., Whittard, D., & Ritchie, F. (2022). Data use externatilies: Report to department for digital, culture, media and sport by Belmana with the University of the West of England. https://www.gov.uk: Department for Digital, Culture, Media and Sport

This study was commissioned by the Department for Digital, Culture, Media and Sport to: ● Identify the likely positive and negative externalities of data use (that is, the wider social impacts of data use) and ● Provide an assessment of the viabili... Read More about Data use externatilies: Report to department for digital, culture, media and sport by Belmana with the University of the West of England.

Frameworks, principles, and accreditation: Making data governance work (2022)
Presentation / Conference
Ritchie, F. (2022, November). Frameworks, principles, and accreditation: Making data governance work. Presented at RSS Data Ethics and Governance – origins, progress and priorities, London

Presentation to the Royal Statistical Society Data Ethics Section, covering the origins and development of the Five Safes, the EDRU approach to problems-solving, principles-based regulation, and how these all need to work together to achieve effectiv... Read More about Frameworks, principles, and accreditation: Making data governance work.

Can we identify students in ASHE? (2022)
Working Paper
Phan, V., Ritchie, F., Whittard, D., Stokes, L., Forth, J., & Bryson, A. Can we identify students in ASHE?

ASHE is a key dataset in the UK, the only one which allows long-term analysis of flows in labour market status and earnings, and hence vitally important in the understanding of low pay and wage progression. Separating out students from non-student wo... Read More about Can we identify students in ASHE?.

The incidence of low pay is falling in Britain, but why – and can we trust the figures? (2022)
Working Paper
Whittard, D., Phan, V., Stokes, L., Forth, J., Bryson, A., Singleton, C., & Ritchie, F. The incidence of low pay is falling in Britain, but why – and can we trust the figures?

Recent research indicates that the percentage of employees in Britain who are low paid – earning below two-thirds median hourly earnings – has been falling in the last 6-7 years. It points to the increased ‘bite’ of the adult National Minimum Wage (N... Read More about The incidence of low pay is falling in Britain, but why – and can we trust the figures?.

Not just arms and legs: Employer perspectives on student workers (2022)
Journal Article
Whittard, D., Drew, H., & Ritchie, F. (2022). Not just arms and legs: Employer perspectives on student workers. Journal of Education and Work, 35(6-7), 751-765. https://doi.org/10.1080/13639080.2022.2126972

The student workforce plays a substantial part in several low-paying industries such as retail and hospitality, and this has grown over time. However, there has been little recent research. The usual assumption is that students compete successfully w... Read More about Not just arms and legs: Employer perspectives on student workers.

Risk of disclosure when reporting commonly used univariate statistics (2022)
Conference Proceeding
Derrick, B., Green, E., Ritchie, F., & White, P. (2022). Risk of disclosure when reporting commonly used univariate statistics. In Lecture Notes in Computer Science (119-129). https://doi.org/10.1007/978-3-031-13945-1_9

When basic or descriptive summary statistics are reported, it may be possible that the entire sample of observations is inadvertently disclosed, or that members within a sample will be able to work out responses of others. Three sets of univariate su... Read More about Risk of disclosure when reporting commonly used univariate statistics.

10 is the safest number that there's ever been (2022)
Journal Article
Ritchie, F. (2022). 10 is the safest number that there's ever been. Transactions on data privacy, 15(2), 109-140

When checking frequency and magnitude tables for disclosure risk, the cell threshold (the minimum number of observations in each cell) is a crucial parameter. In rules-based environments, this is a hard limit on what can or can't be published. In pri... Read More about 10 is the safest number that there's ever been.

Enriched ASHE Quick Start Guide (2022)
Working Paper
Whittard, D., Ritchie, F., Stokes, L., Forth, J., Phan, V., Bryson, A., & Singleton, C. Enriched ASHE Quick Start Guide

The Wage and Employment Dynamics (WED) project was funded by Administrative Data Research 2019-2022 to review, quality assure and enhance ASHE data. The project was also provided with ASHE data linked to the 2011 Census for England and Wales. This do... Read More about Enriched ASHE Quick Start Guide.

A marriage of convenience: How employers and students working in hospitality view the employment relationship (2022)
Journal Article
Evans, C., Ritchie, C., Drew, H., & Ritchie, F. (2022). A marriage of convenience: How employers and students working in hospitality view the employment relationship. Hospitality and Society, 12(3), 299-318. https://doi.org/10.1386/hosp_00055_1

Since the 1990s, the hospitality industry has been increasingly characterized by temporary and insecure forms of employment, a development, which has coincided with rising numbers of students seeking part-time employment. This provides increased job... Read More about A marriage of convenience: How employers and students working in hospitality view the employment relationship.

Weighting for employer non-response in ASHE (2022)
Working Paper
Stokes, L., Forth, J., Ritchie, F., Singleton, C., Phan, V., Bryson, A., …McKenzie, A. Weighting for employer non-response in ASHE

The Annual Survey of Hours and Earnings (ASHE) is based on a 1% sample of employee jobs and provides many of the UK’s official earnings statistics. Weights are provided with the core dataset, which adjust the profile of the annual achieved sample suc... Read More about Weighting for employer non-response in ASHE.

Accounting for firms in ethnicity wage gaps throughout the earnings distribution (2022)
Working Paper
Phan, V., Singleton, C., Bryson, A., Forth, J., Ritchie, F., Stokes, L., & Whittard, D. (2022). Accounting for firms in ethnicity wage gaps throughout the earnings distribution

Ethnicity wage gaps in Great Britain are large and have persisted over time. Previous studies of these gaps have been almost exclusively confined to analyses of household data, so they could not account for the role played by individual employers, de... Read More about Accounting for firms in ethnicity wage gaps throughout the earnings distribution.

Disclosure risks in odds ratios and logistic regression (2022)
Presentation / Conference
Derrick, B., Green, E., Ritchie, F., & White, P. (2022, April). Disclosure risks in odds ratios and logistic regression. Paper presented at Scottish Economic Society Annual Conference 2022: Special session 'Protecting confidentiality in social science research outputs', Glasgow

When publishing statistics from confidential data, there exists a risk that the statistic might inadvertently reveal confidential information. Statistical disclosure control (SDC) aims to reduce that risk to an acceptable level. Most SDC theory is co... Read More about Disclosure risks in odds ratios and logistic regression.

Safety in numbers: Minimum thresholding, Maximum bounds and Little White Lies : The case of the mean and standard deviation (2022)
Presentation / Conference
Derrick, B., Green, E., Kember, K., Ritchie, F., & White, P. (2022, April). Safety in numbers: Minimum thresholding, Maximum bounds and Little White Lies : The case of the mean and standard deviation. Paper presented at Scottish Economic Society, Glasgow

Reporting the sample mean, sample standard deviation and sample size could in some cases lead to the unique identification of the underpinning sample. The likelihood of this reveal via direct enumeration of the possible search space decreases with i... Read More about Safety in numbers: Minimum thresholding, Maximum bounds and Little White Lies : The case of the mean and standard deviation.

Longitudinal attrition in ASHE (2022)
Working Paper
Forth, J., Phan, V., Stokes, L., Bryson, A., Ritchie, F., Whittard, D., & Singleton, C. Longitudinal attrition in ASHE

The Annual Survey of Hours and Earnings (ASHE) provides many of the UK’s official earnings statistics. The survey operates on an annual 1% sample of employee jobs. However, the method of sampling - based on the final two digits of an employee’s Natio... Read More about Longitudinal attrition in ASHE.

Using the ‘five safes’ to structure economic evaluations of data governance (2022)
Working Paper
Ritchie, F., & Whittard, D. Using the ‘five safes’ to structure economic evaluations of data governance

The ‘five safes’ is a popular data governance framework. It is used to design and critique data management strategies across the world, and has also been used as a performance framework to measure the effectiveness of data access operations. We repor... Read More about Using the ‘five safes’ to structure economic evaluations of data governance.

Measuring the value of data governance in agricultural investments: A case study (2022)
Journal Article
Whittard, D., Ritchie, F., Rose, M., & Musker, R. (2022). Measuring the value of data governance in agricultural investments: A case study. Experimental Agriculture, 58, Article e8. https://doi.org/10.1017/S0014479721000314

Summary The study at hand measures the value of improving data governance and access in the Supporting Soil Health Interventions (SSHI) project in Ethiopia. We applied two separate but interlinked models, one qualitative and one quantitative, to crea... Read More about Measuring the value of data governance in agricultural investments: A case study.

Exploring the workplace location problem in the Annual Survey of Hours and Earnings (2022)
Working Paper
Whittard, D., Ritchie, F., Phan, V., Forth, J., Bryson, A., Stokes, L., …McKenzie, A. Exploring the workplace location problem in the Annual Survey of Hours and Earnings

The Annual Survey of Hours and Earnings (ASHE) is an important source of longitudinal linked employer-employee payroll earnings data for Britain. It provides accurate information on employees’ hours and earnings and information on the location of em... Read More about Exploring the workplace location problem in the Annual Survey of Hours and Earnings.

Statistical disclosure control for HESA: Part 1: Review of SDC theory (2021)
Report
Green, E., & Ritchie, F. (2021). Statistical disclosure control for HESA: Part 1: Review of SDC theory. Higher Education Statistics Agency (HESA)

This report for the Higher Education Statistics Agency (HESA) is a summary of statistical disclosure control (SDC) methods for tabular outputs.

Automatic Checking of Research Outputs (ACRO): A tool for dynamic disclosure checks (2021)
Journal Article
Green, E., Ritchie, F., & Smith, J. (2021). Automatic Checking of Research Outputs (ACRO): A tool for dynamic disclosure checks. ESS Statistical Working Papers, 2021 Edition, https://doi.org/10.2785/75954

This paper discusses the issues surrounding the creation of an automatic tool to reduce the burden of output checking in research environments. It describes ACRO (Automatic Checking of Research Outputs), a Stata tool written as a proof-of-concept, an... Read More about Automatic Checking of Research Outputs (ACRO): A tool for dynamic disclosure checks.

Statistical disclosure controls for machine learning models (2021)
Conference Proceeding
Krueger, S., Mansouri-Benssassi, E., Ritchie, F., & Smith, J. (2021). Statistical disclosure controls for machine learning models

Artificial Intelligence (AI) models are trained on large datasets. Where the training data is sensitive, the data holders need to consider risks posed by access to the training data and risks posed by the models that are released. The first problem c... Read More about Statistical disclosure controls for machine learning models.

The present and future of confidential microdata access: Post-workshop report (2021)
Presentation / Conference
Green, E., Ritchie, F., Tava, F., Ashford, W., & Ferrer Breda, P. (2021, July). The present and future of confidential microdata access: Post-workshop report. Presented at The Present and Future of Microdata Access

In the summer of 2021, the University of the West of England, in collaboration with UN Economic Commission for Europe, Eurostat, INXEDA and statistical organisations across the world, hosted a workshop to review lessons learnt in microdata access ove... Read More about The present and future of confidential microdata access: Post-workshop report.

The present and future of confidential microdata access [draft] (2021)
Presentation / Conference
Green, E., & Ritchie, F. (2021, July). The present and future of confidential microdata access [draft]. Presented at The Present and Future of Microdata Access

This briefing document was prepared for the DRAGoN conference 'The Present and Future of Microdata Access', 5th-9th July 2021. It provides an introduction to the topics to be covered in the conference.

Measuring the value of improving data governance and access in Gates Foundation programme: A case study of the Supporting Soil Health Interventions in Ethiopia projects (2021)
Journal Article
Whittard, D., Ritchie, F., & Nyengani, J. (2021). Measuring the value of improving data governance and access in Gates Foundation programme: A case study of the Supporting Soil Health Interventions in Ethiopia projects. Gates Open Research, 5, Article 97. https://doi.org/10.21955/gatesopenres.1116786.1

The Centre for Agriculture and Bioscience International (CABI) and the Open Data Institute (ODI) commissioned a team of economists to measure the value of improving data governance and access in the Supporting Soil Health Interventions in Ethiopia (S... Read More about Measuring the value of improving data governance and access in Gates Foundation programme: A case study of the Supporting Soil Health Interventions in Ethiopia projects.

Sequential mixed methods research: Non-compliance in apprentice pay with owls (2021)
Presentation / Conference
Drew, H., & Ritchie, F. (2021, June). Sequential mixed methods research: Non-compliance in apprentice pay with owls. Paper presented at 20th European Conference on Research Methodology for Business and Management Studies, University of Aveiro, Portugal

Within mixed methods literature, the relationship between qualitative and quantitative data collection is ubiquitously presented as sequential. Thus, the most followed approach is for the first stage of data collection to follow the second, or to run... Read More about Sequential mixed methods research: Non-compliance in apprentice pay with owls.

Process and economic evaluation of the ODI R&D programme: Final report (2021)
Report
Alves, K., Tava, F., Whittard, D., Green, E., Beata Kreft, M., & Ritchie, F. (2021). Process and economic evaluation of the ODI R&D programme: Final report. London: Open Data Institute

The Open Data Institute was funded by Innovate UK to undertake a major programme of Research and Development on "Data Innovation for the UK", which was re-scoped and funded on a yearly basis for a total of 4 years (called, for short, "The R&D program... Read More about Process and economic evaluation of the ODI R&D programme: Final report.

Understanding a pandemic: The power of administrative data (2021)
Book Chapter
Waind, E., Ritchie, F., Bailey, N., Caskie, P., Morrison-Rees, S., Lowe, S., & Webster, N. (2021). Understanding a pandemic: The power of administrative data. In Productivity and the Pandemic. Edward Elgar Publishing

This chapter is taken from the book Productivity and the Pandemic. It suggests how administrative data is essential to understanding what is happening now, and what happpens next.

Microdata access and privacy: What have we learned over twenty years? (2021)
Journal Article
Ritchie, F. (2021). Microdata access and privacy: What have we learned over twenty years?. Journal of Privacy and Confidentiality, 11(1), 1-8. https://doi.org/10.29012/jpc.766

Felix Ritchie reflects on lessons learned in twenty years of microdata access in the UK and Canada. Based on his contribution to the panel on "Privacy And Microdata Access: Two Worlds Colliding?" at the October 2020 Canadian Research Data Centre Netw... Read More about Microdata access and privacy: What have we learned over twenty years?.

Financial resilience, income dependence and organisational survival in UK charities (2021)
Journal Article
Green, E., Ritchie, F., Bradley, P., & Parry, G. (2021). Financial resilience, income dependence and organisational survival in UK charities. Voluntas: International Journal of Voluntary and Nonprofit Organizations, 32, 992–1008. https://doi.org/10.1007/s11266-020-00311-9

The financial well-being of the charity sector has important social implications. Numerous studies have analysed whether the concentration of income in a few sources increases financial vulnerability. However, few studies have systematically consider... Read More about Financial resilience, income dependence and organisational survival in UK charities.

Using ASHE to examine trends in low pay: Initial exploration of the data (2020)
Report
Bryson, A., Phan, V., Stokes, L., Ritchie, F., Forth, J., McKenzie, A., & Whittard, D. (in press). Using ASHE to examine trends in low pay: Initial exploration of the data. Bristol: Low Pay Commission

Using the Annual Survey of Hours and Earnings (ASHE) 2004-2019 we report consistent time-series estimates of the percentage of jobs on and around the minimum wage; low paid jobs above the minimum; and ‘high paid’ jobs. In doing so we report on some i... Read More about Using ASHE to examine trends in low pay: Initial exploration of the data.

Runners, repeaters, strangers and aliens: Operationalising efficient output disclosure control (2020)
Journal Article
Alves, K., & Ritchie, F. (2020). Runners, repeaters, strangers and aliens: Operationalising efficient output disclosure control. Statistical Journal of the IAOS, 36(4), 1281-1293. https://doi.org/10.3233/SJI-200661

Statistical agencies and other government bodies increasingly use secure remote research facilities to provide access to sensitive data for research and analysis by internal staff and third parties. Such facilities depend on human intervention to ens... Read More about Runners, repeaters, strangers and aliens: Operationalising efficient output disclosure control.

Frameworks, principles and accreditation in modern data management (2020)
Working Paper
Ritchie, F., & Green, E. Frameworks, principles and accreditation in modern data management

The Five Safes framework is increasingly widely used for data governance. Since its conception in 2003, it has influenced data management in many ways, particularly in the public sector. As it has become established, both the advantages and limitatio... Read More about Frameworks, principles and accreditation in modern data management.

Understanding output checking (2020)
Report
Green, E., Ritchie, F., & Smith, J. (2020). Understanding output checking. Luxembourg: European Commission (Eurostat - Methodology Directorate)

This report for Eurostat (Methodology) considers the conceptual and practical issues that need to be addressed in designing and implementing automatic disclosure control checking for statistical research outputs. The report covers - The basic theo... Read More about Understanding output checking.

10 is the safest number that there’s ever been (2019)
Presentation / Conference
Ritchie, F. (2019, October). 10 is the safest number that there’s ever been. Paper presented at Workshop on statistical data confidentiality 2019, The Hague

When checking frequency and magnitude tables for disclosure risk, the cell threshold (the minimum number of observations in each cell) is the crucial statistic. In rules-based environments, this is a hard limit on what can or can’t be published. In p... Read More about 10 is the safest number that there’s ever been.

User-focused threat identification for anonymised microdata (2019)
Journal Article
Ritchie, F., Hafner, H., & Lenz, R. (2019). User-focused threat identification for anonymised microdata. Statistical Journal of the IAOS, 35(4), 703-713. https://doi.org/10.3233/SJI-190506

© 2019 - IOS Press and the authors. When producing anonymised microdata for research, national statistics institutes (NSIs) identify a number of 'risk scenarios' of how intruders might seek to attack a confidential dataset. This approach has been cri... Read More about User-focused threat identification for anonymised microdata.

The five safes of risk-based anonymization (2019)
Journal Article
Arbuckle, L., & Ritchie, F. (2019). The five safes of risk-based anonymization. IEEE Security and Privacy Magazine, 17(5), 84-89. https://doi.org/10.1109/MSEC.2019.2929282

The sharing of data for the purposes of data analysis and research can have many benefits. At the same time, concerns and controversies about data ownership and data privacy elicit significant debate. So how do we utilize data in a way that protects... Read More about The five safes of risk-based anonymization.

Analyzing the disclosure risk of regression coefficients (2019)
Journal Article
Ritchie, F. (2019). Analyzing the disclosure risk of regression coefficients. Transactions on data privacy, 12(2), 145-173

A major growth area in social science research this century has been access to highly sensitive confidential microdata, often via restricted-access remote facilities. These allow researchers highly unlimited access to manipulate the data but with che... Read More about Analyzing the disclosure risk of regression coefficients.

Confidentiality and linked data (2018)
Book Chapter
Ritchie, F., & Smith, J. Confidentiality and linked data. In G. Roarson (Ed.), Privacy and Data Confidentiality Methods – a National Statistician’s Quality Review (1-34). Newport: Office for National Statistics

This chapter considers the confidentiality issues around linked data. It notes that the use and availability of secondary (adminstrative or social media) data, allied to powerful processing and machine learning techniques, in theory means that re-ide... Read More about Confidentiality and linked data.

Evidence-based, default-open, risk-managed, user-centred data access (2018)
Presentation / Conference
Ritchie, F., Hafner, H., Lenz, R., & Welpton, R. (2018, October). Evidence-based, default-open, risk-managed, user-centred data access. Paper presented at Conference of European Statistics Stakeholders, Bamberg

In recent years, there has been an increasing demand from the academic community for more access to confidential data for research purposes, particularly that data collected by government departments. This has happened for three reasons. First, both... Read More about Evidence-based, default-open, risk-managed, user-centred data access.

Re-thinking the indices of multiple deprivation (for England): A review and exploration of alternative/complementary area-based indicator systems (2018)
Report
Smith, I., Green, E., Whittard, D., & Ritchie, F. (2018). Re-thinking the indices of multiple deprivation (for England): A review and exploration of alternative/complementary area-based indicator systems. London: Power to Change

Power to Change was established by the Big Lottery as an organisation whose mission is to fund community businesses and through such investment make an impact on the most disadvantaged places in England. Through setting its mission to target the most... Read More about Re-thinking the indices of multiple deprivation (for England): A review and exploration of alternative/complementary area-based indicator systems.

Spontaneous recognition: An unneccessary control on data access? (2017)
Book Chapter
Ritchie, F. (2017). Spontaneous recognition: An unneccessary control on data access?. In E. Baldacci, G. Benoist, C. Boldsen, M. Galambosne Tiszbergen, J. Gerendas, M. Karlberg, …Z. Vereczkei (Eds.), Selected papers from the 2016 Conference of European Statistics Stakeholders (148-158). Luxembourg: Publications Office of the European Union. https://doi.org/10.2785/091435

Social scientists increasingly expect to have access to detailed source microdata for research purposes. As the level of detail increases, data owners worry about ‘spontaneous recognition’, the likelihood that a microdata user believes that he or she... Read More about Spontaneous recognition: An unneccessary control on data access?.

Open data: Who needs it? (2017)
Presentation / Conference
Ritchie, F. (2017, September). Open data: Who needs it?. Presented at UNECE/Eurostat work session on statistical data confidentiality - 2017, Skopje, FYR Macedonia

This presentation, to introduce and stimulate a panel discussion, argued that we have 50 years worth of experience in knowing how to use data safely for researcher; as such we should be concentrating on practical management problems not theory: "how-... Read More about Open data: Who needs it?.

Lessons learned in training ‘safe users’ of confidential data (2017)
Presentation / Conference
Ritchie, F., Green, E., Newman, J., & Parker, T. (2017, September). Lessons learned in training ‘safe users’ of confidential data. Paper presented at UNECE/Eurostat work session on statistical data confidentiality - 2017, Skopje, FYR Macedonia

Many statistical organisations require researchers using detailed sensitive data to undergo ‘safe researcher’ training. Such training has traditionally reflected the ‘policing’ model of data protection. This mirrors the defensive stance often adopted... Read More about Lessons learned in training ‘safe users’ of confidential data.

The "Five Safes": A framework for planning, designing and evaluating data access solutions (2017)
Presentation / Conference
Ritchie, F. (2017, September). The "Five Safes": A framework for planning, designing and evaluating data access solutions. Paper presented at Data for Policy 2017, London, UK

The ‘Five Safes’ is a popular way to structure thinking about data access solutions. Originally used mainly by statistical agencies and social science academics , in recent years it has been adopted more widely across government, health organisations... Read More about The "Five Safes": A framework for planning, designing and evaluating data access solutions.

Spontaneous recognition: An unnecessary control on data access? (2017)
Journal Article
Ritchie, F. (2017). Spontaneous recognition: An unnecessary control on data access?. https://doi.org/10.2866/430525

Social scientists increasingly expect to have access to detailed data for research purposes. As the level of detail increases, data providers worry about “spontaneous recognition”, the likelihood that a microdata user believes that he or she has acci... Read More about Spontaneous recognition: An unnecessary control on data access?.

Ensuring the confidentiality of statistical outputs from the ADRN (2017)
Report
from the ADRN

This technical report discusses potential risks to confidentiality from publication of statistical results based on confidential data, and what we can do to minimise that risk while still ensuring that useful research gets published.

Measuring compliance with minimum wages (2017)
Journal Article
Ritchie, F., Veliziotis, M., Drew, H., & Whittard, D. (2017). Measuring compliance with minimum wages. Journal of Economic and Social Measurement, 42(3-4), 249-270. https://doi.org/10.3233/JEM-180448

© 2017 - IOS Press and the authors. All rights reserved. Identifying genuine underpayment of minimum wages is not straightforward. Some well-known statistical issues affect the measurement of compliance rates, but factors such as processing or behavi... Read More about Measuring compliance with minimum wages.

Improving data quality: The value of the user as data detective (2016)
Presentation / Conference
Ritchie, F. (2016, October). Improving data quality: The value of the user as data detective. Presented at Conference of European Statistics Stakeholders, Budapest, Hungary

In this presentation, we explore how users can contribute to a better understanding of data quality. We illustrate, with reference to minimum wage compliance, how users identify the sort of data problems missed by NSIs

Department of social services data access project final report (2016)
Report
Ritchie, F., & Green, E. (2016). Department of social services data access project final report

This report reviews the context and options available to the Department of Social Service (DSS) in developing its data access strategy, and proposes future developments based upon international practice. The structure of the report is separated into... Read More about Department of social services data access project final report.

Financial resilience in charities v.2 (2016)
Report
Green, E., Ritchie, F., Parry, G., & Bradley, P. Financial resilience in charities v.2

Document submitted to the Select Committee on Charities; House of Lords. 30th September 2016

Evidence-based, context-sensitive, user-centred, risk-managed SDC planning: Designing data access solutions for scientific use (2015)
Presentation / Conference
Hafner, H., Lenz, R., Ritchie, F., & Welpton, R. (2015, October). Evidence-based, context-sensitive, user-centred, risk-managed SDC planning: Designing data access solutions for scientific use. Paper presented at UNECE/Eurostat work session on statistical data confidentiality - 2015, Helsinki, Finland

Disclosure control planning is characterised by over-reliance on theoretical models, inappropriate disclosure scenarios, worst-case planning, confusion over subjective versus objective risk management, and an unwillingness to consider the evidence ba... Read More about Evidence-based, context-sensitive, user-centred, risk-managed SDC planning: Designing data access solutions for scientific use.

Principles- versus rules-based output statistical disclosure control in remote access environments (2015)
Journal Article
Ritchie, F., & Elliot, M. (2015). Principles- versus rules-based output statistical disclosure control in remote access environments. IASSIST quarterly / International Association for Social Science Information Service and Technology, 2015(Summer), 5-13

In recent years, the level of detail in confidential data made available to social scientists has increased dramatically. Much of this has been due to the growth in secure data access facilities, which allow access to the most detailed data under str... Read More about Principles- versus rules-based output statistical disclosure control in remote access environments.

Enabling data linkage to maximise the value of public health research data (2015)
Report
Green, E., Ritchie, F., Mytton, J., Webber, D. J., Deave, T., Montgomery, A., …Chowdhury, S. (2015). Enabling data linkage to maximise the value of public health research data

This project was commissioned by The Wellcome Trust on behalf of the Public Health Research Data Forum. The project aimed to identify the gains to public health research from linking existing data sources, the opportunities in and barriers to such da... Read More about Enabling data linkage to maximise the value of public health research data.

The measurement of apprentice pay: Report commissioned by the Low Pay Commission (2015)
Report
Drew, H., Ritchie, F., & Veliziotis, M. (2015). The measurement of apprentice pay: Report commissioned by the Low Pay Commission

This report considers the measurement of apprentice pay, both the accuracy of that measurement and what can be said about compliance with the National Minimum Wage. In summary, there are substantial problems with accurately identifying apprentice pay... Read More about The measurement of apprentice pay: Report commissioned by the Low Pay Commission.

Understanding official data sources: Final report for the low pay commission (2014)
Report
Ritchie, F., Whittard, D., & Dawson, C. (2014). Understanding official data sources: Final report for the low pay commission

The paper is split into three main sections: a review of existing data sources; an analysis of characteristics of the main reference datasets used for the production of research and official statistics; and an investigation into the imputation code u... Read More about Understanding official data sources: Final report for the low pay commission.

Access to sensitive data: Satisfying objectives rather than constraints (2014)
Journal Article
Ritchie, F. (2014). Access to sensitive data: Satisfying objectives rather than constraints. Journal of Official Statistics, 30(3), 533-545. https://doi.org/10.2478/JOS-2014-0033

The argument for access to sensitive unit-level data produced within government is usually framed in terms of risk and the legal responsibility to maintain confidentiality. This article argues that the framing of the question may restrict the set of... Read More about Access to sensitive data: Satisfying objectives rather than constraints.

How do knowledge brokers work? Implications for policy and practice in the case of WERS (2014)
Journal Article
Drew, H., Ritchie, F., & King, A. (2014). How do knowledge brokers work? Implications for policy and practice in the case of WERS. International Journal of Technology Management and Sustainable Development, 13(3), 205-218. https://doi.org/10.1386/tmsd.13.3.205_1

© 2014 Intellect Ltd Article. English language. A resource-based view of organizations suggests that internal knowledge is amongst the most important sources of competitive advantage (Hendry and Pettigrew 1990; Leonard-Barton 1995). Regardless of whe... Read More about How do knowledge brokers work? Implications for policy and practice in the case of WERS.

International access to restricted data: A principles-based standards approach (2013)
Journal Article
Ritchie, F. (2013). International access to restricted data: A principles-based standards approach. Statistical Journal of the IAOS, 29(4), 289-300. https://doi.org/10.3233/SJI-130780

Cross-border access to restricted government microdata for research has made relatively little progress. Recent developments are notable as exceptions. This paper argues that the situation is made more complex by the lack of a common general frame of... Read More about International access to restricted data: A principles-based standards approach.

Impact evaluation workplace employment relations survey and european social survey: Final report to the ESRC (2013)
Report
Drew, H., King, A., & Ritchie, F. (2013). Impact evaluation workplace employment relations survey and european social survey: Final report to the ESRC

The Economic and Social Research Council (ESRC) commissioned the University of the West of England, Bristol (UWE) to undertake an impact evaluation of the Workplace Employee Relations Survey (WERS) and the European Social Survey (ESS) focusing on the... Read More about Impact evaluation workplace employment relations survey and european social survey: Final report to the ESRC.

Sharing risks, sharing benefits: Data as a public good (2011)
Presentation / Conference
Ritchie, F., & Welpton, R. (2011, October). Sharing risks, sharing benefits: Data as a public good. Paper presented at Work session on statistical data confidentiality 2011; Eurostat, Tarragona, Spain

Effective researcher management (2009)
Presentation / Conference
Desai, T., & Ritchie, F. (2009, December). Effective researcher management. Paper presented at UNECE Worksession on Statistical Data Confidentiality 2009, Bilbao, Spain

National Statistical Institutes [NSIs] are increasingly investigating new ways of providing access to confidential microdata for research purposes. These innovations are being driven by the requirement for NSIs to ensure the best possible return for... Read More about Effective researcher management.

UK release practices for official microdata (2009)
Journal Article
Ritchie, F. (2009). UK release practices for official microdata. Statistical Journal of the IAOS, 26(3-4), 103-111. https://doi.org/10.3233/SJI-2009-0706

This paper describes the principles and practices by which microdata collected by the Office for National Statistics (ONS) is made available to researchers. Access to detailed confidential microdata, often from official sources, is acknowledged to be... Read More about UK release practices for official microdata.

A good night out: Alcohol-related behaviours in young adults (2009)
Journal Article
Ritchie, C., Ritchie, F., & Ward, R. (2009). A good night out: Alcohol-related behaviours in young adults. Worldwide Hospitality and Tourism Themes, 1(2), 169-193. https://doi.org/10.1108/17554210910962549

Purpose: The purpose of this paper is to investigate drinking patterns; attitudes towards alcohol consumption and alcohol-related behaviours amongst differing groups of young adults. A further aim is to investigate whether the drinking behaviours of... Read More about A good night out: Alcohol-related behaviours in young adults.

Disclosure detection in research environments in practice (2007)
Presentation / Conference
Ritchie, F. (2007, December). Disclosure detection in research environments in practice. Paper presented at UNECE/Eurostat work session on statistical data confidentiality - 2007, Manchester, United Kingdom

There is an increasing demand for access to raw confidential data, and NSIs have responded by setting up controlled research facilities. However, the most common approaches to statistical disclosure detection and control (SDDC) struggle to accommod... Read More about Disclosure detection in research environments in practice.

Female earnings and gender differentials in Great Britain 1977-1994 (1998)
Journal Article
Ritchie, F., & Bell, D. (1998). Female earnings and gender differentials in Great Britain 1977-1994. Labour Economics, 5(3), 331-357. https://doi.org/10.1016/S0927-5371%2898%2900005-0

This paper employs an extremely large but comparatively under-researched dataset, the New Earnings Survey, to construct a model of female earnings in Great Britain from 1977 to 1994. This study is the first to utilise the dataset's panel nature. Unus... Read More about Female earnings and gender differentials in Great Britain 1977-1994.

Hellenic statistical authority mission on microdata access: Final report
Report
Ritchie, F. Hellenic statistical authority mission on microdata access: Final report

A mission was convened to review current data access practices at the Hellenic Statistical Authority and make recommendations for future development. The resulting report defines a complete data access strategy for the Greek NSI. The report uses the... Read More about Hellenic statistical authority mission on microdata access: Final report.

User-focused threat identification for anonymised microdata
Working Paper
Hafner, H., Lenz, R., & Ritchie, F. (2015). User-focused threat identification for anonymised microdata. Bristol

When producing anonymised microdata for research, national statistics institutes (NSIs) identify a number of 'risk scenarios' of how intruders might seek to attack a confidential dataset. This paper argues that the strategy used to identify confident... Read More about User-focused threat identification for anonymised microdata.

Behavioural aspects of the national minimum wage: Measuring and interpreting behaviour in the low-wage labour market
Working Paper
Fry, S., & Ritchie, F. (2013). Behavioural aspects of the national minimum wage: Measuring and interpreting behaviour in the low-wage labour market. UK

Report for LPC on how low pay is measured in official data sources. Finds that (a) employers tend to 'round' hourly pay rates, suggesting scope for rent-sharing in these low-paying jobs, and/or high transactions costs associated with wage-setting; an... Read More about Behavioural aspects of the national minimum wage: Measuring and interpreting behaviour in the low-wage labour market.

Can a change in attitudes improve effective access to administrative data for research?
Working Paper
Ritchie, F. (2016). Can a change in attitudes improve effective access to administrative data for research?. Bristol, UK

The re-use of administrative data for social research holds great potential. From a privacy perspective, administrative data present some additional challenges, including lack of consent, existence of matching databases, and the association with data... Read More about Can a change in attitudes improve effective access to administrative data for research?.

Operationalising ‘safe statistics’: The case of linear regression
Working Paper
Ritchie, F. (2014). Operationalising ‘safe statistics’: The case of linear regression. Bristol

The recent growth in research access to confidential government microdata has prompted the development of more general 'output-based statistical disclosure control' (OSDC) methods which go beyond tabular protection. Central to OSDC is the concept of... Read More about Operationalising ‘safe statistics’: The case of linear regression.

Addressing the human factor in data access: Incentive compatibility, legitimacy and cost-effectiveness in public data resources
Working Paper
Ritchie, F., & Welpton, R. (2014). Addressing the human factor in data access: Incentive compatibility, legitimacy and cost-effectiveness in public data resources. Bristol

Traditional models of incentivising people suggest that positive incentives are more effective than negative ones. We argue that in data access the opposite can be true, as the assumptions made at the design stage can fundamentally change the user en... Read More about Addressing the human factor in data access: Incentive compatibility, legitimacy and cost-effectiveness in public data resources.

Resistance to change in government: Risk, inertia and incentives
Working Paper
Ritchie, F. (2014). Resistance to change in government: Risk, inertia and incentives. Bristol

There is a popular impression that governments are resistant to change and innovation, and that this is due to a combination of overly bureaucratic processes and a culture of risk aversion. It is debatable that this is well-founded, theoretically or... Read More about Resistance to change in government: Risk, inertia and incentives.

What is a manufacturing job?
Working Paper
Ritchie, F., Thomas, A., & Welpton, R. (2012). What is a manufacturing job?. UK

Policy initiatives in the UK targeting manufacturing industries have for a number of years been driven by a perceived importance of this sector to the economy. In order to target such policies, it is important to establish the true size of this secto... Read More about What is a manufacturing job?.

Accessing the new earnings survey panel: Efficient techniques and applications
Thesis
Ritchie, F. (2005). Accessing the new earnings survey panel: Efficient techniques and applications. (Thesis). University of Stirling. Retrieved from https://uwe-repository.worktribe.com/output/1055954

The New Earnings Survey Panel Dataset is one of the largest datasets of its kind in the world. Its size and confidentiality restrictions present considerable difficulties for analysis using standard econometric packages. This thesis presents... Read More about Accessing the new earnings survey panel: Efficient techniques and applications.

Operationalising principles-based output statistical disclosure control
Other
Ritchie, F., & Welpton, R. (2015). Operationalising principles-based output statistical disclosure control

This document is intended to help support staff and managers in research environments to implement principles-based output statistical disclosure control of results generated from confidential sources of data. It contains extensive discussion on the... Read More about Operationalising principles-based output statistical disclosure control.