X
  • Home
  • About us
    • About CLOSER
      Our aim is to maximise the use, value and impact of UK’s longitudinal studies.
    • Our partners
      Find out more about our partner organisations.
    • Explore the studies
      Find out more about the longitudinal studies in CLOSER.
    • Our funders
      CLOSER is funded by the ESRC.
    • Who we are
      Meet the academics and professionals managing CLOSER.
    • Our Communities of Practice
      Find out more about our Communities of Practice.
  • Our studies
    • Explore the studies
      In this section you can find out more about the longitudinal studies that are part of CLOSER.
    • Timeline of studies
      View the interactive timeline of studies.
  • Search our data
    • How to access the data
      Learn how to access the data from the CLOSER studies
    • CLOSER Discovery
      Start using our search engine.
  • Research we fund
    • About the research we fund
      We fund interdisciplinary research across the major longitudinal studies.
    • Data harmonisation
      We are working to make the data from our studies more comparable.
    • Data linkage
      We are helping to link data from our studies to administrative records.
    • world icon
      CLOSER International
      Our CLOSER International project aims to promote the value of longitudinal studies in low and middle-income countries.
    • Other research we fund
      We fund other research in the biomedical and social sciences.
  • News & blogs
    • News
      The latest news from the home of longitudinal research.
    • Blogs
      Opinion, analysis and discussion from the UK’s longitudinal studies community.
  • Events & training
    • Upcoming events & training
      See what events and training we have in the coming months.
    • Previous events
      Take a look at our previous events and associated resources.
    • CLOSER Learning Hub
      Find out about our online learning resource for those new to longitudinal studies.
  • Our resources
    • COVID-19 Longitudinal Research Hub
      Explore COVID-19 related activity including new surveys, data releases and findings from the longitudinal research community
    • Cross-study data guides
      Explore our interactive guides to discover measures used to assess cognition, physical activity, and diet in a number of UK longitudinal studies.
    • Our longitudinal resources
      Access our publications library and links to external resources.
    • Our longitudinal evidence
      Explore findings from our longitudinal studies.
    • Our changing society
      Information about the historical and political backdrop to cohort members’ lives.
    • Preparing for the future of longitudinal science
      Learn how CLOSER can help the UK’s longitudinal population studies meet the challenges facing them in the future.

Search
Menu

Home  >  Blogs  >  Discover the future

Discover the future

30 August 2018

Scoop.it ShareThis

Blog

Meta data codeThe discoverability of data collected by the UK’s longitudinal studies has come a long way since 2015, argues CLOSER’s Senior Metadata Officer Hayley Mills, who charts the past, present and future of finding study data.

The past

Previously, trying to find out what data had been collected by the eight longitudinal studies in CLOSER involved accessing and searching through a variety of different forms of documentation, often varying by study. It was an involved and time-consuming process for researchers and those working in policy. For those new to the studies this was even more daunting, as understanding the vast amount of data collected could be overwhelming.

If you were a study, you may have had to handle incoming requests from researchers who wanted to browse the available data, and invest time in trying to find the most appropriate variables for each request. Managing longitudinal data is not easy, with studies having to maintain complex and diverse data, as well as make these available for several decades – over 70 years in some cases. This longevity brings with it potential risks: for example, loss of knowledge over time through staff changes or relocation. In addition, many of the systems may not have been built for interoperability, potentially resulting in duplication of work and information when working with others.

The present

With the digital age beginning decades ago, and new researchers growing up in the age of Google, expectations about how we find and manage data have changed. So we set out to create CLOSER Discovery on behalf of the longitudinal community, to bring the discovery of longitudinal data in line with current technologies and to address some of these challenges.

Our first, and fundamental goal was make it easier – in some cases even possible – to search the data collected from the UK’s longitudinal studies, as well as the related survey questions and measurements. We also wanted to provide sufficient information to understand those underlying questions and measurements, and the context within which information was collected. Finally, we wanted as far as possible for it to be future-proof, adhering to the best metadata standards for interoperability with other infrastructures, both in the UK and internationally.

Three ways CLOSER Discovery makes your life easier

In addition to the benefits of discoverability, CLOSER Discovery and its infrastructure has the potential to be a powerful tool and resource for researchers and data managers.

  1. It facilitates cooperation

Using CLOSER Discovery, researchers can now find all the information in one place. Discovery provides detailed information about variables, data collection instruments and the data collection process, as well as allowing comparability and equivalency of this metadata between studies. This all aids the ability of researchers to harmonise data and draw comparisons between studies, an area of increasing interest both from funders (to maximise the value of publically funded data sets) and policymakers (to help them understand change across generations).

The metadata in CLOSER Discovery can be queried by all kinds of search engines, archives and data analysis tools by using either the API (Application Programming Interface) or OAI–PMH (Open Archives Initiative – Protocol for Metadata Harvesting), eliminating the need for individual studies to provide this metadata themselves and avoiding duplication.

  1. It is transparent

CLOSER Discovery facilitates openness of metadata by providing detailed provenance of a study’s data in a safe and secure way for studies that cannot make data openly accessible. In addition, longitudinal studies can be complex to understand, and getting to know a study can take a long time. Often, useful information is held in several different places or with a number of individuals. CLOSER Discovery provides a more, centralised, standardised and simplified method of learning about the studies.

  1. It is sustainable

Running longitudinal studies is a costly process and requires lots of manual work. CLOSER Discovery brings the studies’ infrastructure and information more in line with current technologies, like automation. It uses the same metadata standard (Data Documentation Initiative) as many other data centres, research organisations, statistical agencies and international organisations such as the World Bank. This guarantees the robustness and long-term validity of the metadata now being generated. As technology develops further, these standardised, sustainable metadata are easily moved to new platforms and systems, without any loss of information. This helps studies to protect against the risk of losing metadata about their data as well as losing the knowledge about data held by staff.

The future

CLOSER Discovery will never be a finished product. Firstly, we are improving transparency further by allowing researchers to create lists of key variables that can be shared or referenced in journal articles. Secondly, we are encouraging more collaboration by identifying equivalent variables within and across studies, as well as working with other metadata platforms. And lastly, we are continually adding content from current and additional studies to safeguard more data and metadata for a sustainable future.

Explore CLOSER Discovery and let us know how you think we can make it even better.


Hayley Mills is a Senior Metadata Officer for CLOSER, the home of longitudinal research.

 

Suggested citation:
Mills H (2018) “Discover the future”, CLOSER blog.

  • Contact
  • Jobs
  • Privacy policy
  • Cookies
Back to top

CLOSER
UCL Social Research Institute
55-59 Gordon Square
London WC1H 0NU

map

TEL +44 (0)20 7612 6938 EMAIL closer@ucl.ac.uk

social media

Love longitudinal?

Sign up for our email newsletters to get the latest from CLOSER

Sign up
© 2018 CLOSER. All rights reserved.