Managing data changes for comparison over time

Changes to data, statistics and information can happen over time, and can include changes to the structure of the information to improve accuracy, relevance or efficiency or to adhere to international best practice. They may be forced due to changes in the source data for other reasons. All such changes need to be managed to ensure information is comparable over time.

Impact on data quality   Consistency

Learning outcomes

  • Recognise changes to the structure of your information.
  • Understand the need to manage changes to ensure continuity and consistency.
  • Understand the different types of changes to the data structure.
  • Understand the techniques available to maintain continuity.

Any change in the data structure introduces a break in the time series. This is called a discontinuity.

Points of discontinuity in a time series must be identified and explained.

Substantial revisions to time series should, if possible, provide:

  • consistent back-data series
  • analysis of the differences between the old and revised series
  • explanation of the effect on any previously published commentary or interpretation.

Users must be advised of substantial conceptual and methodological changes before statistics are released based on the new methods.

Backcasting

A number of statistical modelling methods are available to produce estimates for past time periods under the new measurement conditions. This is called backcasting.

The method chosen depends on the needs of the users, and the availability of information and resources.

Guidance

Top