Skip to main content

Table 5 Methodologies used to specify data quality for implementation

From: Ontological specification of quality of chronic disease data in EHRs to support decision analytics: a realist review

Study types

1

2

3

4

5

Summary and results of methodologies

Contexts

Reference

       

(Gillies 2000a)

 

√

   

Represent a tool to assist with continuous improvement of the use of information systems in general practice based on their requirements which is accurate information

Health information

      

Shows how the model can be practically used to improving the use of coding (external consistency of data) and accurate information (data correctness) within a general practice in a systematic way

 

(Kahn et al. 2012)

√

√

   

This is a well-grounded, logical approach and a case study to indicate health organizations need sound, dependable, useful and usable information for analytical purposes.

Clinical data

      

However, there is need to some details of their participants, sampling and why focus on only 16 dimensions of Information Quality (IQ).

 
      

This approach could be applicable way for the assessment of DQ in CDM because such an assessment provides a reasonable baseline for determining what improvements should be made in DQ based on fitness for purpose for analytical purposes

 

(Liaw et al. 2011)

√

√

√

  

They used a well-designed framework to describe the intrinsic DQ (correctness and consistency) and fitness for purpose (completeness) for research and clinical purposes

Clinical data

      

However, this study raised the theoretical dependence of the SQL/SAS approach on the lack of a transparent and explicit data model, metadata and process within proprietary EHRs

 

(Arts et al. 2003)

√

√

   

Their approach demonstrates that after physicians’ training, completeness, correctness and adherence to data definitions increased in ICUs significantly

Clinical data

(Arts et al. 2002b)

√

√

   

Demonstrate a list of procedures for high data quality assurance in medical registry based on causes of insufficient data quality

Health information

(Arts et al. 2002a)

√

√

√

  

Show that the overall DQ of medical registries has good quality (focusing on accuracy and completeness) and also explain their positive results as compared with earlier reports from the literature.

Clinical data

      

However, they did not compare data quality before and after the implementation of procedures to improve the accuracy of data

 

(Stvilia et al. 2009)

√

√

   

Use a mixed methodology with multiple data sources: 1. The analysis of 150 Web pages and related web sites identified the major approaches the providers use to define their

Health web pages

      

IQ criteria set: a. centrally defined, b. community constructed, and c. outsourced to third-party raters. 2. The researchers surveyed a convenience sample of 108 healthcare information consumers to gain better

 
      

insight into the health IQ evaluation behaviour of consumers. 3. Semi structured in-depth interviews with a sample of 20 survey participants

 
      

Use a sample of the IPL’s Q&A communication archives to identify the healthcare IQ criteria used by consumers and information intermediaries

 
      

Results show that consumers may lack the motivation or literacy skills to evaluate the information quality of health

 

(Kahn et al. 2002)

√

    

Developing a two-by-two conceptual model for describing IQ (PSP/IQ)

Health information

      

Mapping the 16 IQ dimensions into their model

 
      

Survey 45 professionals to determine which IQ dimensions belong in each quadrant of the model

 
      

Case study in 3 healthcare organizations that 75 people in each organization completed a 70-item questionnaire (a 10-point Likert scale) for assessing the quality of their patients information on

 
      

Provide a reasonable baseline for determining what improvements should be made in DQ (soundness, dependable useful and usable information) based on fitness for purpose for professionals analytical purposes.

 
      

Demonstrating the efficacy of the PSP/IQ model in three large healthcare organizations

 

(Britt et al. 2007)

√

√

   

Use statistical methods to manage data quality using SAS as a computer program in statistical package

Clinical data

      

Measure representativeness, reliability, validity and accuracy of BEACH data eg. Reliability of coding of reasons for encounters and issues validity of ICPC to categorizing data. Accuracy of problem labels recorded by GPs (About 1000 GPs participate yearly)

 

(Chen 2009)

√

√

   

Focus on a full mathematical analysis (mathematical software)

Infectious diseases

      

Investigate the effect of quality of information and amount of information are used interchangeably in the health behaviour e.g. decision making

 

(Choquet et al. 2010)

 

√

   

Use Talend Open Studio open source software as well as developed stored procedures in SQL for the object quality criteria

Hospital dataset

      

Use the 6 HL7 information models for modelizing their domain

 
      

Apply the TDQM 4 steps approach to score quality of each vertex of IQT

 
      

Use two consensual resources to standardize the EHR vocabulary, include: 1) ATC: The WHO drugs and substances international classification and 2) NEWT: organisms taxonomy database

 
      

Propose methods and measures to assess data quality (focus on data accuracy)

 
      

Propose 3 dimensions to classify the quality measures proposed (objects, concepts, and terms) as vertexes of their model Information Quality Triangle = IQT)

 
      

Measure the distance between standardized information models and reference terminologies against its CIS

 
      

Allow building pertinent and coherent monitoring trends

 
      

Present that controlled vocabularies are a necessity to share data

 

(Cunningham-Myrie et al. 2008)

   

√

 

Use ICD-10 for coding various collected data and to facilitate comparability of standardized data

Health information

      

Use Two broad categories of information were sought: a) epidemiological data and b) health service utilization data

 
      

Show that data management systems in hospitals were not linked to facilitate generation of cost-effectiveness estimates and other information required to compare options for health investment

 
      

Show methodological way for improvement health information quality for the economic analysis

 

(Huaman et al. 2009)

√

√

   

Timeliness and data quality were assessed by calculating the percentage of reports sent on time and percentage of errors per total number of reports, respectively

Infectious disease surveillance

      

Use training program: 12 week prospective study with training program for reporting personnel.

 
      

Randomised selection to phone, visit or control for their supervisions

 
      

The training improved report timeliness but did not have such impact on data quality.

 

(Kiragga et al. 2011)

√

√

√

  

Use the Research Cohort database as the reference "gold standard" for the assessment of data accuracy

Infectious diseases

      

Use statistical test e.g.: Categorical variables were compared using Chi-square test, the Mann–Whitney test was used for the continuous variables

 
      

Compare 2 databases, one from a clinic and one from a research team to assess the quality of data (completeness and accuracy)

 
      

Results show that there is a high rate of underreporting of OIs in a routine HIV clinic database and demonstrate high rates differences between clinic and research databases

 
      

Their findings have important implications for the use and interpretation of data derived from routine HIV observational databases for research and audit, and they highlight the need for ongoing regular validation of key data items in these databases

 

(Lima et al. 2010)

 

√

√

  

Use a decision support example around a hypothetical patient called John who experiences an exacerbation of his COPD

Clinical Guidelines (CG) for COPD

      

Use the Clinical Guideline for COPD that there are 16 criteria that suggest the patient should be admitted and the model takes into account answers to each criterion

 
      

Present a model for the prediction and evaluation of quality of information to a multi criteria decision making process

 
      

Model describes a decision support tool for use in the management of COPD

 
  1. Notes for study types: See Table 2 for legend.