Health services research: reporting on studies using secondary data sources

Table 2: Author checklist and reviewer questionnaire for studies using secondary data sources
Abstract
  • Does the structured abstract include all the subheadings of an original research article?
Introduction
  • Is the problem the study was designed to address clearly stated?
  • Is the current state of knowledge in the area concisely summarized?
  • Is the research question or objective relevant to health care and appropriate for the target audience?
Methods

General considerations

  • Is the study setting or context well described?
  • Is the sample frame representative of the target population?
  • Is there evidence of sampling bias?
  • Are the inclusion and exclusion criteria clearly noted?

Use of secondary data

  • Was consent to use the secondary data obtained (if appropriate) and confidentiality maintained throughout the study?
  • Was the information drawn from the data source specified fully?
  • Was the accuracy and completeness of the data source assessed, particularly for the specific information being sought?
  • Do the data provide appropriate information or measures to answer the research question?
  • Was the process of any database linkages explained?

Analytical and statistical issues

  • Was the unit of analysis (e.g. patients, providers, hospitals or geographic regions) specified and characterized?
  • Were appropriate statistical methods used?
  • Were sensitivity analyses described to determine the robustness of the results?
  • In descriptive studies of practice patterns, were the obvious sources of variation considered (e.g. adjustment for age and sex differences in populations or for disease prevalence)?
  • In analytical studies of practice patterns:
    • Were the simultaneous effects of multiple potential sources of variation analysed?
    • Were practice styles characterized rigorously with explicit criteria?
    • Was there adequate statistical power to test the relationships of interest?
  • In analytical studies of outcomes:
    • Were the outcome measures appropriate?
    • Were the comparison groups adequately characterized to permit adjustment for confounding factors?
Results
  • Do the results cover everything identified in the methods section?
  • Is there a report on missing data or excluded subjects?
Discussion
  • Are the main findings of the study summarized?
  • Is the significance of the study addressed in relation to other studies?
  • Are the results appropriately interpreted and are other possible interpretations of the results considered?
  • Are the limitations of the study identified?
  • Are areas for further study suggested?
Tables and figures
  • Are the tables and figures effective in conveying the main points of the study?
References
  • Are the references relevant, complete and current?


[Return to text]