Assessing the Validity of Claims-Based Diagnostic Codes for Psychotic and Affective Disorders and the Influence of the Coding Transition from the ICD-9 to the ICD-10 in Taiwan's National Health Insurance Research Database
Journal
Clinical Epidemiology
Journal Volume
17
Start Page
635
End Page
645
ISSN
1179-1349
Date Issued
2025
Author(s)
Wang, Yen-Wen
Chan, Jen-Hui
Abstract
Purpose: No studies have validated psychiatric diseases diagnoses in Taiwan's National Health Insurance Research Database (NHIRD). We aimed to assess the interrater reliability of chart-review among psychiatrists, examine the validity of the diagnostic codes for psychotic disorders and affective diseases in the NHIRD against review-based diagnoses, and examine whether the change in the coding system from the ICD-9-CM to the ICD-10-CM affected the validity of the diagnostic codes.
Patients and methods: The study participants were psychiatric inpatients aged 18 to 65 years who were admitted in 2015 and 2017, respectively, to the main and three branch hospitals of National Taiwan University Hospital. A chart review was conducted among 48 purposively selected inpatients with discharge diagnoses in five core categories to assess interrater reliability. This chart-review procedure was then used to generate diagnostic codes for a stratified sampling of 727 inpatients with discharge diagnoses in 12 diagnostic categories of psychotic disorders and affective disorders to examine the validity of the diagnostic codes.
Results: The intraclass correlation coefficient reliability of schizophrenia and three broad categories of diagnoses indicated good interrater reliability. The positive predictive value and sensitivity of common diagnoses in the narrow category (eg, schizophrenia) or the broad category (eg, psychotic disorders, bipolar disorders, and major depressive disorders) were high-performing (≥ 0.70), whereas those of the diagnoses of low prevalence were modest. The validity indices of claims-based diagnoses using the ICD-10-CM tended to be better than those using the ICD-9-CM.
Conclusion: This first-ever study validating psychiatric diagnoses in Taiwan's NHIRD using a structured chart review suggests that the diagnostic codes of narrow categories of schizophrenia or other broad categories are recommended for high-performing validity indices. Intensive training for the coding plus the specific details requested by the ICD-10 may increase the validity of the claims-based databases for psychotic and affective disorders.
Subjects
electronic health records
health insurance database
interrater reliability
intraclass correlation coefficient reliability
positive predictive value
psychiatry
psychotic disorders
sensitivity
Publisher
Dove Medical Press Ltd
Type
journal article