Wang, Yen-WenYen-WenWangCHEN-CHUNG LIUChan, Jen-HuiJen-HuiChanCHI-SHIN WUHSI-CHUNG CHENCHENG-CHE CHENWEI-LIEH HUANGSHIH-CHENG LIAOTZUNG-JENG HWANGWEI J. CHEN2025-09-172025-09-172025https://scholars.lib.ntu.edu.tw/handle/123456789/732156Purpose: No studies have validated psychiatric diseases diagnoses in Taiwan's National Health Insurance Research Database (NHIRD). We aimed to assess the interrater reliability of chart-review among psychiatrists, examine the validity of the diagnostic codes for psychotic disorders and affective diseases in the NHIRD against review-based diagnoses, and examine whether the change in the coding system from the ICD-9-CM to the ICD-10-CM affected the validity of the diagnostic codes. Patients and methods: The study participants were psychiatric inpatients aged 18 to 65 years who were admitted in 2015 and 2017, respectively, to the main and three branch hospitals of National Taiwan University Hospital. A chart review was conducted among 48 purposively selected inpatients with discharge diagnoses in five core categories to assess interrater reliability. This chart-review procedure was then used to generate diagnostic codes for a stratified sampling of 727 inpatients with discharge diagnoses in 12 diagnostic categories of psychotic disorders and affective disorders to examine the validity of the diagnostic codes. Results: The intraclass correlation coefficient reliability of schizophrenia and three broad categories of diagnoses indicated good interrater reliability. The positive predictive value and sensitivity of common diagnoses in the narrow category (eg, schizophrenia) or the broad category (eg, psychotic disorders, bipolar disorders, and major depressive disorders) were high-performing (≥ 0.70), whereas those of the diagnoses of low prevalence were modest. The validity indices of claims-based diagnoses using the ICD-10-CM tended to be better than those using the ICD-9-CM. Conclusion: This first-ever study validating psychiatric diagnoses in Taiwan's NHIRD using a structured chart review suggests that the diagnostic codes of narrow categories of schizophrenia or other broad categories are recommended for high-performing validity indices. Intensive training for the coding plus the specific details requested by the ICD-10 may increase the validity of the claims-based databases for psychotic and affective disorders.enelectronic health recordshealth insurance databaseinterrater reliabilityintraclass correlation coefficient reliabilitypositive predictive valuepsychiatrypsychotic disorderssensitivity[SDGs]SDG3[SDGs]SDG8journal article10.2147/CLEP.S52261840661787