September 2010, Volume 32, No. 3
Original Articles

Accuracy and completeness of ICPC coding for chronic disease in general outpatient clinics

Lawrence CL Wong 王志龍, MK Lee 李文基, HT Mak 麥凱婷, PK Wong 黃柏鍵, KW Chung 鍾建榮, KH Wong 黃幗開, SM Tam 譚思敏, HW Li 李向榮, TB Chan 陳定邦, Kenny Kung 龔敬樂, Augustine Lam 林璨, Philip KT Li 李錦滔

HK Pract 2010;32:129-135

Summary

Objective: To assess the accuracy and completeness of the International Classification of Primary Care Coding (ICPC) for chronic illnesses in the general outpatient clinics (GOPCs) and to identify common issues in coding for further improvements and implementation.

Design: This is a retrospective review of case notes belonging to patients attending eight GOPCs. The data were obtained through the collection of the relevant data in the Hospital Authority’s computerized Clinical Management System (CMS).

Subjects: A random sample of patients attended from the period: 1st December to 7th December 2008.

Main outcome measures: The type and number of chronic illnesses of each case, and the accuracy and completeness of their corresponding ICPC coding.

Results: 6095 (38.0% of total attendance) records were reviewed, of which 3274 (53.7%) patients had chronic illness. Overall 6608 chronic illnesses were identified, with a mean of 2.0 chronic illnesses per consultation. 75.4% of chronic illnesses were correctly coded. 19.4% and 5.3% were missed and wrongly coded respectively. The percentage of missing coding was positively correlated to the case complexity while the percentage of correct coding was inversely correlated.

Conclusion: 24.7% of ICPC codes for chronic illness were either missed or wrongly coded. The commonly missed or wrongly coded ICPC was identified. Further study, such as focus group discussion or questionnaire for doctors, will be needed to explore the reasons and for further improvements.

Keywords: International Classification of Primary Care (ICPC), general outpatient clinics (GOPCs), chronic disease, completeness, accuracy 

摘要

目的: 評估普通科門診使用基層醫療國際疾病分類 (ICPC),做慢性疾病編碼的準確性和完整性,並找出其中常見的問題,以便進一步改善和施行。

設計:在八個普通科門診診所,通過醫管局的臨床資訊管理系統(CMS)收集相關資料,進行回顧性病歷研究。

對象:隨機抽取的2008 年12 月1 日至7 日期間到診病人的病例。

主要測量內容:每個個案的慢性疾病的類型和數量,以及其相應的國際編碼的準確性和完整性。

結果:共研究了6095 位病人的病例記錄,佔總就診人次的38.0% ,其中53.7% ,即3274 位患者有長期疾病。合共檢定6608 個慢性疾病,平均每次診治有2.0 個。75.4% 的慢性疾病被正確編碼, 19.4%和5.3%則分別被遺漏編碼或錯誤編碼。遺漏編碼的百分比和相關案例的複雜性呈正相關關係,而正確編碼的百分比則呈負相關。

結論:24.7% 的慢性疾病編碼發生遺漏或者錯誤 。已經確認了最常出現問題的慢性疾病編碼,需要做更深入研究,例如通過小組討論或醫生問卷調查以探討問題的原因及做進一步的改善。

主要詞彙:基層醫療國際疾病分類(ICPC),普通科門診,慢性疾病,完整性,準確性


Introduction

The International Classification of Primary Care (revised version) (ICPC-2)1 coding was designed for the classification of patient’s reasons for encounter, health problems or diagnoses. ICPC coding is essential for the monitoring of clinical practice, clinical and administrative planning and implementation.2,3 An accurate and complete coding of ICPC facilitates future epidemiological data gathering, and is crucial in health services planning and research. Nevertheless, a recent audit in the Family Medicine Integrated Clinic illustrated that a high percentage of ICPC coding does not equate with a high ICPC coding accuracy and completenss.4 There was a clinical audit in the four primary care clinics of the Department of Health5, but there had been no similar studies in the Hospital Authority (HA) general outpatient clinics. 

Health services funding in HA’s in-patients is based on case complexity. Costs are expected to be higher for those with more complex disease combinations, which in turn attract greater resources from the government. If GOPCs (which form the major bulk of Hong Kong’s public primary care) future funding is to be based on case complexity or pay for performance, accurate and complete coding would be essential to ensure appropriate resources allocation. Furthermore, since patients with chronic illness comprise the majority among GOPC attendees (around 60% caseload from statistic s in the New Terrorities East Cluster6), priority must be given to the promotion of correct coding for chronic illnesses.

Doctors working in GOPCs comprise a heterogeneous group of professionals, including community based family medicine trainees, higher family medicine trainees, doctors without any prior vocational training in family medicine, doctors with prior non-family medicine vocational training, and family medicine specialists. Trainees may have had the opportunity to receive training in ICPC coding through their structured educational programme (as part of their family medicine training requirement). Non-trainees would have received brief introduction on ICPC. However, they may not have formal training for ICPC coding and this is not in the undergraduate curriculum. Doctors need to input ICPC coding for each reason for encounter (RFE) at each consultation. There is no upper limit for the number of

ICPC coding in each consultation and there is no prioritization for ICPC coding in the system. Doctors code ICPC at the highest level of their clinical judgment. That means they will code the disease only rather than the symptom, i.e. code (R74) upper respiratory infection acute, rather than (R05) cough.

This study aims to assess the accuracy and completeness of ICPC coding for those with chronic illness in GOPCs and to identify the common errors in coding, with a view for future interventions to improve ICPC coding for chronic illnesses in GOPCs. 

Method

Case review process

Case notes belonging to patients attending eight general outpatient clinics in the HA New Territories East Cluster from 1st December to 7th December 2008 were reviewed. In each GOPC, one (for those with three or less consultation rooms) or two (for those with four or more consultation rooms) consultation rooms were randomly selected for patient sampling. Within that one week period, different days were again randomly selected. Consultation notes of all patients who received consultations in the selected rooms and days were reviewed. This was a retrospective study, and all attending doctors were blinded about the study. Case notes of patients with chronic illness were further assessed for the accuracy and completeness of the ICPC coding. Clinical notes were retrieved through the Clinical Management System (CMS), the computerized medical system used by the Hospital Authority. There were nine investigators in the study. Two of them were basic trainees of family medicine and the other seven investigators achieved Fellowships of Hong Kong College of Family Physicians or higher qualifications. In order to decrease the inter-investigators variation, standardization meetings were held before data collection. Each case was reviewed by one investigator. Regular standardization meetings were also held during the data collection period to discuss the problem arising during reviewing the consultation notes.

Outcome variables

For each patient episode, investigators derived presumptive diagnoses from the case notes and drug prescription, and matched these with the ICPC codes entered for that particular episode. Each code entered for that consultation was then classified into any of the three categories, discrepancies would be resolved by discussion and consensus among investigators:

  • Correct: the ICPC code (or codes) matches the description in the case notes and/or drug prescribed. For example, patient follow up for hypertension with complication was coded K87 (hypertension, complicated)
  • Incorrect: although an ICPC code (or codes) had been assigned, the description in the case notes and/or drug prescribed did not match the code. For example, patient follow up for hypertension with complication was incorrectly coded K86 ( hypertension, uncomplicated), rather than K87 (hypertension, complicated)
  • Missing: the corresponding chronic disease ICPC code (or codes) had not been assigned for the description in the case notes and/or drug prescribed. For example, patient follow up for hypertension with complication was not coded K87 (hypertension, complicated) or any other related coding.
  • The following two assumptions were made in this study:
    a) chronic illness was defined as a condition that requires:
  • regular follow up as arranged by the attending doctor, or
  • the long term regular use of medications (four weeks or more), or
  • regular investigations as part of monitoring
    b) case complexity was dependent on the following two factors, larger number indicated greater complexity
  • number of chronic illnesses
  • number of medications prescribed
    The following parameters were collected:
  • Patient’s age and gender
  • Type and number of chronic illnesses presented to the attending doctor (using the method above)
  • Number of presenting problems (termed reasons for encounter [RFEs]) other than chronic illness
  • Number and type of medications, both related or not related to the chronic illness, prescribed in the consultation

Statistical analysis

Based on an estimated GOPC attendance of 790,000 per year, and taking a confidence level of 95% and confidence interval of 5%, the minimum required sample size will be 384. Microsoft excel was used for all data entry and analysis. The correlation was calculated by Pearson correlation method.

Results

Number of presenting problems & chronic illness

6095 (38.0% of total attendance) case records were reviewed. Amongst these 3274 (53.7%) patients had chronic illness. Overall 6068 chronic illnesses were encountered, with a mean of 2.0 chronic illnesses encountered per consultation. For each consultation for chronic illness, there was on average an extra 0.6 other presenting problem. The percentage of coding for non-chronic illness RFE in patients with chronic illness was only 26.5%, i.e. 73.5% of non-chronic illness ICPC coding missing in patients attending for chronic illnesses with other reasons for encounter. Individual clinic data were shown in Table 1 for references.

Table 1: Summary of results of different clinics
Clinic 1 Clinic 2 Clinic 3 Clinic 4 Clinic 5 Clinic 6 Clinic 7 Clinic 8 Total
Total cases in this clinic 3111 2709 1152 771 1823 2478 1677 2335 16056
Total cases recruited 945 912 397 394 712 965 667 1103 6095
Total chronic cases recruited 490 353 248 225 478 396 459 625 3274
% of chronic case 51.9% 38.7% 62.5% 57.1% 67.1% 41.0% 68.8% 56.7% 53.7%
Mean Age 63.5 61.2 67.8 66.3 65.8 64.0 64.8 62.6 64.2
Sex (male to female) ratio 0.70 0.89 0.65 0.67 0.71 0.79 0.90 0.73 0.76
Total chronic problems seen 916 653 503 411 1034 819 1007 1265 6608
No. of chronic problems per case 1.9 1.8 2.0 1.8 2.2 2.1 2.2 2.0 2.0
Total RFE seen 1172 834 678 541 1287 1136 1234 1656 8538
No. of RFE per case 2.4 2.4 2.7 2.4 2.7 2.9 2.7 2.6 2.6
Case coding rate 99.6% 100.0% 98.0% 98.2% 97.7% 98.2% 99.3% 98.9% 98.8%
% of correct coding per case 78.7% 80.0% 73.2% 69.5% 73.0% 70.4% 71.8% 80.8% 75.4%
% of missing coding per case 16.9% 12.5% 21.9% 21.4% 20.8% 25.7% 24.2% 14.8% 19.4%
% of wrong coding per case 4.5% 7.5% 4.8% 9.1% 6.3% 3.9% 4.1% 4.4% 5.3%

ICPC coding accuracy and completeness for chronic illness

Among those with chronic illness, 98.8% had some form of ICPC coded, which included any acute or chronic, correct or wrong ICPC coding. However, only 75.4% of chronic illnesses were correctly coded. 19.4% and 5.3% of ICPC codes for chronic illnesses were missing and wrongly coded respectively. (Figure 1) Among those with missing codings, 43.2% (719) were considered to be in this category because drugs were prescribed for longer than four weeks but without related ICPC codes. Such medications include lubricating eye drops, antacids and analgesic balm.

figure_1

ICPC coding accuracy and completeness, and case complexity

The percentage of correct coding was inversely correlated with the case complexity. In this study, the number of chronic problems per patient ranged from one to six (Table 2), with a decreasing percentage of correct coding as the number of chronic problems increased (r = -0.7). Similarly the number of medications prescribed per consultation (ranging from zero to fifteen) was also inversely correlated with the percentage of correct coding (r = -0.67), as shown in Table 3

Table 2: Correlation of percentage of coding and correctness in terms of number of chronic problems in a case
No. of chronic problems in a case 1 2 3 4 5 6 correlation ( r )
No. of cases 1207 1162 619 220 56 10
No. of cases with coding 1184 1160 612 215 55 9
Cases with coding 98.1% 99.8% 98.9% 97.7% 98.2% 90.0% -0.70
% of correct coding per case 91.7% 71.5% 61.4% 54.3% 47.9% 45.0% -0.95
% of missing coding per case 4.2% 23.7% 32.2% 36.5% 40.7% 51.7% 0.96
% of wrong coding per case 4.1% 4.9% 6.4% 9.20% 11.4% 3.3% 0.31

 

Table 3: Correlation of the percentage of coding and correctness in terms of number of long term medications in a case
No. of long term medication in a consultation 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Correlation( r )
( for 0 to 10 medication only)
No. of cases 64 740 805 632 428 272 151 91 48 80 14 5 3 0 0 1
No. of cases with coding 62 728 797 629 422 270 150 91 46 19 12 5 3 0 0 1
% of cases with coding 96.9 98.4 99.0 99.5 98.6 99.3 99.3 100 95.8 95.0 85.7 100 100 0.0 0.0 100 -0.67
% of correct coding per case 81.8 89.6 82.0 70.2 66.0 63.4 63.4 57.5 54.2 48.4 41.9 51.6 49.0 0.0 0.0 80.0 -0.97
% of missing coding per case 12.8 6.1 14.7 24.6 27.7 29.7 26.9 31.2 39.2 47.0 48.4 28.4 44.3 0.0 0.0 20.0 0.96
% of wrong coding per case 5.5 4.3 3.3 5.2 6.3 6.9 9.7 11.3 6.5 4.6 9.6 20.0 6.7 0.0 0.0 0.0 0.57

The correctness of ICPC coding was strongly and inversely correlated to case complexity both in terms of the number of chronic problems per case (r = -0.95) and the number of medications prescribed (r = -0.97). On the other hand, the percentage of missing coding was strongly and positively correlated to the number of chronic problems in a case (r = 0.96) and the number of medications prescribed (r = 0.96). There was only a weak correlation between the percentage of wrong coding and case complexity (r = 0.31 for chronic problems per case, and r = 0.56 for number of medications prescribed).

Coding accuracy and completeness for specific chronic illnesses

The ten most commonly encounter ed chronic illnesses and their coding performance are shown in Table 4. The large majority had >50% correct coding frequencies. Uncomplicated hypertension, non-insulin dependent diabetes and lipid disorder were associated with the highest percentage of correct coding. On the other hand, complicated hypertension (K87) and cerebrovascular disease (K91) had the highest percentage of wrong coding (59.5% and 60.9% respectively). 152 out of the 153 patients coded as having uncomplicated hypertension (K86) actually had complicated hypertension (K87). 110 out of the 112 patients coded as having cerebrovascular accident (ie acute stroke) should have been coded with K91 (cerebrovascular disease). 

Table 4: The ten most commonly encountered chronic illnesses and their coding performance
Common chronic illness Frequency of encounter Correct coding frequency (percentage) Missing coding frequency (percentage) Wrong coding frequency (percentage) Most common wrong coding frequency (percentage of wrong coding)
Hypertension uncomplicated (K86) 2376

2215

(93.2%)

121

(5.1%)

40

(1.7%)

K87, 11 (27.5%) Hypertension complicated

K85, 5 (12.5%) Elevated blood pressure

R05, 5 (12.5%) Cough

Diabetes non-insulin dependent (T90) 994

925

(93.1%)

55

(5.5%)

14

(1.4%)

K86, 6 (42.9%) Hypertension uncomplicated

T901, 3 (21.4%) Impaired glucose tolerance

R74, 3 (21.4%) Upper respiratory infection acute

Lipid disorder (T93) 517

348

(67.3%)

165

(31.9%)

4

(0.78%)

R74, 2 (50%) Upper respiratory infection acute

R25, 1 (25%) Sputum/ phlegm abnormal

U27, 1 (25%) Fear of urinary disease other

Hypertension complicated (K87) 257

83

(32.3%)

21

(8.2%)

153

(59.5%)

K86, 152 (99.3%) Hypertension uncomplicated

K85, 1, (0.7%) Elevated blood pressure

Cerebrovascular disease (K91) 184

34

(18.5%)

38

(20.7%)

112

(60.9%)

K90, 110 (98.2%) Stroke/ cerebrovascular accident

K89, 1 (0.9%) Transient cerebral ischaemia

L10, 1 (0.9) Elbow symptom/ complaint

Benign prostatic hypertrophy (Y85) 127

86

(67.7%)

32

(25.2%)

9

(7.1%)

Urinary symptoms 7, (77.8%) include: U02 Urinary frequency/ urgency; U07 Urine symptom/ complaint other; U08 Urinary retention; U29 Urinary symptom/
complaint other; Y02 Pain in testis/ scrotum


R74, 1 (11.1%) Upper respiratory infection acute


T93, 1 (11.1%) Lipid disorder

Hypothyroidism/myxoedema (T86) 119

99

(83.2%)

15

(12.6%)

5

(4.2%)

T85, 1 (20%) Hyperthyroidism/ thyrotoxicosis

K86, 1 (20%) Hypertension uncomplicated

R74, 1 (20%) Upper respiratory infection acute

Gout (T92) 111

77

(69.4%)

33

(29.7%)

1

(0.9%)

R05, 1 (100%) Cough
Ischaemic heart disease w/o angina (K76) 99

55

(55.6%)

40

(40.4%)

4

(4.04%)

K75, 3 (75%) Acute myocardial infarction

K74, 1 (25%) Ischaemic heart disease w. angina

Chronic obstructive pulmonary disease (R95) 89

79

(88.8%)

6

(6.7%)

4

(4.5%)

Respiratory problems, 3 (75%) include: R79 Chronic

Bronchitis; R96 Asthma; R74 Upper respiratory
infection acute

S14, 1 (25%) Burn, Scald

Ischaemic heart disease without angina (K76) had the highest missing coding frequency (40.4%). The percentage of correct and wrong coding were 55.6% and 4.04% respectively. As for the results of the most common wrong code, most wrong codes were in the same categories as the correct ones. Benign prostate hypertrophy (Y85) was often wrongly coded as various urogenital symptoms (for examples, U02 urinary frequency / urgency, U07 Urine symptom / complaint other, U08 urinary retention, U29 urinary symptom / complaint other and Y02 pain in testis/scrotum) and chronic obstructive pulmonary disease (R95) was often wrongly coded as various other respiratory conditions (R79 chronic bronchitis, R96 asthma and R74 upper respiratory infection acute). Upper respiratory infection acute (R74), which was not a chronic illness, was wrongly coded among half of the top ten diseases: T90, T93, Y85, T86 and K76.

Discussion

This study revealed that GOPC doctors working at the review clinics assigned at least one code for the large majority of patients. However, the percentage of correct coding specifically for chronic illness was only 75.4%. 19.4% and 5.3% were missed and wrongly coded respectively. Case complexity appears to be an important association in relation to ICPC coding, as indicated by the strong correlation with the percentage of correct coding and missing coding. It is understandable that more coding errors will occur when the doctor has to deal with more problems during a consultation. It is unknown whether allowing more time for doctors to perform coding during their work will enhance coding accuracy and completeness, since time is obviously a factor to consider when dealing with more problems. On the other hand, doctors’ understanding towards ICPC appears to be particularly important for specific diseases, including complicated hypertension and cerebrovascular disease. These two entities are often wrongly coded as uncomplicated hypertension or stroke respectively. Although only slightly different in wordings, they represent entirely different stages of the same disease requiring different management and hence with different cost implications. It is possible that such errors in coding represent doctors’ habit of simply repeating what was coded in previous consultations. Ensuring high coding accuracy and completeness, not simply a high percentage of coding will enhance epidemiological data collection and subsequent health services planning.

Disease coding in GOPCs was only implemented since their transfer to the HA in 2003 along with the introduction of CMS. At the same time CMS promoted computerization of clinical notes entry and medication prescription. However, technological advances created more non-clinical tasks, including appointment booking. Indeed, disease coding could be argued by some to be a form of non-clinical task. There is currently no direct link between doctors’ performance and services funding. This lack of incentive may prove to be crucial in improving disease coding accuracy and completeness in the future. There is growing of international interest in using financial incentives to improve quality of care. The US Institute of Medicine reported that “pay for performance should be introduced as a stimulus to foster comprehensive and system-wide improvements in the quality of care”.7 The number and the nature of diseases managed were part of the index for the “performance” of a clinic. An accurate and complete ICPC coding would be essential to reflect the performance and to ensure appropriate resources allocation. If incentives are not available , authorities will need to consider alternative measures to improve coding, such as the employment of staff specific for disease coding in Australia.

Interestingly, although the percentage of coding for chronic illnesses is generally high, coexisting non-chronic illness RFE codings were frequently missing (73.5%). Postulated reasons for this discrepancy include GOPC doctors’ concentration on managing chronic illness, the self perceived lesser importance of acute conditions, doctors’ lack of knowledge in ICPC coding, and an inability to arrive at a relevant diagnosis for coding. Coexistence of chronic and acute conditions in one patient is not uncommon in the authors’ practice, but there is no data in Hong Kong to formally support this. Further studies will be required to delineate the reasons behind this discrepancy, with a view to enhance coding in these mixed conditions.

Limitations and Future Implications

Although this study was obtained from representative samples across all GOPCs in the HA NTEC, this may still not be representative of the more than 70 GOPCs in Hong Kong. Coding accuracy and completeness were based on investigators’ interpretation of computer case notes, which presumed that the case notes were of sufficient detail to reflect the actual consultation process. Further studies should be designed to assess the accuracy and completeness of ICPC coding across the whole territory, with assessment not purely based on consultation notes. In addition, qualitative studies to look at doctors’ views and knowledge towards ICPC coding should be performed so that future coding accuracy and completeness can be improved.

Conclusion

Despite a high percentage of ICPC coding in GOPCs, the percentage of correct coding for chronic illness was comparatively low. Health authorities should design new measures to enhance coding accuracy and completeness so that doctors will have a stronger incentive for correct coding which will eventually allow for improving epidemiological data gathering and health services planning.

Key messages

  1. ICPC is essential for the monitoring of clinical practice, clinical and administrative planning and implementation.
  2. Despite a high percentage of ICPC coding in GOPCs, the percentage of correct coding for chronic illness was comparatively low.
  3. For client followed up for chronic illness, coexisting non-chronic illness RFE coding was frequently missing.
  4. New measures are needed to enhance coding accuracy and completeness, so that doctors will have a stronger incentive for correct coding which will eventually allow for improving epidemiological data gathering and health services planning.

Lawrence CL Wong, MFM (Monash), FHKCFP, FRACGP, FHKAM (Family Medicine)
Resident Specialist in Family Medicine,

MK Lee, MBChB, FHKCFP, FRACGP
Resident in Family Medicine,

HT Mak, MBChB,
Resident in Family Medicine,

PK Wong, MBBS, Dip Med (CUHK), DCH (Ireland)
Resident in Family Medicine,

KW Chung, MBChB, FHKCFP, FRACGP
Resident in Family Medicine,

KH Wong, MBChB, FHKCFP, FRACGP
Resident in Family Medicine,

SM Tam, FHKCFP, FRACGP, FHKAM (Family Medicine)
Associate Consultant in Family Medicine

HW Li, FHKCFP, FRACGP, FHKAM (Family Medicine)
Resident Specialist in Family Medicine,

TB Chan, MBBS, FHKCFP, FRACGP
Resident in Family Medicine,

Kenny Kung, MRCGP, FHKCFP, FRACGP, FHKAM (Family Medicine)
Associate Consultant in Family Medicine,

Augustine Lam, FRACGP, FHKCFP, FHKAM (Family Medicine)
Consultant in Family Medicine,
Department of Family Medicine, New Territories East Cluster, Hospital Authority

Philip K T Li, MD, FRCP (Lond), FRCP (Edin), FACP
Director of Family Medicine,
Family Medicine Training Centre, Prince of Wales Hospital.

Correspondence to: Dr Lawrence CL Wong, Family Medicine Training Centre,
Prince of Wales Hospital, Shatin, N.T., Hong Kong SAR.


References
  1. International Classification of Primary Care (Revised Second Edition) (ICPC-2) WONCA International Classification Committee, Oxford Medical Publications.
  2. Hofmans-Okkes, IM, Lamberts, H. The International Classification of Primary Care (ICPC): new application in research and computer-based patient records in family practice. Family Practice 1996;13:294-302.
  3. World Health Organization Family of International Classification (WHO-FIC) Report, Meeting of heads of WHO collaborating Centres, Cologne Germany, 19-35 October, 2003.
  4. Cheng J, Lee MK, Kung K, et al. A Survey on the International Classification of Primary Care Coding in a Family Medicine Integrated Clinic. Presented in HKCFP ASM 2008.
  5. Lam WK, Ho KY, et al. A clinical audit on International classification of Primary Care Coding in 4 primary care clinics and common errors in coding International Classification of Primary Care – 2. HK Pract 2005;27:344-352.
  6. Data from Clinical Data Analysis and Reporting System (CDARS) 2009 of Hospital Authority.
  7. Committee on redesigning health insurance performance measures, payment, and performance improvement programs. Rewarding provider performance: aligning incentives in medicare. Washington DC: Institute of Medicine, 2007.