Validation of Medication Proxies for the Identification of Hospitalizations for Major Adverse Cerebro-Cardiovascular Events

Introduction

One of the aims of pharmaco-epidemiology is to estimate the real-world beneficial or side effects of medications.1 Although randomized controlled trials (RCTs) are seen as the golden standard for causal claims, the use of a RCT is not suitable or possible for every pharmaco-epidemiological research question.2 Therefore, the use of big data from secondary healthcare databases, also described as routine care data, is common.3 The use of secondary databases has some advantages over RCTs, such as the presence of real-world users which may differ from clinical trial study populations, larger sample sizes, lower costs, longer follow-up and thus increased generalizability.2 Since secondary databases are not necessarily designed for research purposes,3 clinically relevant factors for answering specific research questions may be absent.2 The use of secondary database is therefore always a trade-off between the number of available observations and amount and validity of available information.4

To enhance the validity of a database for research purposes, data can be enriched. Enrichment is possible by combining the main database with other data sources or by using available data as well as possible. A frequently applied example of database enrichment is the use of medication proxies to indicate a patients’ medical conditions. Examples of such proxies include flagging insulin and/or oral hypoglycemic agent users as diabetes patients,5 or use of drugs for chronic airway diseases to identify patients with asthma or COPD.6 Similar proxies have been used for several other diseases such as cardiovascular diseases, HIV, and Parkinson’s disease.7,8 These proxies were used to estimate the prevalence of certain diseases9,10 or in risk-adjustment systems.11 Most of which focus on chronic conditions, in contrast to acute events. For example, Füssenich et al12 showed that stroke was more difficult to predict with pharmaceutical prescriptions than several chronic conditions.

Since cerebro-cardiovascular diseases were both globally and in Western Europe, the leading cause of death in 2019, with an estimated 33% of all deaths both globally and in Western Europe,13,14 research towards preventive medication for these diseases as well as these diseases as an outcome themselves is needed. Unfortunately, not every secondary database contains the desired outcome; hence, enrichment of these databases using proxies is an important method for investigating the relationship between available information in the database and an unavailable outcome. Therefore, a validated medication proxy for both history of, and incident cerebro-cardiovascular events is important to support studies and findings based on medication-use databases.

In this study, we will replicate the validation study by Pouwels et al,15 who presented the accuracy of several medication proxies for the identification of incident and prevalent major cerebro-cardiovascular events. The study by Pouwels et al15 was based on data from 2008 and 2009 of approximately 17,000 patients with type 2 diabetes. We focused on the same medication classes as Pouwels et al15 to recreate the same type of results. Next to that, these medication classes are shown to be clinically relevant as they are found among have the highest prevalence in patients with cerebro-cardiovascular diseases by Ma et al.16

Access to the large healthcare insurance claims database provided us the opportunity to repeat the analysis with more recent data from 2013 to 2021 and for a larger population of primary preventive patients starting any anti-hypertensive or anti-lipidemic drug. The aim is to examine the accuracy of the proposed medication proxies. Subgroup analyses were planned according to age, sex, and relevant comorbidities such as diabetes.

Methods Study Design and Data Source

Using the claims database of a large Dutch healthcare insurer, we conducted a retrospective population-based inception cohort study. This database contains claims from at least two million people over more than five years and covers a representative sample of about 12% of the Dutch population.17 For the time someone is insured, the database, except for over-the-counter medication, is complete regarding pharmaceutical dispensings and hospital admissions. To enhance transparency for patients, healthcare providers, and health insurers, the Dutch diagnose–behandel–combinatie (diagnosis–treatment–combination; DBC) system is developed for managing declarations. Unfortunately, there is no direct mapping from this system to international coding systems, such as the International Classification of Diseases tenth revision (ICD-10), so a diagnosis is not available in this type of claims data. Nevertheless, we tried to add the closest related ICD-10 code in Supplementary Table A. Due to the large number of participants in combination with de-identified data, informed consent was not required.18

Study Population

We used the same dataset as in a previous study19 in which we included adult patients who started any antihypertensive and/or antihyperlipidemic therapy anywhere between 2013 and 2020. The index date was defined as the date of the initial claim for dispensing antihyperlipidemic or antihypertensive drugs. To be included in this cohort study, patients were required to have a minimum of two years of medical history in the claims database prior to the index date and at least two claims for dispensing antihyperlipidemic or antihypertensive drugs within one year after the index date, and patients were required to be 19 years or older on the index date. Patients were followed for a maximum of 10 years, with the end of the follow-up period, patient death, or patient stopping insurance, whatever came first, indicating the end of follow-up. More information about the inclusion and exclusion criteria and the definition of antihyperlipidemic and antihypertensive therapy can be found in Steenhuis et al.19

Cerebro-Cardiovascular Drugs

In this study, we used claims for dispensing the following cerebro-cardiovascular drugs as a proxy for a hospitalization for cerebro-cardiovascular events: Vitamin K antagonists (with ATC code starting with B01AA), platelet aggregation inhibitors (B01AC), and nitrates (C01DA). Each of these three classes were tested separately, as well as the combination of Vitamin K antagonists and platelet aggregation inhibitors; and the combination of all the three abovementioned medication classes. In the case of a combination of drugs, the first claim for dispensing one of the drug classes was used as an identifier for a cerebro-cardiovascular event.

Identification of Hospitalization for Incident MACCE

We aimed to evaluate whether we can validly identify patients with an incident major acute cerebro-cardiovascular event using different claims for dispensing drugs for the treatment of cerebro-cardiovascular diseases. For this purpose, the first MACCE hospitalization (based on a claim in Supplementary Table A) was defined as an incident MACCE. All first MACCE hospitalizations after the index date were defined as incident cases. We were interested in cerebro-cardiovascular drug treatment initiation, defined as the first claim of dispensing a cerebro-cardiovascular drug with no such claim of dispensing that drug in the 730 days before the first dispensing. Patients who already had at least one claim of dispensing the drug of interest or had a MACCE hospitalization in the 730 days before or 90 days after their index date were excluded from this analysis. Drugs dispensed for the first time between 30 days before and 90 days after the MACCE hospitalization event were considered true positives, when dispensed more than 30 days before or more than 90 days after the MACCE hospitalization or when there was no hospitalization as a false positive, and when not dispensed during the entire follow-up period, while there was a MACCE hospitalization as a false negative. Identification window of 30 days before and 90 days after the incident MACCE hospitalization were set equal to the study of Pouwels et al.15

Identification of History of Hospitalization for MACCE

The outcome was defined as the first MACCE hospitalization (based on a claim in Supplementary Table A) after 2012. Drug dispensings 30 days before or any time after the MACCE hospitalization event were considered as true positives, when dispensed more than 30 days before the hospitalization or when there was no hospitalization as a false positive, and when not dispensed while there was a hospitalization as a false negative. Patients who left the database within two years of their first hospitalization (by either leaving the health insurer or death) were excluded from the analysis. Patients with a cerebro-cardiovascular drug dispensing or MACCE hospitalization before the defined outcome were excluded from the analysis. Identification window of 30 days before and unlimited time after the MACCE hospitalization were set equal to the study of Pouwels et al.15

Statistical Analysis

We analyzed the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, area under receiver operating characteristic curve (AUROC)20 and Cohen's Kappa20,21 of medications relative to history of or incident MACCE hospitalizations. We chose to report all accuracy measures, as the priority of accuracy measures largely depends on the type of research.22 Confidence intervals for the sensitivity, specificity, PPV, NPV, and accuracy were calculated using the exact method of Clopper and Pearson,23 with a significance level of 5%. All calculations were performed using SAS Enterprise Guide 9.4.

Sensitivity Analyses

The above-mentioned analyses were repeated for the following subgroups: patients who started antihyperlipidemic therapy only, patients who received antihypertensive therapy only, patients who started both antihypertensive and antihyperlipidemic therapy, patients with diabetes, patients with asthma/COPD, men, women, and three different age groups. Patients who received at least 180 DDD of blood glucose-lowering drugs (ATC code starting with A10) within a year or had a hospital claim related to diabetes at any time during the study period were classified as having diabetes (Supplementary Table B1). Similarly, patients were classified as having asthma/COPD when they received at least 180 DDD of glucocorticoids (R03BA), adrenergics in combination with corticosteroids (R03AK), adrenergics in combination with anticholinergics (R03AL) within a year, or had a hospital claim related to asthma and/or COPD (Supplementary Table B1). Selection of subgroups was based on variables that can add to cardiovascular risk.14

Furthermore, to identify incident hospitalizations for MACCE, we performed a sensitivity analysis by varying the identification window. Varying the number of days before the hospitalization with 45, 15 and 0 and the number of days after the event with 60 and 120 days.

Results Identification of Incident Hospitalization for MACCE

A total of 113,896 patients receiving primary preventive antihypertensive and/or antihyperlipidemic therapy were selected for analysis. More than half (52.2%) of the study population was male, with a mean age of 58.1 years (SD: 13.0). A total of 5.6% were diagnosed with diabetes and 8.1% were diagnosed with asthma/COPD. Of the 113,896 patients, 31,383 (27,6%) started antihyperlipidemic therapy, 77,947 (68,4%) started antihypertensive therapy, and 4,566 (4,0%) started both hyperlipidemic and antihypertensive therapy. In total, 10,965 patients (9,6%) were hospitalized for MACCE after the index date (Table 1).

Table 1 Baseline Characteristics of Both Patients’ Groups That Were Used for Analysis

Three different medication proxies (Vitamin K antagonists, platelet aggregation inhibitors, and nitrates) for the identification of a hospitalization for an incident MACCE had a sensitivity ranging from 2.2% to 66.2% and a PPV ranging from 13.7% to 50.2%. Specificity and NPV for the three different proxies were more similar (94.6–98.6% resp. 90.9–97.2%). Combining the three different proxies increased the sensitivity to 71.5% (95% confidence interval [95% CI]: 70.4–72.5%), whereas the PPV was 44.9% (95% CI: 44.0–45.8, Table 2). Platelet aggregation inhibitors were the most important proxy.

Table 2 Identifying Incident Hospitalizations for an MACCE

Identification of History of MACCE Hospitalization

For the second analysis, we selected a total of 136,703 patients who started antihypertensive and/or antihyperlipidemic therapy. Demographics of this patient group were similar to those of the previous analysis. The largest difference was in the percentage of patients who started antihypertensive therapy or the combination of antihypertensive and antihyperlipidemic therapy. In total, 25.4% of the patients had a recorded history of a hospitalization for a cerebro-cardiovascular event (Table 1).

The three different medication proxies showed a sensitivity ranging from 5.2% to 83.9% and a PPV ranging from 29.8% to 72.9%. The specificity and NPV showed ranges that were closer together but wider than those used for the identification of hospitalizations for incident MACCE. Combining the three proxies increased the sensitivity to 86.9% (95% CI: 86.5–87.3%) (Table 3).

Table 3 Identifying History of a Hospitalization for a MACCE

Sensitivity Analyses

All results of the sensitivity analyses pointed in the same direction as the main analyses. We noted a difference in the sensitivity of the proxy for hospitalization for an incident MACCE in patients who started antihyperlipidemic versus antihypertensive therapy. A higher sensitivity was observed in the group of patients with diabetes (Table 4). Next to that, we noted a lower sensitivity, specificity, PPV, NPV, and accuracy in all sensitivity analyses in which the identification window before the event was set to zero days. The results of other proxies and those of the proxy for any history of hospitalization for a cardiovascular event can be found in Supplementary Tables C and D).

Table 4 Sensitivity Analysis for Identifying Incident Hospitalizations for a MACCE

Discussion

In the group of patients starting primary preventive antihypertensive and/or antihyperlipidemic drug therapy, more than 70% of the hospitalizations for incident MACCE and 86% of a history of such hospitalizations could be identified using the proxy of a single claim for a dispensing of either platelet aggregation inhibitors, nitrates, or vitamin K antagonists.

Our three medication classes (ATC: B01AA, B01AC, and C01D) contained the drugs found as having the highest prevalence (excluding the drugs we defined as antihypertensive and antihyperlipidemic therapy) in patients with cerebro-cardiovascular diseases by Ma et al.16 Based on their research, the addition of furosemide (C03CA01) or the complete class of drugs plain sulfonamides (C03CA) could be an addition to our best medication proxy for identifying cardiovascular events. Less than 80 patients or 4% of the false negatives could be identified using plain sulfonamides. Although looking at a Scottish and slightly different study population (patients not necessarily on antihypertensive and/or antihyperlipidemic therapy), the results of Payne et al24 pointed in the same direction and found a difference in sensitivity between nitrates and platelet aggregation inhibitors of the same order. Finally, compared to Pouwels et al15 we found approximately the same sensitivity and specificity. Both the PPV and NPV were significantly higher than those reported by Pouwels et al15 but this could be explained by different study populations. Since they used a diabetes-only population, the incidence and prevalence of MACCE will differ, which affects both the PPV and NPV.25,26 This even holds when looking at a diabetes-only population (Table 4 and Supplementary Table C), since we examined a group of patients with diabetes using primary preventive cerebro-cardiovascular therapy (antihyperlipidemic and/or antihypertensive medication), while Pouwels et al15 studied an unselected group of patients with type II diabetes.

Using our best medication proxy, we correctly identified 71.5% of the incident hospitalizations for MACCE. The inability to identify the other 28.5% could have several reasons: Firstly, patients died, which may or may not be a result of the MACCE, or left the database before they were able to recover and pick up a prescription. In our dataset, we could not determine the cause of death for those who died before hospitalization, but only less than 1% of the patients who were hospitalized for a cerebro-cardiovascular event (our cases) died within 90 days after the hospitalization, while another less than 1% of the patients with a hospitalization for a MACCE left the database within 90 days. Hence, this does not explain the 28.5% unidentifiable cases. Secondly, patients were prescribed other types of cerebro-cardiovascular drug therapy. After an extensive search for any other types of medications prescribed in case of a hospitalization for a cerebro-cardiovascular event, only proton pump inhibitors (A02BC) appeared more frequently; however, these drugs are used for gastric protection when aspirin is prescribed27 and hence do not qualify as a proxy. Furthermore, direct acting oral anticoagulants (B01AF) could be an addition to the proxy as the next cerebro-cardiovascular event related medication in the list, but they were only found in less than 15% of the false negatives. Next to that, the classes of medication our study population was based on could be a possible identifier for hospitalization for cardiovascular events. Therefore, statins could be an identifier for hospitalization for a cardiovascular event in cases where the patient is on antihypertensive therapy (Supplementary Table E), or vice versa. Using antihyperlipidemic or antihypertensive therapy as a proxy in our dataset could identify approximately 2.8% of incident MACCE hospitalizations. Thirdly, patients were not prescribed relevant medications for the treatment of MACCE. This could be the case when patients experience a less severe cerebro-cardiovascular event, such as a TIA.

Up to 50.2% of the patients (depending on the proxy) who were classified as a MACCE hospitalization were actually hospitalized. Although the selected medication proxies are mainly prescribed in the case of a cardiovascular event, not all cardiovascular events are severe enough or noticed in a timely manner such that a patient goes to a hospital within the time window we set. Hence, these claims for a dispensing could indicate a MACCE which did not lead to a hospitalization.

In the sensitivity analysis, a higher sensitivity was observed for patients with diabetes, starting with antihyperlipidemic medication and men. This could be a result of subgroups already having a higher risk of suffering from a MACCE.28,29 A lower sensitivity and AUROC scores can be found in the subgroups with an age less than 50, women and those with COPD, which could be a result of a lower risk of suffering from a MACCE.28,29 Next to that, lower sensitivity, specificity, PPV, NPV, and accuracy were observed when the identification window before the hospitalization was set to zero. This indicates that patients were prescribed medication for the treatment before the actual event and could be a result of medication being prescribed preoperatively.

To determine the most useful proxy, sensitivity and specificity values for each proxy were added. Based on a cut-off value of 1.5 for sensitivity + specificity,26 we conclude that the proxies based on platelet aggregation inhibitors only; platelet aggregation inhibitors and/or vitamin K antagonists; or platelet aggregation inhibitors and/or vitamin K antagonists and/or nitrates were all useful proxies for identifying incident MACCE hospitalizations as well as a history of such hospitalization. Kappa values for the abovementioned proxies for both hospitalization for incident MACCE as well as any history of MACCE hospitalization ranged from 0.51 to 0.6, indicating a moderate agreement between the proxy and events.30 This was also true for all investigated subgroups. AUROC scores for these three proxies for both outcomes were above 0.8, indicating a very good diagnostic accuracy.31 Furthermore, all our proxies had a specificity over 93%, which indicates that the association between our proxies and the outcome is less likely due to other variables, hence a larger probability of a causal relationship between proxy and outcome (or the other way around) can be assumed.32 The PPV of all proxies for the identification of an incident hospitalization for a MACCE is low. Low PPV follows from a low number of true positives in relation to false positives. Higher PPV can be seen if medication dispensings can be used as a identifier for a GP diagnoses as well.15 The results in this study are based on Dutch claims database. Therefore, one should be careful in generalizing these results towards other countries, since different prescribing guidelines could cause misclassification and less access to pharmacies can underidentify severe cases of MACCE. Nevertheless, the results of this study can be used in database in which only pharmaceutical data is available to enhance the data.

The medication classes used in this research partly overlapped with some pharmaceutical cost groups used in the Dutch risk-adjustment system.33 However, it should be kept in mind that the latter was intended to predict healthcare costs of the chronically ill, while we focused on the identification of an event.

Using more advanced statistical techniques or adding variables, such as age or sex, could improve the prediction model used. However, this comes with the risk of creating a model that is much more difficult to understand or the need to gather more data than is available. The strength of the designed model is that it can be used in every database where medication use information is available.

Conclusion

The combined medication proxy of any claim for a dispensing of either vitamin K antagonists, platelet aggregation inhibitors, or nitrates could accurately identify 71.5% of the hospitalizations for an incident MACCE in patients on primary preventive antihypertensive and/or antihyperlipidemic therapy, while it could correctly identify 86.9% of the patients on primary preventive antihypertensive and/or antihyperlipidemic therapy who were hospitalized for a cerebro-cardiovascular event before the claim for a dispensing of their medication. Nevertheless, PPV of all proxies was low for identifying a hospitalization for an incident MACCE. Further research is required to determine whether these (or other) proxies can identify cardiovascular events without a hospitalization, or milder cerebro-cardiovascular events such as a TIA as well.

Data Sharing Statement

The data used for this study were provided by Menzis Zorgverzekeraar N.V. Restrictions apply to the availability of these data, which were used under license for this study. Data are available from the first author with the permission of Menzis Zorgverzekeraar N.V.

Ethics Approval and Informed Consent

The Menzis Zorgverzekeraar N.V. claims database contains data that is collected in accordance with Dutch Code of Conduct for Processing Personal Data by Health Insurers, to which Dutch and European (GDPR) privacy legislation applies. According to the Dutch Central Committee on Research Involving Human Subjects (CCMO), approval from the medical ethics committee was not necessary nor required for this study being a retrospective cohort study.34 Informed consent was waived by using deidentified administrative data with a large number of participants in a retrospective design.

Funding

Li is funded by the China Scholarship Council (file no: 202106070028). The grant agency does not impose restrictions on conduct of analyses or dissemination of findings.

Disclosure

Steenhuis reports personal fees from Menzis Zorgverzekeraar N.V., outside the submitted work. Li is funded by the China Scholarship Council (file no: 202106070028). Feenstra and Hak do not declare any conflicts of interest in this work.

References

1. Montastruc J-L, Benevent J, Montastruc F, et al. What is pharmacoepidemiology? Definition, methods, interest and clinical applications. Therapies. 2019;74(2):169–174. doi:10.1016/j.therap.2018.08.001

2. Harpe SE. Using secondary data sources for pharmacoepidemiology and outcomes research. Pharmacotherapy. 2009;29(2):138–153. doi:10.1592/phco.29.2.138

3. Gandhi S, Salmon JW, Kong SX, Zhao SZ. Administrative databases and outcomes assessment: an overview of issues and potential utility. J Managed Care Pharm. 1999;5(3):215–222. doi:10.18553/jmcp.1999.5.3.215

4. Wray NP, Ashton CM, Kuykendall DH, et al. Using administrative databases to evaluate the quality of medical care: a conceptual framework. Soc Sci Med. 1995;40(12):1707–1715. doi:10.1016/0277-9536(94)00275-x

5. Lipscombe LL, Hwee J, Webster L, et al. Identifying diabetes cases from administrative data: a population-based validation study. BMC Health Serv Res. 2018;18(1):316. doi:10.1186/s12913-018-3148-0

6. Pont LG, van der Werf GT, Denig P, et al. Identifying general practice patients diagnosed with asthma and their exacerbation episodes from prescribing data. Eur J Clin Pharmacol. 2002;57(11):819–825. doi:10.1007/s00228-001-0395-4

7. Huber CA, Szucs TD, Rapold R, et al. Identifying patients with chronic conditions using pharmacy data in Switzerland: an updated mapping approach to the classification of medications. BMC Public Health. 2013;13:1030. doi:10.1186/1471-2458-13-1030

8. Von Korff M, Wagner EH, Saunders K. A chronic disease score from automated pharmacy data. J Clin Epidemiol. 1992;45(2):197–203. doi:10.1016/0895-4356(92)90016-G

9. Slobbe LCJ, Füssenich K, Wong A, et al. Estimating disease prevalence from drug utilization data using the Random Forest algorithm. Eur J Public Health. 2019;29(4):615–621. doi:10.1093/eurpub/cky270

10. Chini F, Pezzotti P, Orzella L, et al. Can we use the pharmacy data to estimate the prevalence of chronic conditions? A comparison of multiple data sources. BMC Public Health. 2011;11:688. doi:10.1186/1471-2458-11-688

11. Lamers LM, van Vliet RCJA. The pharmacy-based cost group model: validating and adjusting the classification of medications for chronic conditions to the Dutch situation. Health Policy. 2004;68(1):113–121. doi:10.1016/j.healthpol.2003.09.001

12. Füssenich K, Boshuizen HC, Nielen MMJ, et al. Mapping chronic disease prevalence based on medication use and socio-demographic variables: an application of LASSO on administrative data sources in healthcare in the Netherlands. BMC Public Health. 2021;21(1):1039. doi:10.1186/s12889-021-10754-4

13. Roser M. Causes of Death Globally: What Do People Die From? Our World in Data; 2021.

14. Mubarik S, Luo L, Naeem S, et al. Epidemiology and demographic patterns of cardiovascular diseases and neoplasms deaths in Western Europe: a 1990–2019 analysis. Public Health. 2024;231:187–197. doi:10.1016/j.puhe.2024.04.003

15. Pouwels KB, Voorham J, Hak E, et al. Identification of major cardiovascular events in patients with diabetes using primary care data. BMC Health Serv Res. 2016;16:110. doi:10.1186/s12913-016-1361-2

16. Ma -T-T, Wong ICK, Whittlesea C, et al. Initial cardiovascular treatment patterns during the first 90 days following an incident cardiovascular event. Br J Clin Pharmacol. 2021;87(3):1043–1055. doi:10.1111/bcp.14463

17. Nijhof E, Romp M, van Wetten N. Inzicht in het overstapseizoen. In: Zorgthermometer Verzekerden in Beeld. Vektis; 2022.

18. Insurance terms and conditions Menzis Basis 2022 [in Menzis 2021].

19. Steenhuis D, Li X, Feenstra T, et al. The association between deductibles and cardiovascular medication adherence: a retrospective inception cohort study. Drugs - Real World Outcomes. 2023;11:99–108. doi:10.1007/s40801-023-00397-9

20. Rainio O, Teuho J, Klén R. Evaluation metrics and statistical tests for machine learning. Sci Rep. 2024;14(1):6086. doi:10.1038/s41598-024-56706-x

21. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46 doi:10.1177/001316446002000104

22. Chubak J, Pocobelli G, Weiss NS. Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol. 2012;65(3):343–349.e2. doi:10.1016/j.jclinepi.2011.09.002

23. Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26(4):404–413. doi:10.1093/biomet/26.4.404

24. Payne RA, Abel GA, Simpson CR. A retrospective cohort study assessing patient characteristics and the incidence of cardiovascular disease using linked routine primary and secondary care data. BMJ Open. 2012;2(2):e000723. doi:10.1136/bmjopen-2011-000723

25. Parikh R, Mathai A, Parikh S, et al. Understanding and using sensitivity, specificity and predictive values. Indian J Ophthalmol. 2008;56(1):45–50. doi:10.4103/0301-4738.37595

26. Power M, Fell G, Wright M. Principles for high-quality, high-value testing. Evid Based Med. 2013;18(1):5–10. doi:10.1136/eb-2012-100645

27. Agewall S, Cattaneo M, Collet JP, et al. Expert position paper on the use of proton pump inhibitors in patients with cardiovascular disease and antithrombotic therapy. Eur Heart J. 2013;34(23):1708–1713. doi:10.1093/eurheartj/eht042

28. Steenhuis D, de Vos S, Bos J, et al. Role of traditional cardiovascular risk factors after initiation of statin therapy: a PharmLines Inception Cohort Study. Cardiovasc Ther. 2022;2022:6587165. doi:10.1155/2022/6587165

29. Steenhuis D, de Vos S, Bos JHJ, et al. Risk factors for drug-treated major adverse cardio-cerebrovascular events in patients on primary preventive statin therapy: a retrospective cohort study. Prev Med Rep. 2023;34:102258. doi:10.1016/j.pmedr.2023.102258

30. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–174. doi:10.2307/2529310

31. Šimundić AM. Measures of diagnostic accuracy: basic definitions. Ejifcc. 2009;19(4):203–211.

32. Shimonovich M, Pearce A, Thomson H, et al. Assessing causality in epidemiology: revisiting Bradford Hill to incorporate developments in causal thinking. Eur J Epidemiol. 2021;36(9):873–887. doi:10.1007/s10654-020-00703-7

33. Risk Adjustment Policy Rules 2024 [in Dutch: Beleidsregels Risicoverevening 2024], Staatscourant 2023, 28694.

34. Ministerie van Volksgezondheid, Welzijn en Sport. Your research: is it subject to the WMO or not? Investigators | the Central Committee on Research on Involving Human Subjects. 2023. Available from: https://english.ccmo.nl/investigators/legal-framework-for-medical-scientific-research/your-research-is-it-subject-to-the-wmo-or-not. Accessed March25, 2025.

Comments (0)

No login
gif