Agreement process of ECG annotations using thesaurus (list of typical phrases) of ECG conclusions
https://doi.org/10.33667/2078-5631-2022-11-19-26
Abstract
A thesaurus (logically ordered list) of statements for the ECG annotation has been developed. 549 ECGs from the PTB Diagnostic ECG Database were independently annotated by 3 clinicians using this thesaurus and web interface. The resulting independent annotations did not match (the proportion of matches was from 3 to 100% for different groups of conclusions in pairwise comparison of annotators). The annotations were agreed, for which a special procedure was developed. The procedure includes participation of moderators (highly qualified physicians) and using videoconferencing. Annotations are published in the public domain and can be used both for the purposes of knowledge control and for testing the accuracy of the automatic ECG analysis algorithms and software.
Supporting agencies: The authors would like to thank the management and staff of OOO MKS (Moscow) for their support during the work. The authors express their gratitude to the staff of the ECG Laboratory of the Department of New Diagnostic Methods of ‘National Medical Research Center for Cardiology named after academician E.I. Chazov’ T.A. Sakhnova, E.V. Blinova, A.V. Sobolev for discussion of the manuscript and a number of valuable considerations expressed by them during the discussion.
About the Authors
D. V. Drozdov
Moscow Institute of Physics and Technology
Russian Federation
Russian Federation
Drozdov Dmitrii V.
Moscow
D. V. Shutov
Scientific and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Department of Healthcare of the City of Moscow
Russian Federation
Russian Federation
Shutov Dmitry V.
Moscow
T. M. Gazashvili
L.A. Vorokhobov City Clinical Hospital of the Department of Healthcare of the City of Moscow
Russian Federation
Russian Federation
Gazashvili Tamara M.
Moscow
N. A. Polyanskaya
Siberian District Medical Centre Of Federal Medical-Biological Agency
Russian Federation
Russian Federation
Polyanskaya Natalia A.
Novosibirsk
M. Y. Zhuk
A.S. Puchkov Ambulance and Emergency Medical Care Station
Russian Federation
Russian Federation
Zhuk Maria Yu.
Novosibirsk
References
1. ГОСТ IEC60601–2–51–2011 Изделия медицинские электрические. Часть 2–51. Частные требования безопасности с учетом основных функциональных характеристик к регистрирующим и анализирующим одноканальным и многоканальным электрокардиографам. // М.: Стандартинформ, 2013. – 100 с. Идентичен международному стандарту IEC60601–2–51:2003 Medical electrical equipment Part 2–51: Particular requirements for safety, including essential performance, of recording and analysing single channel and multichannel electrocardiographs.
2. Physionet The Research Resource for Complex Physiologic Signals электронный ресурс https://physionet.org/ (дата обращения 10.09.2020)
3. Bousseljot R., Kreiseler D., Schnabel A. Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet //Biomedizinische Technik / Biomedical Engineering. – 1995. – Vol. 40. – No. s1. – P. 317–318.
4. PTB Diagnostic ECG Database (Ralf-Dieter Bousseljot, published: Sept. 25, 2004. Version: 1.0.0) электронный ресурс https://physionet.org/content/ptbdb/1.0.0/ DOI doi.org/10.13026/C28C71 (дата обращения 10.09.2020)
5. Goldberger, A., Amaral, L., Glass, L. et. al. PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals. Circulation [Online]. – 2000. – Vol. 101. – No. 23. – P. e215–e220.
6. ECG.RU. Clinical evaluation of ECG‑12. Electronic resource https://ecg.ru/records (accessed 12.09.2020)
7. Recommendations for the standardization and interpretation of the electrocardiogram: part II: electrocardiography diagnostic statement list a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society Endorsed by the International Society for Computerized Electrocardiology //Journal of the American College of Cardiology. – 2007. – Vol. 49. – No. 10. – P. 1128–1135.
8. Caceres C. What arguments could be made against the automation of electrocardiography? / Computing systems and automatic diagnosis of heart diseases: [Collected papers] / Ed.C. Caceres and L. Dreyfus; Per. from English. L.I. Titomir and V.V. Shakin – M .: Mir, 1974.– 501 p.
9. Cook D.A., Oh S.Y., Pusic M.V. Accuracy of Physicians’ Electrocardiogram Interpretations: A Systematic Review and Meta-analysis. // JAMA Intern Med.– 2020 (Nov 1). – Vol. 180. – No. 11. – Р. 1461–1471. doi:10.1001/jamainternmed.2020.3989.
10. Moody G.B., Mark R.G. The impact of the MIT-BIH Arrhythmia Database // IEEE Eng in Med and Biol. – 2001. – Vol. 20. – No. 3. – P. 45–50.
11. Smíšek R. et al. CSE database: extended annotations and new recommendations for ECG software testing //Med Biol Eng Comp. – 2017. – Vol. 55. – No. 8.– P. 1473–1482. – doi:10.1007/s11517–016–1607–5
12. Willems J. L. Common Standards for Quantitative Electrocardiography // Journal of medical engineering and technology. – 1985. – Vol. 9. – No. 5. – P. 209–217. – doi:10.3109/03091908509032101
13. Test database ROKhMINE «ECG in 12 standard leads» http://www.rohmine.org/baza-dannykh-rokhmine/testovaya-baza-standart-ekg‑2018-g/ (accessed 30.08.2020)
14. Shutov D.V., Drozdov D.V., Gazashvili T.M. et al. Methodological and normative aspects of creating an ECG data set for testing automated algorithms and artificial intelligence systems. Vrach i informatsionnye tekhnologii.– 2021.– No. 4.– P. 4–15. – doi:1025881/18110193_2021_4_4
15. Statement of Validation and Accuracy for the Glasgow 12-Lead ECG Analysis Program. 2009 PhysioControl, Inc.
Review
For citations:
Drozdov D.V., Shutov D.V., Gazashvili T.M., Polyanskaya N.A., Zhuk M.Y. Agreement process of ECG annotations using thesaurus (list of typical phrases) of ECG conclusions. Medical alphabet. 2022;(11):19-26. (In Russ.) https://doi.org/10.33667/2078-5631-2022-11-19-26
Views:
615
Email this article 