<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">vitj</journal-id><journal-title-group><journal-title xml:lang="ru">Врач и информационные технологии</journal-title><trans-title-group xml:lang="en"><trans-title>Medical Doctor and Information Technologies</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1811-0193</issn><issn pub-type="epub">2413-5208</issn><publisher><publisher-name>Pirogov National Medical and Surgical Center</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.25881/18110193_2022_3_54</article-id><article-id custom-type="elpub" pub-id-type="custom">vitj-143</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ПРАКТИЧЕСКИЙ ОПЫТ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>PRACTICE EXPERIENCE</subject></subj-group></article-categories><title-group><article-title>Выбор предикторов для моделей классификации и прогноза в медицине</article-title><trans-title-group xml:lang="en"><trans-title>Feature selection for medical prognostic models</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Лучинин</surname><given-names>А. С.</given-names></name><name name-style="western" xml:lang="en"><surname>Luchinin</surname><given-names>A. S.</given-names></name></name-alternatives><bio xml:lang="ru"><p>к.м.н.</p><p>г. Киров</p></bio><bio xml:lang="en"><p>PhD</p><p>Kirov</p></bio><email xlink:type="simple">luchinin@niigpk.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Лянгузов</surname><given-names>А. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Lyanguzov</surname><given-names>A. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>к.м.н.</p><p>г. Киров</p></bio><bio xml:lang="en"><p>PhD</p><p>Kirov</p></bio><email xlink:type="simple">lyanguzov@niigpk.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>ФГБУН КНИИГиПК ФМБА России</institution><country>Россия</country></aff><aff xml:lang="en"><institution>The Federal State-Financed Scientific Institution Kirov Research Institute of Hematology and Blood Transfusion under the Federal Medical Biological Agency</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2022</year></pub-date><pub-date pub-type="epub"><day>03</day><month>04</month><year>2025</year></pub-date><volume>0</volume><issue>3</issue><fpage>54</fpage><lpage>67</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Лучинин А.С., Лянгузов А.В., 2025</copyright-statement><copyright-year>2025</copyright-year><copyright-holder xml:lang="ru">Лучинин А.С., Лянгузов А.В.</copyright-holder><copyright-holder xml:lang="en">Luchinin A.S., Lyanguzov A.V.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://www.vit-j.ru/jour/article/view/143">https://www.vit-j.ru/jour/article/view/143</self-uri><abstract><p>Процессы создания максимально простой и одновременно эффективной прогностической модели в медицине должны быть сбалансированы. Факторы, включенные в модель, являются основой ее качества и практической значимости, однако их выбор — не всегда простая задача. Цель исследования — сравнение разных методов селекции предикторов для создания медицинских прогностических моделей.Материалы и методы. Для выбора предикторов использовали такие методы, как корреляция, фильтрация признаков на основе базовой статистики, однофакторный анализ Хосмера-Лемешоу, так и сложные, которые часто используются в машинном обучении: рекурсивное исключение признаков, регрессия «LASSO» и деревья классификации. Прогностические модели построили с использованием метода бинарной множественной логистической регрессии. Статистический анализ проводился с использованием языка программирования R (версия 3.4.2).Результаты. Наборы предикторов, полученные при помощи методов «LASSO» и случайного леса, а также методом пошаговой регрессии, позволили построить наиболее точные прогностические модели (минимальное значение AIC). Базовые методы статистического анализа и однофакторный регрессионный анализ по методу Хосмера-Лемешоу оказались наименее эффективными.Заключение. Применение методов селекции предикторов часто существенно сокращает их количество, отсеивая неинформативные, что улучшает качество будущей модели прогноза.</p></abstract><trans-abstract xml:lang="en"><p>It is very important to balance the processes of creating the simplest and most effective predictive models in medicine. The predictors in the model determine its quality and practical relevance but selecting them is not always easy. The aim of the study is to compare different methods of prediction selection to create medical prognostic models.Methods. We compare simple methods, such as correlation, predictor filtering based on basic statistics, and Hosmer-Lemeshow univariate analysis, with more complex methods often used in machine learning, such as recursive feature elimination, LASSO regression, and classification trees. The predictive models were built using the binary multiple logistic regression method. Statistical analysis was carried out using the programming language R (version 3.4.2).Results. Based on the LASSO and random forest methods, as well as the stepwise regression method, the most accurate predictive models were constructed (minimum AIC value). The Hosmer-Lemeshow method and basic methods of statistical analysis have been found to be the least effective.Conclusion. The use of predictor selection methods often significantly reduces their number, filtering out non-informative ones, which improves the quality of the predictive model.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>прогноз</kwd><kwd>прогностические модели</kwd><kwd>селекция предикторов</kwd></kwd-group><kwd-group xml:lang="en"><kwd>prognosis</kwd><kwd>predictive models</kwd><kwd>predictor selection</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Altman DG, Vergouwe Y, Royston P, Moons KGM. Prognosis and prognostic research: validating a prognostic model. BMJ (Clinical research ed.). 2009; 338: b605. doi: 10.1136/bmj.b605.</mixed-citation><mixed-citation xml:lang="en">Altman DG, Vergouwe Y, Royston P, Moons KGM. Prognosis and prognostic research: validating a prognostic model. BMJ (Clinical research ed.). 2009; 338: b605. doi: 10.1136/bmj.b605.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">van Beek PE, Andriessen P, Onland W, Schuit E. Prognostic Models Predicting Mortality in Preterm Infants: Systematic Review and Meta-analysis. Pediatrics. 2021; 147(5): e2020020461. doi: 10.1542/peds.2020-020461.</mixed-citation><mixed-citation xml:lang="en">van Beek PE, Andriessen P, Onland W, Schuit E. Prognostic Models Predicting Mortality in Preterm Infants: Systematic Review and Meta-analysis. Pediatrics. 2021; 147(5): e2020020461. doi: 10.1542/peds.2020-020461.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Van Calster B, Wynants L, Timmerman D, Steyerberg EW, Collins GS. Predictive analytics in health care: how can we know it works? Journal of the American Medical Informatics Association: JAMIA. 2019; 26(12): 1651-1654. doi: 10.1093/jamia/ocz130.</mixed-citation><mixed-citation xml:lang="en">Van Calster B, Wynants L, Timmerman D, Steyerberg EW, Collins GS. Predictive analytics in health care: how can we know it works? Journal of the American Medical Informatics Association: JAMIA. 2019; 26(12): 1651-1654. doi: 10.1093/jamia/ocz130.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Andrade C. Sample Size and its Importance in Research. Indian Journal of Psychological Medicine. 2020; 42(1): 102-103. doi: 10.4103/IJPSYM.IJPSYM_504_19.</mixed-citation><mixed-citation xml:lang="en">Andrade C. Sample Size and its Importance in Research. Indian Journal of Psychological Medicine. 2020; 42(1): 102-103. doi: 10.4103/IJPSYM.IJPSYM_504_19.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Pourhoseingholi MA, Vahedi M, Rahimzadeh M. Sample size calculation in medical studies. Gastroenterology and Hepatology from Bed to Bench. 2013; 6(1): 14-17.</mixed-citation><mixed-citation xml:lang="en">Pourhoseingholi MA, Vahedi M, Rahimzadeh M. Sample size calculation in medical studies. Gastroenterology and Hepatology from Bed to Bench. 2013; 6(1): 14-17.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Chowdhury MZI, Turin TC. Variable selection strategies and its importance in clinical prediction modelling. Family Medicine and Community Health. 2020; 8(1): e000262. doi: 10.1136/fmch-2019-000262.</mixed-citation><mixed-citation xml:lang="en">Chowdhury MZI, Turin TC. Variable selection strategies and its importance in clinical prediction modelling. Family Medicine and Community Health. 2020; 8(1): e000262. doi: 10.1136/fmch-2019-000262.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Chen R-C, Dewi C, Huang S-W, Caraka RE. Selecting critical features for data classification based on machine learning methods. Journal of Big Data. 2020; 7(1): 52. doi: 10.1186/s40537-020-00327-4.</mixed-citation><mixed-citation xml:lang="en">Chen R-C, Dewi C, Huang S-W, Caraka RE. Selecting critical features for data classification based on machine learning methods. Journal of Big Data. 2020; 7(1): 52. doi: 10.1186/s40537-020-00327-4.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Staartjes VE, Kernbach JM, Stumpo V, van Niftrik CHB, Serra C, Regli L. Foundations of Feature Selection in Clinical Prediction Modeling. Acta Neurochirurgica. Supplement. 2022; 134: 51-57. doi: 10.1007/978-3-030-85292-4_7.</mixed-citation><mixed-citation xml:lang="en">Staartjes VE, Kernbach JM, Stumpo V, van Niftrik CHB, Serra C, Regli L. Foundations of Feature Selection in Clinical Prediction Modeling. Acta Neurochirurgica. Supplement. 2022; 134: 51-57. doi: 10.1007/978-3-030-85292-4_7.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Li L. Dimension reduction for high-dimensional data. Methods in Molecular Biology (Clifton, N.J.). 2010; 620: 417-434. doi: 10.1007/978-1-60761-580-4_14.</mixed-citation><mixed-citation xml:lang="en">Li L. Dimension reduction for high-dimensional data. Methods in Molecular Biology (Clifton, N.J.). 2010; 620: 417-434. doi: 10.1007/978-1-60761-580-4_14.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Ameringer S, Serlin RC, Ward S. Simpson’s Paradox and Experimental Research. Nursing research. 2009; 58(2): 123-127. doi: 10.1097/NNR.0b013e318199b517.</mixed-citation><mixed-citation xml:lang="en">Ameringer S, Serlin RC, Ward S. Simpson’s Paradox and Experimental Research. Nursing research. 2009; 58(2): 123-127. doi: 10.1097/NNR.0b013e318199b517.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Kim JH. Multicollinearity and misleading statistical results. Korean Journal of Anesthesiology. 2019; 72(6): 558-569. doi: 10.4097/kja.19087.</mixed-citation><mixed-citation xml:lang="en">Kim JH. Multicollinearity and misleading statistical results. Korean Journal of Anesthesiology. 2019; 72(6): 558-569. doi: 10.4097/kja.19087.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Zhang Z. Variable selection with stepwise and best subset approaches. Annals of Translational Medicine. 2016; 4(7): 136. doi: 10.21037/atm.2016.03.35.</mixed-citation><mixed-citation xml:lang="en">Zhang Z. Variable selection with stepwise and best subset approaches. Annals of Translational Medicine. 2016; 4(7): 136. doi: 10.21037/atm.2016.03.35.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Tibshirani R. The lasso method for variable selection in the Cox model. Statistics in Medicine. 1997; 16(4): 385–395. doi: 10.1002/(sici)1097-0258(19970228)16:4&lt;385::aid-sim380&gt;3.0.co;2-3.</mixed-citation><mixed-citation xml:lang="en">Tibshirani R. The lasso method for variable selection in the Cox model. Statistics in Medicine. 1997; 16(4): 385–395. doi: 10.1002/(sici)1097-0258(19970228)16:4&lt;385::aid-sim380&gt;3.0.co;2-3.</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Rigatti SJ. Random Forest. Journal of Insurance Medicine (New York, N.Y.). 2017; 47(1): 31-39. doi: 10.17849/insm-47-01-31-39.1.</mixed-citation><mixed-citation xml:lang="en">Rigatti SJ. Random Forest. Journal of Insurance Medicine (New York, N.Y.). 2017; 47(1): 31-39. doi: 10.17849/insm-47-01-31-39.1.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Degenhardt F, Seifert S, Szymczak S. Evaluation of variable selection methods for random forests and omics data sets. Briefings in Bioinformatics. 2019; 20(2): 492-503. doi: 10.1093/bib/bbx124.</mixed-citation><mixed-citation xml:lang="en">Degenhardt F, Seifert S, Szymczak S. Evaluation of variable selection methods for random forests and omics data sets. Briefings in Bioinformatics. 2019; 20(2): 492-503. doi: 10.1093/bib/bbx124.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Sun GW, Shook TL, Kay GL. Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis. Journal of Clinical Epidemiology. 1996; 49(8): 907-916. doi: 10.1016/0895-4356(96)00025-x.</mixed-citation><mixed-citation xml:lang="en">Sun GW, Shook TL, Kay GL. Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis. Journal of Clinical Epidemiology. 1996; 49(8): 907-916. doi: 10.1016/0895-4356(96)00025-x.</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Dziak JJ, Coffman DL, Lanza ST, Li R, Jermiin LS. Sensitivity and specificity of information criteria. Briefings in Bioinformatics. 2020; 21(2): 553-565. doi: 10.1093/bib/bbz016.</mixed-citation><mixed-citation xml:lang="en">Dziak JJ, Coffman DL, Lanza ST, Li R, Jermiin LS. Sensitivity and specificity of information criteria. Briefings in Bioinformatics. 2020; 21(2): 553-565. doi: 10.1093/bib/bbz016.</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Thompson HW, Mera R, Prasad C. The Analysis of Variance (ANOVA). Nutritional Neuroscience. 1999; 2(1): 43-55. doi: 10.1080/1028415X.1999.11747262.</mixed-citation><mixed-citation xml:lang="en">Thompson HW, Mera R, Prasad C. The Analysis of Variance (ANOVA). Nutritional Neuroscience. 1999; 2(1): 43-55. doi: 10.1080/1028415X.1999.11747262.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
