<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">donstu</journal-id><journal-title-group><journal-title xml:lang="en">Advanced Engineering Research (Rostov-on-Don)</journal-title><trans-title-group xml:lang="ru"><trans-title>Advanced Engineering Research (Rostov-on-Don)</trans-title></trans-title-group></journal-title-group><issn pub-type="epub">2687-1653</issn><publisher><publisher-name>Don State Technical University</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.23947/2687-1653-2024-24-1-36-47</article-id><article-id custom-type="edn" pub-id-type="custom">HTOURY</article-id><article-id custom-type="elpub" pub-id-type="custom">donstu-2157</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>MECHANICS</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>МЕХАНИКА</subject></subj-group></article-categories><title-group><article-title>Prediction of Rheological Parameters of Polymers by Machine Learning Methods</article-title><trans-title-group xml:lang="ru"><trans-title>Прогнозирование реологических параметров полимеров методами машинного обучения</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-3518-8942</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Кондратьева</surname><given-names>Т. Н.</given-names></name><name name-style="western" xml:lang="en"><surname>Kondratieva</surname><given-names>T. N.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Татьяна Николаевна Кондратьева, кандидат технических наук, доцент кафедры математики и информатики</p><p>344003, г. Ростов-на-Дону, пл. Гагарина, 1</p></bio><bio xml:lang="en"><p>Tatiana N. Kondratieva, Cand.Sci. (Eng.), Associate Professor of the Mathematics and Informatics Department</p><p>1, Gagarin sq., Rostov-on-Don, 344003</p></bio><email xlink:type="simple">ktn618@yandex.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-9133-8546</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Чепурненко</surname><given-names>А. С.</given-names></name><name name-style="western" xml:lang="en"><surname>Chepurnenko</surname><given-names>A. S.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Антон Сергеевич Чепурненко, доктор технических наук, доцент, профессор кафедры сопротивление материалов</p><p>344003, г. Ростов-на-Дону, пл. Гагарина, 1</p></bio><bio xml:lang="en"><p>Anton S. Chepurnenko, Dr.Sci. (Eng.), Associate Professor, professor of the Strength of Materials Department</p><p>1, Gagarin sq., Rostov-on-Don, 344003</p></bio><email xlink:type="simple">anton_chepurnenk@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Донской государственный технический университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Don State Technical University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2024</year></pub-date><pub-date pub-type="epub"><day>29</day><month>03</month><year>2024</year></pub-date><volume>24</volume><issue>1</issue><fpage>36</fpage><lpage>47</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Kondratieva T.N., Chepurnenko A.S., 2024</copyright-statement><copyright-year>2024</copyright-year><copyright-holder xml:lang="ru">Кондратьева Т.Н., Чепурненко А.С.</copyright-holder><copyright-holder xml:lang="en">Kondratieva T.N., Chepurnenko A.S.</copyright-holder><license license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://www.vestnik-donstu.ru/jour/article/view/2157">https://www.vestnik-donstu.ru/jour/article/view/2157</self-uri><abstract><sec><title>Introduction</title><p>Introduction. All polymer materials and composites based on them are characterized by pronounced rheological properties, the prediction of which is one of the most critical tasks of polymer mechanics. Machine learning methods open up great opportunities in predicting the rheological parameters of polymers. Previously, studies were conducted on the construction of predictive models using artificial neural networks and the CatBoost algorithm. Along with these methods, due to the capability to process data with highly nonlinear dependences between features, machine learning methods such as the k-nearest neighbor method, and the support vector machine (SVM) method, are widely used in related areas. However, these methods have not been applied to the problem discussed in this article before. The objective of the research was to develop a predictive model for evaluating the rheological parameters of polymers using artificial intelligence methods by the example of polyvinyl chloride.</p></sec><sec><title>Materials and Methods</title><p>Materials and Methods. This paper used k-nearest neighbor method and the support vector machine to determine the rheological parameters of polymers based on stress relaxation curves. The models were trained on synthetic data generated from theoretical relaxation curves constructed using the nonlinear Maxwell-Gurevich equation. The input parameters of the models were the amount of deformation at which the experiment was performed, the initial stress, the stress at the end of the relaxation process, the relaxation time, and the conditional end time of the process. The output parameters included velocity modulus and initial relaxation viscosity coefficient. The models were developed in the Jupyter Notebook environment in Python.</p></sec><sec><title>Results</title><p>Results. New predictive models were built to determine the rheological parameters of polymers based on artificial intelligence methods. The proposed models provided high quality prediction. The model quality metrics in the SVR algorithm were: MAE – 1.67 and 0.72; MSE – 5.75 and 1.21; RMSE – 1.67 and 1.1; MAPE – 8.92 and 7.3 for the parameters of the initial relaxation viscosity and velocity modulus, respectively, with the coefficient of determination R2 – 0.98. The developed models showed an average absolute percentage error in the range of 5.9 – 8.9%. In addition to synthetic data, the developed models were also tested on real experimental data for polyvinyl chloride in the temperature range from 20° to 60°C.</p><p>Discussion and Conclusion. The approbation of the developed models on real experimental curves showed a high quality of their approximation, comparable to other methods. Thus, the k-nearest neighbor algorithm and SVM can be used to predict the rheological parameters of polymers as an alternative to artificial neural networks and the CatBoost algorithm, requiring less effort to preset adjustment. At the same time, in this research, the SVM method turned out to be the most preferred method of machine learning, since it is more effective in processing a large number of features</p></sec></abstract><trans-abstract xml:lang="ru"><sec><title>Введение</title><p>Введение. Для всех полимерных материалов и композитов на их основе характерны явно выраженные реологические свойства, прогнозирование которых является одной из важнейших задач механики полимеров. Большие возможности для прогнозирования реологических параметров полимеров открывают методы машинного обучения. Ранее проводились исследования на предмет построения прогнозных моделей с использованием искусственных нейронных сетей и алгоритма CatBoost. Наряду с этими методами, благодаря возможности обрабатывать данные с сильно нелинейными зависимостями между признаками, широкое применение в смежных областях находят методы машинного обучения — метод k-ближайших соседей и метод опорных векторов (SVM). Однако ранее к проблеме, рассмотренной в данной статье, эти методы не применялись. Целью работы явилась разработка прогнозной модели для оценки реологических параметров полимеров методами искусственного интеллекта на примере поливинилхлорида.</p></sec><sec><title>Материалы и методы</title><p>Материалы и методы. В работе применены метод k-ближайших соседей и метод опорных векторов для определения реологических параметров полимеров на основе кривых релаксации напряжений. Обучение моделей выполнялось на синтетических данных, сгенерированных на основе теоретических кривых релаксации, построенных с использованием нелинейного уравнения Максвелла-Гуревича. Входными параметрами моделей выступали величина деформации, при которой производился эксперимент, начальное напряжение, напряжение в конце процесса релаксации, время релаксации и условное время окончания процесса. Выходные параметры: модуль скорости и коэффициент начальной релаксационной вязкости. Модели разработаны в среде Jupyter Notebook на языке Python.</p></sec><sec><title>Результаты исследования</title><p>Результаты исследования. Построены новые прогнозные модели для определения реологических параметров полимеров на основе методов искусственного интеллекта. Предложенные модели обеспечивают высокое качество прогнозирования. Метрики качества модели в алгоритме SVR составляют: MAE — 1,67 и 0,72; MSE — 5,75 и 1,21; RMSE — 1,67 и 1,1; MAPE — 8,92 и 7,3 для параметров начальной релаксационной вязкости и модуля скорости соответственно с коэффициентом детерминации R2 — 0,98. Разработанные модели показали среднюю абсолютную процентную ошибку в диапазоне 5,9–8,9 %. Помимо синтетических данных, разработанные модели также апробировалась на реальных экспериментальных данных для поливинилхлорида в диапазоне температур от 20° до 60 °C.</p></sec><sec><title>Обсуждение и заключение</title><p>Обсуждение и заключение. Апробация разработанных моделей на реальных экспериментальных кривых показала высокое качество их аппроксимации, сопоставимое с другими методами. Таким образом, алгоритмы k-ближайших соседей и SVM могут использоваться для прогнозирования реологических параметров полимеров как альтернатива искусственным нейронным сетям и алгоритму CatBoost, требующая меньших усилий по предварительной настройке. При этом в данном исследовании наиболее предпочтительным методом машинного обучения оказался метод SVM, так как он более эффективен в обработке большого числа признаков.</p></sec></trans-abstract><kwd-group xml:lang="ru"><kwd>реология</kwd><kwd>полимеры</kwd><kwd>искусственный интеллект</kwd><kwd>машинное обучение</kwd><kwd>k-ближайшие соседи</kwd><kwd>опорная векторная регрессия</kwd></kwd-group><kwd-group xml:lang="en"><kwd>rheology</kwd><kwd>polymers</kwd><kwd>artificial intelligence</kwd><kwd>machine learning</kwd><kwd>k-nearest neighbors</kwd><kwd>support vector regression</kwd></kwd-group></article-meta></front><body><p>Introduction. Polymers are used in various industries, including the production of plastics, textiles, packaging materials, and more. Accurate prediction of the rheological parameters of polymers is a complex task that is important for optimizing production processes and creating products with desired properties.</p><p>Today, machine learning methods have gained great popularity in various fields, including chemistry and materials science, due to their ability to efficiently process and analyze large amounts of data. These methods make it possible to predict the properties of materials. In [<xref ref-type="bibr" rid="cit1">1</xref>], a platform based on machine learning was described, and the integration of metrological support in the context of digital transformation was proposed. In [<xref ref-type="bibr" rid="cit2">2</xref>], the local distribution of deformation, the development of plastic anisotropy, and fracture in additively manufactured alloys were predicted. The problems of developing measuring control regulators on digital platforms were formulated in [<xref ref-type="bibr" rid="cit3">3</xref>]. An intelligent model for controlling the parameters of overlap joint welding was built in [<xref ref-type="bibr" rid="cit4">4</xref>]. However, the issues of using machine learning methods to predict the rheological properties of polymers remain insufficiently investigated. This is caused by both technical and methodological difficulties, such as the heterogeneity of the polymer structure, their sensitivity to external conditions, and complex interactions between molecules during deformation.</p><p>Research in the field of rheological properties of polymers and composites using machine learning methods has great prospects in the construction industry [<xref ref-type="bibr" rid="cit5">5</xref>]. For numerous polymers, the experimental data are well described by the generalized nonlinear Maxwell-Gurevich equation [<xref ref-type="bibr" rid="cit6">6</xref>], which has the form for a uniaxial stress state [<xref ref-type="bibr" rid="cit7">7</xref>]:</p><p> (1)</p><p>where ε* — creep deformation, f* — stress function, σ — stress, E∞ — module of high elasticity, — initial relaxation viscosity, m* — velocity module.</p><p>Various intelligent machine learning models can be used to determine the rheological parameters of polymers, such as the initial relaxation viscosity (hereinafter just “viscosity”) and the velocity module [8, 9]. For example, one such model is a neural network that can be trained on generated datasets to determine optimal polymer parameters [<xref ref-type="bibr" rid="cit10">10</xref>].</p><p>Prediction based on synthesized data is a fairly common practice, including for nonlinear optimization methods [11, 12]. One of the ways to generate data is the use of Rosenbrock, Himmelblau, and Booth functions [<xref ref-type="bibr" rid="cit13">13</xref>], which are effectively applied to test optimization methods such as gradient descent methods, genetic algorithms, and the Newton method. This approach was applied in [<xref ref-type="bibr" rid="cit14">14</xref>], where a data set based on theoretical stress relaxation curves using the nonlinear Maxwell-Gurevich equation was generated to test the efficiency of various optimization methods.</p><p>In [<xref ref-type="bibr" rid="cit15">15</xref>], several machine learning approaches were given to predict the durability of a reinforced concrete beam, such as a neural network of back propagation, linear and ridge regression, a decision tree, and a random forest. The input parameters of the study were both various characteristics of the material and their properties, depending on the environment (temperature, humidity). Finally, according to the results of the study, the back propagation model determined a more accurate forecast (85%), the average values (MAE) and MAPE were 1.13% and 14.5%, respectively.</p><p>Another approach to solving inverse problems of creep theory using the neural network method is based on training a model on large amounts of experimental data. In [<xref ref-type="bibr" rid="cit16">16</xref>], a neural network model was developed, which was trained on data obtained as a result of long-term experiments on polymer materials, and successfully predicted the viscoelastic behavior of these materials. The data obtained from experiments on samples of various materials were used for the study.</p><p>Unlike the above-mentioned papers, the presented research is intended to promote the development of more accurate and reliable methods for predicting polymer properties, such as the k-nearest neighbor method and the support vector machine, which is important for various industries and science.</p><p>The research objective was to develop a predictive model based on artificial intelligence methods for analyzing the rheological properties of polymers. Previously, the authors had already used a machine learning algorithm based on gradient boosting CatBoost to process stress relaxation curves [17, 18]. CatBoost is one of the most powerful machine learning algorithms applicable to solving not only regression problems, but also classification and ranking problems [<xref ref-type="bibr" rid="cit19">19</xref>].</p><p>The CatBoost method can be useful for solving some tasks, but it also has its limitations and disadvantages. In this regard, there is an interest in using other algorithms mentioned earlier [<xref ref-type="bibr" rid="cit20">20</xref>] to solve the problem.</p><p>Materials and Methods. The generated data array is partially presented in Table 1. This array was formed on the basis of theoretical stress relaxation curves described by the Maxwell-Gurevich equation, according to the technique presented in [<xref ref-type="bibr" rid="cit14">14</xref>]. The variation ranges of the velocity modulus and the initial relaxation viscosity in the generated array correspond to the real ranges for polyvinyl chloride in the temperature interval from 20° to 60°C. The total number of numerical experiments (n) was 30,000.</p><table-wrap id="table-1"><caption><p>Table 1</p><p>Table of initial data for training the model</p></caption><table><tbody><tr><td>No</td><td>Deformation, %</td><td>Stress at the beginning of the process σ0, MPa</td><td>Stress at the end of the process σ∞, MPa</td><td>Relaxation time&#13;
tn, h</td><td>Conditional end time of the process t95, h</td><td>Velocity module m*, MPa</td><td>Viscosity 106, MPa∙s</td></tr><tr><td>1</td><td>1.000</td><td>10.000</td><td>0.909</td><td>0.277</td><td>1.484</td><td>6.000</td><td>3.000</td></tr><tr><td>2</td><td>2.000</td><td>20.000</td><td>1.818</td><td>0.109</td><td>1.003</td><td>6.000</td><td>3.000</td></tr><tr><td>3</td><td>3.000</td><td>30.000</td><td>2.727</td><td>0.046</td><td>0.820</td><td>6.000</td><td>3.000</td></tr><tr><td>4</td><td>1.000</td><td>10.000</td><td>0.909</td><td>0.861</td><td>4.615</td><td>6.000</td><td>9.333</td></tr><tr><td>5</td><td>2.000</td><td>20.000</td><td>1.818</td><td>0.339</td><td>3.122</td><td>6.000</td><td>9.333</td></tr><tr><td>6</td><td>3.000</td><td>30.000</td><td>2.727</td><td>0.142</td><td>2.552</td><td>6.000</td><td>9.333</td></tr><tr><td>7</td><td>1.000</td><td>10.000</td><td>0.909</td><td>1.445</td><td>7.747</td><td>6.000</td><td>15.667</td></tr><tr><td>…</td></tr><tr><td>29997</td><td>3</td><td>45</td><td>37.5</td><td>0.285</td><td>2.476</td><td>15</td><td>53.666</td></tr><tr><td>29998</td><td>1</td><td>15</td><td>12.5</td><td>1.003</td><td>4.255</td><td>15</td><td>60</td></tr><tr><td>29999</td><td>2</td><td>30</td><td>25</td><td>0.558</td><td>3.371</td><td>15</td><td>60</td></tr><tr><td>30000</td><td>3</td><td>45</td><td>37.5</td><td>0.319</td><td>2.769</td><td>15</td><td>60</td></tr></tbody></table></table-wrap><p>The data set consisted of five input variables and two output variables. Input variables (unit measure): deformation — ε (%); stress at the beginning of the process — σ0 (MPa); stress at the end of the process — σ∞ (MPa); relaxation time — tn (h); conditional end time of the process — t95 (h). Output variables (unit measure): velocity module — m* (MPa); initial relaxation viscosity —  (in Table 1 and further, simply “viscosity”) (106 MPa∙s). Values σ0, σ∞, tn и t95 are schematically shown on the typical stress relaxation curve (Fig. 1).</p><fig id="fig-1"><caption><p>Fig. 1. Typical stress relaxation curve</p></caption><graphic xlink:href="donstu-24-1-g001.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/3RI3quBHzzN7yM0u0TyPmvFfan5bkzC645nbNtvB.png</uri></graphic></fig><p>The k-nearest neighbor (k-NN) algorithm is based on the similarity analysis of nearby objects. The k-NN method is in great demand for solving various types of machine learning tasks.</p><p>Formula (2) represents the general form of the algorithm, where w(i, x) — weight function evaluating the importance of the i-th neighbor.</p><p> (2)</p><p>The maximum total weight can be achieved for several objects at the same time. The entropy of this process can be adjusted using nonlinear sequence w(i, x) = [i ≤ k]qi (exponentially weighted k-nearest neighbor method) provided that 0 ≤ q ≤ 0.5.</p><p>Representing a fairly simple machine learning algorithm, k-NN is well applicable to solving classification and regression problems. The advantages of this method are ease of implementation, no need for pre-training of the model. It is used for all types of data, including categorical and numeric. Disadvantages: a tendency to over-training (provided that k is too small), poor performance with large amounts of data, it is not possible to take into account the relationship between the signs.</p><p>The support vector algorithm — support vector regression (SVR) — solves the problem of minimizing the sum of the mean absolute error. SVR is more resistant to outliers, unlike the least squares method, due to the regularization coefficient (C) and the “epsilon-insensitive tube” (ε). In this case, ε determines the width of the tube in which errors are ignored. Stochastic gradient descent is used to find the minimum of the function.  </p><p>The support vector machine learning algorithm is function F(x) of approximation and regularization of empirical risk, which converts training and test samples into output data for each object of the corresponding sample. Formula (3) represents the general form of the algorithm, (4) is a linearly separable sample, (5) is a linearly inseparable sample, where C — regularization coefficient, Mi(w, w0) — scalar product of vectors (feature and support vector), wi— weight coefficients.</p><p>Function  is a function of a pair of objects , п representable as a scalar product in some space H, for which transformation  takes place. Function  — kernel if  , provided that K is symmetric:  and nonnegative definite:  The regularization coefficient is determined by the sliding mode control method.</p><p>Advantages of the SVM method are as follows: high accuracy in classification problems in nonlinear spaces; ability to work with a large number of features (including categorical and numerical), generalize data (which provides applying the model to new data), work with data that are not linearly separable due to the use of kernel functions.</p><p>Disadvantages of the SVM method include inefficiency of working with large amounts of data; low interpretability of the model; the requirement to configure numerous parameters, such as the type of kernel (its parameters, regularization parameters), etc.</p><p>In this research, algorithms are developed in the Jupyter Notebook intelligent computing environment using machine learning methods.</p><p> </p><p>The selection of such a parameter as the number of neighbors affects the generalizing ability of the developed model and is important for its correct operation. The most suitable algorithm for calculating distance based on data is Distance, in which the weights of objects are inversely proportional to their distance. Accordingly, in the case of closer neighbors of the query object, they have more influence than their neighbors located at a greater distance from the object.</p><p>The data set was divided into training and test samples in a ratio of 75/25. In turn, 20% of the training sample became validation. The sample size was: training — xtrain = 20,400; test — xtest = 6,000; validation — xeval = 3,600. For variables ytrain, ytest, yeval, the data were distributed in a similar way.</p><p>To build the k-nearest neighbor model, the following parameters were selected: number of neighbors, sheet size, interval, and weight function. The range and functionality of the values for the configurable parameters are shown in Table 2.</p><table-wrap id="table-2"><caption><p>Table 2</p><p>Parameter table for k-NN model</p></caption><table><tbody><tr><td>No</td><td>Parameter</td><td>Value</td><td>Functional</td></tr><tr><td>1</td><td>Number of neighbors (k)</td><td>3, 5, 7, 9</td><td>Determines optimal number of neighbors for query</td></tr><tr><td>2</td><td>Sheet size (n)</td><td>15, 20, 30</td><td>Determines speed of querying and required memory for storing the tree</td></tr><tr><td>3</td><td>Interval (p)</td><td>1 (l1), 2 (l2)</td><td>Defines power parameter (Minkowski metric)</td></tr><tr><td>4</td><td>Weight function (w)</td><td>'uniform', 'distance'</td><td>Predicting weights</td></tr></tbody></table></table-wrap><p>To build the SVR model, the following parameters were selected: kernel type, kernel order, regularization coefficient (quadratic regularizer), ε. The range and functional values for the adjustable parameters are presented in Table 3.</p><table-wrap id="table-3"><caption><p>Table 3</p><p>Parameter table for SVR model</p></caption><table><tbody><tr><td>No</td><td>Parameter</td><td>Value</td><td>Functional</td></tr><tr><td>1</td><td>Kernel type</td><td>'linear'; 'poly'; 'rbf'; 'sigmoid'</td><td>Defines type of hyperplane (linear/nonlinear)</td></tr><tr><td>2</td><td>Kernel order</td><td>1, 2, 3, 4, 5, 7</td><td>Defines degree of polynomial function of kernel</td></tr><tr><td>3</td><td>Quadratic regularizer (C)</td><td>2; 3; 4; 5; 7; 10</td><td>Solves problems of vector multicollinearity and model retraining</td></tr><tr><td>4</td><td>ε</td><td>0.1; 0.2; 0.5; 1; 1.5; 2; 3</td><td>Determines deviation of the object (proximity measure)</td></tr></tbody></table></table-wrap><sec><title>Research Results</title><p>Figure 2 shows the correlations between the variables.</p><p>The following types of linear correlations between individual input and output variables of the model can be noted:</p><p>The presence of a moderate correlation between variables or its absence indicates only the absence of a linear relationship; therefore, it is possible to have a nonlinear relationship between variables.</p><fig id="fig-2"><caption><p>Fig. 2. Correlation matrix</p></caption><graphic xlink:href="donstu-24-1-g002.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/Fl8qd82gcP4kkW56tcvbELfc6C7a9mfni3WSNAnC.png</uri></graphic></fig><p>Table 4 shows the statistical characteristics of the original data set.</p><table-wrap id="table-4"><caption><p>Table 4</p><p>Statistical characteristics of the original data set</p></caption><table><tbody><tr><td>Parameter</td><td>ε</td><td>σ0</td><td>σ∞</td><td>tn</td><td>t95</td><td>m*</td><td> </td></tr><tr><td>Unit measure</td><td>%</td><td>MPa</td><td>MPa</td><td>h</td><td>h</td><td>MPa</td><td>106 MPa∙s</td></tr><tr><td>count</td><td>30,000.00</td><td>30,000.00</td><td>30,000.00</td><td>30,000.00</td><td>30,000.00</td><td>30,000.00</td><td>30,000.00</td></tr><tr><td>mean</td><td>2.00</td><td>25.00</td><td>15.78</td><td>0.75</td><td>4.41</td><td>10.50</td><td>31.50</td></tr><tr><td>std</td><td>0.82</td><td>10.77</td><td>9.10</td><td>0.94</td><td>4.40</td><td>2.87</td><td>18.19</td></tr><tr><td>min</td><td>1.00</td><td>10.00</td><td>0.91</td><td>0.00</td><td>0.07</td><td>6.00</td><td>3.00</td></tr><tr><td>max</td><td>3.00</td><td>45.00</td><td>37.50</td><td>10.04</td><td>38.02</td><td>15.00</td><td>60.00</td></tr></tbody></table></table-wrap><p>The best parameters for the k-nearest neighbor model were determined as a result of 5-block cross-validation (Table 5).</p><table-wrap id="table-5"><caption><p>Table 5</p><p>Best k-NN model parameters</p></caption><table><tbody><tr><td>Parameter</td><td>Number of neighbors (k)</td><td>Sheet size (n)</td><td>Interval (p)</td><td>Weight function (w)</td></tr><tr><td></td><td>3</td><td>15</td><td>2</td><td>'distance'</td></tr><tr><td>m*</td><td>5</td><td>15</td><td>2</td><td>'distance'</td></tr></tbody></table></table-wrap><p>The best parameters of the SVR model for viscosity parameters  (at the beginning of the relaxation process) and velocity module  were obtained empirically (Table 6).</p><table-wrap id="table-6"><caption><p>Table 6</p><p>Best parameters of SVR model</p></caption><table><tbody><tr><td>Parameter</td><td>Kernel type</td><td>Kernel order</td><td>Quadratic regularizer</td><td>ε</td></tr><tr><td></td><td>'rbf'</td><td>2</td><td>5</td><td>0.3</td></tr><tr><td>m*</td><td>'rbf'</td><td>3</td><td>6</td><td>0.3</td></tr></tbody></table></table-wrap><p>The ratio between the real and predicted values for the k-NN model in terms of the parameters “Viscosity” and “Velocity modulus” is shown in Figures 3, 4.</p><fig id="fig-3"><caption><p>Fig. 3. Diagrams of prediction errors of k-NN, “Viscosity”</p></caption><graphic xlink:href="donstu-24-1-g003.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/1mdG7gmdKyu10qryCh854ZQTdVDcHfl8IAtQNPXZ.png</uri></graphic></fig><fig id="fig-4"><caption><p>Fig. 4. Diagrams of prediction errors of k-NN, “Velocity module”</p></caption><graphic xlink:href="donstu-24-1-g004.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/vQ0RRBFEOLrFc04eAgaP3Qcp1yoknCfTJzdXGrWB.png</uri></graphic></fig><p>The ratio between the real and predicted values for the SVR model according to the parameters “Viscosity” and “Velocity module” is shown in Figures 5, 6.</p><fig id="fig-5"><caption><p>Fig. 5. Diagrams of prediction errors of k-NN, “Viscosity”</p></caption><graphic xlink:href="donstu-24-1-g005.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/AYcn4A71icBdg9rjOKa9rDRzdr69CHCSq2GMBX8a.png</uri></graphic></fig><fig id="fig-6"><caption><p>Fig. 6. Diagrams of prediction errors of k-NN, “Velocity module”</p></caption><graphic xlink:href="donstu-24-1-g006.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/XTB7XdiYHsPHx1px9EuNskxtsGnPQM8xYiXkZxUM.png</uri></graphic></fig><p>The metrics of the developed models of k-nearest neighbors and support vectors are presented in Tables 7 and 8, respectively.</p><table-wrap id="table-7"><caption><p>Table 7</p><p>Metrics of the developed k-NN models</p></caption><table><tbody><tr><td>Parameter</td><td>MAE</td><td>MSE</td><td>RMSE</td><td>MAPE (%)</td><td>R2 train</td><td>R2 test</td></tr><tr><td> </td><td>1.8</td><td>6.8</td><td>2.6</td><td>5.9</td><td>1.00</td><td>0.98</td></tr><tr><td>m*</td><td>0.7</td><td>0.8</td><td>0.9</td><td>6.9</td><td>0.99</td><td>0.98</td></tr></tbody></table></table-wrap><table-wrap id="table-8"><caption><p>Table 8</p><p>Metrics of the developed SVR models</p></caption><table><tbody><tr><td>Parameter</td><td>MAE</td><td>MSE</td><td>RMSE</td><td>MAPE (%)</td><td>R2 train</td><td>R2 test</td></tr><tr><td> </td><td>1.67</td><td>5.75</td><td>1.67</td><td>8.92</td><td>0.98</td><td>0.97</td></tr><tr><td>m*</td><td>0.72</td><td>1.21</td><td>1.1</td><td>7.3</td><td>0.89</td><td>0.87</td></tr></tbody></table></table-wrap><p>In addition to synthetic data, the developed models were also tested on real experimental data presented in [<xref ref-type="bibr" rid="cit13">13</xref>]. Experimental relaxation curves of polyvinyl chloride were used for various temperatures in the range from 20° to 60°C. In Figure 7, the experimental stress values at different temperatures at different points in time are marked with felt-tip pens, and solid lines show stress relaxation curves based on values m* and   predicted by the models.</p><fig id="fig-7"><caption><p>Fig. 7. Results of testing the model on experimental data</p></caption><graphic xlink:href="donstu-24-1-g007.png"><uri content-type="original_file">https://cdn.elpub.ru/assets/journals/donstu/2024/1/ocyls4T0bj2fmaCMLvXk1u3sR2qHvufxWYzHNHGL.png</uri></graphic></fig><p>Discussion and Conclusion. Figure 5 shows that the quality of prediction based on experimental data is quite high, specifically, for temperatures of 30°C, 50°C and 60°C. For other temperatures, the prediction quality is somewhat lower, which is due to the quality of the experimental curves themselves. It was necessary to extend the experiment time and wait for the curves to reach the horizontal asymptote.</p><p>In this research, the most preferred method is the support vector machine (SVM). This is due to the fact that SVM can process data with a large number of features, which is important for the analysis of rheological parameters of materials. In addition, SVM works with nonlinear dependences between features, it is applicable to solve the regression problem, which is required to determine the rheological parameters of materials.</p><p>However, the CatBoost method can also be effective in this task, especially, if there are categorical features in the data. In addition, CatBoost can process missing data, which can be important for analyzing rheological parameters of materials.</p><p>The k-nearest neighbor method is less preferable in this task due to its low efficiency in processing a large number of features, as well as the presence of problems with high data dimensionality.</p><p>In the course of the investigation, it has been shown that the use of machine learning methods makes it possible to effectively analyze and process large amounts of data, including information about the characteristics of polymers and their rheological properties. The model developed on the basis of such an analysis maintains high accuracy in predicting the rheological parameters of polyvinyl chloride, which is confirmed by the results of cross-validation and comparison to experimental data.</p><p>One of the key advantages of this approach is the ability to automate the process of predicting the rheological parameters of polymers, which reduces the time and cost of research and development of new materials. In addition, the model can be easily adapted to analyze other types of polymers and predict their properties.</p><p>As a result of this research, a predictive model has been developed to evaluate the rheological parameters of polyvinyl chloride using artificial intelligence methods based on data of its characteristics and rheological properties. The model demonstrates high prediction accuracy and can be used to optimize the production and development of new polymer-based materials.</p></sec></body><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Dudukalov EV, Munister VD, Zolkin AL, Losev AN, Knishov AV. The Use of Artificial Intelligence and Information Technology for Measurements in Mechanical Engineering and in Process Automation Systems in Industry 4.0. Journal of Physics: Conference Series. IOP Publishing. 2021;1889(5):052011. https://doi.org/10.1088/1742-6596/1889/5/052011</mixed-citation><mixed-citation xml:lang="en">Dudukalov EV, Munister VD, Zolkin AL, Losev AN, Knishov AV. The Use of Artificial Intelligence and Information Technology for Measurements in Mechanical Engineering and in Process Automation Systems in Industry 4.0. Journal of Physics: Conference Series. IOP Publishing. 2021;1889(5):052011. https://doi.org/10.1088/1742-6596/1889/5/052011</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Waqas Muhammad, Abhijit P Brahme, Olga Ibragimova, Jidong Kang, Kaan Inal. A Machine Learning Framework to Predict Local Strain Distribution and the Evolution of Plastic Anisotropy &amp; Fracture in Additively Manufactured Alloys. International Journal of Plasticity. 2021;136:102867. https://doi.org/10.1016/j.ijplas.2020.102867</mixed-citation><mixed-citation xml:lang="en">Waqas Muhammad, Abhijit P Brahme, Olga Ibragimova, Jidong Kang, Kaan Inal. A Machine Learning Framework to Predict Local Strain Distribution and the Evolution of Plastic Anisotropy &amp; Fracture in Additively Manufactured Alloys. International Journal of Plasticity. 2021;136:102867. https://doi.org/10.1016/j.ijplas.2020.102867</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Won-Bin Oha, Tae-Jong Yuna, Bo-Ram Leea, Chang-Gon Kima, Zong-Liang Lianga, Ill-Soo Kim. A Study on Intelligent Algorithm to Control Welding Parameters for Lap-joint. Procedia Manufacturing. 2019;30:48–55. http://doi.org/10.1016/j.promfg.2019.02.008</mixed-citation><mixed-citation xml:lang="en">Won-Bin Oha, Tae-Jong Yuna, Bo-Ram Leea, Chang-Gon Kima, Zong-Liang Lianga, Ill-Soo Kim. A Study on Intelligent Algorithm to Control Welding Parameters for Lap-joint. Procedia Manufacturing. 2019;30:48–55. http://doi.org/10.1016/j.promfg.2019.02.008</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Amit R Patel, Kashyap K Ramaiya, Chandrakant V Bhatia, Hetalkumar N Shah, Sanket N Bhavsar. Artificial Intelligence: Prospect in Mechanical Engineering Field—A Review. In book: Data Science and Intelligent Applications. Singapore: Springer; 2021. P. 267–282. https://doi.org/10.1007/978-981-15-4474-3_31</mixed-citation><mixed-citation xml:lang="en">Amit R Patel, Kashyap K Ramaiya, Chandrakant V Bhatia, Hetalkumar N Shah, Sanket N Bhavsar. Artificial Intelligence: Prospect in Mechanical Engineering Field—A Review. In book: Data Science and Intelligent Applications. Singapore: Springer; 2021. P. 267–282. https://doi.org/10.1007/978-981-15-4474-3_31</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Amjadi M, Fatemi A. Creep and Fatigue Behaviors of High-Density Polyethylene (HDPE): Effects of Temperature, Mean Stress, Frequency, and Processing Technique. International Journal of Fatigue. 2020;141:105871. http://doi.org/10.1016/j.ijfatigue.2020.105871</mixed-citation><mixed-citation xml:lang="en">Amjadi M, Fatemi A. Creep and Fatigue Behaviors of High-Density Polyethylene (HDPE): Effects of Temperature, Mean Stress, Frequency, and Processing Technique. International Journal of Fatigue. 2020;141:105871. http://doi.org/10.1016/j.ijfatigue.2020.105871</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Chepurnenko V, Yazyev B, Xuanzhen Song. Creep Calculation for a Three-Layer Beam with a Lightweight Filler. MATEC Web of Conferences. 2017;129:05009. https://doi.org/10.1051/matecconf/201712905009</mixed-citation><mixed-citation xml:lang="en">Chepurnenko V, Yazyev B, Xuanzhen Song. Creep Calculation for a Three-Layer Beam with a Lightweight Filler. MATEC Web of Conferences. 2017;129:05009. https://doi.org/10.1051/matecconf/201712905009</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Litvinov SV, Yazyev BM, Turko MS. Effecting of Modified HDPE Composition on the Stress-Strain State of Constructions. IOP Conference Series: Materials Science and Engineering. 2018;463(4):042063. https://doi.org/10.1088/1757-899X/463/4/042063</mixed-citation><mixed-citation xml:lang="en">Litvinov SV, Yazyev BM, Turko MS. Effecting of Modified HDPE Composition on the Stress-Strain State of Constructions. IOP Conference Series: Materials Science and Engineering. 2018;463(4):042063. https://doi.org/10.1088/1757-899X/463/4/042063</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Guangjian Xiang, Deshun Yin, Ruifan Meng, Siyu Lu. Creep Model for Natural Fiber Polymer Composites (NFPCs) Based on Variable Order Fractional Derivatives: Simulation and Parameter Study. Journal of Applied Polymer Science. 2020;137(24):48796. http://doi.org/10.1002/app.48796</mixed-citation><mixed-citation xml:lang="en">Guangjian Xiang, Deshun Yin, Ruifan Meng, Siyu Lu. Creep Model for Natural Fiber Polymer Composites (NFPCs) Based on Variable Order Fractional Derivatives: Simulation and Parameter Study. Journal of Applied Polymer Science. 2020;137(24):48796. http://doi.org/10.1002/app.48796</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Tugce Tezel, Volkan Kovan, Eyup Sabri Topal. Effects of the Printing Parameters on Short‐Term Creep Behaviors of Three‐Dimensional Printed Polymers. Journal of Applied Polymer Science. 2019;136(21):47564. http://doi.org/10.1002/app.47564</mixed-citation><mixed-citation xml:lang="en">Tugce Tezel, Volkan Kovan, Eyup Sabri Topal. Effects of the Printing Parameters on Short‐Term Creep Behaviors of Three‐Dimensional Printed Polymers. Journal of Applied Polymer Science. 2019;136(21):47564. http://doi.org/10.1002/app.47564</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Litvinov SV, Trush LI, Yazyev SB. Flat Axisymmetrical Problem of Thermal Creepage for Thick-Walled Cylinder Made of Recyclable PVC. Procedia Engineering. 2016;150:1686–1693. https://doi.org/10.1016/j.proeng.2016.07.156</mixed-citation><mixed-citation xml:lang="en">Litvinov SV, Trush LI, Yazyev SB. Flat Axisymmetrical Problem of Thermal Creepage for Thick-Walled Cylinder Made of Recyclable PVC. Procedia Engineering. 2016;150:1686–1693. https://doi.org/10.1016/j.proeng.2016.07.156</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Dudnik AE, Chepurnenko AS, Litvinov SV. Determining the Rheological Parameters of Polyvinyl Chloride, with Change in Temperature Taken into Account. International Polymer Science and Technology. 2017;44(1):43–48. https://doi.org/10.1177/0307174X1704400109</mixed-citation><mixed-citation xml:lang="en">Dudnik AE, Chepurnenko AS, Litvinov SV. Determining the Rheological Parameters of Polyvinyl Chloride, with Change in Temperature Taken into Account. International Polymer Science and Technology. 2017;44(1):43–48. https://doi.org/10.1177/0307174X1704400109</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Litvinov S, Yazyev S, Chepurnenko A, Yazyev B. Determination of Rheological Parameters of Polymer Materials Using Nonlinear Optimization Methods. In book: A. Mottaeva (ed). Proceedings of the XIII International Scientific Conference on Architecture and Construction. Singapore: Springer; 2020. P. 587–594. https://doi.org/10.1007/978-981-33-6208-6_58</mixed-citation><mixed-citation xml:lang="en">Litvinov S, Yazyev S, Chepurnenko A, Yazyev B. Determination of Rheological Parameters of Polymer Materials Using Nonlinear Optimization Methods. In book: A. Mottaeva (ed). Proceedings of the XIII International Scientific Conference on Architecture and Construction. Singapore: Springer; 2020. P. 587–594. https://doi.org/10.1007/978-981-33-6208-6_58</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Соловьева Е.В., Аскадский А.А., Попова М.Н. Исследование релаксационных свойств первичного и вторичного поливинилхлорида. Пластические массы. 2013;2:54–62.</mixed-citation><mixed-citation xml:lang="en">Solovyova EB, Askadskiy AA, Popova MN. Investigation of Relaxation Properties of Primary and Secondary Polyvinyl Chloride. Plasticheskie massy. 2013;2:54–62. (In Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Chepurnenko A. Determining the Rheological Parameters of Polymers Using Artificial Neural Networks. Polymers. 2022;14(19):3977. https://doi.org/10.3390/polym14193977</mixed-citation><mixed-citation xml:lang="en">Chepurnenko A. Determining the Rheological Parameters of Polymers Using Artificial Neural Networks. Polymers. 2022;14(19):3977. https://doi.org/10.3390/polym14193977</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Yu Xuan Rui. Developing an Artificial Neural Network Model to Predict the Durability of the RC Beam by Machine Learning Approaches. Case Studies in Construction Materials. 2022;17:e01382. http://doi.org/10.1016/j.cscm.2022.e01382</mixed-citation><mixed-citation xml:lang="en">Yu Xuan Rui. Developing an Artificial Neural Network Model to Predict the Durability of the RC Beam by Machine Learning Approaches. Case Studies in Construction Materials. 2022;17:e01382. http://doi.org/10.1016/j.cscm.2022.e01382</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Nagababu Andraju, Greg W Curtzwiler, Yun Ji, Kozliak Evguenii, Prakash Ranganathan. Machine-Learning-Based Predictions of Polymer and Postconsumer Recycled Polymer Properties. A Comprehensive Review. ACS Applied Materials &amp; Interfaces. 2022;14(38):42771–42790. http://doi.org/10.1021/acsami.2c08301</mixed-citation><mixed-citation xml:lang="en">Nagababu Andraju, Greg W Curtzwiler, Yun Ji, Kozliak Evguenii, Prakash Ranganathan. Machine-Learning-Based Predictions of Polymer and Postconsumer Recycled Polymer Properties. A Comprehensive Review. ACS Applied Materials &amp; Interfaces. 2022;14(38):42771–42790. http://doi.org/10.1021/acsami.2c08301</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Чепурненко А.С., Кондратьева Т.Н., Дебердеев Т.Р., Акопян В.Ф., Аваков А.А., Чепурненко В.С. Прогнозирование реологических параметров полимеров с помощью алгоритма градиентного бустинга CatBoost. Все материалы: Энциклопедический справочник. 2023;(6):21–29.</mixed-citation><mixed-citation xml:lang="en">Chepurnenko AS, Kondratieva TN, Deberdeev TR, Akopyan VF, Avakov AA, Chepurnenko VS. Prediction of Rheological Parameters of Polymers Using CatBoost Gradient Boosting Algorithm. All Materials: Encyclopedic Reference Book. 2023;(6):21–29. (In Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Kondratieva T, Prianishnikova L, Razveeva I. Machine Learning for Algorithmic Trading. E3S Web of Conferences. 2020;224:01019. https://doi.org/10.1051/e3sconf/202022401019</mixed-citation><mixed-citation xml:lang="en">Kondratieva T, Prianishnikova L, Razveeva I. Machine Learning for Algorithmic Trading. E3S Web of Conferences. 2020;224:01019. https://doi.org/10.1051/e3sconf/202022401019</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Stelmakh SA, Shcherban EM, Beskopylny AN, Mailyan LR, Meskhi B, Razveeva I, et al. Prediction of Mechanical Properties of Highly Functional Lightweight Fiber-Reinforced Concrete Based on Deep Neural Network and Ensemble Regression Trees Methods. Materials. 2022;15(19):6740. https://doi.org/10.3390/ma15196740</mixed-citation><mixed-citation xml:lang="en">Stelmakh SA, Shcherban EM, Beskopylny AN, Mailyan LR, Meskhi B, Razveeva I, et al. Prediction of Mechanical Properties of Highly Functional Lightweight Fiber-Reinforced Concrete Based on Deep Neural Network and Ensemble Regression Trees Methods. Materials. 2022;15(19):6740. https://doi.org/10.3390/ma15196740</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Beskopylny AN, Stelmakh SA, Shcherban EM, Mailyan LR, Meskhi B, Razveeva I, et al. Concrete Strength Prediction Using Machine Learning Methods CatBoost, k-Nearest Neighbors, Support Vector Regression. Applied Sciences. 2022;12(21):10864. https://doi.org/10.3390/app122110864</mixed-citation><mixed-citation xml:lang="en">Beskopylny AN, Stelmakh SA, Shcherban EM, Mailyan LR, Meskhi B, Razveeva I, et al. Concrete Strength Prediction Using Machine Learning Methods CatBoost, k-Nearest Neighbors, Support Vector Regression. Applied Sciences. 2022;12(21):10864. https://doi.org/10.3390/app122110864</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
