<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">gpntb</journal-id><journal-title-group><journal-title xml:lang="ru">Научные и технические библиотеки</journal-title><trans-title-group xml:lang="en"><trans-title>Scientific and Technical Libraries</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1027-3689</issn><issn pub-type="epub">2686-8601</issn><publisher><publisher-name>Russian National Public Library for Science and Technology</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.33186/1027-3689-2022-12-15-34</article-id><article-id custom-type="elpub" pub-id-type="custom">gpntb-1044</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>НАУКОМЕТРИЯ. БИБЛИОМЕТРИЯ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>SCIENTOMETRICS. BIBLIOMETRICS</subject></subj-group></article-categories><title-group><article-title>Оценка качества открытых данных Роспатента в контексте интеграции с отечественными информационными системами текущих исследований</article-title><trans-title-group xml:lang="en"><trans-title>Assesment of Rospatent open data quality within the context of integration with national current research information systems</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9339-1589</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Зелепухина</surname><given-names>В. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Zelepukhina</surname><given-names>V. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Зелепухина Виктория Андреевна – канд. техн. наук, старший научный сотрудник</p><p>Астрахань</p></bio><bio xml:lang="en"><p>Victoria A. Zelepukhina – Cand. Sc. (Engineering), Senior Researcher</p><p>Astrakhan</p></bio><email xlink:type="simple">v.zelepukhina@asu.edu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Астраханский государственный университет им. В. Н. Татищева</institution><country>Россия</country></aff><aff xml:lang="en"><institution>V. N. Tatishchev Astrakhan State University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2022</year></pub-date><pub-date pub-type="epub"><day>12</day><month>01</month><year>2023</year></pub-date><volume>0</volume><issue>12</issue><fpage>15</fpage><lpage>34</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Зелепухина В.А., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Зелепухина В.А.</copyright-holder><copyright-holder xml:lang="en">Zelepukhina V.A.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://ntb.gpntb.ru/jour/article/view/1044">https://ntb.gpntb.ru/jour/article/view/1044</self-uri><abstract><p>Информационные системы текущих исследований (Current Research Information Systems, CRIS) агрегируют сведения о научно-исследовательских проектах организации и их финансировании, о публикациях сотрудников и объектах интеллектуальной собственности. На основе данных, представленных в CRIS, проводится наукометрический анализ, оцениваются результативность научной деятельности и инновационный потенциал организации, принимаются управленческие решения. Поэтому своевременная загрузка качественной и достоверной информации – важная задача для CRIS. Потенциальным источником сведений об объектах интеллектуальной собственности (патентах и свидетельствах о государственной регистрации) для отечественных CRIS являются открытые данные (ОД) Роспатента, которые, согласно концепции ОД, допускают автоматизированную обработку на условиях свободной лицензии (бесплатно). Исследования показывают, что, несмотря на публикацию ОД в машиночитаемых форматах, их практическое применение осложняется наличием некорректных, неполных и несогласованных записей. Поэтому перед загрузкой ОД Роспатента в CRIS требуются предварительная оценка качества данных и их улучшение, если это возможно. К настоящему времени качество ОД Роспатента исследовано по нескольким критериям: доступность, заполненность метаданных, наличие обратной связи. Оценка качества данных на уровне содержимого наборов не проводилась. Цель настоящей работы – оценить внутреннее качество наборов ОД Роспатента, включающих сведения об изобретениях, полезных моделях, промышленных образцах, программах для ЭВМ, базах данных, топологиях интегральных микросхем, в контексте интеграции этих данных с системами CRIS. Качество измерялось по следующим характеристикам: полнота, точность, согласованность, своевременность и актуальность. В результате исследования выявлены неполные, неточные и несогласованные записи.</p></abstract><trans-abstract xml:lang="en"><p>Current Research Information Systems (CRIS) are to aggregate data on organizational research projects and their funding, on employers’ publications and intellectual property subject matters. The scientometric analysis is based on CRIS data to assess research output and innovative potential of organizations, and to make management solutions. The early loading of quality and reliable information is the most important task for CRIS. The Rospatent open data that allow for automated processing based on free (free of charge) licensing makes the potential source for data on intellectual property subject matters (patent and government registration certificates) for national CRIS. The studies evidence that despite publishing OD in machine-readable formats, their practical application is impeded by incorrect, incomplete and uncoordinated entries. Therefore, before loading. Rospatent OD have to be assessed for quality and to be improved, if possible. As for today, Rospatent OD quality is assessed by several criteria: accessibility, metadata completeness, feedback. However, at the content level, the open data have not been assessed. The purpose of the article is to evaluate the internal quality of Rospatent OD sets including information on inventions, utility models, industrial designs, computer programs, databases, circuit layouts, within the context of OD integration in CRIS systems. The quality is assessed in several characteristics: completeness, accuracy, consistency, expedience, and relevancy. The study has revealed incomplete, inaccurate and uncoordinated entries.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>CRIS</kwd><kwd>информационные системы текущих исследований</kwd><kwd>качество данных</kwd><kwd>измерение качества данных</kwd><kwd>оценка качества данных</kwd><kwd>открытые данные</kwd><kwd>Роспатент</kwd><kwd>объекты интеллектуальной собственности</kwd><kwd>патенты</kwd></kwd-group><kwd-group xml:lang="en"><kwd>CRIS</kwd><kwd>current research information system</kwd><kwd>data quality</kwd><kwd>data quality measurements</kwd><kwd>data quality assessment</kwd><kwd>open data</kwd><kwd>Rospatent</kwd><kwd>intellectual property subject matters</kwd><kwd>patents</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Интеллектуальная Система Тематического Исследования Наукометрических данных. URL: https://istina.msu.ru (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Intellektual`naia Sistema Tematicheskogo Issledovaniia Naukometricheskikh danny`kh. URL: https://istina.msu.ru (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">SciAct – информационно-аналитическая система мониторинга и учёта научной деятельности. URL: https://sciact.ru (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">SciAct – informatcionno-analiticheskaia sistema monitoringa i uchyota nauchnoi` deiatel`nosti. URL: https://sciact.ru (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Информационно-аналитическая система «Результаты научной деятельности». URL: https://science.asu.edu.ru (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Informatcionno-analiticheskaia sistema «Rezul`taty` nauchnoi` deiatel`nosti». URL: https://science.asu.edu.ru (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Azeroual O., Saake G., Abuosba M., Schöpfel J. Quality of Research Information in RIS Databases: A Multidimensional Approach // Business Information Systems. BIS 2019. Lecture Notes in Business Information Processing. 2019. Vol. 353. P. 337–349. URL: https://doi.org/10.1007/978-3-030-20485-3_26.</mixed-citation><mixed-citation xml:lang="en">Azeroual O., Saake G., Abuosba M., Schöpfel J. Quality of Research Information in RIS Databases: A Multidimensional Approach // Business Information Systems. BIS 2019. Lecture Notes in Business Information Processing. 2019. Vol. 353. P. 337–349. URL: https://doi.org/10.1007/978-3-030-20485-3_26.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Azeroual O., Schöpfel J. Quality Issues of CRIS Data: An Exploratory Investigation with Universities from Twelve Countries // Publications. 2019. URL: https://doi.org/10.3390/publications7010014 (дата обращения: 02.11.2022).</mixed-citation><mixed-citation xml:lang="en">Azeroual O., Schöpfel J. Quality Issues of CRIS Data: An Exploratory Investigation with Universities from Twelve Countries // Publications. 2019. URL: https://doi.org/10.3390/publications7010014 (data obrashcheniia: 02.11.2022).</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">ГОСТ Р ИСО 8000-2-2019. Качество данных. Часть 2. Словарь. Москва : Стандартинформ, 2019. 12 с.</mixed-citation><mixed-citation xml:lang="en">GOST R ISO 8000-2-2019. Kachestvo danny`kh. Chast` 2. Slovar`. Moskva : Standartinform, 2019. 12 с.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Васенин В. А., Афонин С. А., Зензинов А. А., Лунев К. В., Шачнев Д. А. Механизмы системы «ИСТИНА» для интеллектуального анализа состояния и стимулирования хода выполнения проектов в сфере науки и высшего образования // Научный сервис в сети Интернет. 2019. № 21. С. 210–221. URL: http://doi.org/10.20948/abrau-2019-48.</mixed-citation><mixed-citation xml:lang="en">Vasenin V. A., Afonin S. A., Zenzinov A. A., Lunev K. V., Shachnev D. A. Mehanizmy` sistemy` «ISTINA» dlia intellektual`nogo analiza sostoianiia i stimulirovaniia hoda vy`polneniia proektov v sfere nauki i vy`sshego obrazovaniia // Nauchny`i` servis v seti Internet. 2019. № 21. S. 210–221. URL: http://doi.org/10.20948/abrau-2019-48.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Открытые данные Роспатента. URL: https://rospatent.gov.ru/opendata (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Otkry`ty`e danny`e Rospatenta. URL: https://rospatent.gov.ru/opendata (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Открытые реестры. URL: https://new.fips.ru/registers-web/ (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Otkry`ty`e reestry`. URL: https://new.fips.ru/registers-web/ (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Условия использования открытых данных Роспатента / Открытая лицензия. URL: https://rospatent.gov.ru/content/uploadfiles/opendata-terms-of-use.docx (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Usloviia ispol`zovaniia otkry`ty`kh danny`kh Rospatenta / Otkry`taia licenziia. URL: https://rospatent.gov.ru/content/uploadfiles/opendata-terms-of-use.docx (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Чесноков М. Ю. Поиск аномалий в задаче повышения качества открытых данных // Проблемы управления. 2019. № 3. С. 53–62. URL: https://doi.org/10.25728/pu.2019.3.6.</mixed-citation><mixed-citation xml:lang="en">Chesnokov M. Iu. Poisk anomalii` v zadache povy`sheniia kachestva otkry`ty`kh danny`kh // Problemy` upravleniia. 2019. № 3. S. 53–62. URL: https://doi.org/10.25728/pu.2019.3.6.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Sadiq S., Indulska M. Open data: Quality over quantity // International Journal of Information Management. 2017. Vol. 37 (3). P. 150–154. URL: https://doi.org/10.1016/j.ijinfomgt.2017.01.003.</mixed-citation><mixed-citation xml:lang="en">Sadiq S., Indulska M. Open data: Quality over quantity // International Journal of Information Management. 2017. Vol. 37 (3). P. 150–154. URL: https://doi.org/10.1016/j.ijinfomgt.2017.01.003.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Torchiano M., Vetrò A., Iuliano F. Preserving the benefits of Open Government Data by measuring and improving their quality: an empirical study // 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC). 2017. Vol. 1. P. 144–153. URL: https://doi.org/10.1109/COMPSAC.2017.192.</mixed-citation><mixed-citation xml:lang="en">Torchiano M., Vetrò A., Iuliano F. Preserving the benefits of Open Government Data by measuring and improving their quality: an empirical study // 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC). 2017. Vol. 1. P. 144–153. URL: https://doi.org/10.1109/COMPSAC.2017.192.</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Vetrò A., Canova L., Torchiano M., Minotas C. O., Iemma R., Morando F. Open data quality measurement framework: Definition and application to Open Government Data // Government Information Quarterly. 2016. Vol. 33 (2). P. 325–337. URL: http://doi.org/10.1016/j.giq.2016.02.001.</mixed-citation><mixed-citation xml:lang="en">Vetrò A., Canova L., Torchiano M., Minotas C. O., Iemma R., Morando F. Open data quality measurement framework: Definition and application to Open Government Data // Government Information Quarterly. 2016. Vol. 33 (2). P. 325–337. URL: http://doi.org/10.1016/j.giq.2016.02.001.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Rula A., Maurino A., Batini C. Data quality issues in linked open data // Data and information quality. 2016. P. 87–112. URL: https://doi.org/10.1007/978-3-319-24106-7_4.</mixed-citation><mixed-citation xml:lang="en">Rula A., Maurino A., Batini C. Data quality issues in linked open data // Data and information quality. 2016. P. 87–112. URL: https://doi.org/10.1007/978-3-319-24106-7_4.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Открытость государства в России – 2021. URL: https://ach.gov.ru/upload/pdf/Otkrytost-2021.pdf (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Otkry`tost` gosudarstva v Rossii – 2021. URL: https://ach.gov.ru/upload/pdf/Otkrytost2021.pdf (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Российский сервер Еspacenet. URL: https://ru.espacenet.com (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Rossii`skii` server Еspacenet. URL: https://ru.espacenet.com (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Поисковая система Designview. URL: https://www.tmdn.org/tmdsviewweb/welcome#/dsview (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Poiskovaia sistema Designview. URL: https://www.tmdn.org/tmdsviewweb/welcome#/dsview (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Поисковая система Google Patents. URL: https://patents.google.com (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Poiskovaia sistema Google Patents. URL: https://patents.google.com (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Яндекс.Патенты – поиск по патентным документам. URL: https://yandex.ru/patents (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Yandex.Patenty` – poisk po patentny`m dokumentam. URL: https://yandex.ru/patents (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">eLIBRARY.RU. Поиск патентов. URL: https://elibrary.ru/patents.asp (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">eLIBRARY.RU. Poisk patentov. URL: https://elibrary.ru/patents.asp (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Официальные публикации ФИПС. URL: https://www.fips.ru/publication-web/ (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Ofitcial`ny`e publikatcii FIPS. URL: https://www.fips.ru/publication-web/ (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Информационно-поисковая система ФИПС. URL: https://www.fips.ru/iiss/ (дата обращения: 18.03.2022).</mixed-citation><mixed-citation xml:lang="en">Informatcionno-poiskovaia sistema FIPS. URL: https://www.fips.ru/iiss/ (data obrashcheniia: 18.03.2022).</mixed-citation></citation-alternatives></ref><ref id="cit24"><label>24</label><citation-alternatives><mixed-citation xml:lang="ru">Batini C. Data Quality Assessment // Encyclopedia of Database Systems. Boston: Springer, 2009. P. 608–612. URL: https://doi.org/10.1007/978-0-387-39940-9_107.</mixed-citation><mixed-citation xml:lang="en">Batini C. Data Quality Assessment // Encyclopedia of Database Systems. Boston: Springer, 2009. P. 608–612. URL: https://doi.org/10.1007/978-0-387-39940-9_107.</mixed-citation></citation-alternatives></ref><ref id="cit25"><label>25</label><citation-alternatives><mixed-citation xml:lang="ru">DAMA-DMBOK: Свод знаний по управлению данными. Второе издание / Dama International [пер. с англ. Г. Агафонова]. Москва : Олимп-Бизнес, 2020. 828 с.</mixed-citation><mixed-citation xml:lang="en">DAMA-DMBOK: Svod znanii` po upravleniiu danny`mi. Vtoroe izdanie / Dama International [per. s angl. G. Agafonova]. Moskva : Olimp-Biznes, 2020. 828 s.</mixed-citation></citation-alternatives></ref><ref id="cit26"><label>26</label><citation-alternatives><mixed-citation xml:lang="ru">Mahanti R. Data Quality: Dimensions, Measurement, Strategy, Management, and Governance. Quality Press, 2019. 526 р.</mixed-citation><mixed-citation xml:lang="en">Mahanti R. Data Quality: Dimensions, Measurement, Strategy, Management, and Governance. Quality Press, 2019. 526 р.</mixed-citation></citation-alternatives></ref><ref id="cit27"><label>27</label><citation-alternatives><mixed-citation xml:lang="ru">Lee Y. W., Pipino L. L., Funk J. D., Wang R. Y. Journey to data quality. The MIT Press, 2006. 240 р.</mixed-citation><mixed-citation xml:lang="en">Lee Y. W., Pipino L. L., Funk J. D., Wang R. Y. Journey to data quality. The MIT Press, 2006. 240 р.</mixed-citation></citation-alternatives></ref><ref id="cit28"><label>28</label><citation-alternatives><mixed-citation xml:lang="ru">Sattler Ku. Data Quality Dimensions // Encyclopedia of Database Systems. Boston: Springer, 2009. P. 612–615. URL: https://doi.org/10.1007/978-0-387-39940-9.</mixed-citation><mixed-citation xml:lang="en">Sattler Ku. Data Quality Dimensions // Encyclopedia of Database Systems. Boston: Springer, 2009. P. 612–615. URL: https://doi.org/10.1007/978-0-387-39940-9.</mixed-citation></citation-alternatives></ref><ref id="cit29"><label>29</label><citation-alternatives><mixed-citation xml:lang="ru">Gualo F., Rodriguez M., Verdugo J., Caballero I., Piattini M. Data quality certification using ISO/IEC 25012: Industrial experiences // Journal of Systems and Software. 2021. Vol. 176. P. 110938. URL: https://doi.org/10.1016/j.jss.2021.110938.</mixed-citation><mixed-citation xml:lang="en">Gualo F., Rodriguez M., Verdugo J., Caballero I., Piattini M. Data quality certification using ISO/IEC 25012: Industrial experiences // Journal of Systems and Software. 2021. Vol. 176. P. 110938. URL: https://doi.org/10.1016/j.jss.2021.110938.</mixed-citation></citation-alternatives></ref><ref id="cit30"><label>30</label><citation-alternatives><mixed-citation xml:lang="ru">Zhao Y., Gong J., Hu Y., Liu Z., Cai L. Analysis of quality evaluation based on ISO/IEC SQuaRE series standards and its considerations // 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS). 2017. P. 245–250. URL: https://doi.org/10.1109/ICIS.2017.7960001.</mixed-citation><mixed-citation xml:lang="en">Zhao Y., Gong J., Hu Y., Liu Z., Cai L. Analysis of quality evaluation based on ISO/IEC SQuaRE series standards and its considerations // 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS). 2017. P. 245–250. URL: https://doi.org/10.1109/ICIS.2017.7960001.</mixed-citation></citation-alternatives></ref><ref id="cit31"><label>31</label><citation-alternatives><mixed-citation xml:lang="ru">Behkamal B., Kahani M., Bagheri E., Jeremic Z. A metrics-driven approach for quality assessment of linked open data // Journal of theoretical and applied electronic commerce research. 2014. Vol. 9 (2). P. 64–79. URL: https://doi.org/10.4067/S0718-18762014000200006.</mixed-citation><mixed-citation xml:lang="en">Behkamal B., Kahani M., Bagheri E., Jeremic Z. A metrics-driven approach for quality assessment of linked open data // Journal of theoretical and applied electronic commerce research. 2014. Vol. 9 (2). P. 64–79. URL: https://doi.org/10.4067/S0718-18762014000200006.</mixed-citation></citation-alternatives></ref><ref id="cit32"><label>32</label><citation-alternatives><mixed-citation xml:lang="ru">Liu H., Sang Z., Karali S. Approximate quality assessment with sampling approaches // 2019 International Conference on Computational Science and Computational Intelligence (CSCI). 2019. P. 1306–1311. URL: https://doi.org/10.1109/CSCI49370.2019.00244.</mixed-citation><mixed-citation xml:lang="en">Liu H., Sang Z., Karali S. Approximate quality assessment with sampling approaches // 2019 International Conference on Computational Science and Computational Intelligence (CSCI). 2019. P. 1306–1311. URL: https://doi.org/10.1109/CSCI49370.2019.00244.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
