<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">donstu</journal-id><journal-title-group><journal-title xml:lang="en">Advanced Engineering Research (Rostov-on-Don)</journal-title><trans-title-group xml:lang="ru"><trans-title>Advanced Engineering Research (Rostov-on-Don)</trans-title></trans-title-group></journal-title-group><issn pub-type="epub">2687-1653</issn><publisher><publisher-name>Don State Technical University</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.23947/2687-1653-2023-23-2-180-190</article-id><article-id custom-type="elpub" pub-id-type="custom">donstu-2036</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>INFORMATION TECHNOLOGY, COMPUTER SCIENCE AND MANAGEMENT</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ИНФОРМАТИКА, ВЫЧИСЛИТЕЛЬНАЯ ТЕХНИКА И УПРАВЛЕНИЕ</subject></subj-group></article-categories><title-group><article-title>Visual Coherence for Augmented Reality</article-title><trans-title-group xml:lang="ru"><trans-title>Визуальная когерентность в дополненной реальности</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-5552-1290</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Горбунов</surname><given-names>А. Л.</given-names></name><name name-style="western" xml:lang="en"><surname>Gorbunov</surname><given-names>A. L.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Андрей Леонидович Горбунов, кандидат технических наук, доцент кафедры управления воздушным движением; гендиректор</p><p>125993, РФ, г. Москва, Кронштадтский бул., 20</p><p>115372, РФ, г. Москва, ул. Загорьевская, 5</p></bio><bio xml:lang="en"><p>Andrey L. Gorbunov, Cand.Sci. (Eng.), associate professor, Air Traffic Control Department; Director-General</p><p>20, Kronshtadtskii blvd, Moscow, 125993, RF</p><p>5, Zagoryevskaya St., Moscow, 115372, RF</p></bio><email xlink:type="simple">a-gorbunov@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Московский государственный технический университет гражданской авиации; ООО «Авиареал»</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Moscow State Technical University of Civil Aviation; “Aviareal” LLC</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2023</year></pub-date><pub-date pub-type="epub"><day>14</day><month>07</month><year>2023</year></pub-date><volume>23</volume><issue>2</issue><fpage>180</fpage><lpage>190</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Gorbunov A.L., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Горбунов А.Л.</copyright-holder><copyright-holder xml:lang="en">Gorbunov A.L.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://www.vestnik-donstu.ru/jour/article/view/2036">https://www.vestnik-donstu.ru/jour/article/view/2036</self-uri><abstract><sec><title>Introduction</title><p>Introduction. The 2020s were marked by the emergence of a new generation of computer simulators using augmented reality. One of the promising advantages of augmented reality technology is the ability to safely simulate hazardous situations real-world. A prerequisite for realizing this advantage is to provide the visual coherence of augmented reality scenes: virtual objects must be indistinguishable from real ones. All IT leaders consider augmented reality as a next “big wave”; thus, the visual coherence is becoming a key issue for IT in general. However, it is in aerospace applications that the visual coherence has already acquired practical significance. An example is Boeing's development of an augmented reality flight simulator, which began in 2022. Visual coherence is a complex problem, one of the aspects of which is to provide the correct overall coloration of virtual objects in an augmented reality scene. The objective of the research was to develop a new method of such tinting.</p></sec><sec><title>Materials and Methods</title><p>Materials and Methods. The developed method (called spectral transplantation) uses two-dimensional spectral image transformations.</p></sec><sec><title>Results</title><p>Results. A spectral transplantation technology is proposed that provides direct transfer of color, brightness, and contrast characteristics from the real background to virtual objects. An algorithm for automatic selection of the optimal type of spectral transformation has been developed.</p><p>Discussion and Conclusion. Being a fully automatic process without recording lighting conditions, spectral transplantation solves a number of complex problems of visual coherence. Spectral transplantation can be a valuable addition to other methods of providing visual coherence.</p></sec></abstract><trans-abstract xml:lang="ru"><sec><title>Введение</title><p>Введение. 2020-е годы ознаменовались появлением нового поколения компьютерных тренажеров с применением технологии дополненной реальности. Одно из преимуществ данной технологии — возможность безопасного моделирования опасных ситуаций в реальном мире. Необходимым условием использования этого преимущества является обеспечение визуальной когерентности сцен дополненной реальности: виртуальные объекты должны быть неотличимы от реальных. Все мировые IT-лидеры рассматривают дополненную реальность как следующую волну радикальных изменений в цифровой среде, поэтому визуальная когерентность становится ключевым вопросом для будущего IT, а в аэрокосмических приложениях визуальная когерентность уже приобрела практическое значение. Примером может служить разработка корпорацией Боинг пилотского тренажера с дополненной реальностью (2022). Визуальная когерентность — сложная комплексная проблема, одним из аспектов которой является обеспечение корректной колористической тонировки виртуальных объектов в сцене дополненной реальности. Цель работы — разработка нового метода такой тонировки.</p></sec><sec><title>Материалы и методы</title><p>Материалы и методы. В разработанном методе (названном спектральной трансплантацией) используются двумерные спектральные преобразования изображений.</p></sec><sec><title>Результаты исследования</title><p>Результаты исследования. Предложена технология спектральной трансплантации, обеспечивающая прямую передачу характеристик цвета, яркости и контраста от реального фона к виртуальным объектам. Разработан алгоритм автоматического выбора оптимального вида спектрального преобразования.</p></sec><sec><title>Обсуждение и заключение</title><p>Обсуждение и заключение. Будучи полностью автоматическим процессом без регистрации условий освещенности, спектральная трансплантация решает ряд сложных проблем визуальной когерентности. Спектральная трансплантация может стать ценным дополнением к другим методам обеспечения визуальной когерентности.</p></sec></trans-abstract><kwd-group xml:lang="ru"><kwd>компьютерные тренажеры</kwd><kwd>дополненная реальность</kwd><kwd>визуальная когерентность</kwd></kwd-group><kwd-group xml:lang="en"><kwd>computer simulators</kwd><kwd>augmented reality</kwd><kwd>visual coherence</kwd></kwd-group><funding-group><funding-statement xml:lang="ru">автор выражает благодарность А. Теренци (Inglobe Technologies Srl, Чеккано, Италия) за поддержку в разработке программного обеспечения.</funding-statement><funding-statement xml:lang="en">the author would like to thank Alessandro Terenzi, Inglobe Technologies Srl, Ceccano, Italy, for his support in software development.</funding-statement></funding-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Hughes C.L., Fidopiastis C., Stanney K.M., et al. The Psychometrics of Cybersickness in Augmented Reality. Frontiers in Virtual Reality. 2020;1:602954. https://doi.org/10.3389/frvir.2020.602954</mixed-citation><mixed-citation xml:lang="en">Hughes CL, Fidopiastis C, Stanney KM, et al. The Psychometrics of Cybersickness in Augmented Reality. Frontiers in Virtual Reality. 2020;1:602954. https://doi.org/10.3389/frvir.2020.602954</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Somanath G., Kurz D. HDR Environment Map Estimation for Real-Time Augmented Reality. Cupertino, CA: Apple Inc.; 2020. URL: https://arxiv.org/pdf/2011.10687.pdf (accessed: 17.06.2022).</mixed-citation><mixed-citation xml:lang="en">Somanath G, Kurz D. HDR Environment Map Estimation for Real-Time Augmented Reality. Cupertino, CA: Apple Inc.; 2020. URL: https://arxiv.org/pdf/2011.10687.pdf (accessed: 17.06.2022).</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Kronander J., Banterle F., Gardner A., et al. Photorealistic Rendering of Mixed Reality Scenes. Computer Graphics Forum. 2015;34(2):643–665. https://doi.org/10.1111/cgf.12591</mixed-citation><mixed-citation xml:lang="en">Kronander J, Banterle F, Gardner A, et al. Photorealistic Rendering of Mixed Reality Scenes. Computer Graphics Forum. 2015;34(2):643–665. https://doi.org/10.1111/cgf.12591 (accessed: 17.06.2022).</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Debevec P., Graham P., Busch J., et al. A Single-Shot Light Probe. SIGGRAPH ’12: ACM SIGGRAPH 2012 Talks. 2012;10:1–19. URL: https://vgl.ict.usc.edu/Research/SSLP/A_Single_Shot_Light_Probe-SIGGRAPH2012.pdf (accessed: 17.06.2022).</mixed-citation><mixed-citation xml:lang="en">Debevec P, Graham P, Busch J, et al. A Single-Shot Light Probe. SIGGRAPH ’12: ACM SIGGRAPH 2012 Talks. 2012;10:1–19. URL: https://vgl.ict.usc.edu/Research/SSLP/A_Single_Shot_Light_Probe-SIGGRAPH2012.pdf (accessed: 17.06.2022).</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Alhakamy A., Tuceryan M. CubeMap360: Interactive Global Illumination for Augmented Reality in Dynamic Environment. In: Proc. IEEE SoutheastCon. Huntsville, AL: IEEE; 2019. https://doi.org/10.1109/SoutheastCon42311.2019.9020588</mixed-citation><mixed-citation xml:lang="en">Alhakamy A, Tuceryan M. CubeMap360: Interactive Global Illumination for Augmented Reality in Dynamic Environment. In: Proc. IEEE SoutheastCon. Huntsville, AL: IEEE; 2019. https://doi.org/10.1109/SoutheastCon42311.2019.9020588</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Knorr S.B., Kurz D. Real-Time Illumination Estimation from Faces for Coherent Rendering. In: Proc. IEEE Int. Symposium on Mixed and Augmented Reality (ISMAR). Munich: IEEE; 2014. P. 113–122. https://doi.org/10.1109/ISMAR.2014.6948483</mixed-citation><mixed-citation xml:lang="en">Knorr SB, Kurz D. Real-Time Illumination Estimation from Faces for Coherent Rendering. In: Proc. IEEE Int. Symposium on Mixed and Augmented Reality (ISMAR). Munich: IEEE; 2014. P. 113–122. https://doi.org/10.1109/ISMAR.2014.6948483</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Seiji Tsunezaki, Ryota Nomura, Takashi Komuro, et al. Reproducing Material Appearance of Real Objects using Mobile Augmented Reality. In: Proc. 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). Munich: IEEE; 2018. P. 196–197. https://doi.org/10.1109/ISMAR-Adjunct.2018.00065</mixed-citation><mixed-citation xml:lang="en">Seiji Tsunezaki, Ryota Nomura, Takashi Komuro, et al. Reproducing Material Appearance of Real Objects using Mobile Augmented Reality. In: Proc. 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). Munich: IEEE; 2018. P. 196–197. https://doi.org/10.1109/ISMAR-Adjunct.2018.00065</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Reinhard E., Akyuz A.O., Colbert M., et al. Real-Time Color Blending of Rendered and Captured Video. In: Proc. Interservice/Industry Training, Simulation and Education Conference (I/ITSEC). Orlando, Florida: National Training and Simulation Association; 2004. P. 1–9. URL: https://user.ceng.metu.edu.tr/~akyuz/files/blend.pdf (accessed: 17.06.2022).</mixed-citation><mixed-citation xml:lang="en">Reinhard E, Akyuz AO, Colbert M, et al. Real-Time Color Blending of Rendered and Captured Video. In: Proc. Interservice/Industry Training, Simulation and Education Conference (I/ITSEC). Orlando, Florida: National Training and Simulation Association; 2004. P. 1–9. URL: https://user.ceng.metu.edu.tr/~akyuz/files/blend.pdf (accessed: 17.06.2022).</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Xuezhong Xiao, Lizhuang Ma. Gradient-Preserving Color Transfer. Computer Graphics Forum. 2009;28(7):1879–1886. https://doi.org/10.1111/j.1467-8659.2009.01566.x</mixed-citation><mixed-citation xml:lang="en">Xuezhong Xiao, Lizhuang Ma. Gradient-Preserving Color Transfer. Computer Graphics Forum. 2009;28(7):1879–1886. https://doi.org/10.1111/j.1467-8659.2009.01566.x</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Горбунов А.Л. и др. Способ формирования изображения дополненной реальности, обеспечивающий совпадение визуальных характеристик реальных и виртуальных объектов. Патент РФ, № 2667602, 2019.</mixed-citation><mixed-citation xml:lang="en">Gorbunov AL, et al. Sposob formirovaniya izobrazheniya dopolnennoi real'nosti, obespechivayushchii sovpadenie vizual'nykh kharakteristik real'nykh i virtual'nykh ob"ektov. RF Patent No. 2667602. 2019. (In Russ.)</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Oliva A., Torralba A.J., Schyns Ph.G. Hybrid Images. ACM Transactions on Graphics. 2006;25(3):527–532. https://doi.org/10.1145/1179352.1141919</mixed-citation><mixed-citation xml:lang="en">Oliva A, Torralba AJ, Schyns PhG. Hybrid Images. ACM Transactions on Graphics. 2006;25(3):527–532. https://doi.org/10.1145/1179352.1141919</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Kán P., Kafumann H. DeepLight: Light Source Estimation for Augmented Reality Using Deep Learning. The Visual Computer. 2019;35:873–883. https://doi.org/10.1007/s00371-019-01666-x</mixed-citation><mixed-citation xml:lang="en">Kán P, Kafumann H. DeepLight: Light Source Estimation for Augmented Reality Using Deep Learning. The Visual Computer. 2019;35:873–883. https://doi.org/10.1007/s00371-019-01666-x</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
