Integrative Systems<\/p>\n
Author:<\/strong> Cristina Daiana Duarte | Email:<\/strong> cristinaduarte88@gmail.com<\/p>\n Cristina Daiana Duarte 1\u00b0<\/sup>, Francisco Ramiro Iaconis 1\u00b0<\/sup>, Marianela Pacheco 3\u00b0<\/sup>, Juan Ignacio Ru\u00edz D\u00edaz 2\u00b0<\/sup>, \u00c1ngel Javier Tabullo 4\u00b0<\/sup>, Claudio Augusto Delrieux 2\u00b0<\/sup>, Gustavo Gasaneo 1\u00b0<\/sup><\/p>\n 1\u00b0 Instituto de F\u00edsica del Sur (Ifisur), Departamento de F\u00edsica, Universidad Nacional del Sur, CONICET, Bah\u00eda Blanca We propose novel visual-auditory multisensory signal analysis techniques to explore how auditory and visual stimuli processing interact, and how one modality is managed when attention is captured by the other. We conducted an experiment that modified traditional speech audiometry by introducing visual stimuli, where images were integrated into conventional setup. This experiment combines eye-tracking and brain EEG signals, with the aim to discriminate different auditory thresholds from brain activity and eye movement. Author: Duarte Cristina Daiana | email: cristinaduarte88@gmail.com | Integrative Systems<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[35],"class_list":["post-1982","post","type-post","status-publish","format-standard","hentry","category-session-2","tag-integrative-systems"],"_links":{"self":[{"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/posts\/1982","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/comments?post=1982"}],"version-history":[{"count":1,"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/posts\/1982\/revisions"}],"predecessor-version":[{"id":2145,"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/posts\/1982\/revisions\/2145"}],"wp:attachment":[{"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/media?parent=1982"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/categories?post=1982"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/csan2023.saneurociencias.org.ar\/index.php\/wp-json\/wp\/v2\/tags?post=1982"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n
\n2\u00b0 Departamento de Ingenier\u00eda El\u00e9ctrica y Computadoras, Universidad Nacional del Sur, CONICET, Bah\u00eda Blanca
\n3\u00b0 Universidad Nacional de C\u00f3rdoba, CONICET
\n4\u00b0 INCIHUSA (Instituto de Ciencias Humanas Sociales y Ambientales), CONICET<\/p>\n
\nSix participants followed two experimental phases. Initially, disyllabic words were presented in auditory form at an intensity loud enough for allowing accurate discrimination. At the same time two images were presented on a computer screen. The subjects were instructed to choose the image corresponding to the heard word. In the second part, a similar sequence was repeated with a lower auditory level (only fifty percent of words could be recognized).
\nPupil size and gaze paths were tracked synchronically with the EEG signal during the experiments. Novel statistical-complexity-based evaluation methods were applied to these fused signals. The evaluated parameters were used as feature vectors to represent these signals, with which a classification model was trained. We used three different classification models (Decision Trees, Random Forest, K-Nearest Neighbors). The best model achieved a 79% accuracy in threshold determination.<\/p>\n","protected":false},"excerpt":{"rendered":"