Publications
.Since my colleagues and I are interested in the entirety of the communication chain - from higher cognition to language production, perception, and comprehension, including motor control and neural changes during communication as well as over the course of language acquisition or learning - my scope of publications and collaborations is somewhat broad, encompassing both a variety of methods (EEG, fMRI, computational modeling, machine learning, behavioral and motion capture studies), and a variety of populations/languages.
For ease of understanding of the lab's work within a sub-field, the publications here are divided into neurolinguistcs, computational linguistic research (primarily on sign languages), applied and clinical neuroscience (diagnostics and education), and perception-language-action research.
Manuscript titles link to .pdf documents of the publications; doi (digital object identifieer) addresses link to publications online.
Neurolinguistics
Krebs, J., Wilbur, R.B., Roehm, D., & Malaia, E. A. (2023). Neural mechanisms of Event Visibility in sign languages. Language, Cognition, and Neuroscience. doi: 10.1080/23273798.2023.2228437
Krebs, J., Fessl, I., Wilbur, R. B., Malaia, E., Wiesinger, H-P., Schwameder, H., Roehm, D. (2023) Event structure reflected in muscle activation differences in Austrian Sign Language (ÖGS) verbs: First evidence from surface electromyography. Proceedings of Formal and Experimental Advances in Sign language Theory (FEAST 2023). doi: 10.31009/FEAST.i5.07
Krebs, J., Malaia, E. A., Roehm, D., Wilbur, R. B. (2023) Visual boundaries in sign motion: processing with and without lip-reading cues. Proceedings of the Experiments in Linguistic Meaning meeting, 2, pp. 164-175.doi: 10.3765/elm.2.5336
Krebs, J., Malaia, E. A., Wilbur, R.B. & Roehm, D. (2022) EEG analysis based on dynamic visual stimuli: best practices in analysis of sign language data. The Croatian Review of Rehabilitation Research (Hrvatska revija za rehabilitacijska istraživanja, HRRI), 58, 245-266. doi: 10.31299/hrri.58.si.13
Radoševic, T., Malaia, E.A., Milkovic, ́M. (2022). Predictive Processing in Sign Languages: A Systematic Review. Front. Psychol. 13:805792. doi: 10.3389/fpsyg.2022.805792
Krebs, J., Roehm, D., Wilbur, R. B., & Malaia, E. A. (2021). Age of sign language acquisition has lifelong effect on syntactic preferences in sign language users. International Journal of Behavioral Development, doi: 10.1177/0165025420958193.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2021). Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
Malaia, E.A., Krebs, J., Wilbur, R.B., Roehm, D. (2020). Age of acquisition effects differ across linguistic domains in sign language: EEG evidence. Brain and Language, doi: 10.1016/j.bandl.2019.104708.
Krebs, J., Malaia, E., Wilbur, R., Roehm, D.(2020). Subjektpräferenz in der Österreichischen Gebärdensprache (ÖGS). DAS ZEICHEN: Zeitschrift für Sprache und Kultur Gehörloser (The Sign: Journal for language and culture of the Deaf), 114; pp. 96-107.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2019). Interaction between topic marking and subject preference strategy in sign language processing. Language, Cognition, and Neuroscience, doi: 10.1080/23273798.2019.1667001
Malaia, E., & Wilbur, R. B. (2019). Visual and linguistic components of short-term memory: a common neural model for spoken and sign languages. Cortex, doi: 10.1016/j.cortex.2018.05.020
Krebs, J., Malaia, E., Wilbur, R. B., & Roehm, D. (2018). Subject preference emerges as cross-modal strategy for linguistic processing. Brain research, 1691, 105-117. doi: 10.1016/j.brainres.2018.03.029
Malaia, E., Newman, S. (2015). Neural bases of syntax-semantics interface processing. Cognitive Neurodynamics, 9(3), 317-329. doi: 10.1007/s11571-015-9328-2
Malaia, E., Tommerdahl, J., Mckee, F.W. (2014). Deductive versus probabilistic reasoning in healthy adults: An EEG analysis of neural differences. Journal of Psycholinguistic Research, 44 (5), 533-544. doi: 10.1007/s10936-014-9297-3
Malaia, E., Newman, S. (2014). Neural bases of event knowledge and syntax integration in comprehension of complex sentences. Neurocase, 21 (6), 753-766. doi: 10.1080/13554794.2014.989859
Malaia, E., Gonzalez-Castillo, J., Weber-Fox, C., Talavage, T.M., Wilbur, R.B. (2014). Neural processing of verbal event structure: temporal and functional dissociation between telic and atelic verbs. In: Mandouilidou, C., de Ameida, R. (eds.) Cognitive Science Perspectives on Verb Representation and Processing, pp. 131 - 140. Springer: Lausanne.
Malaia, E., Talavage, T., Wilbur, R.B. (2014) Functional connectivity in task-negative network of the Deaf: effects of sign language experience. PeerJ, doi: 10.7717/peerj.446
Barbu, A., Barrett, D., Chen, W., Siddarth, N., Xiong, C., Corso, J., Fellbaum, C., Hanson, C., Hanson, S., Helie, S., Malaia, E., Pearlmutter, B., Siskind, J., Talavage, T., Wilbur, R. (2014). Seeing is Worse than Believing: Reading People’s Minds Better than Computer-Vision Methods Recognize Actions. In D. Fleet et al. (Eds.) European Conference on Computer Vision 2014, Lecture Notes in Computer Science, pp. 612–627. Springer: Lausanne.
Newman, S., Malaia, E., & Seo, R. (2014). Does degree of handedness in a group of right-handed individuals affect language comprehension? Brain and Cognition, 86, 98-103. doi: 10.1016/j.bandc.2014.02.002
Newman, S., Malaia, E., Seo, R., Hu, C. (2013) The effect of individual differences in working memory capacity on sentence comprehension: an fMRI study. Brain Topography, 26(3), 458-67. doi: 10.1007/s10548-012-0264-8
Malaia, E., Wilbur, R.B., Weber-Fox, C. (2012). Down the garden path in EEG: telicity effects on thematic role re-assignment in relative clauses with transitive verbs. Journal of Psycholinguistic Research 41(5), 323-345. doi: 10.1007/s10936-011-9195-x
Malaia, E., Wilbur, R., Weber-Fox, C. (2009). ERP evidence for telicity effects on syntactic processing in garden-path sentences. Brain and Language 108(3), 145-158. doi: 10.1016/j.bandl.2008.09.003
Computational sign language research
This work, funded by the the Marie Curie action of the European Union and NSF uses tools of information theory to develop convergent algorithms for analysis of information transfer based on biological signals across different data types (articulator motion in sign language; neural activity data from fMRI and EEG).
Related publications:
Malaia, E., Borneman, J., & Gurbuz, S. (2024). Capturing Motion: Using Radar to Build Better Sign Language Corpora. In Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources (pp. 384–389).
Krebs, J., Malaia, E., Fessl, I., Wiesinger, H.-P., Wilbur, R., Roehm, D., Schwameder, H. (2024). Motion Capture Analysis of Verb and Adjective Types in Austrian Sign Language (ÖGS). In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 11619–11624).
Malaia, E., Borneman, J., Borneman, S., Krebs, J., Wilbur, R.B. (2023) Prediction underlying comprehension of human motion: analysis of Deaf signer and non-signer EEG in response to visual stimuli. Frontiers in Neuroscience, 17. doi: 10.3389/fnins.2023.1218510
Malaia, E., Borneman, J. D., *Kurtlogu, E., Gurbuz, S., Crawford, C., Griffin, D., Gurbuz, A. (2022) Complexity in sign languages: linguistic and dimensional analysis of information transfer in dynamic visual communication. Linguistics Vanguard special issue Measuring Language Complexity. doi: 10.1515/lingvan-2021-0005
Rahman, M. M., Malaia, E. A., Gurbuz, A. C., Griffin, D. J., Crawford C., Gurbuz, S. Z. (2022) Effect of Kinematics and Fluency in Adversarial Synthetic Data Generation for ASL Recognition with RF Sensors. IEEE Transactions on Aerospace and Electronic Systems, 58 (4), pp. 2732-2745. doi: 10.1109/TAES.2021.3139848
Kurtoğlu, E., Gurbuz, A. C., Malaia, E. A., Griffin, D., Crawford C., Gurbuz, S.Z. (2022). ASL Trigger Recognition in Mixed Activity/Signing Sequences for RF Sensor-Based User Interfaces. IEEE Transactions on Human-Machine Systems, doi: 10.1109/THMS.2021.3131675
Bradeley, C., Wilbur, R.B., Malaia, E. A., Siskind, J. (2022). Visual form of ASL verb signs predicts non-signer judgment of transitivity. PLoS One, 17(2): e0262098.doi: 10.1371/journal.pone.0262098
Gurbuz, S. Z., *Rahman, M. M., *Kurtoglu, E., Malaia, E.A., Gurbuz, A. C., Griffin, D. J., & Crawford, C. (2022) Multi-Frequency RF Sensor Fusion for Word-Level Fluent ASL Recognition. IEEE Sensors. doi: 10.1109/JSEN.2021.3078339
Ford, K., Borneman, J., Krebs, J., Malaia, E. A., Ames, B. (2021) Classification of visual comprehension based on EEG data using sparse optimal scoring. Journal of Neural Engineering, 18(2), 2661-2665. doi: 10.1088/1741-2552/abdb3b
Malaia, E. A., Borneman, S. C., Krebs, J., & Wilbur, R. B. (2021). Low-frequency entrainment to visual motion underlies sign language comprehension. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 2456-2463. doi: 10.1109/TNSRE.2021.3127724
Gurbuz, S., Gurbuz, A., Malaia, E. A., Griffin, D., Crawford, C., *Rahman, M., *Aksu, R., *Kurtoglu, E., *Mdrafiy, R., *Anbuselvam A., *Ozcelik, E. A. (2021). American Sign Language Recognition Using RF Sensing. IEEE Sensors, 21(3), 3763-3775. doi: 10.1109/JSEN.2020.3022376
Malaia, E., Wilbur, R.B. (2020). Syllable as a unit of information transfer in linguistic communication: the Entropy Syllable Parsing model. WIREs Cognitive Science, https://doi.org/10.1002/wcs.1518.
Gurbuz, S. Z., Gurbuz, A. C., Malaia, E. A., Griffin, D. J., Crawford, C., Rahman, M. M., ... & Macks, T. (2020). A Linguistic Perspective on Radar Micro-Doppler Analysis of American Sign Language. In 2020 IEEE International Radar Conference (RADAR) (pp. 232-237)
Borneman, J. D., Malaia, E., & Wilbur, R. B. (2018). Motion characterization using optical flow and fractal complexity. Journal of Electronic Imaging, 27(5), 051229. doi: 10.1117/1.JEI.27.5.051229
Wilbur, R.B., Malaia, E. A. (2018) A new technique for assessing narrative prosodic effects in sign languages. In A. Hübl & M. Steinbach (eds.), Linguistic Foundations of Narration in Spoken and Sign Languages, Amsterdam: John Benjamins.
Malaia, E. A. (2017) Methodologies for quantitative analysis of information transfer sign language and gesture data (commentary). Behavioral and Brain Sciences. doi: 10.1017/S0140525X15002988
Malaia, E. A., Borneman, J.D., Wilbur, R.B. (2017). Information transfer capacity of articulators in American Sign Language. Language and Speech. DOI: 10.1177/0023830917708461
Malaia, E. A., Borneman, J.D., Wilbur, R.B. (2016) Assessment of information content in visual signal: analysis of optical flow fractal complexity. Visual Cognition doi: 10.1080/13506285.2016.1225142
Malaia, E.A., Wilbur, R.B., Milković, M. (2013). Kinematic parameters of signed verbs. Journal of Speech, Language, and Hearing Research, 56, 1-12. doi: 10.1044/1092-4388(2013/12-0257)
Malaia, E.A., Wilbur, R.B. (2012). Kinematic signatures of telic and atelic events in ASL predicates. Language and Speech, 55(3), 407-421. doi: 10.1177/0023830911422201
Clinical and applied neuroscience
This work, which has been previously funded by the Department of Energy Ralph E. Powe Award, and European Institutes for Advanced Study, investigated applications of neuroscience research in clinical populations.
Related publications:
Kalahasti, D., Sazonov, E., Malaia, E. (in press). Identification of hunger and satiety states from EEG data. 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
McCleod, M., Borneman, S., Malaia, E. (2024) Neurocomputational Phenotypes in Female and Male Autistic Individuals. Journal of Science and Health at The University of Alabama, 21, pp. 23-28.
Turk, E. G., Malaia, E. (2023). The Unseen Families: A Systematic Review of Alternative Parental Interaction Techniques and Developmental Outcomes. Journal of Science and Health at The University of Alabama, 20, 28-38.
Tomeny, T., Hudac, C., Malaia, E., Morett, L., Tomeny, K., Watkins, L., Kana, R. (2023) Serving Individuals with Autism Spectrum Disorder in the Age of COVID-19: Special Considerations for Rural Families. Rural Special Education Quarterly, 42(2), pp. 105-118. doi: 10.1177/875687052311674
Malaia, E.A., Ahn, S., Rubchinsky, L.L. (2020). Dysregulation of temporal dynamics of synchronous neural activity in adolescents on autism spectrum. Autism Research, https://doi.org/10.1002/aur.2219.
Malaia, E.A., Cockerham, D., & Rublein, K. (2018). Visual integration of fear and anger emotional cues by children on the autism spectrum and neurotypical peers: An EEG study. Neuropsychologia 126, pp. 138-146. doi: 10.1016/j.neuropsychologia.2017.06.014
Malaia, E.A., Bates, E., Seitzman, B., & Coppess, K. (2016). Altered brain network dynamics in youths with autism spectrum disorder. Experimental Brain Research, 234(12), 3425-3431. doi: 10.1007/s00221-016-4737-y
Cockerham, D., Malaia, E.A. (2017). Neuroscience-supported approaches to teaching students on the autism spectrum. Special Issue on Educational Neuroscience, Zeitschrift fur Psychologie 224 (4), 290-293. doi: 10.1027/2151-2604/A000265
Malaia, E.A., Egorova, E., Hinesley, V. (2016). Developmental Characteristics of Gifted Children: Educational Approaches. In J. Horvath, J. Lodge, and J. Hattie (eds.) From the Laboratory to the Classroom: Translating the Science of Learning for Teachers. Routledge, UK, pp. 215-228.
Malaia, E.A., Wilbur, R.B. (2014). Enhancement of spatial processing in sign language users. In D. R. Montello, K. E. Grossner, and D. G. Janelle (eds.), Space in Mind: Concepts and Ontologies for Spatial Thinking, pp. 159-171, MIT press.
Perception - action - language relationship
Krebs, J., Wilbur, R.B., Roehm, D., Malaia, E. A., (accepted). The role of prosodic cues in topic signaling in Austrian Sign Language. Sign Language and Linguistics.
Malaia, E., Krebs, J. (accepted). Sign Language in aging population: neurobehavioral evidence. Topics in Cognitive Science.
Malaia, E., Milković, M. (2021). Aspect – theoretical and experimental perspectives. In J. Quer, R. Pfau and A. Herrmann (eds.) Routledge Handbook of Theoretical and Experimental Sign Language Research, pp. 194-212. London, UK: Routledge.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2020). Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
Malaia, E., Basu, D. Comparative analysis of interface between aspect and event structure in verbal morphosyntax of Russian and Bangla. (2020). Взаимодействие аспекта со смежными категориями: материалы VII Международной Комиссии по аспектологии Международного комитета славистов. (In: Proceedings of 7th International Conference on Slavic Aspect). St. Petersburg: Russian State Pedagogical University Press.
Blumenthal-Drame, A., Malaia, E. (2018). Shared neural and cognitive mechanisms in action and language: The Multi-Scale Information Transfer framework. WIREs Cognitive Science, DOI: 10.1002/wcs.1484.
Malaia, E.A. (2014). It Still Isn't Over: Event Boundaries in Language and Perception. Language and Linguistics Compass, 8(3), 89-98. doi: 10.1111/lnc3.12071
Malaia, E.A., Ranaweera, R., Wilbur, R.B., Talavage. T.M. (2013). Event segmentation in a visual language: Neural bases of processing American Sign Language predicates. Neuroimage 59(4), 4094-4101. doi: 10.1016/S1053-8119(09)71736-7
Malaia, E.A., Wilbur, R.B., Weber-Fox, C. (2013). Event end-point primes the Undergoer argument: a look at neurobiological bases of event structure. In Gehrke, B., Arsenijevic, B. (eds.) Subatomic semantics of event predicates, pp. 231-248. Springer: Studies in Linguistics and Philosophy. doi: 10.1007/978-94-007-5983-1_9
Malaia, E.A., Wilbur, R.B. (2012). What Sign Languages show: neurobiological bases of visual phonology. Di Sciullo, A.M. (ed.) Towards a biolinguistic understanding of grammar: essays on interfaces, pp. 265-275. John Benjamins.
Malaia, E.A., Wilbur, R.B. (2012). Telicity expression in visual modality. In McNally, L. & Delmonte, V. (eds.) Telicity, change, and state: A cross-categorial view of event structure, pp. 122-136. Oxford: Oxford University Press.
For ease of understanding of the lab's work within a sub-field, the publications here are divided into neurolinguistcs, computational linguistic research (primarily on sign languages), applied and clinical neuroscience (diagnostics and education), and perception-language-action research.
Manuscript titles link to .pdf documents of the publications; doi (digital object identifieer) addresses link to publications online.
Neurolinguistics
Krebs, J., Wilbur, R.B., Roehm, D., & Malaia, E. A. (2023). Neural mechanisms of Event Visibility in sign languages. Language, Cognition, and Neuroscience. doi: 10.1080/23273798.2023.2228437
Krebs, J., Fessl, I., Wilbur, R. B., Malaia, E., Wiesinger, H-P., Schwameder, H., Roehm, D. (2023) Event structure reflected in muscle activation differences in Austrian Sign Language (ÖGS) verbs: First evidence from surface electromyography. Proceedings of Formal and Experimental Advances in Sign language Theory (FEAST 2023). doi: 10.31009/FEAST.i5.07
Krebs, J., Malaia, E. A., Roehm, D., Wilbur, R. B. (2023) Visual boundaries in sign motion: processing with and without lip-reading cues. Proceedings of the Experiments in Linguistic Meaning meeting, 2, pp. 164-175.doi: 10.3765/elm.2.5336
Krebs, J., Malaia, E. A., Wilbur, R.B. & Roehm, D. (2022) EEG analysis based on dynamic visual stimuli: best practices in analysis of sign language data. The Croatian Review of Rehabilitation Research (Hrvatska revija za rehabilitacijska istraživanja, HRRI), 58, 245-266. doi: 10.31299/hrri.58.si.13
Radoševic, T., Malaia, E.A., Milkovic, ́M. (2022). Predictive Processing in Sign Languages: A Systematic Review. Front. Psychol. 13:805792. doi: 10.3389/fpsyg.2022.805792
Krebs, J., Roehm, D., Wilbur, R. B., & Malaia, E. A. (2021). Age of sign language acquisition has lifelong effect on syntactic preferences in sign language users. International Journal of Behavioral Development, doi: 10.1177/0165025420958193.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2021). Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
Malaia, E.A., Krebs, J., Wilbur, R.B., Roehm, D. (2020). Age of acquisition effects differ across linguistic domains in sign language: EEG evidence. Brain and Language, doi: 10.1016/j.bandl.2019.104708.
Krebs, J., Malaia, E., Wilbur, R., Roehm, D.(2020). Subjektpräferenz in der Österreichischen Gebärdensprache (ÖGS). DAS ZEICHEN: Zeitschrift für Sprache und Kultur Gehörloser (The Sign: Journal for language and culture of the Deaf), 114; pp. 96-107.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2019). Interaction between topic marking and subject preference strategy in sign language processing. Language, Cognition, and Neuroscience, doi: 10.1080/23273798.2019.1667001
Malaia, E., & Wilbur, R. B. (2019). Visual and linguistic components of short-term memory: a common neural model for spoken and sign languages. Cortex, doi: 10.1016/j.cortex.2018.05.020
Krebs, J., Malaia, E., Wilbur, R. B., & Roehm, D. (2018). Subject preference emerges as cross-modal strategy for linguistic processing. Brain research, 1691, 105-117. doi: 10.1016/j.brainres.2018.03.029
Malaia, E., Newman, S. (2015). Neural bases of syntax-semantics interface processing. Cognitive Neurodynamics, 9(3), 317-329. doi: 10.1007/s11571-015-9328-2
Malaia, E., Tommerdahl, J., Mckee, F.W. (2014). Deductive versus probabilistic reasoning in healthy adults: An EEG analysis of neural differences. Journal of Psycholinguistic Research, 44 (5), 533-544. doi: 10.1007/s10936-014-9297-3
Malaia, E., Newman, S. (2014). Neural bases of event knowledge and syntax integration in comprehension of complex sentences. Neurocase, 21 (6), 753-766. doi: 10.1080/13554794.2014.989859
Malaia, E., Gonzalez-Castillo, J., Weber-Fox, C., Talavage, T.M., Wilbur, R.B. (2014). Neural processing of verbal event structure: temporal and functional dissociation between telic and atelic verbs. In: Mandouilidou, C., de Ameida, R. (eds.) Cognitive Science Perspectives on Verb Representation and Processing, pp. 131 - 140. Springer: Lausanne.
Malaia, E., Talavage, T., Wilbur, R.B. (2014) Functional connectivity in task-negative network of the Deaf: effects of sign language experience. PeerJ, doi: 10.7717/peerj.446
Barbu, A., Barrett, D., Chen, W., Siddarth, N., Xiong, C., Corso, J., Fellbaum, C., Hanson, C., Hanson, S., Helie, S., Malaia, E., Pearlmutter, B., Siskind, J., Talavage, T., Wilbur, R. (2014). Seeing is Worse than Believing: Reading People’s Minds Better than Computer-Vision Methods Recognize Actions. In D. Fleet et al. (Eds.) European Conference on Computer Vision 2014, Lecture Notes in Computer Science, pp. 612–627. Springer: Lausanne.
Newman, S., Malaia, E., & Seo, R. (2014). Does degree of handedness in a group of right-handed individuals affect language comprehension? Brain and Cognition, 86, 98-103. doi: 10.1016/j.bandc.2014.02.002
Newman, S., Malaia, E., Seo, R., Hu, C. (2013) The effect of individual differences in working memory capacity on sentence comprehension: an fMRI study. Brain Topography, 26(3), 458-67. doi: 10.1007/s10548-012-0264-8
Malaia, E., Wilbur, R.B., Weber-Fox, C. (2012). Down the garden path in EEG: telicity effects on thematic role re-assignment in relative clauses with transitive verbs. Journal of Psycholinguistic Research 41(5), 323-345. doi: 10.1007/s10936-011-9195-x
Malaia, E., Wilbur, R., Weber-Fox, C. (2009). ERP evidence for telicity effects on syntactic processing in garden-path sentences. Brain and Language 108(3), 145-158. doi: 10.1016/j.bandl.2008.09.003
Computational sign language research
This work, funded by the the Marie Curie action of the European Union and NSF uses tools of information theory to develop convergent algorithms for analysis of information transfer based on biological signals across different data types (articulator motion in sign language; neural activity data from fMRI and EEG).
Related publications:
Malaia, E., Borneman, J., & Gurbuz, S. (2024). Capturing Motion: Using Radar to Build Better Sign Language Corpora. In Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources (pp. 384–389).
Krebs, J., Malaia, E., Fessl, I., Wiesinger, H.-P., Wilbur, R., Roehm, D., Schwameder, H. (2024). Motion Capture Analysis of Verb and Adjective Types in Austrian Sign Language (ÖGS). In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 11619–11624).
Malaia, E., Borneman, J., Borneman, S., Krebs, J., Wilbur, R.B. (2023) Prediction underlying comprehension of human motion: analysis of Deaf signer and non-signer EEG in response to visual stimuli. Frontiers in Neuroscience, 17. doi: 10.3389/fnins.2023.1218510
Malaia, E., Borneman, J. D., *Kurtlogu, E., Gurbuz, S., Crawford, C., Griffin, D., Gurbuz, A. (2022) Complexity in sign languages: linguistic and dimensional analysis of information transfer in dynamic visual communication. Linguistics Vanguard special issue Measuring Language Complexity. doi: 10.1515/lingvan-2021-0005
Rahman, M. M., Malaia, E. A., Gurbuz, A. C., Griffin, D. J., Crawford C., Gurbuz, S. Z. (2022) Effect of Kinematics and Fluency in Adversarial Synthetic Data Generation for ASL Recognition with RF Sensors. IEEE Transactions on Aerospace and Electronic Systems, 58 (4), pp. 2732-2745. doi: 10.1109/TAES.2021.3139848
Kurtoğlu, E., Gurbuz, A. C., Malaia, E. A., Griffin, D., Crawford C., Gurbuz, S.Z. (2022). ASL Trigger Recognition in Mixed Activity/Signing Sequences for RF Sensor-Based User Interfaces. IEEE Transactions on Human-Machine Systems, doi: 10.1109/THMS.2021.3131675
Bradeley, C., Wilbur, R.B., Malaia, E. A., Siskind, J. (2022). Visual form of ASL verb signs predicts non-signer judgment of transitivity. PLoS One, 17(2): e0262098.doi: 10.1371/journal.pone.0262098
Gurbuz, S. Z., *Rahman, M. M., *Kurtoglu, E., Malaia, E.A., Gurbuz, A. C., Griffin, D. J., & Crawford, C. (2022) Multi-Frequency RF Sensor Fusion for Word-Level Fluent ASL Recognition. IEEE Sensors. doi: 10.1109/JSEN.2021.3078339
Ford, K., Borneman, J., Krebs, J., Malaia, E. A., Ames, B. (2021) Classification of visual comprehension based on EEG data using sparse optimal scoring. Journal of Neural Engineering, 18(2), 2661-2665. doi: 10.1088/1741-2552/abdb3b
Malaia, E. A., Borneman, S. C., Krebs, J., & Wilbur, R. B. (2021). Low-frequency entrainment to visual motion underlies sign language comprehension. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 2456-2463. doi: 10.1109/TNSRE.2021.3127724
Gurbuz, S., Gurbuz, A., Malaia, E. A., Griffin, D., Crawford, C., *Rahman, M., *Aksu, R., *Kurtoglu, E., *Mdrafiy, R., *Anbuselvam A., *Ozcelik, E. A. (2021). American Sign Language Recognition Using RF Sensing. IEEE Sensors, 21(3), 3763-3775. doi: 10.1109/JSEN.2020.3022376
Malaia, E., Wilbur, R.B. (2020). Syllable as a unit of information transfer in linguistic communication: the Entropy Syllable Parsing model. WIREs Cognitive Science, https://doi.org/10.1002/wcs.1518.
Gurbuz, S. Z., Gurbuz, A. C., Malaia, E. A., Griffin, D. J., Crawford, C., Rahman, M. M., ... & Macks, T. (2020). A Linguistic Perspective on Radar Micro-Doppler Analysis of American Sign Language. In 2020 IEEE International Radar Conference (RADAR) (pp. 232-237)
Borneman, J. D., Malaia, E., & Wilbur, R. B. (2018). Motion characterization using optical flow and fractal complexity. Journal of Electronic Imaging, 27(5), 051229. doi: 10.1117/1.JEI.27.5.051229
Wilbur, R.B., Malaia, E. A. (2018) A new technique for assessing narrative prosodic effects in sign languages. In A. Hübl & M. Steinbach (eds.), Linguistic Foundations of Narration in Spoken and Sign Languages, Amsterdam: John Benjamins.
Malaia, E. A. (2017) Methodologies for quantitative analysis of information transfer sign language and gesture data (commentary). Behavioral and Brain Sciences. doi: 10.1017/S0140525X15002988
Malaia, E. A., Borneman, J.D., Wilbur, R.B. (2017). Information transfer capacity of articulators in American Sign Language. Language and Speech. DOI: 10.1177/0023830917708461
Malaia, E. A., Borneman, J.D., Wilbur, R.B. (2016) Assessment of information content in visual signal: analysis of optical flow fractal complexity. Visual Cognition doi: 10.1080/13506285.2016.1225142
Malaia, E.A., Wilbur, R.B., Milković, M. (2013). Kinematic parameters of signed verbs. Journal of Speech, Language, and Hearing Research, 56, 1-12. doi: 10.1044/1092-4388(2013/12-0257)
Malaia, E.A., Wilbur, R.B. (2012). Kinematic signatures of telic and atelic events in ASL predicates. Language and Speech, 55(3), 407-421. doi: 10.1177/0023830911422201
Clinical and applied neuroscience
This work, which has been previously funded by the Department of Energy Ralph E. Powe Award, and European Institutes for Advanced Study, investigated applications of neuroscience research in clinical populations.
Related publications:
Kalahasti, D., Sazonov, E., Malaia, E. (in press). Identification of hunger and satiety states from EEG data. 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
McCleod, M., Borneman, S., Malaia, E. (2024) Neurocomputational Phenotypes in Female and Male Autistic Individuals. Journal of Science and Health at The University of Alabama, 21, pp. 23-28.
Turk, E. G., Malaia, E. (2023). The Unseen Families: A Systematic Review of Alternative Parental Interaction Techniques and Developmental Outcomes. Journal of Science and Health at The University of Alabama, 20, 28-38.
Tomeny, T., Hudac, C., Malaia, E., Morett, L., Tomeny, K., Watkins, L., Kana, R. (2023) Serving Individuals with Autism Spectrum Disorder in the Age of COVID-19: Special Considerations for Rural Families. Rural Special Education Quarterly, 42(2), pp. 105-118. doi: 10.1177/875687052311674
Malaia, E.A., Ahn, S., Rubchinsky, L.L. (2020). Dysregulation of temporal dynamics of synchronous neural activity in adolescents on autism spectrum. Autism Research, https://doi.org/10.1002/aur.2219.
Malaia, E.A., Cockerham, D., & Rublein, K. (2018). Visual integration of fear and anger emotional cues by children on the autism spectrum and neurotypical peers: An EEG study. Neuropsychologia 126, pp. 138-146. doi: 10.1016/j.neuropsychologia.2017.06.014
Malaia, E.A., Bates, E., Seitzman, B., & Coppess, K. (2016). Altered brain network dynamics in youths with autism spectrum disorder. Experimental Brain Research, 234(12), 3425-3431. doi: 10.1007/s00221-016-4737-y
Cockerham, D., Malaia, E.A. (2017). Neuroscience-supported approaches to teaching students on the autism spectrum. Special Issue on Educational Neuroscience, Zeitschrift fur Psychologie 224 (4), 290-293. doi: 10.1027/2151-2604/A000265
Malaia, E.A., Egorova, E., Hinesley, V. (2016). Developmental Characteristics of Gifted Children: Educational Approaches. In J. Horvath, J. Lodge, and J. Hattie (eds.) From the Laboratory to the Classroom: Translating the Science of Learning for Teachers. Routledge, UK, pp. 215-228.
Malaia, E.A., Wilbur, R.B. (2014). Enhancement of spatial processing in sign language users. In D. R. Montello, K. E. Grossner, and D. G. Janelle (eds.), Space in Mind: Concepts and Ontologies for Spatial Thinking, pp. 159-171, MIT press.
Perception - action - language relationship
Krebs, J., Wilbur, R.B., Roehm, D., Malaia, E. A., (accepted). The role of prosodic cues in topic signaling in Austrian Sign Language. Sign Language and Linguistics.
Malaia, E., Krebs, J. (accepted). Sign Language in aging population: neurobehavioral evidence. Topics in Cognitive Science.
Malaia, E., Milković, M. (2021). Aspect – theoretical and experimental perspectives. In J. Quer, R. Pfau and A. Herrmann (eds.) Routledge Handbook of Theoretical and Experimental Sign Language Research, pp. 194-212. London, UK: Routledge.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2020). Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
Malaia, E., Basu, D. Comparative analysis of interface between aspect and event structure in verbal morphosyntax of Russian and Bangla. (2020). Взаимодействие аспекта со смежными категориями: материалы VII Международной Комиссии по аспектологии Международного комитета славистов. (In: Proceedings of 7th International Conference on Slavic Aspect). St. Petersburg: Russian State Pedagogical University Press.
Blumenthal-Drame, A., Malaia, E. (2018). Shared neural and cognitive mechanisms in action and language: The Multi-Scale Information Transfer framework. WIREs Cognitive Science, DOI: 10.1002/wcs.1484.
Malaia, E.A. (2014). It Still Isn't Over: Event Boundaries in Language and Perception. Language and Linguistics Compass, 8(3), 89-98. doi: 10.1111/lnc3.12071
Malaia, E.A., Ranaweera, R., Wilbur, R.B., Talavage. T.M. (2013). Event segmentation in a visual language: Neural bases of processing American Sign Language predicates. Neuroimage 59(4), 4094-4101. doi: 10.1016/S1053-8119(09)71736-7
Malaia, E.A., Wilbur, R.B., Weber-Fox, C. (2013). Event end-point primes the Undergoer argument: a look at neurobiological bases of event structure. In Gehrke, B., Arsenijevic, B. (eds.) Subatomic semantics of event predicates, pp. 231-248. Springer: Studies in Linguistics and Philosophy. doi: 10.1007/978-94-007-5983-1_9
Malaia, E.A., Wilbur, R.B. (2012). What Sign Languages show: neurobiological bases of visual phonology. Di Sciullo, A.M. (ed.) Towards a biolinguistic understanding of grammar: essays on interfaces, pp. 265-275. John Benjamins.
Malaia, E.A., Wilbur, R.B. (2012). Telicity expression in visual modality. In McNally, L. & Delmonte, V. (eds.) Telicity, change, and state: A cross-categorial view of event structure, pp. 122-136. Oxford: Oxford University Press.
