Publications
.
Communication in children on Autism Spectrum
Our work, funded by the Department of Energy Ralph E. Powe Award, and European Institutes for Advanced Study, investigates neural bases of communication in children and adolescents on Autism Spectrum. We use neural data (EEG, fMRI), and develop new analysis methods for it, including frequency domain analyses based on statistical physics models.
Related publications:
Malaia, E.A., Ahn, S., Rubchinsky, L.L. (2020). Dysregulation of temporal dynamics of synchronous neural activity in adolescents on autism spectrum. Autism Research, https://doi.org/10.1002/aur.2219.
Malaia, E., Cockerham, D., & Rublein, K. (2018). Visual integration of fear and anger emotional cues by children on the autism spectrum and neurotypical peers: An EEG study. Neuropsychologia.
Cockerham, D., Malaia, E. (2017) Neuroscience-supported approaches to teaching students on the autism spectrum. Special Issue on Educational Neuroscience, Zeitschrift fur Psychologie 224 (4), 290-293.
Malaia, E., Bates, E., Seitzman, B., & Coppess, K. (2016). Altered brain network dynamics in youths with autism spectrum disorder. Experimental brain research, 234(12), 3425-3431.
Computational analysis of sign language signal
This work, funded by the the Marie Curie action of the European Union and NSF uses tools of information theory to develop convergent algorithms for analysis of information transfer based on biological signals across different data types (articulator motion in sign language; neural activity data from fMRI and EEG).
Related publications:
Gurbuz, S., Gurbuz, A., Malaia, E. A., Griffin, D., Crawford, C., *Rahman, M., *Aksu, R., *Kurtoglu, E., *Mdrafiy, R., *Anbuselvam A., *Ozcelik, E. A. (2021). American Sign Language Recognition Using RF Sensing. IEEE Sensors, 21(3), 3763-3775. doi: 10.1109/JSEN.2020.3022376
Malaia, E., Wilbur, R.B. (2020). Syllable as a unit of information transfer in linguistic communication: the Entropy Syllable Parsing model. WIREs Cognitive Science, https://doi.org/10.1002/wcs.1518.
Gurbuz, S. Z., Gurbuz, A. C., Malaia, E. A., Griffin, D. J., Crawford, C., Rahman, M. M., ... & Macks, T. (2020). A Linguistic Perspective on Radar Micro-Doppler Analysis of American Sign Language. In 2020 IEEE International Radar Conference (RADAR) (pp. 232-237)
Blumenthal-Drame, A., Malaia, E. (2018) Shared neural and cognitive mechanisms in action and language: The Multi-Scale Information Transfer framework. WIREs Cognitive Science, DOI: 10.1002/wcs.1484.
Borneman, J. D., Malaia, E., & Wilbur, R. B. (2018). Motion characterization using optical flow and fractal complexity. Journal of Electronic Imaging, 27(5), 051229.
Wilbur, R.B., Malaia, E. (2018) A new technique for assessing narrative prosodic effects in sign languages. In A. Hübl & M. Steinbach (eds.), Linguistic Foundations of Narration in Spoken and Sign Languages, Amsterdam: John Benjamins.
Malaia, E. (2017) Methodologies for quantitative analysis of information transfer sign language and gesture data (commentary). Behavioral and Brain Sciences.
Malaia, E., Borneman, J.D., Wilbur, R.B. (2017). Information transfer capacity of articulators in American Sign Language. Language and Speech. DOI: 10.1177/0023830917708461
Malaia, E., Borneman, J.D., Wilbur, R.B. (2016) Assessment of information content in visual signal: analysis of optical flow fractal complexity. Visual Cognition doi:10.1080/13506285.2016.1225142
Neurolinguistics and theoretical linguistics
Ford, K., Borneman, J., Krebs, J., Malaia, E. A., Ames, B. (2021) Classification of visual comprehension based on EEG data using sparse optimal scoring. Journal of Neural Engineering, 18(2), 2661-2665. doi: 10.1088/1741-2552/abdb3b
Krebs, J., Roehm, D., Wilbur, R. B., & Malaia, E. A. (2021). Age of sign language acquisition has lifelong effect on syntactic preferences in sign language users. International Journal of Behavioral Development, doi: 10.1177/0165025420958193.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2021) Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
2021
Malaia, E.A., Krebs, J., Wilbur, R.B., Roehm, D. (2020) Age of acquisition effects differ across linguistic domains in sign language: EEG evidence. Brain and Language, https://doi.org/10.1016/j.bandl.2019.104708.
Malaia, E., Basu, D. Comparative analysis of interface between aspect and event structure in verbal morphosyntax of Russian and Bangla. Взаимодействие аспекта со смежными категориями: материалы VII Международной Комиссии по аспектологии Международного комитета славистов. (In: Proceedings of 7th International Conference on Slavic Aspect). St. Petersburg: Russian State Pedagogical University Press.
Krebs, J., Malaia, E., Wilbur, R., Roehm, D.(2020). Subjektpräferenz in der Österreichischen Gebärdensprache (ÖGS). DAS ZEICHEN: Zeitschrift für Sprache und Kultur Gehörloser (The Sign: Journal for language and culture of the Deaf), 114; pp. 96-107.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2019). Interaction between topic marking and subject preference strategy in sign language processing. Language, Cognition, and Neuroscience, https://doi.org/10.1080/23273798.2019.1667001
Malaia, E., & Wilbur, R. B. (2019). Visual and linguistic components of short-term memory: a common neural model for spoken and sign languages. Cortex, https://doi.org/10.1016/j.cortex.2018.05.020.
Krebs, J., Malaia, E., Wilbur, R. B., & Roehm, D. (2018). Subject preference emerges as cross-modal strategy for linguistic processing. Brain research, 1691, 105-117.
Malaia, E., Newman, S. (2015) Neural bases of syntax-semantics interface processing. Cognitive Neurodynamics, 9(3), 317-329.
Malaia, E., Tommerdahl, J., Mckee, F.W. (2014). Deductive and heuristic reasoning processing markers in EEG. Journal of Psycholinguistic Research, 44 (5), 533-544.
Malaia, E., Newman, S. (2014) Neural bases of event knowledge and syntax integration in comprehension of complex sentences. Neurocase, 21 (6), 753-766.
Malaia, E., Gonzalez-Castillo, J., Weber-Fox, C., Talavage, T.M., Wilbur, R.B. (2014). Neural processing of verbal event structure: temporal and functional dissociation between telic and atelic verbs. In: Mandouilidou, C., de Ameida, R. (eds.) Cognitive Science Perspectives on Verb Representation and Processing, pp. 131 - 140. Springer: Lausanne.
Malaia, E., Talavage, T., Wilbur, R.B. (2014) Functional connectivity in task-negative network of the Deaf: effects of sign language experience. PeerJ, doi: 10.7717/peerj.446
Barbu, A., Barrett, D., Chen, W., Siddarth, N., Xiong, C., Corso, J., Fellbaum, C., Hanson, C., Hanson, S., Helie, S., Malaia, E., Pearlmutter, B., Siskind, J., Talavage, T., Wilbur, R. (2014). Seeing is Worse than Believing: Reading People’s Minds Better than Computer-Vision Methods Recognize Actions. In D. Fleet et al. (Eds.) European Conference on Computer Vision 2014, Lecture Notes in Computer Science, pp. 612–627. Springer: Lausanne.
Newman, S., Malaia, E., & Seo, R. (2014). Does degree of handedness in a group of right-handed individuals affect language comprehension? Brain and Cognition, 86, 98-103.
Newman, S., Malaia, E., Seo, R., Hu, C. (2013) The effect of individual differences in working memory capacity on sentence comprehension: an fMRI study. Brain Topography, 26(3), 458-67.
Malaia, E., Wilbur, R.B., Weber-Fox, C. (2012). Down the garden path in EEG: telicity effects on thematic role re-assignment in relative clauses with transitive verbs. Journal of Psycholinguistic Research 41(5), 323-345.
Malaia, E., Wilbur, R., Weber-Fox, C. (2009). ERP evidence for telicity effects on syntactic processing in garden-path sentences. Brain and Language 108(3), 145-158.
Perception - action - sign language relationship
Malaia, E., Milković, M. (2021). Aspect – theoretical and experimental perspectives. In J. Quer, R. Pfau and A. Herrmann (eds.) Routledge Handbook of Theoretical and Experimental Sign Language Research, pp. 194-212. London, UK: Routledge.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2020) Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
Malaia, E., Ranaweera, R., Wilbur, R.B., Talavage. T.M. (2013). Event segmentation in a visual language: Neural bases of processing American Sign Language predicates. Neuroimage 59(4), 4094-4101.
Malaia, E. (2014). It Still Isn't Over: Event Boundaries in Language and Perception. Language and Linguistics Compass, 8(3), 89-98.
Malaia, E., Wilbur, R.B. (2012). Motion capture signatures of telic and atelic events in ASL predicates. Language and Speech, 55(3), 407-421.
Malaia, E., Wilbur, R.B., Weber-Fox, C. (2013). Event end-point primes the Undergoer argument: a look at neurobiological bases of event structure. In Gehrke, B., Arsenijevic, B. (eds.) Subatomic semantics of event predicates, pp. 231-248. Springer: Studies in Linguistics and Philosophy.
Malaia, E., Wilbur, R.B., Milković, M. (2013). Kinematic parameters of signed verbs at morpho-phonology interface. Journal of Speech, Language, and Hearing Research, 56, 1-12.
Malaia, E., Wilbur, R.B. (2012). What Sign Languages show: neurobiological bases of visual phonology. Di Sciullo, A.M. (ed.) Towards a biolinguistic understanding of grammar: essays on interfaces, pp. 265-275. John Benjamins.
Malaia, E., Wilbur, R.B. (2012). Telicity expression in visual modality. In McNally, L. & Delmonte, V. (eds.) Telicity, change, and state: A cross-categorial view of event structure, pp. 122-136. Oxford: Oxford University Press.
Applications of research to Mind, Brain, and Education
Malaia, E., Egorova, E., Hinesley, V. (2016) Developmental Characteristics of Gifted Children: Educational Approaches. In J. Horvath, J. Lodge, and J. Hattie (eds.) From the Laboratory to the Classroom: Translating the Science of Learning for Teachers. Routledge, UK, pp. 215-228.
Malaia, E., Wilbur, R.B. (2014). Enhancement of spatial processing in sign language users. In D. R. Montello, K. E. Grossner, and D. G. Janelle (eds.), Space in Mind: Concepts and Ontologies for Spatial Thinking, pp. 159-171, MIT press.
Communication in children on Autism Spectrum
Our work, funded by the Department of Energy Ralph E. Powe Award, and European Institutes for Advanced Study, investigates neural bases of communication in children and adolescents on Autism Spectrum. We use neural data (EEG, fMRI), and develop new analysis methods for it, including frequency domain analyses based on statistical physics models.
Related publications:
Malaia, E.A., Ahn, S., Rubchinsky, L.L. (2020). Dysregulation of temporal dynamics of synchronous neural activity in adolescents on autism spectrum. Autism Research, https://doi.org/10.1002/aur.2219.
Malaia, E., Cockerham, D., & Rublein, K. (2018). Visual integration of fear and anger emotional cues by children on the autism spectrum and neurotypical peers: An EEG study. Neuropsychologia.
Cockerham, D., Malaia, E. (2017) Neuroscience-supported approaches to teaching students on the autism spectrum. Special Issue on Educational Neuroscience, Zeitschrift fur Psychologie 224 (4), 290-293.
Malaia, E., Bates, E., Seitzman, B., & Coppess, K. (2016). Altered brain network dynamics in youths with autism spectrum disorder. Experimental brain research, 234(12), 3425-3431.
Computational analysis of sign language signal
This work, funded by the the Marie Curie action of the European Union and NSF uses tools of information theory to develop convergent algorithms for analysis of information transfer based on biological signals across different data types (articulator motion in sign language; neural activity data from fMRI and EEG).
Related publications:
Gurbuz, S., Gurbuz, A., Malaia, E. A., Griffin, D., Crawford, C., *Rahman, M., *Aksu, R., *Kurtoglu, E., *Mdrafiy, R., *Anbuselvam A., *Ozcelik, E. A. (2021). American Sign Language Recognition Using RF Sensing. IEEE Sensors, 21(3), 3763-3775. doi: 10.1109/JSEN.2020.3022376
Malaia, E., Wilbur, R.B. (2020). Syllable as a unit of information transfer in linguistic communication: the Entropy Syllable Parsing model. WIREs Cognitive Science, https://doi.org/10.1002/wcs.1518.
Gurbuz, S. Z., Gurbuz, A. C., Malaia, E. A., Griffin, D. J., Crawford, C., Rahman, M. M., ... & Macks, T. (2020). A Linguistic Perspective on Radar Micro-Doppler Analysis of American Sign Language. In 2020 IEEE International Radar Conference (RADAR) (pp. 232-237)
Blumenthal-Drame, A., Malaia, E. (2018) Shared neural and cognitive mechanisms in action and language: The Multi-Scale Information Transfer framework. WIREs Cognitive Science, DOI: 10.1002/wcs.1484.
Borneman, J. D., Malaia, E., & Wilbur, R. B. (2018). Motion characterization using optical flow and fractal complexity. Journal of Electronic Imaging, 27(5), 051229.
Wilbur, R.B., Malaia, E. (2018) A new technique for assessing narrative prosodic effects in sign languages. In A. Hübl & M. Steinbach (eds.), Linguistic Foundations of Narration in Spoken and Sign Languages, Amsterdam: John Benjamins.
Malaia, E. (2017) Methodologies for quantitative analysis of information transfer sign language and gesture data (commentary). Behavioral and Brain Sciences.
Malaia, E., Borneman, J.D., Wilbur, R.B. (2017). Information transfer capacity of articulators in American Sign Language. Language and Speech. DOI: 10.1177/0023830917708461
Malaia, E., Borneman, J.D., Wilbur, R.B. (2016) Assessment of information content in visual signal: analysis of optical flow fractal complexity. Visual Cognition doi:10.1080/13506285.2016.1225142
Neurolinguistics and theoretical linguistics
Ford, K., Borneman, J., Krebs, J., Malaia, E. A., Ames, B. (2021) Classification of visual comprehension based on EEG data using sparse optimal scoring. Journal of Neural Engineering, 18(2), 2661-2665. doi: 10.1088/1741-2552/abdb3b
Krebs, J., Roehm, D., Wilbur, R. B., & Malaia, E. A. (2021). Age of sign language acquisition has lifelong effect on syntactic preferences in sign language users. International Journal of Behavioral Development, doi: 10.1177/0165025420958193.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2021) Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
2021
Malaia, E.A., Krebs, J., Wilbur, R.B., Roehm, D. (2020) Age of acquisition effects differ across linguistic domains in sign language: EEG evidence. Brain and Language, https://doi.org/10.1016/j.bandl.2019.104708.
Malaia, E., Basu, D. Comparative analysis of interface between aspect and event structure in verbal morphosyntax of Russian and Bangla. Взаимодействие аспекта со смежными категориями: материалы VII Международной Комиссии по аспектологии Международного комитета славистов. (In: Proceedings of 7th International Conference on Slavic Aspect). St. Petersburg: Russian State Pedagogical University Press.
Krebs, J., Malaia, E., Wilbur, R., Roehm, D.(2020). Subjektpräferenz in der Österreichischen Gebärdensprache (ÖGS). DAS ZEICHEN: Zeitschrift für Sprache und Kultur Gehörloser (The Sign: Journal for language and culture of the Deaf), 114; pp. 96-107.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2019). Interaction between topic marking and subject preference strategy in sign language processing. Language, Cognition, and Neuroscience, https://doi.org/10.1080/23273798.2019.1667001
Malaia, E., & Wilbur, R. B. (2019). Visual and linguistic components of short-term memory: a common neural model for spoken and sign languages. Cortex, https://doi.org/10.1016/j.cortex.2018.05.020.
Krebs, J., Malaia, E., Wilbur, R. B., & Roehm, D. (2018). Subject preference emerges as cross-modal strategy for linguistic processing. Brain research, 1691, 105-117.
Malaia, E., Newman, S. (2015) Neural bases of syntax-semantics interface processing. Cognitive Neurodynamics, 9(3), 317-329.
Malaia, E., Tommerdahl, J., Mckee, F.W. (2014). Deductive and heuristic reasoning processing markers in EEG. Journal of Psycholinguistic Research, 44 (5), 533-544.
Malaia, E., Newman, S. (2014) Neural bases of event knowledge and syntax integration in comprehension of complex sentences. Neurocase, 21 (6), 753-766.
Malaia, E., Gonzalez-Castillo, J., Weber-Fox, C., Talavage, T.M., Wilbur, R.B. (2014). Neural processing of verbal event structure: temporal and functional dissociation between telic and atelic verbs. In: Mandouilidou, C., de Ameida, R. (eds.) Cognitive Science Perspectives on Verb Representation and Processing, pp. 131 - 140. Springer: Lausanne.
Malaia, E., Talavage, T., Wilbur, R.B. (2014) Functional connectivity in task-negative network of the Deaf: effects of sign language experience. PeerJ, doi: 10.7717/peerj.446
Barbu, A., Barrett, D., Chen, W., Siddarth, N., Xiong, C., Corso, J., Fellbaum, C., Hanson, C., Hanson, S., Helie, S., Malaia, E., Pearlmutter, B., Siskind, J., Talavage, T., Wilbur, R. (2014). Seeing is Worse than Believing: Reading People’s Minds Better than Computer-Vision Methods Recognize Actions. In D. Fleet et al. (Eds.) European Conference on Computer Vision 2014, Lecture Notes in Computer Science, pp. 612–627. Springer: Lausanne.
Newman, S., Malaia, E., & Seo, R. (2014). Does degree of handedness in a group of right-handed individuals affect language comprehension? Brain and Cognition, 86, 98-103.
Newman, S., Malaia, E., Seo, R., Hu, C. (2013) The effect of individual differences in working memory capacity on sentence comprehension: an fMRI study. Brain Topography, 26(3), 458-67.
Malaia, E., Wilbur, R.B., Weber-Fox, C. (2012). Down the garden path in EEG: telicity effects on thematic role re-assignment in relative clauses with transitive verbs. Journal of Psycholinguistic Research 41(5), 323-345.
Malaia, E., Wilbur, R., Weber-Fox, C. (2009). ERP evidence for telicity effects on syntactic processing in garden-path sentences. Brain and Language 108(3), 145-158.
Perception - action - sign language relationship
Malaia, E., Milković, M. (2021). Aspect – theoretical and experimental perspectives. In J. Quer, R. Pfau and A. Herrmann (eds.) Routledge Handbook of Theoretical and Experimental Sign Language Research, pp. 194-212. London, UK: Routledge.
Krebs, J., Malaia, E.A., Wilbur, R.B., Roehm, D. (2020) Psycholinguistic mechanisms of classifier processing in sign language. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi: 10.1037/xlm0000958
Malaia, E., Ranaweera, R., Wilbur, R.B., Talavage. T.M. (2013). Event segmentation in a visual language: Neural bases of processing American Sign Language predicates. Neuroimage 59(4), 4094-4101.
Malaia, E. (2014). It Still Isn't Over: Event Boundaries in Language and Perception. Language and Linguistics Compass, 8(3), 89-98.
Malaia, E., Wilbur, R.B. (2012). Motion capture signatures of telic and atelic events in ASL predicates. Language and Speech, 55(3), 407-421.
Malaia, E., Wilbur, R.B., Weber-Fox, C. (2013). Event end-point primes the Undergoer argument: a look at neurobiological bases of event structure. In Gehrke, B., Arsenijevic, B. (eds.) Subatomic semantics of event predicates, pp. 231-248. Springer: Studies in Linguistics and Philosophy.
Malaia, E., Wilbur, R.B., Milković, M. (2013). Kinematic parameters of signed verbs at morpho-phonology interface. Journal of Speech, Language, and Hearing Research, 56, 1-12.
Malaia, E., Wilbur, R.B. (2012). What Sign Languages show: neurobiological bases of visual phonology. Di Sciullo, A.M. (ed.) Towards a biolinguistic understanding of grammar: essays on interfaces, pp. 265-275. John Benjamins.
Malaia, E., Wilbur, R.B. (2012). Telicity expression in visual modality. In McNally, L. & Delmonte, V. (eds.) Telicity, change, and state: A cross-categorial view of event structure, pp. 122-136. Oxford: Oxford University Press.
Applications of research to Mind, Brain, and Education
Malaia, E., Egorova, E., Hinesley, V. (2016) Developmental Characteristics of Gifted Children: Educational Approaches. In J. Horvath, J. Lodge, and J. Hattie (eds.) From the Laboratory to the Classroom: Translating the Science of Learning for Teachers. Routledge, UK, pp. 215-228.
Malaia, E., Wilbur, R.B. (2014). Enhancement of spatial processing in sign language users. In D. R. Montello, K. E. Grossner, and D. G. Janelle (eds.), Space in Mind: Concepts and Ontologies for Spatial Thinking, pp. 159-171, MIT press.
