Gestik3

1) The neural correlates of natural social-communicative perception processes in patients with schizophrenia and healthy controls: Understanding, recognition and interpretation of verbal and non-verbal information

Funding: DFG

2) Investigating disorder specific differences in the neural correlates of natural social-communicative perception processes in patients with schizophrenia, depression and bipolar disorder

Funding: Förder- und Innovationspools der RHÖN-Klinikum AG

3)  The neural correlates of social-communicative perception in patients with schizophrenia, major depression und bipolar disorder: Disorder specific and disorder-unspecific aspects of the comprehension, recognition and interpretation of verbal and non-verbal information

Funding: DFG

Who’s working on Gestik3?

Principal investigators: Benjamin Straube, Tilo Kircher 

Associated investigators: Arne Nagels, Yifei He

PhD students: Miriam Steines, Anne Suffel, Momoko Choudhury

Student assistants: Katrin Leinweber, Raphaela Hettich

Rekrutierung: Patienten mit Depression, bipolarer Störung oder Schizophrenie gesucht – Gestikstudie_Flyer

Related publications

Nagels, A., Kircher, T., Grosvald, M., Steines, M., & Straube, B. (2019). Evidence for gesture-speech mismatch detection impairments in schizophrenia. Psychiatry Research. IF: 2.223

Suffel, A., Nagels, A., Steines, M., Kircher, T., & Straube, B. (2020). Feeling addressed ! The neural processing of social communicative cues in patients with major depression. Human Brain Mapping, 41, 3541–3554. https://doi.org/10.1002/hbm.25027

Nagels, A., Kircher, T., Steines, M., Grosvald, M., Straube, B. (2015). A Brief Self-Rating Scale for the Assessment of Individual Differences in Gesture Perception and Production. Learning and Individual Differences, 39, 73-80. IF: 1.565

Nagels, A., Kircher, T., Steines, M., & Straube, B. (2015). Feeling Addressed! The Role of Body Orientation and Co-Speech Gesture in Social Communication. Human Brain Mapping, 36(5), 1925-36. IF: 5.969

Nagels, A., Chatterjee, A., Kircher, T., & Straube, B. (2013). The role of semantic abstractness and perceptual category in processing speech accompanied by gestures. Frontiers in Behavioral Neuroscience, 7. doi:10.3389/fnbeh.2013.00181 IF: 4.160

Straube, B., Green, A., Sass, K., Kirner-Veselinovic, A., & Kircher, T. (2013). Neural integration of speech and gesture in schizophrenia: Evidence for differential processing of metaphoric gestures. Human Brain Mapping 34(7), 1696–1712. IF: 6.924

Straube, B., He, Y., Steines, M., Gebhardt, H., Kircher, T., Sammer, G., & Nagels, A. (2013). Supramodal neural processing of abstract information conveyed by speech and gesture. Frontiers in Behavioral Neuroscience, 7. doi:10.3389/fnbeh.2013.00120 IF: 4.160

Steines, M., Nagels, A., Kircher, T., Straube, B., 2021. The role of the left and right inferior frontal gyrus in processing metaphoric and unrelated co-speech gestures. Neuroimage 237, 118182. https://doi.org/10.1016/j.neuroimage.2021.118182 IF: 5.902

He, Y., Steines, M., Sammer, G., Nagels, A., Kircher, T., Straube, B., (2021). NeuroImage : Clinical Modality-specific dysfunctional neural processing of social-abstract and non-social-concrete information in schizophrenia. NeuroImage Clin. 29, 102568. https://doi.org/10.1016/j.nicl.2021.102568

Cuevas, P., He, Y., Billino, J., Kozasa, E., Straube, B., (2021). Age-related effects on the neural processing of semantic complexity in a continuous narrative: Modulation by gestures already present in young to middle-aged adults. Neuropsychologia 151. https://doi.org/10.1016/J.NEUROPSYCHOLOGIA.2020.107725

Schmalenbach, S.B., Billino, J., Kircher, T., Van Kemenade, B., (Straube, B., 2017). Links between gestures and multisensory processing: individual differences suggest a compensation mechanism. Front. Psychol. 8, 1828. https://doi.org/10.3389/FPSYG.2017.01828

He, Y., Luell, S., Straube, B., Nagels, A., (2020). Gesture’s body orientation modulates the N400 during semantic integration of gesture and visual sentence. Hum. Brain Mapp. 1–11. https://doi.org/10.1101/2020.03.10.985234

Straube, B., Wroblewski, A., Jansen, A., He, Y., (2018). The connectivity signature of co-speech gesture integration: The superior temporal sulcus modulates connectivity between areas related to visual gesture and auditory speech processing. Neuroimage 181, 539–549. https://doi.org/10.1016/J.NEUROIMAGE.2018.07.037

He, Y., Nagels, A., Schlesewsky, M., Straube, B., (2018). The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech. Front. Psychol. 9, 1–11. https://doi.org/10.3389/fpsyg.2018.01348

Osorio, S., Straube, B., Meyer, L., He, Y., (2023). The role of co-speech gestures in retrieval and prediction during naturalistic multimodal narrative processing. Lang. Cogn. Neurosci. 1–16. https://doi.org/10.1080/23273798.2023.2295499

Riedl, L., Nagels, A., Sammer, G., Choudhury, M., Nonnenmann, A., Sütterlin, A., Feise, C., Haslach, M., Bitsch, F., Straube, B., (2022). Multimodal speech-gesture training in patients with schizophrenia spectrum disorder : Effects on quality of life and neural processing. Schizophr. Res. 246, 112–125. https://doi.org/10.1016/j.schres.2022.06.009

Cuevas, P., He, Y., Steines, M., Straube, B., (2021). The processing of semantic complexity and co-speech gestures in schizophrenia: a naturalistic, multimodal fMRI study. bioRxiv 2021.05.18.444612. https://doi.org/10.1101/2021.05.18.444612

Choudhury, M., Steines, M., Nagels, A., Riedl, L., Kircher, T., Straube, B., (2021). Neural Basis of Speech-Gesture Mismatch Detection in Schizophrenia Spectrum Disorders. Schizophr. Bull. 47, 1761–1771. https://doi.org/10.1093/schbul/sbab059 IF: 7.958

Straube, B., & Leinweber, K. (2024, January 31). Dimensions of mental representations in psychiatry: An example from speech and gesture processing in schizophrenia. Retrieved from osf.io/preprints/psyarxiv/zqb5r