Scientific Publications

Check out publication activity within our network

  • MultiplEYE Mid-Term Conference Proceedings

    List of accepted abstracts available through PsychArchives with a DOI

    Keynote Speeches

    • Pezzelle, S. (2024, October 7). Leveraging Gaze Data in Image Description Generation: Towards More Human-Like Visually-Grounded NLP Models. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15496
    • Müller, M.-L. (2024, October 7). Data Management in Eye-Tracking Research: Crucial Steps and Challenges. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15484

    Conference presentations

    • Dinçtopal Deniz, N., & Bakay, Özge. (2024, October 7). Long-distance licensing of Turkish NPIs: Surprisal and retroactive intrusion effects. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15478
    • Hollenstein, N., Kasperė, R., & Jäger, L. A. (2024, October 7). Opportunities and Challenges in the MultiplEYE Data Collection. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15479
    • Lõo, K., Bertram, R., & Kuperman, V. (2024, October 7). Morphological Effects in Estonian and Finnish Text Reading. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15480
    • Nisioi, S. (2024, October 7). Lexical Complexity Prediction Using Eye-Tracking Data. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15481
    • Fuchs, Z., Parshina, O., Sekerina, I. A., & Polinsky, M. (2024, October 7). Processing of External vs. Internal Agreement. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15482
    • Pavlinušić Vilus, E., Matić Škorić, A., Cergol, K., & Palmović, M. (2024, October 7). Surprisal and Non-Canonical Word Order in Sentence Processing: Evidence from an Eye-Tracking Study. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15483
    • Pavlinušić Vilus, E., Matić Škorić, A., Cergol, K., & Palmović, M. (2024, October 7). Surprisal and Non-Canonical Word Order in Sentence Processing: Evidence from an Eye-Tracking Study. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15483
    • Canaj, K. (2024, October 7). Eye-Tracking Analysis of Reading and Comprehension Difficulties in German as a Foreign Language: Focus on German for Medical Professions. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15485
    • Ertam, F. (2024, October 7). Can Eye-Tracking be used in Cyber Security Operations?. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15486
    • Freibergs, Z., Poškute, A., Pezzuto, D., Van Ginkel, R., Ilkevič, E., & Grikšienė, R. (2024, October 7). Personality Through The Lens: Eye-tracking and Physiological Stress Pathsways. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15487
    • Filip, M. (2024, October 7). Comparing MECO and MultiplEYE: Implementation and Data Collection in the Czech Language. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15488
    • Qazi, A. M., McCrae, J. P., & Nasir, J. A. (2024, October 7). Eye Movements as Indicators for Fake News Detection: A Machine Learning Approach. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15489
    • Kote, N., Petani, M., Haveriku, A., Trandafili, E., & Kajo Meçe, E. (2024, October 7). A Real-Time Eye-Tracking Model for detecting ‘Short Attention Span’ using CNNs and Dlib. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15490
    • Yılmaz, T., & Karakuş, C. (2024, October 7). Online Psychotherapy and Eye-Tracking Studies: A Rapid Review. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15491
    • Kasperė, R., Motiejūnienė, J., Hollenstein, N., & Yildirim, F. (2024, October 7). Eye-Tracking for Analysing Reception of Machine Translation and Sign Language. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15492
    • Papadopoulos, T. C., Acartürk, C., Fella, A., Özkan, A., Klimek-Jankowska, D., Krejtz, I., & Barkana, D. E. (2024, October 7). Eye-Tracking in Reading Research: A Systematic Review of Studies with Children of Varying Reading Ability. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15493
    • Bytyçi, E., & Rogova, E. (2024, October 7). Eye-tracking in Natural Language Processing of Albanian language. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15494
    • Cakir, M., & Yildirim, F. (2024, October 7). Effects of Stimulus Type on Eye-Movement Measures During Mindless Reading and Mindless Listening. [Conference object] MultiplEYE Mid-Term Conference 2024, Tirana, Albania. https://doi.org/10.23668/psycharchives.15495

  • Scientific Publications (2024)

    • Deborah N. Jakobi, Daniel G. Krakowczyk, and Lena A. Jäger. (2024). Reporting Eye-Tracking Data Quality: Towards a New Standard. In Proceedings of the 2024 Symposium on Eye Tracking Research and Applications (ETRA ’24). Association for Computing Machinery, New York, NY, USA, Article 47, 1–3. https://doi.org/10.1145/3649902.36556 
    • Haveriku, A., Paci, H., Kote, N., Meçe, E.K. (2024). Systematic Review of Eye-Tracking Studies. In: Barolli, L. (eds) Advances in Internet, Data & Web Technologies. EIDWT 2024. Lecture Notes on Data Engineering and Communications Technologies, vol 193. Springer, Cham. https://doi.org/10.1007/978-3-031-53555-0_24
    • Kristina Cergol and Marijan Palmović. “The role of prosodic information in silent reading: An eye–tracking study.” Suvremena lingvistika 50, br. 97 (2024): 1-22. https://doi.org/10.22210/suvlin.2024.097.01
    • Kristina Cergol and Marijan Palmovic. 2024. The role of stress in silent reading. In Proceedings of the 2024 Symposium on Eye Tracking Research and Applications (ETRA ’24). Association for Computing Machinery, New York, NY, USA, Article 83, 1–5. https://doi.org/10.1145/3649902.3656492
    • Matvieieva, S., Babych, V. (2023). Eye-Tracking Corpora: a brief overview. The world of language – the world in language: proceedings of the VII International Scientific Conference (Kyiv, October 27, 2023; Mykhailo Dragomanov State University of Ukraine) (pp. 183–185). Kyiv: Mykhailo Dragomanov State University of Ukraine. https://fif.udu.edu.ua/images/Conferences/2023/SM_2023_zb.pdf 
    • Reich, D. R., Deng, S., Björnsdóttir, M., Jäger, L., & Hollenstein, N. (2024, May). Reading Does Not Equal Reading: Comparing, Simulating and Exploiting Reading Behavior across Populations. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 13586-13594). https://aclanthology.org/2024.lrec-main.1187/
    • Schipke, C. S., Stegenwallner-Schütz, M., & Adani, F. (2024). Underpinning the On-Line Processing of (Non-)Canonical Sentences in German-Speaking Four-Year-Olds: The Interplay of Cognitive Control and Memory Capacity. Language Learning and Development, 20(3), 249–277. https://doi.org/10.1080/15475441.2024.2313217
    • Schipke, C., Stegenwallner-Schütz, M., & Adani, F. (2024). Underpinning the Online Processing of (Non-)Canonical Sentences in German-Speaking Four-Year-Olds: The Interplay of Cognitive Control and Memory Capacity. Language Learning and Development. https://doi.org/10.1080/15475441.2024.2313217
    • Stephanie Brandl, Oliver Eberle, Tiago Ribeiro, Anders Søgaard, and Nora Hollenstein. 2024. Evaluating Webcam-based Gaze Data as an Alternative for Human Rationale Annotations. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 6544–6556, Torino, Italia. ELRA and ICCL. https://aclanthology.org/2024.lrec-main.580
    • Vanek, N., Matić Škorić, A., Košutar, S. et al. Mental simulation of the factual and the illusory in negation processing: evidence from anticipatory eye movements on a blank screen. Sci Rep 14, 2844 (2024). https://doi.org/10.1038/s41598-024-53353-0
    • Zhang, L., & Hollenstein, N. (2024, May). Eye-Tracking Features Masking Transformer Attention in Question-Answering Tasks. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 7057-7070). https://aclanthology.org/2024.lrec-main.585/
    • Ethan G. Wilcox, Cui Ding, Mrinmaya Sachan, and Lena A. Jäger. Mouse Tracking for Reading (MoTR): A New Naturalistic Incremental Processing Measurement Tool, Journal of Memory and Language,
      https://www.sciencedirect.com/science/article/pii/S0749596X24000378
    • Lena S. Bolliger, Patrick Haller, Lena A. Jäger. On the alignment of LM language generation and human language comprehension,  EMNLP/BlackboxNLP 2024
      https://aclanthology.org/2024.blackboxnlp-1.14/
    • Patrick Haller, Jannis Vamvas, and Lena A. Jäger. Yes, no, maybe? Revisiting language models’ response stability under paraphrasing for the assessment of political leaning, COLM 2024
      https://colmweb.org/AcceptedPapers.html#:~:text=Patrick%20Haller%2C%20Jannis%20Vamvas%2C%20Lena%20Ann%20J%C3%A4ger
    • Patrick Haller, Lena S. Bolliger, and Lena A. Jäger. On language models’ cognitive biases in reading time prediction, ICML workshop on Large Language Models and Cognition 2024,
      https://openreview.net/forum?id=io5QAglkER
    • Samuel Kiegeland, David R. Reich, Ryan Cotterell, Lena A. Jäger, Ethan Wilcox. The Pupil Becomes the Master: Eye-Tracking Feedback for Tuning LLMs, ICML workshop on Large Language Models and Cognition 2024.
      https://openreview.net/forum?id=8oLUcBgKua 
    • Shuwen Deng, Paul Prasse, David R. Reich, Tobias Scheffer, and Lena A. Jäger. Fine-Tuning Pre-Trained Language Models with Gaze Supervision, ACL 2024.
      https://aclanthology.org/2024.acl-short.21/ 
    • Patrick Haller, Lena S. Bolliger, and Lena A. Jäger. Language models emulate certain cognitive profiles: An investigation of how predictability measures interact with individual differences, ACL 2024.
      https://aclanthology.org/2024.findings-acl.469/
    • Guojun Wu, Lena S. Bolliger, David R. Reich, and Lena A. Jäger. An eye opener regarding task-based text gradient saliency, ACL/CMCL 2024.
      https://aclanthology.org/2024.cmcl-1.22/ 
    • Tarek Alakmeh, David R. Reich, Lena A. Jäger, and Thomas Fritz. Predicting Code Comprehension: A Novel Approach to Align Human Gaze with Code using Deep Neural Networks, FSE 2024.
      https://dl.acm.org/doi/10.1145/3660795 
    • Sabine Dziemian, Gaston Bujia, Paul Prasse, Zofia Barańczuk-Turska, Lena A. Jäger, Juan E. Kamienkowski, Nicolas Langer. Saliency Models Reveal Reduced Top-Down Attention in Attention-Deficit/ Hyperactivity Disorder: A Naturalistic Eye-Tracking Study, JAACAP Open​.
      https://www.jaacapopen.org/article/S2949-7329(24)00028-0/fulltext 

  • Scientific Publications
    (May – October 2023)

    • Acartürk, C., Özkan, A., Pekçetin, T.N. et al. TURead: An eye movement dataset of Turkish reading. Behav Res (2023). https://doi.org/10.3758/s13428-023-02120-6
    • Frank, S.L., Aumeistere, A. An eye-tracking-with-EEG coregistration corpus of narrative sentences. Lang Resources & Evaluation (2023). https://doi.org/10.1007/s10579-023-09684-x
    • Lena S. Bolliger, David R. Reich, Patrick Haller, Deborah N. Jakobi, Paul Prasse, Lena A. Jäger (2023): ScanDL: A diffusion model for generating synthetic scanpaths on texts, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023), https://doi.org/10.48550/arXiv.2310.15587
    • Lisa Beinborn and Nora Hollenstein. Cognitive Plausibility in Natural Language Processing. Part of the book series: Synthesis Lectures on Human Language Technologies (SLHLT), Springer Nature, 2023. https://doi.org/10.1007/978-3-031-43260-6
    • Matvieieva, S. Eye-tracking technology for cognitive linguistics (pp. 51–53). Program and papers of Fourth International Scientific and Practical Conference “Language Philosophy and New Trends in Translation and Linguistic Studies”. Kyiv: Mykhailo Drahomanov State University of Ukraine, (2023).  https://cutt.ly/uwqyNpXG
    • Ryzhova, M., Škrjanec, I., Quach, N., Chase, A. V., Ellsiepen, E., & Demberg, V. (2023). Word Familiarity Classification From a Single Trial Based on Eye-Movements. A Study in German and English. Proceedings of the 2023 Symposium on Eye Tracking Research and Applications (ETRA ’23) (pp. 1–2, Article No.: 60). New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3588015.3590118
    • Shuwen Deng, Paul Prasse, David R. Reich, Tobias Scheffer, Lena A. Jäger (2023): Pre-trained language models augmented with synthetic scanpaths for natural language understanding, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023). https://doi.org/10.48550/arXiv.2310.14676
    • Skrjanec, I., Broy, F. Y., & Demberg, V. (2023). Expert-adapted language models improve the fit to reading times. 27th International Conference on Knowledge-Based and Intelligent Information & EngineeringSystems (KES 2023). PsyArXiv. https://doi.org/10.31234/osf.io/dc8y6

  • Network Scientific Publications (January-April 2023)

    Vulchanova, M., Vulchanov, V. & Allen, M. Word learning in ASD: the sensorimotor, the perceptual and the symbolic. J Cult Cogn Sci (2023). https://doi.org/10.1007/s41809-022-00117-9

    Søby, K., Milburn, E., Kristensen, L., Vulchanov, V., & Vulchanova, M. (2023). In the native speaker’s eye: Online processing of anomalous learner syntax. Applied Psycholinguistics, 1-28. https://doi.org/10.1017/S0142716422000418

    Krassanakis, V. (2023). PeyeMMV: Python implementation of EyeMMV’s fixation detection algorithm. Software Impacts, 100475. https://doi.org/10.1016/j.simpa.2023.100475

    Daniel G. Krakowczyk, David R. Reich, Jakob Chwastek, Assunta Süss, Paul Prasse, Deborah N. Jakobi, Oleksii Turuta, Paweł Kasprowski and Lena A. Jäger ETRA 2023. pymovements: A Python package for eye movement data processing. https://doi.org/10.48550/arXiv.2304.09859

    Shuwen Deng, David R. Reich, Paul Prasse, Patrick Haller, Tobias Scheffer and Lena A. Jäger. (2023) Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Reading, To appear in The Proceedings of the ACM of Human Computer Interaction https://doi.org/10.48550/arXiv.2304.10784

    Daniel Krakowczyk, Paul Prasse, David R. Reich, Sebastian Lapuschkin, Tobias Scheffer and Lena A. Jäger, ETRA 2023.Bridging the Gap: Gaze Events as Interpretable Concepts to Explain Deep Neural Sequence Models
    https://doi.org/10.48550/arXiv.2304.1353    6

    Lago, S., Stone, K., Oltrogge, E., & Veríssimo, J. (2022, online). Possessive processing in bilingual comprehension. Language Learning. https://doi.org/10.1111/lang.12556

    Pouw, C., Hollenstein, N., and Beinborn, L. : Cross-Lingual Transfer of Cognitive Complexity, to appear in Findings of EACL, https://arxiv.org/pdf/2302.12695.pdf

    Björnsdóttir, M., Hollenstein, N., & Barrett, M. Dyslexia Prediction from Natural Reading of Danish Texts. In The 24rd Nordic Conference on Computational Linguistics. 2023. 

    Ribeiro, T., Brandl, S., Søgaard, A., & Hollenstein, N. (2023). WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset. arXiv preprint arXiv:2303.17876. https://arxiv.org/abs/2303.17876 

    Yang, Duo, and Nora Hollenstein. “PLM-AS: Pre-trained Language Models Augmented with Scanpaths for Sentiment Classification.” Proceedings of the Northern Lights Deep Learning Workshop. Vol. 4. 2023. https://doi.org/10.7557/18.6797

    Khurana, V., Singla, Y. K., Hollenstein, N., Kumar, R., & Krishnamurthy, B. (2023). Synthesizing Human Gaze Feedback for Improved NLP Performance. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. https://arxiv.org/abs/2302.05721