Publications and outreach

Publications
Keynote talks
Further reading

Publications

We are happy to provide you with publications in International Sign, plain language or in a version suitable for screed readers on request. Link to contact information

Battisti, A.; Ebling, S. (2024). Automatic Annotation Elaboration as Feedback to Sign Language Learners. In The 18th Linguistic Annotation Workshop (LAW-XVIII), St. Julian’s, Malta, 22 March 2024.
Full Paper: Automatic Annotation Elaboration ... (PDF)Abstract, screen reader ready: Automatic Annotation Elaboration ... (PDF, 32 KB)
Battisti, A.; van den Bold, E.; Göhring, A.; Holzknecht, F.; Ebling, S. (2024). Person Identification from Pose Estimates in Sign Language. In Proc. 11th Workshop on the Representation and Processing of Sign Languages. LREC-Coling 2024.
Full paper: Person Identification from Pose Estimates ... (PDF)
Abstract, screen reader ready: Person Identification from Pose Estimates (PDF, 37 KB)
Bericht (in German): Anonymisierung der Posen (PDF, 159 KB)
DSGS-Video: Anonymisierung der Posen
Carrer, L., Säuberli, A., Kappus, A. and Sarah Ebling. (2024). Towards Holistic Human Evaluation of Automatic Text Simplification. In Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024, pages 71–80, Torino, Italia. ELRA and ICCL.
Towards Holistic Human Evaluation of Automatic Text Simplification (PDF)
Towards Holistic Human Evaluation ... (Abstract, screen reader ready) (PDF, 33 KB)
Studie zur Prüfung von automatisch vereinfachten Texten (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 55 KB)
Cory, O., Sincan, O.M., Vowels, M., Battisti, A., Holzknecht, F., Tissi, K., Sidler-Miserez, S., Haug, T., Ebling, S. and Bowden, R. (2024). Modelling the Distribution of Human Motion for Sign Language Assessment. 12th Workshop on Assistive Computer Vision and Robotics at ECCV.
Modelling the Distribution of Human Motion for Sign Language Assessment (PDF)
Gao, Y., Fischer, L., Lintner, A., Ebling, S. (2024). Audio Description Generation in the Era of LLMs and VLMs: A Review of Transferable Generative AI Technologies. ArXiv.org 2410.08860, University of Zurich.
Audio Description Generation in the Era of LLMs and VLMs (PDF)
Audio Description Generation... (Abstract, screen reader ready) (PDF, 33 KB)
Hermann, E., Magimai.-Doss, M. (2023). Few-shot Dysarthric Speech Recognition with Text-to-Speech Data Augmentation. In Proceedings INTERSPEECH 2023, p. 156-160.
Few-shot Dysarthric Speech Recognition with Text-to-Speech Data Augmentation (PDF)
Few-shot Dysarthric Speech Recognition ... (Abstract, screen reader ready) (PDF, 36 KB)
Ivashechkin, M.; Mendez, O.; Bowden, R. (2023). Denoising Diffusion for 3D Hand Pose Estimation from Images. In Proc. 11th Workshop on Assistive Computer Vision and Robotics. Int. Conf. on Computer Vision 2023.
Denoising Diffusion for 3D Hand Pose Estimation from Images (PDF)
Denoising Diffusion for 3D Hand Pose Estimation ... (Abstract, screen reader ready) (PDF, 31 KB)Denoising Diffusion for 3D Hand Pose Estimation ... (Abstract in International Sign) (MP4, 23 MB)
Jiang, Z., Göhring, A., Moryossef, A., Sennrich, R., and Ebling, S. (2024). SwissSLi: the Multi-parallel Sign Language Corpus for Switzerland. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 15448–15456, Torino, Italia. ELRA and ICCL.
SwissSLi: the Multi-parallel Sign Language Corpus for Switzerland (PDF)
SwissSLi ... (Abstract, screen reader ready) (PDF, 35 KB)
Jiang, Z.; Moryossef, A.; Müller, M.; Ebling, S. (2023). Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting. In Findings of the Association for Computational Linguistics: EACL 2023, p. 1706-1724.
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting (PDF)
Machine Translation between Spoken Languages and Signed Languages ... (Abstract, screen reader ready) (PDF, 52 KB)Machine Translation between Spoken Languages and Signed Languages ... (Abstract in International Sign) (MP4, 28 MB)
Lakhal, M.I ; Bowden, R. (2024). Diversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder. IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG).
Diversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder (PDF)
Mascarell, L., Chalumattu, R., and Rios, A. (2024). German Also Hallucinates! Inconsistency Detection in News Summaries with the Absinth Dataset. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7696–7706, Torino, Italia. ELRA and ICCL.
German Also Hallucinates! Inconsistency Detection in News Summaries with the Absinth Dataset (PDF)
German also Hallucinates! ... (HTML)
Moryossef, A., Müller, M., Göhring, A., Jiang, Z., Goldberg, Y., and Ebling, S. (2023). An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation. ArXiv.org 2305.17714, University of Zurich.
An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation (PDF)
An Open-Source Gloss-Based Baseline ... (Abstract, screen reader ready) (PDF, 50 KB)
Moryossef, A.; Jiang, Z.; Müller, M.; Ebling, S.; and Goldberg, Y. (2023). Linguistically Motivated Sign Language Segmentation. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 12703–12724, Singapore.
Linguistically Motivated Sign Language Segmentation.Linguistically Motivated Sign Language Segmentation. (Abstract, screen reader ready) (PDF, 59 KB)
Müller, M.; Alikhani, M.; Avramidis, E.; Bowden, R.; Braffort, A.; Camgöz, N. C.; Ebling, S.; España-Bonet, C.; Göhring, A.; Grundkiewicz, R.; Inan, M.; Jiang, Z.; Koller, O.; Moryossef, A.; Rios, A.; Shterionov, D.; Sidler-Miserez, S.; Tissi, K.; and Van Landuyt, D. (2023). Findings of the WMT 2023 Shared Task on Sign Language Translation. In Proceedings of the Eighth Conference on Machine Translation.
Findings of the WMT 2023 Shared Task on Sign Language Translation (PDF)
Findings of the WMT 2023 Shared Task ... (Abstract, screen reader ready) (PDF, 53 KB)
Müller, M.; Ebling, S.; Avramidis, E.; Battisti, A.; Berger, M.; Bowden, R.; Braffort, A.; Camgöz, N. C.; España-Bonet, C.; Grundkiewicz, R.; Jiang, Z.; Koller, O.; Moryossef, A.; Perrollaz, R.; Reinhard, S.; Rios, A.; Shterionov, D.; Sidler-Miserez, S.; Tissi, K.; and Van Landuyt, D. (2022). Findings of the WMT 2022 Shared Task on Sign Language Translation. In Proceedings of the Seventh Conference on Machine Translation, p. 744–772.
Findings of the WMT 2022 Shared Task on Sign Language Translation (PDF).
Findings of the WMT 2022 Shared Task ... (Abstract, screen reader ready) (PDF, 45 KB)
Müller, M.; Jiang, Z.; Moryossef, A.; Rios, A.; and Ebling, S. (2023). Considerations for meaningful sign language machine translation based on glosses. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL). Outstanding Paper Award.
Considerations for meaningful sign language machine translation based on glosses (PDF)
Considerations for meaningful sign language machine translation ... (Abstract, screen reader ready) (PDF, 36 KB)
Pelykh, A., Sincan, O.M. and Bowden, R., (2024). Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation. IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG).
Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation (PDF)
Säuberli, A.; Hansen-Schirra, S.; Holzknecht, F.; Gutermuth, S.; Deilen, S.; Schiffl, L.; and Ebling, S. (2023). Enabling text comprehensibility assessment for people with intellectual disabilities using a mobile application. In Frontiers in Communication, 8.
Enabling text comprehensibility assessment for people with intellectual disabilities using a mobile application (online)
Enabling text comprehensibility assessment ... (Abstract, screen reader ready) (PDF, 44 KB)
Studie über Verständnis-Tests mit einer App (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 73 KB)
Säuberli, A.; Holzknecht, F.; Haller, P.; Deilen, S.; Schiffl, L.; Hansen-Schirra, S.; Ebling, S.(2024). Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities.In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI'24).
Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities (online)
Digital Comprehensibility Assessment of Simplified Texts ... (Abstract, screen reader ready) (PDF, 33 KB)Studie zur Verständlichkeit von vereinfachten Texten (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 144 KB)
Säuberli A. and Clematide, S. 2024. Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Models. In Proceedings of the 3rd Workshop on Tools and Resources for People with REAding DIfficulties (READI) @ LREC-COLING 2024, pages 22–37, Torino, Italia. ELRA and ICCL.
Automatic Generation and Evaluation of Reading Comprehension. Test Items with Large Language Models (PDF)Automatic Generation and Evaluation of Reading Comprehension (Abstract, sceen reader ready) (PDF, 42 KB)
Studie zur Qualität von automatisch erstellten Leseverständnis-Fragen (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 32 KB)
Sincan, O.M.; Camgoz, N.C.; Bowden, R. (2023). Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse. In Proc. 11th Workshop on Assistive Computer Vision and Robotics. Int. Conf. on Computer Vision 2023.
Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse (PDF)
Is context all you need? ... (Abstract, screen reader ready) (PDF, 38 KB)
Sincan, O.M., Camgoz, N.C. and Bowden, R., (2024). Using an LLM to Turn Sign Spottings into Spoken Language Sentences. arXiv preprint arXiv:2403.10434.
Using an LLM to Turn Sign Spottings into Spoken Language Sentences (PDF)
Vlasenko, B.; Vyas, S.; Magimai.-Doss, M. (2024). Comparing data-driven and handcrafted features for dimensional emotion recognition. ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Korea, Republic of, 2024, pp. 11841-11845.
Comparing data-driven and handcrafted features for dimensional emotion recognition (PDF)
Comparing data-driven and handcrafted features ... (Abstract, screen reader ready): (PDF, 37 KB)
Walsh, H., Saunders, Ben,. Bowden, R. (2024). Select and Reorder: A Novel Approach for Neural Sign Language Production. LREC-COLING 2024.
Select and Reorder: A Novel Approach for Neural Sign Language Production (PDF)
Walsh, H., Ravanshad, A., Rahmani, M., and Bowden, R. (2024) A Data-Driven Representation for Sign Language Production. In Proceedings of the 18th International Conference on Automatic Face and Gesture Recognition (FG 2024).
A Data-Driven Representation for Sign Language Production (PDF)
Walsh, H., Saunders, B., Bowden, R. (2024). Sign Stitching: A Novel Approach to Sign Language Production. British Machine Vision Conference (BMVC).
Sign Stitching: A Novel Approach to Sign Language Production (PDF)
Wong, R.; Camgoz, N.C.; Bowden, R. (2023). Learnt Contrastive Concept Embeddings for Sign Recognition. In Proc. 11th Workshop on Assistive Computer Vision and Robotics. Int. Conf. on Computer Vision 2023.
Learnt Contrastive Concept Embeddings for Sign Recognition (PDF)
Learnt Contrastive Concept Embeddings ... (Abstract, screen reader ready) (PDF, 34 KB)

Keynote talks

Developing assistive technologies through co-creation
Talk of our principal investigator Dr. Sarah Ebling at TEDxZurich 2023
Recording of the talk

Developing Sign Language Technologies for the Users: Insights from a NLP Perspective
Talk of our principal investigator Dr. Sarah Ebling at SLRTP 2022
Recordings of this presentation and of other keynote speakers

Flagship Inclusive Information and Communication Technologies (IICT)

Quicklinks und Sprachwechsel

Main navigation

Publications and outreach

Table of contents

Publications

Keynote talks

Further reading