Prof Yvette Graham

Funded Investigator

Yvette Graham is an award-winning Natural Language Processing researcher working on topics such as Machine Translation, Dialogue Systems, Sentiment Analysis, Detection of Fake News and Emotion in Text and Dialogue-based Information Retrieval. Her work includes development of several widely adopted methods of evaluation, such as Direct Assessment, currently employed for deciding results of benchmark tasks at the Conference on Machine Translation (WMT), Trecvid and the annual Multilingual Surface Realisation workshop. Her work on evaluation of Machine Translation systems was awarded best paper award at ACL 2015.

Research Domains

Artificial Intelligence
Deep Learning
Emotion
Human Computer Interaction
Image and Video processing
Information Retrieval
Languages
Linguistics
Machine Learning
Machine Translation
Multimodal Interaction
Natural Language Processing
Personalisation
Sentiment Analysis

Publications

Graph-Based Video-Language Learning with Multi-Grained Audio-Visual Alignment

PUBLICATION:	MM 2023 - 31st ACM International Conference on Multimedia
AUTHOR(S):	Chenyang Lyu, Wenxi Li, Tianbo Ji, Longyue Wang, Liting Zhou, Cathal Gurrin, Linyi Yang, Yi Yu, Yvette Graham, Jennifer Foster
DATE:	27 October 2023
TYPE:	Conf papers

Extending the Scope of Out-of-Domain: Examining QA models in multiple subdomains

PUBLICATION:	ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics
AUTHOR(S):	Chenyang Lyu, Jennifer Foster, Yvette Graham
DATE:	23 May 2022
TYPE:	Conf papers

An Exploration into the Benefits of the CLIP Model for Lifelog Retrieval

PUBLICATION:	CBMI '22 - 19th International Conference on Content-based Multimedia Indexing
AUTHOR(S):	Ly-Duyen Tran, Naushad Alam, Yvette Graham, Linh Khanh Vo, Nghiem Tuong Diep, Binh Nguyen, Liting Zhou, Cathal Gurrin
DATE:	14 September 2022
TYPE:	Conf papers

QAScore - An Unsupervised Unreferenced Metric for the Question Generation Evaluation

PUBLICATION:	Publisher MDPI https://www.mdpi.com/1099-4300/24/11/1514
AUTHOR(S):	Tianbo Ji, Chenyang Lyu, Gareth Jones, Liting Zhou, Yvette Graham
DATE:	24 October 2022
TYPE:	Journal Articles

Semantic-aware Dynamic Retrospective-Prospective Reasoning for Event-level Video Question Answering

PUBLICATION:	ACL 2023 - 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
AUTHOR(S):	Chenyang Lyu, Tianbo Ji, Yvette Graham, and Jennifer Foster
DATE:	09 July 2023
TYPE:	Conf papers

Is a Video worth n x n Images? A Highly Efficient Approach to Transformer-based Video Question Answering

PUBLICATION:	SustaiNLP 2023 - 4th Workshop on Simple and Effication Natural Language Processing @ ACL 2023 - 61st Annual Meeting of the Association for Computational Linguistics
AUTHOR(S):	Chenyang Lyu, Tianbo Ji, Yvette Graham, and Jennifer Foster
DATE:	09 July 2023
TYPE:	Conf papers

Exploiting Rich Textual User-Product Context for Improving Personalised Sentiment Analysis

PUBLICATION:	ACL 2023 - 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
AUTHOR(S):	Chenyang Lyu, Linyi Yang, Yue Zhang, Yvette Graham, Jennifer Foster
DATE:	09 July 2023
TYPE:	Conf papers

Memento 3.0: An Enhanced Lifelog Search Engine for LSC '23

PUBLICATION:	LSC '23 - 6th Annual ACM Lifelog Search Challenge
AUTHOR(S):	Naushed Alam, Yvette Graham, Cathal Gurrin
DATE:	12 June 2023
TYPE:	Conf papers

Achieving Reliable Human Assessment of Open-Domain Dialogue Systems

PUBLICATION:	ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics
AUTHOR(S):	Tianbo Ji, Yvette Graham, Gareth Jones, Chenyang Lyu, Qun Liu
DATE:	01 May 2022
TYPE:	Conf papers

Findings of the 2021 Conference on Machine Translation (WMT21)

PUBLICATION:	WMT 2021 - 6th Conference on Machine Translation
AUTHOR(S):	Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondřej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussa, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin, Marcos Zampieri
DATE:	10 November 2021
TYPE:	Conf papers

Improving Unsupervised Question Answering via Summarization-Informed Question Generation

PUBLICATION:	EMNLP 2021- Conference on Empirical Methods in Natural Language Processing
AUTHOR(S):	Chenyang Lyu, Lifeng Shang, Yvette Graham, Jennifer Foster Xin Jiang, Qun Liu
DATE:	07 November 2021
TYPE:	Conf papers

TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domains

PUBLICATION:	TRECVID 2020 Workshop
AUTHOR(S):	George Awad, Asad Butt, Keith Curtis, Jonathan Fiscus, Afzal Godil, Yooyoung Lee, Andrew Delgado, Jesse Zhang, Eliot Godard, Baptiste Chocot, Lukas Diduch, Jeffrey Liu, Alan F Smeaton, Yvette Graham, Gareth JF Jones, Wessel Kraaij, Georges Quenot
DATE:	27 April 2021
TYPE:	Conf papers

Proceedings of the First Workshop on Human Evaluation of NLP Systems (HumEval) @EACL’21

PUBLICATION:	EACL 2021 - Human Evaluation of NLP Systems (HumEval)
AUTHOR(S):	Anya Belz, Shubham Agarwal, Yvette Graham, Ehud Reiter, Anastasia Shimorina (Editors)
DATE:	19 April 2021
TYPE:	Edited Conf prcdgs

Human Evaluation of NLP Systems, HumEval 2021 - Proceedings of the Workshop, as part of the 16th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2021

PUBLICATION:	EACL 2021 - Human Evaluation of NLP Systems (HumEval)
AUTHOR(S):	Anya Belz, Shubham Agarwal, Yvette Graham, Ehud Reiter, Anastasia Shimorina (Editors)
DATE:	19 April 2021
TYPE:	Edited Conf prcdgs

Proceedings of the 13th International Conference on Natural Language Generation

PUBLICATION:	INLG 2020 - 13th International Conference on Natural Language Generation
AUTHOR(S):	Brian Davis, Yvette Graham, John Kelleher, Yaji Sripada
DATE:	15 December 2020
TYPE:	Edited Conf prcdgs

Improving Document-Level Sentiment Analysis with User and Product Context

PUBLICATION:	COLING 2020 - 28th International Conference on Computational Linguistics
AUTHOR(S):	Chenyang Lyu, Jennifer Foster, Yvette Graham
DATE:	08 December 2020
TYPE:	Conf papers

Statistical Power and Translationese in Machine Translation Evaluation

PUBLICATION:	EMNLP 2020 - Conference on Empirical Methods in Natural Language Processing
AUTHOR(S):	Yvette Graham, Barry Haddow, Philipp Koehn
DATE:	16 November 2020
TYPE:	Conf papers

Assessing Human-Parity in Machine Translation on the Segment Level

PUBLICATION:	EMNLP 2020 - Conference on Empirical Methods in Natural Language Processing
AUTHOR(S):	Yvette Graham, Christian Federmann, Maria Eskevich, Barry Haddow
DATE:	16 November 2020
TYPE:	Conf papers

Incorporating Context and Knowledge for Better Sentiment Analysis of Narrative Text

PUBLICATION:	Text2Story 2020 - 3rd International Workshop on Narrative Extraction from Texts, held in conjunction with ECIR 2020 - 42nd European Conference on Information Retrieval
AUTHOR(S):	Chenyang Lyu, Tianbo Ji, Yvette Graham
DATE:	14 April 2020
TYPE:	Conf papers

Contrasting Human Opinion of Non-Factoid Question Answering with Automatic Evaluation

PUBLICATION:	CHIIR 2020 - 5th ACM Sigur Conference on Human Information Interaction and Retrieval
AUTHOR(S):	Tianbo Ji, Yvette Graham, Gareth Jones
DATE:	15 March 2020
TYPE:	Conf papers

The Second Multilingual Surface Realisation Shared Task ({SR}{'}19): Overview and Evaluation Results

PUBLICATION:	MSIR 2019 - 2nd Workshop on Multilingual Surface Realisation
AUTHOR(S):	Simon Mille, Anja Belz, Bernd Bohnet, Yvette Graham, Leo Wanner
DATE:	03 November 2019
TYPE:	Conf papers

Exploring the Impact of Training Data Bias on Automatic Generation of Video Captions.

PUBLICATION:	MMM 2019 - 25th International Conference on MultiMedia Modeling
AUTHOR(S):	Alan Smeaton, Yvette Graham, Kevin McGuinness, Noel O'Connor, Seán Quinn, Eric Arazo Sanchez
DATE:	08 January 2019
TYPE:	Conf papers

Evaluating the Contribution of Images to Multimodal Machine Translation

PUBLICATION:	Wiml, NIPS 2018-Thirty-second Conference on Neural Information Processing Systems
AUTHOR(S):	Koel Dutta Chowdhury, Yvette Graham
DATE:	03 December 2018
TYPE:	Conf papers

Findings of the 2018 Conference on Machine Translation (WMT18).

PUBLICATION:	WMT 2018 - 3rd Conference on Machine Translation
AUTHOR(S):	Ondřej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Christof Monz
DATE:	31 October 2018
TYPE:	Conf papers

Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance.

PUBLICATION:	WMT 2018 - 3rd Conference on Machine Translation
AUTHOR(S):	Qingsong Ma, Ondřej Bojar, Yvette Graham.
DATE:	31 October 2018
TYPE:	Conf papers

Evaluation of automatic video captioning using direct assessment.

PUBLICATION:	PLOS ONE
AUTHOR(S):	Yvette Graham, George Awad, Alan Smeaton
DATE:	04 September 2018
TYPE:	Journal Articles

The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results

PUBLICATION:	ACL 2018 - First Multilingual Surface Realisation Shared Task (SR’18)
AUTHOR(S):	Simon Mille, Anja Belz, Bernd Bohnet, Yvette Graham, Emily Pitler, Leo Wanner
DATE:	19 July 2018
TYPE:	Conf papers

Translating Pro-Drop Languages with Reconstruction Models

PUBLICATION:	AAAI 2018 - Thirty-Second AAAI Conference on Artificial Intelligence
AUTHOR(S):	Longyue Wang, Zhaopeng Tu, Shuming Shi, Tong Zhang, Yvette Graham, Qun Liu
DATE:	09 February 2018
TYPE:	Conf papers

TRECVID 2017: Evaluating Ad-hoc and Instance Video Search, Events Detection, Video Captioning and Hyperlinking

PUBLICATION:	TRECVid 2017 - TREC VIDEO RETRIEVAL EVALUATION
AUTHOR(S):	G. Awad, A. Butt, J. Fiscus, D. Joy, A. Delgado, M. Michel, A.F. Smeaton, Yvette Graham, G.J.F. Jones, W. Kraaij, G. Quénot, M. Eskevich, R. Ordelman, B.Huet
DATE:	30 November 2017
TYPE:	Conf papers

Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation

PUBLICATION:	EMNLP 2017 - 2017 Conference on Empirical Methods in Natural Language Processing
AUTHOR(S):	Qingsong Ma, Yvette Graham, Timothy Baldwin, Qun Liu
DATE:	07 September 2017
TYPE:	Conf papers

Blend: a Novel Combined MT Metric Based on Direct Assessment

PUBLICATION:	WMT 2017 - Second Conference on Machine Translation
AUTHOR(S):	Qingsong Ma, Yvette Graham, Shugen Wang, Qun Liu
DATE:	07 September 2017
TYPE:	Conf papers

Findings of the 2017 Conference on Machine Translation

PUBLICATION:	WMT 2017 - 2nd Conference on Machine Translation
AUTHOR(S):	Ondrej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Raphael Rubino, Lucia Specia, Marco Turchi
DATE:	07 September 2017
TYPE:	Conf papers

Results of the WMT17 Metrics Shared Task

PUBLICATION:	WMT 2017 - 2nd Conference on Machine Translation
AUTHOR(S):	Ondrej Bojar, Yvette Graham, Amir Kamran
DATE:	07 September 2017
TYPE:	Conf papers

Improving Evaluation of Document-level Machine Translation Quality Estimation

PUBLICATION:	EACL 2017 - 15th Conference of the European Chapter of the Association for Computational Linguistics
AUTHOR(S):	Yvette Graham, Qingsong Ma, Timothy Baldwin, Qun Liu, Carla Parra Escartin, Carolina Scarton
DATE:	04 April 2017
TYPE:	Conf papers

Is all that Glitters in Machine Translation Quality Estimation really Gold?

PUBLICATION:	COLING 2016, the 26th International Conference on Computational Linguistics
AUTHOR(S):	Yvette Graham, Timothy Baldwin, Meghan Dowling, Maria Eskevich, Teresa Lynn, Lamia Tounsi
DATE:	11 December 2016
TYPE:	Conf papers

MaxSD: A Neural Machine Translation Evaluation Metric Optimized by Maximizing Similarity Distance

PUBLICATION:	ICCPOL 2016 - 5th CCF Conference on Natural Language Processing and Chinese Computing (NLPCC 2016) and 24th International Conference on Computer Processing of Oriental Languages
AUTHOR(S):	Qingsong Ma, Fandong Meng, Daqi Zheng, Mingxuan Wang, Yvette Graham, Wenbin Jiang, Qun Liu
DATE:	02 December 2016
TYPE:	Conf papers

Measuring Performance in Machine Translation Quality Estimation

PUBLICATION:	AICS 2016 - 24th Irish Conference on Artificial Intelligence and Cognitive Science (AICS NECTAR Track)
AUTHOR(S):	Yvette Graham
DATE:	20 September 2016
TYPE:	Conf papers

Results of WMT16 Metrics Shared Task

PUBLICATION:	WMT 2016 - 1st Conference on Machine Translation
AUTHOR(S):	Ondřej Bojar, Yvette Graham, Amir Kamran, Miloš Stanojević
DATE:	11 August 2016
TYPE:	Conf papers

Findings of the 2016 Conference on Machine Translation

PUBLICATION:	WMT 2016 - 1st Conference on Machine Translation
AUTHOR(S):	Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, Marcos Zampieri
DATE:	11 August 2016
TYPE:	Conf papers

Tapadóir: English to Irish Machine Translation with Automatic Post-Editing

PUBLICATION:	Celtic Language Technology Workshop
AUTHOR(S):	Meghan Dowling, Teresa Lynn, Yvette Graham, John Judge
DATE:	04 July 2016
TYPE:	Conf papers

English to Irish Machine Translation with Automatic Post-Editing

PUBLICATION:	CLTW 2016 - Second Celtic Language Technology Workshop 2016
AUTHOR(S):	Meghan Dowling, Teresa Lynn, Yvette Graham, John Judge
DATE:	04 July 2016
TYPE:	Conf papers

Achieving Accurate Conclusions in Evaluation of Automatic Machine Translation Metrics

PUBLICATION:	NAACL-HLT 2016 - The 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
AUTHOR(S):	Yvette Graham, Qun Liu
DATE:	12 June 2016
TYPE:	Conf papers

Can machine translation systems be evaluated by the crowd alone

PUBLICATION:	Natural Language Engineering
AUTHOR(S):	Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel
DATE:	01 January 2016
TYPE:	Journal Articles

Improving Evaluation of Machine Translation Quality Estimation

PUBLICATION:	ACL 2015 - 53rd Annual Meeting of the Association of Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJNLP)
AUTHOR(S):	Yvette Graham
DATE:	25 July 2015
TYPE:	Conf papers

Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE

PUBLICATION:	EMNLP 2015 - 10th Workshop on Statistical Machine Translation
AUTHOR(S):	Yvette Graham
DATE:	01 July 2015
TYPE:	Conf papers

Accurate Evaluation of Segment-level Machine Translation Metrics

PUBLICATION:	NAACL HLT 2015 - Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies
AUTHOR(S):	Yvette Graham, Timothy Baldwin, Nitika Mathur
DATE:	31 May 2015
TYPE:	Conf papers

Prof Yvette Graham

Funded Investigator

Social Links

Other Academic Links

Publications