Keisuke Sakaguchi

Contact Information

Tohoku University
6-6-05 Aramaki Aza Aoba, Aoba-ku, Sendai
Miyagi, 980-8579, Japan
URL: https://keisuke-sakaguchi.github.io
Email: keisuke.sakaguchi@tohoku.ac.jp
GitHub: https://github.com/keisks

Professional Experience

RIKEN Center for Advanced Intelligence Project Tokyo, Japan
Visiting Researcher 09/2022 -- present
Tohoku University Miyagi, Japan
Associate Professor 07/2022 -- present
Allen Institute for AI (AI2) Seattle, WA, USA
Research Scientist 08/2018 -- 06/2022
IBM T. J. Watson Research Center Yorktown Heights, NY, USA
Research Intern 05/2017 -- 08/2017
Educational Testing Service (ETS) Princeton, NJ, USA
Research Intern 05/2014 -- 08/2014
Nara Institute of Science and Technology (NAIST) Nara, Japan
JSPS Research Fellow (DC1) 04/2013 -- 08/2013
Microsoft Research Asia Beijing, China
Research Intern 08/2012 -- 11/2012
Yahoo Japan Corporation Tokyo, Japan
Research Intern 08/2011 -- 09/2011
IBM Japan Systems Engineering Co. Ltd. Chiba, Japan
IT Infrastructure Engineer 04/2008 -- 03/2011
RIKEN Brain Science Institute Saitama, Japan
Technical Assistant 12/2006 -- 03/2008

Education

Johns Hopkins University Baltimore, MD, USA
Ph.D. in Computer Science 08/2013 -- 08/2018
Advisor(s): Prof. Benjamin Van Durme, Matt Post
Nara Institute of Science and Technology (NAIST) Nara, Japan
M.E. in Computer and Information Science 04/2011 -- 03/2013
Advisor(s): Prof. Yuji Matsumoto, Mamoru Komachi
University of Essex Colchester, UK
M.A. in Psycholinguistics and Neurolinguistics (with distinction) 10/2005 -- 09/2006
Advisor(s): Prof. Harald Clahsen
Waseda University Tokyo, Japan
B.A. in Literature (major in Philosophy) 4/2001 -- 03/2005
Advisor(s): Marito Sato

Honors and Awards

AAAI Outstanding Paper (Single Best Paper) Award 2020
ACL Outstanding Paper Award 2017
NAIST Excellent Student Scholarship 2013
University of Essex: graduate with distinction in Psycho(&Neuro)linguistics 2006

Professional activities

Area Chair:

EACL 2023 (area: Language Resource and Evaluation), EMNLP 2022 (area: NLP Applications), StarSEM 2022 (area: Commonsense reasoning and natural language understanding)

Reviewer (Journals):

Transactions of the Association for Computational Linguistics (TACL) 2019,2021. Computational Linguistics 2018.

Reviewer (Conferences):

ACL Rolling Review (ARR) 2021, 2022. Annual Meeting of the Association for Computational Linguistics (ACL) 2018, 2019, 2020, 2021. Annual Meeting of the North American Chapter of the ACL (NAACL) 2018, 2019, 2021, 2022. Conference on Empirical Methods on Natural Language Processing (EMNLP) 2015, 2016, 2017, 2018, 2019, 2020, 2021. AAAI Conference on Artificial Intelligence 2020, 2021. International Joint Conferences on Artificial Intelligence (IJCAI) 2019, 2020, 2021. Conference on Computational Natural Language Learning (CoNLL) 2019, 2020. Conference of the European Chapter of the Association for Computational Linguistics (EACL) 2021, Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) 2020. International Joint Conference on Natural Language Processin (IJCNLP) 2017. International Conference on Computational Linguistics (COLING) 2014, 2016, 2018, 2020. International Conference on Spoken Language Translation (IWSLT) 2020.

Reviewer (Workshops):

Methods for Optimizing and Evaluating Neural Language Generation (NeuralGen) 2019. Workshop on Innovative Use of NLP for Building Educational Applications (BEA) 2014, 2015, 2016, 2017, 2019, 2020. Workshop on Noisy User-generated Text (W-NUT) 2018, 2019 2020.


Invited Talks

Large Language Models: What will happen next? 10/25/2022
2022 BrainLink X-Lab Day, Korean Federation of Science and Technology Societies (KOFST), South Korea
Large Language Models: What will happen next? 09/27/2022
AIST AI Research Center, Japan
Large Language Models: What will happen next? 08/23/2022
University of Tokyo, Matsuo-Lab., Japan
Robust Text Correction for Grammar and Fluency 09/27/2018
Microsoft Research, Redmond, WA
Robust Text Correction for Grammar and Fluency 03/30/2018
Allen Institute for Artificial Intelligence, Seattle, WA
Grammatical Error Correction with Neural Reinforcement Learning 02/22/2018
Grammarly Research, Online
Robust Text Correction for Grammar and Fluency 02/09/2018
Amazon Research, Boston, MA
Robust Natural Language Processing 12/14/2017
Chiba Institute of Technology, Software Technology and Artificial Intelligence Research Laboratory, Tokyo, Japan
Robust Natural Language Processing 12/12/2017
NTT Communication Science Laboratories, Kyoto, Japan
Robust Natural Language Processing 12/08/2017
Tohoku University, Inui-Okazaki Lab., Sendai, Japan
Robust Natural Language Processing 12/05/2017
Tokyo Metropolitan University, Natural Language Processing Group. Tokyo, Japan.
Evaluating SMT evaluation 11/27/2013
Rakuten Institute of Technology, NY

Publications

  1. RealTime QA: What’s the Answer Right Now?
    Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, Ronan Le Bras, Akari Asai, Xinyan Yu, Dragomir Radev, Noah A. Smith, Yejin Choi, and Kentaro Inui
    arXiv 2022
  2. Can Machines Learn Morality? The Delphi Experiment
    Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jenny Liang, Jesse Dodge, Keisuke Sakaguchi, Maxwell Forbes, Jon Borchardt, Saadia Gabriel, Yulia Tsvetkov, Oren Etzioni, Maarten Sap, Regina Rini, and Yejin Choi
    arXiv 2022
  3. Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyond
    Masato Mita, Keisuke Sakaguchi, Masato Hagiwara, Tomoya Mizumoto, Jun Suzuki, and Kentaro Inui
    arXiv 2022
  4. Twist Decoding: Diverse Generators Guide Each Other
    Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Hao Peng, Ximing Lu, Dragomir Radev, Yejin Choi, and Noah A. Smith
    Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP) Dec 2022
  5. ELQA: A Corpus of Questions and Answers about the English Language
    Shabnam Behzad, Keisuke Sakaguchi, Nathan Schneider, and Amir Zeldes
    arXiv 2022
  6. Beam Decoding with Controlled Patience
    Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Dragomir Radev, Yejin Choi, and Noah A. Smith
    arXiv 2022
  7. Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand
    Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, and Noah A. Smith
    Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Jul 2022
  8. Transparent Human Evaluation for Image Captioning
    Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, and Noah A. Smith
    Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Jul 2022
  9. Interscript: A dataset for interactive learning of scripts through error feedback
    Niket Tandon, Aman Madaan, Peter Clark, Keisuke Sakaguchi, and Yiming Yang
    The AAAI-22 Workshop on Interactive Machine Learning 2022
  10. Improving Neural Model Performance through Natural Language Feedback on Their Explanations
    Aman Madaan, Niket Tandon, Dheeraj Rajagopal, Yiming Yang, Peter Clark, Keisuke Sakaguchi, and Eduard H. Hovy
    arXiv 2021
  11. GrammarTagger: A Multilingual, Minimally-Supervised Grammar Profiler for Language Education
    Masato Hagiwara, Joshua Tanner, and Keisuke Sakaguchi
    arXiv 2021
  12. proScript: Partially Ordered Scripts Generation
    Keisuke Sakaguchi, Chandra Bhagavatula, Ronan Le Bras, Niket Tandon, Peter Clark, and Yejin Choi
    Findings of the Association for Computational Linguistics: EMNLP 2021 Nov 2021
  13. WinoGrande: An Adversarial Winograd Schema Challenge at Scale
    Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi
    Commun. ACM Aug 2021
  14. COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs
    Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, and Yejin Choi
    Proceedings of the AAAI Conference on Artificial Intelligence May 2021
  15. A Dataset for Tracking Entities in Open Domain Procedural Text
    Niket Tandon, Keisuke Sakaguchi, Bhavana Dalvi, Dheeraj Rajagopal, Peter Clark, Michal Guerquin, Kyle Richardson, and Eduard Hovy
    Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Nov 2020
  16. Uncertain Natural Language Inference
    Tongfei Chen, Zhengping Jiang, Adam Poliak, Keisuke Sakaguchi, and Benjamin Van Durme
    Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Jul 2020
  17. The Universal Decompositional Semantics Dataset and Decomp Toolkit
    Aaron Steven White, Elias Stengel-Eskin, Siddharth Vashishtha, Venkata Subrahmanyan Govindarajan, Dee Ann Reisinger, Tim Vieira, Keisuke Sakaguchi, Sheng Zhang, Francis Ferraro, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme
    Proceedings of the 12th Language Resources and Evaluation Conference May 2020
  18. Abductive Commonsense Reasoning
    Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Wen-tau Yih, and Yejin Choi
    International Conference on Learning Representations 2020
  19. WinoGrande: An Adversarial Winograd Schema Challenge at Scale
    Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi
    Proceedings of the AAAI Conference on Artificial Intelligence Apr 2020
    :trophy: Outstanding Paper Award (Single Best Paper)
  20. WIQA: A dataset for “What if...” reasoning over procedural text
    Niket Tandon, Bhavana Dalvi, Keisuke Sakaguchi, Peter Clark, and Antoine Bosselut
    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) Nov 2019
  21. Efficient Online Scalar Annotation with Bounded Support
    Keisuke Sakaguchi, and Benjamin Van Durme
    Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Jul 2018
  22. Grammatical Error Correction with Neural Reinforcement Learning
    Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme
    Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers) Nov 2017
  23. GEC into the future: Where are we going and how do we get there?
    Keisuke Sakaguchi, Courtney Napoles, and Joel Tetreault
    Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications Sep 2017
  24. Error-repair Dependency Parsing for Ungrammatical Texts
    Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme
    Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Jul 2017
    :trophy: Outstanding Paper Award (1.5% of the submissions)
  25. JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction
    Courtney Napoles, Keisuke Sakaguchi, and Joel Tetreault
    Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers Apr 2017
  26. Robsut Wrod Reocginiton via Semi-Character Recurrent Neural Network
    Keisuke Sakaguchi, Kevin Duh, Matt Post, and Benjamin Van Durme
    Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence 2017
  27. Universal Decompositional Semantics on Universal Dependencies
    Aaron Steven White, Drew Reisinger, Keisuke Sakaguchi, Tim Vieira, Sheng Zhang, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme
    Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing Nov 2016
  28. There’s No Comparison: Reference-less Evaluation Metrics in Grammatical Error Correction
    Courtney Napoles, Keisuke Sakaguchi, and Joel Tetreault
    Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing Nov 2016
  29. Phrase Structure Annotation and Parsing for Learner English
    Ryo Nagata, and Keisuke Sakaguchi
    Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Aug 2016
  30. Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality
    Keisuke Sakaguchi, Courtney Napoles, Matt Post, and Joel Tetreault
    Transactions of the Association for Computational Linguistics 2016
  31. GLEU Without Tuning
    Courtney Napoles, Keisuke Sakaguchi, Matt Post, and Joel R. Tetreault
    arXiv 2016
  32. Ground Truth for Grammatical Error Correction Metrics
    Courtney Napoles, Keisuke Sakaguchi, Matt Post, and Joel Tetreault
    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) Jul 2015
  33. Effective Feature Integration for Automated Short Answer Scoring
    Keisuke Sakaguchi, Michael Heilman, and Nitin Madnani
    Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies May 2015
  34. Efficient Elicitation of Annotations for Human Evaluation of Machine Translation
    Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme
    Proceedings of the Ninth Workshop on Statistical Machine Translation Jun 2014
  35. Discriminative Approach to Fill-in-the-Blank Quiz Generation for Language Learners
    Keisuke Sakaguchi, Yuki Arase, and Mamoru Komachi
    Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Aug 2013
  36. NAIST at 2013 CoNLL Grammatical Error Correction Shared Task
    Ippei Yoshimoto, Tomoya Kose, Kensuke Mitsuzawa, Keisuke Sakaguchi, Tomoya Mizumoto, Yuta Hayashibe, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of the Seventeenth Conference on Computational Natural Language Learning: Shared Task Aug 2013
  37. NAIST at the NLI 2013 Shared Task
    Tomoya Mizumoto, Yuta Hayashibe, Keisuke Sakaguchi, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of the Eighth Workshop on Innovative Use of NLP for Building Educational Applications Jun 2013
  38. Construction of English MWE Dictionary and its Application to POS Tagging
    Yutaro Shigeto, Ai Azuma, Sorami Hisamoto, Shuhei Kondo, Tomoya Kose, Keisuke Sakaguchi, Akifumi Yoshimoto, Frances Yung, and Yuji Matsumoto
    Proceedings of the 9th Workshop on Multiword Expressions Jun 2013
  39. Joint English Spelling Error Correction and POS Tagging for Language Learners Writing
    Keisuke Sakaguchi, Tomoya Mizumoto, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of COLING 2012 Dec 2012
  40. NAIST at the HOO 2012 Shared Task
    Keisuke Sakaguchi, Yuta Hayashibe, Shuhei Kondo, Lis Kanashiro, Tomoya Mizumoto, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of the Seventh Workshop on Building Educational Applications Using NLP Jun 2012