Keisuke Sakaguchi

Contact Information

Allen Institute for Artificial Intelligence (AI2) Email: keisukes@allenai.org
2157 N Northlake Way, Suite 110 GitHub: https://github.com/keisks
Seattle, WA, 98103 https://keisuke-sakaguchi.github.io/

Professional Experience

Allen Institute for AI (AI2) Seattle, WA, USA
Research Scientist 08/2018 -- present
IBM T. J. Watson Research Center Yorktown Heights, NY, USA
Research Intern 05/2017 -- 08/2017
Educational Testing Service (ETS) Princeton, NJ, USA
Research Intern 05/2014 -- 08/2014
Nara Institute of Science and Technology (NAIST) Nara, Japan
JSPS Research Fellow (DC1) 04/2013 -- 08/2013
Microsoft Research Asia Beijing, China
Research Intern 08/2012 -- 11/2012
Yahoo Japan Corporation Tokyo, Japan
Research Intern 08/2011 -- 09/2011
IBM Japan Systems Engineering Co. Ltd. Chiba, Japan
IT Infrastructure Engineer 04/2008 -- 03/2011
RIKEN Brain Science Institute Saitama, Japan
Technical Assistant 12/2006 -- 03/2008

Education

Johns Hopkins University Baltimore, MD, USA
Ph.D. in Computer Science 08/2013 -- 08/2018
Advisor(s): Prof. Benjamin Van Durme, Matt Post
Nara Institute of Science and Technology (NAIST) Nara, Japan
M.E. in Computer and Information Science 04/2011 -- 03/2013
Advisor(s): Prof. Yuji Matsumoto, Mamoru Komachi
University of Essex Colchester, UK
M.A. in Psycholinguistics and Neurolinguistics (with distinction) 10/2005 -- 09/2006
Advisor(s): Prof. Harald Clahsen
Waseda University Tokyo, Japan
B.A. in Literature (major in Philosophy) 4/2001 -- 03/2005
Advisor(s): Marito Sato

Honors and Awards

AAAI Outstanding Paper (Single Best Paper) Award 2020
ACL Outstanding Paper Award 2017
NAIST Excellent Student Scholarship 2013
University of Essex: graduate with distinction in Psycho(&Neuro)linguistics 2006

Publications

  1. Twist Decoding: Diverse Generators Guide Each Other
    Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Hao Peng, Ximing Lu, Dragomir Radev, Yejin Choi, and Noah A. Smith
    arXiv 2022
  2. ELQA: A Corpus of Questions and Answers about the English Language
    Shabnam Behzad, Keisuke Sakaguchi, Nathan Schneider, and Amir Zeldes
    arXiv 2022
  3. Beam Decoding with Controlled Patience
    Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Dragomir Radev, Yejin Choi, and Noah A. Smith
    arXiv 2022
  4. Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand
    Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, and Noah A. Smith
    Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics Jul 2022
  5. Transparent Human Evaluation for Image Captioning
    Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, and Noah A. Smith
    Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics Jul 2022
  6. Interscript: A dataset for interactive learning of scripts through error feedback
    Niket Tandon, Aman Madaan, Peter Clark, Keisuke Sakaguchi, and Yiming Yang
    The AAAI-22 Workshop on Interactive Machine Learning 2022
  7. Improving Neural Model Performance through Natural Language Feedback on Their Explanations
    Aman Madaan, Niket Tandon, Dheeraj Rajagopal, Yiming Yang, Peter Clark, Keisuke Sakaguchi, and Eduard H. Hovy
    arXiv 2021
  8. GrammarTagger: A Multilingual, Minimally-Supervised Grammar Profiler for Language Education
    Masato Hagiwara, Joshua Tanner, and Keisuke Sakaguchi
    arXiv 2021
  9. proScript: Partially Ordered Scripts Generation
    Keisuke Sakaguchi, Chandra Bhagavatula, Ronan Le Bras, Niket Tandon, Peter Clark, and Yejin Choi
    Findings of the Association for Computational Linguistics: EMNLP 2021 Nov 2021
  10. WinoGrande: An Adversarial Winograd Schema Challenge at Scale
    Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi
    Commun. ACM Aug 2021
  11. COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs
    Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, and Yejin Choi
    Proceedings of the AAAI Conference on Artificial Intelligence May 2021
  12. A Dataset for Tracking Entities in Open Domain Procedural Text
    Niket Tandon, Keisuke Sakaguchi, Bhavana Dalvi, Dheeraj Rajagopal, Peter Clark, Michal Guerquin, Kyle Richardson, and Eduard Hovy
    Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Nov 2020
  13. Uncertain Natural Language Inference
    Tongfei Chen, Zhengping Jiang, Adam Poliak, Keisuke Sakaguchi, and Benjamin Van Durme
    Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Jul 2020
  14. The Universal Decompositional Semantics Dataset and Decomp Toolkit
    Aaron Steven White, Elias Stengel-Eskin, Siddharth Vashishtha, Venkata Subrahmanyan Govindarajan, Dee Ann Reisinger, Tim Vieira, Keisuke Sakaguchi, Sheng Zhang, Francis Ferraro, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme
    Proceedings of the 12th Language Resources and Evaluation Conference May 2020
  15. Abductive Commonsense Reasoning
    Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Wen-tau Yih, and Yejin Choi
    International Conference on Learning Representations 2020
  16. WinoGrande: An Adversarial Winograd Schema Challenge at Scale
    Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi
    Proceedings of the AAAI Conference on Artificial Intelligence Apr 2020
    :trophy: Outstanding Paper Award (Single Best Paper)
  17. WIQA: A dataset for “What if...” reasoning over procedural text
    Niket Tandon, Bhavana Dalvi, Keisuke Sakaguchi, Peter Clark, and Antoine Bosselut
    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) Nov 2019
  18. Efficient Online Scalar Annotation with Bounded Support
    Keisuke Sakaguchi, and Benjamin Van Durme
    Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Jul 2018
  19. Grammatical Error Correction with Neural Reinforcement Learning
    Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme
    Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers) Nov 2017
  20. GEC into the future: Where are we going and how do we get there?
    Keisuke Sakaguchi, Courtney Napoles, and Joel Tetreault
    Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications Sep 2017
  21. Error-repair Dependency Parsing for Ungrammatical Texts
    Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme
    Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Jul 2017
    :trophy: Outstanding Paper Award (1.5% of the submissions)
  22. JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction
    Courtney Napoles, Keisuke Sakaguchi, and Joel Tetreault
    Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers Apr 2017
  23. Robsut Wrod Reocginiton via Semi-Character Recurrent Neural Network
    Keisuke Sakaguchi, Kevin Duh, Matt Post, and Benjamin Van Durme
    Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence 2017
  24. Universal Decompositional Semantics on Universal Dependencies
    Aaron Steven White, Drew Reisinger, Keisuke Sakaguchi, Tim Vieira, Sheng Zhang, Rachel Rudinger, Kyle Rawlins, and Benjamin Van Durme
    Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing Nov 2016
  25. There’s No Comparison: Reference-less Evaluation Metrics in Grammatical Error Correction
    Courtney Napoles, Keisuke Sakaguchi, and Joel Tetreault
    Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing Nov 2016
  26. Phrase Structure Annotation and Parsing for Learner English
    Ryo Nagata, and Keisuke Sakaguchi
    Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Aug 2016
  27. Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality
    Keisuke Sakaguchi, Courtney Napoles, Matt Post, and Joel Tetreault
    Transactions of the Association for Computational Linguistics 2016
  28. GLEU Without Tuning
    Courtney Napoles, Keisuke Sakaguchi, Matt Post, and Joel R. Tetreault
    arXiv 2016
  29. Ground Truth for Grammatical Error Correction Metrics
    Courtney Napoles, Keisuke Sakaguchi, Matt Post, and Joel Tetreault
    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) Jul 2015
  30. Effective Feature Integration for Automated Short Answer Scoring
    Keisuke Sakaguchi, Michael Heilman, and Nitin Madnani
    Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies May 2015
  31. Efficient Elicitation of Annotations for Human Evaluation of Machine Translation
    Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme
    Proceedings of the Ninth Workshop on Statistical Machine Translation Jun 2014
  32. Discriminative Approach to Fill-in-the-Blank Quiz Generation for Language Learners
    Keisuke Sakaguchi, Yuki Arase, and Mamoru Komachi
    Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Aug 2013
  33. NAIST at 2013 CoNLL Grammatical Error Correction Shared Task
    Ippei Yoshimoto, Tomoya Kose, Kensuke Mitsuzawa, Keisuke Sakaguchi, Tomoya Mizumoto, Yuta Hayashibe, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of the Seventeenth Conference on Computational Natural Language Learning: Shared Task Aug 2013
  34. NAIST at the NLI 2013 Shared Task
    Tomoya Mizumoto, Yuta Hayashibe, Keisuke Sakaguchi, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of the Eighth Workshop on Innovative Use of NLP for Building Educational Applications Jun 2013
  35. Construction of English MWE Dictionary and its Application to POS Tagging
    Yutaro Shigeto, Ai Azuma, Sorami Hisamoto, Shuhei Kondo, Tomoya Kose, Keisuke Sakaguchi, Akifumi Yoshimoto, Frances Yung, and Yuji Matsumoto
    Proceedings of the 9th Workshop on Multiword Expressions Jun 2013
  36. Joint English Spelling Error Correction and POS Tagging for Language Learners Writing
    Keisuke Sakaguchi, Tomoya Mizumoto, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of COLING 2012 Dec 2012
  37. NAIST at the HOO 2012 Shared Task
    Keisuke Sakaguchi, Yuta Hayashibe, Shuhei Kondo, Lis Kanashiro, Tomoya Mizumoto, Mamoru Komachi, and Yuji Matsumoto
    Proceedings of the Seventh Workshop on Building Educational Applications Using NLP Jun 2012