Grounded Conversation Generation As Guided Traverses In Commonsense Knowledge Graphs | Awesome LLM Papers Contribute to Awesome LLM Papers

Awesome LLM Papers

A curated collection of research papers on Large Language Models (LLMs), transformers, prompting, fine-tuning, and multi-modal systems. Maintained by Sean Moran.

Contact Sean Moran about this survey or website. Made with Jekyll and Hyde.

Grounded Conversation Generation As Guided Traverses In Commonsense Knowledge Graphs

Houyu Zhang, Zhenghao Liu, Chenyan Xiong, Zhiyuan Liu . Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics 2020 – 123 citations

[Code] [Paper]   Search on Google Scholar   Search on Semantic Scholar
ACL Has Code Model Architecture

Human conversations naturally evolve around related concepts and scatter to multi-hop concepts. This paper presents a new conversation generation model, ConceptFlow, which leverages commonsense knowledge graphs to explicitly model conversation flows. By grounding conversations to the concept space, ConceptFlow represents the potential conversation flow as traverses in the concept space along commonsense relations. The traverse is guided by graph attentions in the concept graph, moving towards more meaningful directions in the concept space, in order to generate more semantic and informative responses. Experiments on Reddit conversations demonstrate ConceptFlow’s effectiveness over previous knowledge-aware conversation models and GPT-2 based models while using 70% fewer parameters, confirming the advantage of explicit modeling conversation structures. All source codes of this work are available at https://github.com/thunlp/ConceptFlow.

Similar Work