Skip Thought Generative Adversarial Networks @ NAACL-SRW 2019

arch

Abstract

GANs have been shown to perform exceedingly well on tasks pertaining to image generation and style transfer. In the field of language modelling, word embeddings such as GLoVe and word2vec are state-of-the-art methods for applying neural network models on textual data. Attempts have been made to utilize GANs with word embeddings for text generation. We present an approach to text generation using Skip-Thought sentence embeddings with GANs based on gradient penalty functions and f-measures. The proposed architecture aims to reproduce writing style in the generated text by modelling the way of expression at a sentence level across all works of an author. We ran extensive experiments in different embedding settings on a variety of tasks including conditional text generation and language generation. Our model outperforms baseline text generation networks across several automated evaluation metrics like BLEU-n, METEOR and ROUGE. We also demonstrate wide applicability and effectiveness in real life tasks through human judgement scores.

Overview

poster
Download Poster

If you found this work to be useful, please cite it as:

@inproceedings{ahamad-2019-generating,
title = "Generating Text through Adversarial Training Using Skip-Thought Vectors",
author = "Ahamad, Afroz",
booktitle = "Proceedings of the 2019 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Student Research Workshop",
month = jun,
year = "2019",
address = "Minneapolis, Minnesota",
publisher = "Association for Computational Linguistics",
url = "https://www.aclweb.org/anthology/N19-3008",
doi = "10.18653/v1/N19-3008",
pages = "53--60",
}

ACL Anthology: Generating Text through Adversarial Training using Skip-Thought Vectors