Text Classification in PyTorch

Minimal implementations of text classification models in PyTorch.

• Word-level Convolutional Neural Networks (Kim 2014)
• Character-level Convolutional Neural Networks (Zhang et al 2015)
• Very Deep Convolutional Networks (VDCNNs; Conneau et al 2017)
• Recurrent Neural Networks with attention
• Hierarchical Attention Networks (HANs; Yang et al 2016)

References

Alexis Conneau, Holger Schwenk, Loïc Barrault, Yann Lecun. 2017. Very Deep Convolutional Networks for Text Classification. arXiv:1606.01781.

Bjarke Felbo, Alan Mislove, Anders Søgaard, Iyad Rahwan, Sune Lehmann. 2017. Using Millions of Emoji Occurrences to Learn Any-domain Representations for Detecting Sentiment, Emotion and Sarcasm. https://arxiv.org/abs/1708.00524.

Linyuan Gong, Ruyi Ji. 2018. What Does a TextCNN Learn? arXiv:1801.06287.

Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. arXiv:1408.5882.

Siwei Lai, Liheng Xu, Kang Liu, Jun Zhao. 2015. Recurrent Convolutional Neural Networks for Text Classification. In Proceedings of the 29th AAAI Conference on Artificial Intelligence.

Hoa T. Le, Christophe Cerisara, Alexandre Denis. 2017. Do Convolutional Networks need to be Deep for Text Classification? arXiv:1707.04108.

Shuming Ma, Xu Sun, Junyang Lin, Xuancheng Ren. 2018. A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification. In IJCAI.

Hao Peng, Jianxin Li, Yu He, Yaopeng Liu, Mengjiao Bao, Lihong Wang, Yangqiu Song, Qiang Yang. 2018. Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN. In Proceedings of the International World Wide Web Conference Committee (IW3C2).

Yunlun Yang, Yunhai Tong, Shulei Ma, Zhi-Hong Deng. 2016. A Position Encoding Convolutional Neural Network Based on Dependency Tree for Relation Classification. In EMNLP.

Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy. 2016. Hierarchical Attention Networks for Document Classification. In Proceedings of NAACL-HLT 2016.

Wenpeng Yin, Katharina Kann, Mo Yu, Hinrich Schütze. 2017. Comparative Study of CNN and RNN for Natural Language Processing. arXiv:1702.01923.

Zenan Zhai, Dat Quoc Nguyen, Karin Verspoor. 2018. Comparing CNN and LSTM character-level embeddings in BiLSTM-CRF models for chemical and disease named entity recognition. In Proceedings of the 9th International Workshop on Health Text Mining and Information Analysis (LOUHI).

Ye Zhang, Byron Wallace. 2016. A Sensitivity Analysis of (and Practitioners' Guide to) Convolutional Neural Networks for Sentence Classification. arXiv:1510.03820.

Xiang Zhang, Junbo Zhao, Yann LeCun. 2015. Character-level Convolutional Networks for Text Classification. arXiv:1509.01626.