Reading

Table of Contents

• Natural Language Processing
• Part-of-speech Tagging.
• Named Entity Recognition.
• Dependency Parsing.
• Semantic Role Labeling.
• Coreference Resolution.
• Abstract Meaning Representation.
• Machine Learning
• Gradient Descent.
• Neural Networks.
• Clustering.
• Distributional Semantics
• Word Embeddings.
• Applications
• Sentiment Analysis.

Natural Language Processing

Abstract Meaning Representation

• Generation that Exploits Corpus-based Statistical Knowledge, Langkilde and Knight, ACL, 1998.
• Abstract Meaning Representation for Sembanking, Banarescu et. al., LAW-IR, 2013.
• A Discriminative Graph-Based Parser for the Abstract Meaning Representation, Flanigan et. al., ACL, 2014.
• A Transition-based Algorithm for AMR Parsing, Wang et. al., NAACL, 2015.
• Boosting Transition-based AMR Parsing with Refined Actions and Auxiliary Analyzers, Wang et. al., ACL, 2015.
• Resources
• AMR guidelines.
• Tasks
• SemEval'16: Meaning Representation Parsing.

Machine Learning

Gradient Descent

• Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms, Collins, EMNLP, 2002.
• Solving Large Scale Linear Prediction Problems Using Stochastic Gradient Descent Algorithms, Zhang, ICML, 2004.
• Stochastic Gradient Descent Training for L1-regularized Log-linear Models with Cumulative Penalty, Tsuruoka et. al., ACL, 2009.
• Dual Averaging Methods for Regularized Stochastic Learning and Online Optimization, Xiao, JMLR, 2010.
• Adaptive Subgradient Methods for Online Learning and Stochastic Optimization, Duchi et. al., JMLR, 2012.
• AdaDelta: An Adaptive Learning Rate Method, Zeiler, arXiv:1212.5701, 2012.

Neural Networks

• The Backpropagation Algorithm, Chapter 7 of Neural Networks - A Systematic Introduction, Raul Rojas.
• Neural Networks and Deep Learning, Michael Nielsen.

Clustering

Applications

Sentiment Analysis

• Resources
• Affective Norms for English Words (ANEW).
• SenticNet.
• SentiWordNet.
• The General Inquirer.
• MPQA Subjectivity Lexicon.
• Opinion Mining, Sentiment Analysis and Opinion Spam Detection.
• Sentiment Symposium Tutorial.
• Tasks
• SemEval'14: Aspect Based Sentiment Analysis.
• SemEval'15: Sentiment Analysis in Twitter.