Tools

POS Tagging - Viterbi Decoding

Books and Textbooks

  1. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (3rd Edition)
    Daniel Jurafsky and James H. Martin
    Chapter 8: Part-of-Speech Tagging and Appendix A: Hidden Markov Models
    Online Draft | Stanford University Press

  2. Foundations of Statistical Natural Language Processing
    Christopher D. Manning and Hinrich Schütze
    Chapter 10: Part-of-Speech Tagging
    MIT Press, 1999 | Book Link

  3. Natural Language Processing with Python
    Steven Bird, Ewan Klein, and Edward Loper
    Chapter 5: Categorizing and Tagging Words
    O'Reilly Media, 2009 | Online Version

  4. Introduction to Information Retrieval
    Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze
    Chapter 13: Text Classification and Sequence Labeling
    Cambridge University Press, 2008

Research Papers and Articles

  1. "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition"
    Lawrence R. Rabiner
    Proceedings of the IEEE, Vol. 77, No. 2, 1989
    DOI: 10.1109/5.18626

  2. "Error-Driven Learning and Natural Language Processing: A General Framework"
    Eric Brill
    Computational Linguistics, Vol. 21, No. 4, 1995

  3. "Part-of-Speech Tagging Using a Variable Memory Markov Model"
    Hinrich Schütze and Yoram Singer
    Proceedings of ACL, 1994

Online Resources and Tutorials

  1. Stanford CS224N: Natural Language Processing with Deep Learning
    Lecture 6: Language Models and RNNs (includes HMM content)
    Course Materials

  2. MIT 6.034 Artificial Intelligence - Probabilistic Inference
    Hidden Markov Models and Viterbi Algorithm
    Video Lectures

  3. Wikipedia: Viterbi Algorithm
    Comprehensive mathematical explanation with examples
    https://en.wikipedia.org/wiki/Viterbi_algorithm

  4. Wikipedia: Part-of-Speech Tagging
    Overview of POS tagging methods and applications
    https://en.wikipedia.org/wiki/Part-of-speech_tagging

Video Lectures and MOOCs

  1. "Hidden Markov Models and the Viterbi Algorithm" - Dan Jurafsky (Stanford)
    YouTube Lecture Series

  2. "Natural Language Processing" - Coursera (University of Michigan)
    Week 3: Sequence Labeling and HMMs
    Course Link

  3. "CS188 Artificial Intelligence - HMMs and Particle Filtering" (UC Berkeley)
    YouTube Playlist

Programming Resources and Libraries

  1. NLTK Documentation: POS Tagging
    Python Natural Language Toolkit
    https://www.nltk.org/book/ch05.html

  2. spaCy: Industrial-Strength Natural Language Processing
    Modern POS tagging implementations
    https://spacy.io/usage/linguistic-features#pos-tagging

  3. scikit-learn: Hidden Markov Models
    Python implementation for sequence labeling
    Documentation

Specialized Topics

  1. "Bidirectional LSTM-CRF Models for Sequence Tagging"
    Zhiheng Huang, Wei Xu, and Kai Yu
    arXiv preprint arXiv:1508.01991, 2015
    (Modern neural approaches compared to HMMs)

  2. "Neural Architectures for Named Entity Recognition"
    Guillaume Lample et al.
    NAACL-HLT, 2016
    (Contemporary sequence labeling methods)

  3. Penn Treebank Part-of-Speech Tags
    Standard tagset used in computational linguistics
    Reference Guide