Natural language processing basics
Artificial Intelligence · Engineering
Study notes
Build sentiment analysis: tokenize 'I love this movie' into [I, love, this, movie]; embed each as vectors; a transformer encodes context; a classifier outputs positive. Modern LLMs like GPT predict the next token repeatedly to generate text; fine-tuning on reviews adapts them to sentiment. Chatbots, translation, and summarization all build on these blocks.