NTHU_Natural_Language_Processing-IKMLab

This repository provides course materials of the Natural Language Processing course at NTHU (instructor: Prof. Hung-Yu Kao).

Couse Materials

Week	Topics	Slide	Video	Slido
W1	課程簡介 Syllabus / Introduction to NLP	Slide	Video1 Video2	Slido
W2	自然語言處理簡介 (1/2) Introduction to NLP (vector space, indexing, parts of speech, phrase structure)	Slide1 Slide2	Video1 Video2	Slido
W3	自然語言處理簡介 (2/2) Introduction to NLP (Language model)		Video	Slido
W4	基礎文字資料機器學習 (1/2) Basic machine learning for text (Text Classification, NB, NN)	Slide3-1 Slide3-2 Slide3-3	Video1 Video2	Slido
W5	基礎文字資料機器學習 (2/2) Basic machine learning for text (word embedding, text representation)	Slide4	Video	Slido
W6	文字生成式AI簡介(1/3) Introduction to GAI (text): Word Embeddings, Language Modeling (RNN), Sequence-to-sequence Models, and Attention Mechanisms, Sub-word Tokenization; Transformers		Video	Slido
W7	Python for text tutorial (1/2)	SlideTA Slide5	VideoTA Video	Slido
W8	Python for text tutorial (2/2)	SlideTA bert.ipynb	VideoTA Video	Slido
W9	文字生成式AI簡介(2/3) Introduction to GAI (text): ELMo, BERT, GPT, and T5 (BERT and its Family)	Slide8	Video	Slido
W10	文字生成式AI簡介(3/3) Introduction to GAI (text): Decoding Strategies and Evaluations for Natural Language Generation	SlideTA gpt.ipynb t5.ipynb Slide9	VideoTA Video	Slido
W11	大語言模型簡介與訓練 (1/3): Large language model concept and training (GPT-3, InstructGPT, RLHF)		Video1 Video2	Slido
W12	大語言模型簡介與訓練 (2/3): Parameter Efficient Fine-Tuning (PEFT)	Slide11	Video1	Slido
W13	大語言模型簡介與訓練 (2/3): Introduction and Review technique of Retrieval Augmented Generation (RAG)
W14	Term project presentation (1/3)
W15	Term project presentation (1/3)
W16	Term project presentation (1/3)
W17	Term Project (demo) (optional)
W18	Term Project (demo) (optional)

• Italics: Tutorial; Bold: Reporting