Title: The Model Behind ChatGPT

Abstract: This will be a general talk to introduce a deep learning model called Generative Pre-training Transformer (GPT). First, I will discuss in concept the machine learning approach for the task of question-answering. Then I will describe language modeling and some models such as recurrent neural network (RNN) models for that task. Finally, I will present the Transformer as well as the GPT models that have led to ChatGPT.