From Bag of Words to Large Language Models: Unveiling the Power of Generative AI for Natural Language Processing (October 2023)

Natural Language Processing (NLP) has witnessed a paradigm shift in recent years, driven by the advent of generative AI models. This seminar offers a comprehensive exploration of the evolutionary trajectory of language technologies, spanning from the rudimentary Bag-of-Words model to the sophisticated Long Short-Term Memory (LSTM) networks and culminating in the transformative power of Transformers and Generative Pre-trained Transformers (GPT) based Large Language Models (LLMs). The seminar will provide a rigorous overview of these state-of-the-art models, encompassing their underlying architectural innovations, training methodologies and their profound implications for NLP tasks. The focal point of the seminar centers on the Transformer model--the model that has reshaped the entire NLP landscape, rendering remarkable achievements in machine translation, sentiment analysis and text summarization, among other tasks. The speaker will delve deeply into the architecture of the Transformer model and dissect what makes it so powerful and adaptable to a wide array of NLP tasks. Furthermore, the seminar will conclude with a discussion of Large Language Models based on the Generate Pre-Trained Transformer (GPT) models, elucidating their remarkable capacity to understand language and generate human-like text, thereby enabling transformative applications across diverse domains, from conversational AI and content creation to information retrieval, healthcare, and beyond.

About the speaker
Dr. Ruchit Agrawal is an Assistant Professor and Head of Computer Science Outreach at the University of Birmingham Dubai. Prior to this, he was a postdoctoral research scientist at the University of Oxford at the Computational Health Informatics group. He received his PhD in Computer Science with the prestigious Marie-Curie Scholarship from the Queen Mary University of London. Dr. Agrawal is an expert in machine learning and has published several research papers in leading journals and reputed international conferences of his domain. His broad research interests include multimodal deep learning, large language models, natural language processing and clinical machine learning.

For more information, please contact [email protected].