Complex-Valued AI in LLMs

Date:

This section contains a series of SPAI Group's expositions (or resources) that focus on Complex-valued AI in LLMs.

TitleSpeaker(s)Resources
Introduction to Large Language Models
Nuts and Bolts of LLMsManish Vaghmashi[Slides]
Deep Dive into TransformersPrakhar Verma[Slides]
Deep Dive into AttentionsManish Vaghmashi[Slides]
Training Large Language Models
Pretraining of LLMsManish Vaghmashi[Slides] [Code]

Related Publications
  1. A Multi-Level Cluster-Search for XMC; Mahim Jain*, Gourav Pathak*, Prakhar Verma*, Mahesh Mohan M R; INDOML 2024 poster / slide 1 / slide 2


The probability that we may fail in the struggle ought not to deter us from the support of a cause we believe to be just. -- Abraham Lincoln