Large Language Models and their Ability to Capture Meaning in Unique Vocabularies
Reserach for my Master’s in Computer Science, Vector Institute Collaborative Specialization in AI
@ Western University, London, Ontario, Canada
Supervisor: Professor Dan Lizotte
Associate Professor, Department of Computer Science, Westen University
For my Master's research, I am developing interpretability techniques to assess how Large Language Models (LLMS) capture the meaning of words from highly unusual and unique vocabularies. These unique vocabularies include:
- Reddit communities (and other social media) that utilize memes, slang, and colloquial terms, which constantly evolve as internet culture shifts over time
- Industries that employ specialized terminologies, with some terms having different meanings outside of those industries.