Ai Formulation Development

Research Frontiers in Self-Attention Bias and Positional Encoding

Investigation of inductive biases in attention mechanisms, alternative positional encoding schemes, and methods for incorporating structural information into transformer models.

All AI Formulation Development PhD categories