This tutorial will be given at the ICFA ML for Particle Accelerators workshop in Gyeongju, South Korea the 5th March 2024.
Seq2seq models for time series
What are transformers
What have we used instead of Transformers?
How can we apply transformers for particle accelerators?
Hands-on with code
- Transformer components
- Embeddings
- Positional encoders
- Output projection
- input / output dimensions
- Data to use with transformers
- Loss functions