- Implement PBT in hysteresis-scripts [priority:: low] [completion:: 2024-06-13]
Population based training has been implemented directly into transformertf with custom scripts needing to be defined, but most use cases have been abstracted away: https://gitlab.cern.ch/dsb/hysteresis/transformertf/-/blob/master/tune_example/pbt_lstm.py?ref_type=heads
It turns out that it can be implemented for architecture hyperparameters as well. But we try this out for LSTM by script first.
Resources
https://docs.ray.io/en/latest/tune/examples/pbt_guide.html https://www.deepmind.com/blog/population-based-training-of-neural-networks