Getting starting with transformers

Getting starting with transformers

If you want to know more about the transformers architecture, have a look at:

Bio-transformers

If you want to understand the secret of how to train deep-learning model on protein, the two best repo are: