Skip to main content
Ctrl+K
Logo image

Getting Started

  • Installation
  • Quick Start

Documentation

  • Getting starting with transformers
  • Logging
  • Multi-gpus
  • MSA

Tutorial

  • Loglikelihood
  • Embeddings
  • Finetuning
  • Mutation score

Api reference

  • Bio-transformers method

Contributing

  • Contributing
  • API Reference
    • biotransformers
      • biotransformers.lightning_utils
        • biotransformers.lightning_utils.data
        • biotransformers.lightning_utils.models
        • biotransformers.lightning_utils.optimizer
      • biotransformers.tests
        • biotransformers.tests.conftest
        • biotransformers.tests.test_accuracy
        • biotransformers.tests.test_embeddings
        • biotransformers.tests.test_logits
        • biotransformers.tests.test_loglikelihoods
        • biotransformers.tests.test_mutation_score
      • biotransformers.utils
        • biotransformers.utils.compute_utils
        • biotransformers.utils.constant
        • biotransformers.utils.deprecated
        • biotransformers.utils.logger
        • biotransformers.utils.msa_utils
        • biotransformers.utils.tqdm_utils
        • biotransformers.utils.utils
      • biotransformers.wrappers
        • biotransformers.wrappers.esm_wrappers
        • biotransformers.wrappers.language_model
        • biotransformers.wrappers.rostlab_wrapper
        • biotransformers.wrappers.transformers_wrappers
      • biotransformers.bio_transformers
      • biotransformers.version
  • Repository
  • Suggest edit
  • .md

Getting starting with transformers

Contents

  • Bio-transformers

Getting starting with transformers#

If you want to know more about the transformers architecture, have a look at:

  • The illustrated transformers

  • The annotated transformers

Bio-transformers#

If you want to understand the secret of how to train deep-learning model on protein, the two best repo are:

  • ProtTrans repo

  • ESM repo

previous

Quick Start

next

Logging

Contents
  • Bio-transformers

By InstaDeep

© Copyright 2021, InstaDeep.