Skip to content

dthatprince/pytorch-transformerllm

Repository files navigation

Hugging Face Transformers

(Pipelines, Tokenizer/Model, Pytorch/Tensorflow, Save/Load model and Tokenizer)

Experimenting with Hugging Face Transformers library for various natural language processing (NLP) tasks such as sentiment analysis, tokenization, and model predictions.

Prerequisites

Before you can run the examples in this repository, you need to install the required Python libraries. Make sure you have Python installed on your system, then run the following commands to install the necessary packages:

  • pip install tensorflow
  • pip install tf-keras
  • pip install flax
  • pip install torch torchvision torchaudio
  • pip install transformers

For detailed installation instructions of the Transformers library, visit the official installation page.

Examples: Sentiment Analysis, Text Generation, Classification Pipeline and Fine Tuning

Resources

  • Model Hub: Explore over 34,000 models available in the Hugging Face Model Hub.
  • Transformers Documentation: Detailed documentation and user guides for the Transformers library.

About

Hugging Face and the Transformers PoC using Pipelines, Models, and Tokenizers, with integrated support for both PyTorch and TensorFlow.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages