A set of scripts and configurations for pretraining of Large Language Models (LLM)

Ready-for-use-colab tutorial for finetuning ruDialoGpt3 model on а telegram chat using HuggingFace and PyTorch

Comprehensive benchmarks and evaluations of Large Language Models (LLMs) with a focus on hardware usage, generation speed, and memory requirements.

Pre-training custom ruGPT3 model on books written by F.M. Dostoevski

ruGPT3 bot in telegram based on Python

Docker compose for ru-gpts

Small API reserver for interacting with RuGPT-3

Small http service which generates answer depending on parameter sent