Skip to content

TheDecodeLab/LLM-Healthcare

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM for Healthcare Course

Welcome to the LLM for Healthcare Course repository! This repository contains all the Jupyter notebooks used in the course, designed to be run seamlessly on Google Colab.

Table of Contents

  • Introduction
  • Course Structure
  • Course Syllabus
  • Getting Started
  • Notebooks
  • Contributing
  • License

Introduction

This repository is part of the LLM for Healthcare Course, which aims to provide a comprehensive understanding of how large language models (LLMs) can be applied in the healthcare domain. The course covers various topics, including data preprocessing, model training, evaluation, and deployment.

Course Structure

The course is divided into several modules, each focusing on a specific aspect of LLMs in healthcare for medical students.

Course Syllabus

The following is the course syllabus. Please note that the titles and content are subject to minor changes:

Date Projected Lecture Topic
8/29/24 Introduction to Natural Language Processing (NLP)
9/5/24 Environment setup, Regular Expressions (regex) and Convolutional Neural Networks (CNN); Quiz 1
9/12/24 Medicine/Bio NLP Datasets; potential project ideas; Quiz 2
9/19/24 Hands-on session: application of NLP methods on open-access datasets; assignment 1 is due.
9/26/24 Recurrent Neural Networks (RNN); Advanced RNNs: LSTMs, GRUs; Quiz 3
10/3/24 Word Embeddings, Text Classification; Quiz 4
10/10/24 Language Modeling, Translations, Seq2seq and Attention
10/17/24 Hands-on session: text classification methods; assignment 2 is due.
10/24/24 Transformer Architecture and Training, Transformer Models: BERT, GPT, Transfer Learning, Fine Tuning, Model size reduction: pruning, quantization, knowledge distillation; Quiz 5
10/31/24 Generative models, Quiz 6
11/7/24 LLM Benchmarks and Tests, Chain of Thoughts, Reasoning, Hallucination, LLMs’ Challenges
11/14/24 Hands-on session: LLMs and Generative models (ex: hugging face, …); assignment 3 is due.
11/21/24 Data-efficient methods: few-shot learning, zero-shot learning Multimodal architectures (combining text with other modalities like images, and audio); Prompt Engineering, LLM Agents; Quiz 7
11/28/24
12/5/24 Applications in Biology and Medicine Ethics, fairness, trustful, privacy, Sustainability; Quiz 8
12/12/24 LLMs API and open discussion; Final project is due.

Getting Started

To get started with the notebooks, follow these steps:

  1. Clone the repository:

    git clone https://github.com/yourusername/LLM-for-Healthcare-Course.git
    cd LLM-for-Healthcare-Course
  2. Open the notebooks in Google Colab:

    Each notebook includes a link to open it directly in Google Colab. Simply click the link, and you'll be able to run the notebook in your browser.

Notebooks

Here is a list of the available notebooks:

  1. Week 2 Open In Colab
  2. Week 3 Open In Colab
  3. Week 4 Open In Colab
  4. Week 5 Open In Colab
  5. Week 6 Open In Colab
  6. Week 7 Open In Colab
  7. Week 8 Open In Colab
  8. Week 9 Open In Colab ...

Contributing

Contributions are welcome! If you have any suggestions or improvements, please open an issue or submit a pull request.

License

This project is licensed under the MIT License - see the LICENSE file for details.

About

LLM for Healthcare course

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published