LLM Related Tasks

[mnm-matin]

There are 4 tasks related to LLMs (can break these out into separate issues as needed:

1. Hierarchical Clustering/Taxonomy Creation
   Main Topic -> Sub Topic -> Research Paper

2. Similar Papers Clustering
   For each paper find papers related to it

3. Summaries

• Each Main Topic
• Each Subtopic
• Each paper (which is probably just the abstract)

4. Filter Papers
   Need to filter out papers not related to AI Safety

For LLM related tasks the following are pre-requisite:

• Find a python library to make the code LLM provider agnostic, e.g LiteLLM
• Fixed Data Structure JSON or YAML?