Skip to content

Add LLM factual accuracy evaluation prompt under Prompt Engineering &… #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
AliRizvi433 wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Add LLM factual accuracy evaluation prompt under Prompt Engineering &… #20

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
68ef5f5
Add LLM factual accuracy evaluation prompt under Prompt Engineering &…
AliRizvi433 Jun 18, 2025
8188142
Merge branch 'main' into ali-rizvi-lawliet-prompt
AliRizvi433 Jul 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 23 additions & 5 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,10 +21,11 @@ This repository contains prompt chains for the following domains:
11. **System Monitoring & Debugging**
12. **Web Development**
13. **API Development**
14. **AI/ML Integration**
15. **Testing & Quality Assurance**
16. **Agentic AI**
17. **RAG Application Development**
14. **Legal Tech & AI**
15. **AI/ML Integration**
16. **Testing & Quality Assurance**
17. **Agentic AI**
18. **RAG Application Development**

---

Expand Down Expand Up @@ -856,6 +857,8 @@ This repository contains prompt chains for the following domains:
* **Write SEO-Optimized Blog Content**

```text

=======
"Generate a blog post on {topic} optimized for SEO. Use keyword research to include high-traffic keywords naturally, structure the post with headings and subheadings, and ensure it is engaging and informative. Return the content with SEO suggestions."
```

Expand Down Expand Up @@ -1488,4 +1491,19 @@ This repository contains prompt chains for the following domains:
"Provide deployment instructions to host a RAG application on Render or Railway using FastAPI or Streamlit. Include a requirements.txt, Procfile, or Dockerfile for proper environment setup and execution."
```

---
---

"Set up a CI/CD pipeline to automatically run Keploy tests as part of the deployment process. Include configuration for GitHub Actions or Jenkins to run tests whenever new code is pushed to the repository."
```
### **18. Legal Tech & AI**

* **Evaluate Factual Accyracy of LLM Outputs**

```text
"Given the following user query and the LLM's response, evaluate the factual accuracy of the output. Check if the response is consistent with the provided source text or expected knowledge base. Return a rating (1-5) and a brief explanation."

User Query: {query}
LLM Response: {response}
Reference Text: {reference}"
```