Skip to content

Develop#34

Open
khang3004 wants to merge 4 commits intobird-bench:mainfrom
khang3004:develop
Open

Develop#34
khang3004 wants to merge 4 commits intobird-bench:mainfrom
khang3004:develop

Conversation

@khang3004
Copy link
Copy Markdown

No description provided.

- Add new run scripts for Gemini and Groq LLM providers
- Update existing scripts to read configuration from environment variables
- Consolidate data paths to use data_minidev directory structure
- Ensure eval_result directory creation in evaluation script
- Update .gitignore to exclude data_minidev contents
Add new modules groq_request.py and gemini_request.py to support querying
these LLM APIs for SQL generation tasks. Both modules include parallel
request handling with retry logic and rate limit management.

Update evaluation scripts to use load_json instead of load_jsonl for
consistency, and fix missing results variable in evaluation_ves.py.
…aluation

Add Dockerfile and docker-compose.yml for containerized development with PostgreSQL and MySQL databases.
Include .env.example for environment configuration and Makefile for common setup and Docker commands.
Add REPRODUCTION_GUIDE.md with detailed instructions for reproducing the BIRD Mini-Dev environment using Groq API.
Introduce a standard pyproject.toml file to define the project metadata,
specify Python version requirements, list core dependencies, and configure
the hatchling build system.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant