Skip to content

Use asyncio to enable concurrency #23

@pranshu-raj-211

Description

@pranshu-raj-211

Current operations are extremely slow. Since we're using synchronous programming and have multiple time consuming file and network operations, it's better to just use asyncio to run things concurrently.

This would mean changes like:

  1. Using async function definitions
  2. Using httpx instead of requests

Would need some time to figure out where exactly to make these improvements.
Also need to add metrics collection (time) and better logging.

Sub-issues

Metadata

Metadata

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions