Implement Batch Processing

[mowillia]

Implement batch processing for various computationally intensive parts of processing. This will be mainly relevant for the OCR and fuzzy matching.

Related resources

• Submit LLM requests via their batch API
  • OpenAI Batch API: https://platform.openai.com/docs/guides/batch/batch-api
  • Gemini Batch API: https://ai.google.dev/gemini-api/docs/batch-mode
  • Mistral Batch API: https://docs.mistral.ai/capabilities/batch/
  • LangChain Batch resources: https://medium.com/@hey_16878/efficient-batch-processing-with-langchain-and-openai-overcoming-ratelimiterror-daa9de4bbd8b; https://github.com/langchain-ai/langchain/discussions/24764
• Fuzzy Matching for Voter Record Finding
  • https://www.youtube.com/watch?v=ACFHe2kBqkw&ab_channel=vlogize