Support for communication with runner via message queue only. #7
Description
Currently, when a new submission is made, AICON sends the job to the AICON Runner through RabbitMQ using Celery. However, the information passed in the message only includes the submission ID and some metadata. The task and submission files are not included in the message, so when the AICON runner receives the job, it must contact AICON separately to download the necessary task and submission files.
Proposed Enhancement:
We would like to implement an option where AICON passes all the necessary information (including task and submission files) to the AICON runner via the message queue. This would eliminate the need for the AICON runner to contact AICON to download the task and submission files, simplifying the flow and improving efficiency.
Expected Outcome:
- The AICON runner can receive all necessary data in one message.
- The AICON runner no longer needs to make a separate request to AICON for task or submission files.
- Improved performance and reduced complexity in the communication flow.