[Feature]: Improve latency for index generation

[amishra-u]

Is your feature request related to a problem?

The current incremental indexing process may have high latency due to a multi-layered execution chain. A shell script calls a Python binary, which then invokes a Java binary, ultimately leading to a programmatic invocation of the Java compiler. Each incremental index requires starting new Python interpreter and JVM processes, which are time-consuming. Compiling a single Java class should ideally take milliseconds.

Describe the solution you'd like

Persistent JVM Instance

To reduce latency, we should explore maintaining a persistent JVM instance that exposes an API for direct file compilation. This persistent JVM would programmatically invoke the Java compiler internally, eliminating the numerous intermediary layers and bringing compilation times down to the millisecond range.

Describe alternatives you've considered

No response

Which component does this relate to?

SCIP Generation

Additional context

No response

Code of Conduct

• I agree to follow this project's contribution guidelines