Skip to content

[FEATURE] support sql file from remote ( http / s3 ... ) #198

@raphaelauv

Description

@raphaelauv

Is your feature request related to a problem? Please describe.
Hi, I would like to be able to give as sqlfile an http(s) url or an s3 file_path because I don't want to embeded the sql files directly in my custom flink container image

also without this feature I would need to add an initcontainer to all my flink-sql-runner "deployments"

Describe the solution you'd like
sqlfile support http url or s3 path

and also accept env_var authentication parameters like

HTTP_SQL_FILE_URL_AUTHENTICATION_USER
HTTP_SQL_FILE_URL_AUTHENTICATION_PASSWORD

so I can provide the creds if there is authentication on the https url

Describe alternatives you've considered
add an initcontainer download the sql files

Additional context
Thanks for this project, what do you think about this feature ? Does it make sens ? Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions