The AWS JS SDK supports TCP connection reuse via the AWS_NODEJS_CONNECTION_REUSE_ENABLED environment variable. We could include this env var in the example Lambda function, or at the provider level so it applies to all functions.
It would be good to understand any possible downsides to this approach.