Problem
The Nginx server on dstack gateways uses the default distro-provided config, which can have low file and connection limits (worker_rlimit_nofile, worker_connections) insufficient for production use cases. For example, the limits may default to 1024 files and 768 connections, which would cause Nginx to fail handling more concurrent requests.
Solution
Either allow configuring in the gateway configuration, or hardcode higher limits.
Workaround
SSH to the gateway instance, set new limits by hand.
Would you like to help us implement this feature by sending a PR?
Yes
Problem
The Nginx server on dstack gateways uses the default distro-provided config, which can have low file and connection limits (
worker_rlimit_nofile,worker_connections) insufficient for production use cases. For example, the limits may default to 1024 files and 768 connections, which would cause Nginx to fail handling more concurrent requests.Solution
Either allow configuring in the gateway configuration, or hardcode higher limits.
Workaround
SSH to the gateway instance, set new limits by hand.
Would you like to help us implement this feature by sending a PR?
Yes