Increase envtest timeouts and resource limits for CI#1798
Increase envtest timeouts and resource limits for CI#1798openshift-merge-bot[bot] merged 1 commit intoopenstack-k8s-operators:mainfrom
Conversation
47dc015 to
bc1b10a
Compare
Functional tests were failing during CRD installation with etcd timeouts in CI environments. The error "etcdserver: request timed out" indicates etcd couldn't process CRD creation requests within its default 5-second timeout, likely due to resource constraints (slow disk I/O, CPU pressure, or memory limits in CI). Configuration changes to envtest.Environment: 1. Client-side timeouts: - ControlPlaneStartTimeout: 2 minutes - ControlPlaneStopTimeout: 2 minutes - CRDInstallOptions.MaxTime: 5 minutes 2. API Server configuration: - request-timeout: 5 minutes (allow longer-running requests) - max-requests-inflight: 800 (increased from default 400) - max-mutating-requests-inflight: 400 (increased from default 200) 3. Etcd configuration: - quota-backend-bytes: 8GB (increased from default 2GB) These changes accommodate the large number of CRDs being installed (100+ CRDs from cinder, glance, nova, neutron, and other operators) and resource-constrained CI environments. Errors observed: - etcdserver: request timed out - unable to create CRD "openstackdataplanenodesets.dataplane.openstack.org" - unable to create CRD "routes.route.openshift.io"
|
/test functional |
|
/override ci/prow/openstack-operator-build-deploy-kuttl-4-18 |
|
@stuggi: Overrode contexts on behalf of stuggi: ci/prow/openstack-operator-build-deploy-kuttl-4-18 DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
/lgtm |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: dprince, stuggi The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
adad2c1
into
openstack-k8s-operators:main
Functional tests were failing during CRD installation with etcd
timeouts in CI environments. The error "etcdserver: request timed out"
indicates etcd couldn't process CRD creation requests within its
default 5-second timeout, likely due to resource constraints (slow
disk I/O, CPU pressure, or memory limits in CI).
Configuration changes to envtest.Environment:
Client-side timeouts:
API Server configuration:
Etcd configuration:
These changes accommodate the large number of CRDs being installed
(100+ CRDs from cinder, glance, nova, neutron, and other operators)
and resource-constrained CI environments.
Errors observed: