Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task hook failed envoy_bootstrap: error creating bootstrap configuration for Connect proxy sidecar #308

Open
lens0021 opened this issue Oct 6, 2024 · 4 comments

Comments

@lens0021
Copy link
Member

lens0021 commented Oct 6, 2024

Task "connect-proxy-fastcgi" (prestart sidecar) is "pending"
Task Resources:
CPU      Memory  Disk     Addresses
100 MHz  20 MiB  300 MiB

Task Events:
Started At     = N/A
Finished At    = N/A
Total Restarts = 1
Last Restart   = 2024-10-06T16:16:51Z

Recent Events:
Time                  Type              Description
2024-10-06T16:16:51Z  Restarting        Task restarting in 16.307781831s
2024-10-06T16:16:51Z  Task hook failed  envoy_bootstrap: error creating bootstrap configuration for Connect proxy sidecar: exit status
 1; see: <https://developer.hashicorp.com/nomad/s/envoy-bootstrap-error>
2024-10-06T16:15:51Z  Task Setup        Building Task Directory
2024-10-06T16:15:50Z  Received          Task received by client

https://developer.hashicorp.com/nomad/s/envoy-bootstrap-error

@lens0021 lens0021 self-assigned this Oct 6, 2024
@lens0021
Copy link
Member Author

lens0021 commented Oct 6, 2024

journalctl -feu consul was not helpful

@lens0021
Copy link
Member Author

lens0021 commented Oct 6, 2024

$ nomad logs -f -stderr  -task connect-proxy-fastcgi -job fastcgi
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:430] initializing epoch 0 (base id=0, hot restart version=disabled)
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:432] statically linked extensions:
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:434]   envoy.quic.server_preferred_address: quic.server_preferred_address.fixed
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:434]   envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:434]   envoy.dubbo_proxy.protocols: dubbo
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:434]   envoy.upstreams: envoy.filters.connection_pools.tcp.generic
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:434]   envoy.upstream_options: envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options
[2024-10-06 17:39:00.890][1][info][main] [source/server/server.cc:434]   envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.connection_handler: envoy.connection_handler.default
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   quic.http_server_connection: quic.http_server_connection.default
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.grpc_credentials: envoy.grpc_credentials.aws_iam, envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.udp_proxy
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.dubbo_proxy.filters: envoy.filters.dubbo.router
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.filters.listener: envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.load_balancing_policies: envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, st
arttls, tls
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.header
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.route.early_data_policy: envoy.route.early_data_policy.default
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.path.match: envoy.path.match.uri_template.uri_template_matcher                                                                                                                                                                                                                                                                                                                                              [2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.health_checkers: envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.clusters: envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.dynamic_forward_proxy, envoy.clusters.redis
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.filters.http.upstream: envoy.buffer, envoy.filters.http.admission_control, envoy.filters.http.buffer, envoy.filters.http.header_mutation, envoy.filters.http.upstream_codec
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.dubbo_proxy.serializers: dubbo.hessian2
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.trie_matcher
[2024-10-06 17:39:00.891][1][info][main] [source/server/server.cc:434]   envoy.resource_monitors: envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.matching.input_matchers: envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.ip, envoy.matching.matchers.runtime_fraction
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.formatter: envoy.formatter.cel, envoy.formatter.metadata, envoy.formatter.req_without_query
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   network.connection.client: default, envoy_internal
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network
.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.thrift_proxy.transports: auto, framed, header, unframed
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.request_id: envoy.request_id.uuid
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy
.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.spiffe
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.geoip_providers: envoy.geoip_providers.maxmind
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.retry_priorities: envoy.retry_priorities.previous_priorities
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.health_check.event_sinks: envoy.health_check.event_sink.file
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.common.key_value: envoy.key_value.file_based
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server
_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.resolvers: envoy.ip
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.quic.connection_id_generator: envoy.quic.deterministic_connection_id_generator
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.bootstrap: envoy.bootstrap.internal_listener, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.regex_engines: envoy.regex_engines.google_re2
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.quic.proof_source: envoy.quic.proof_source.filter_chain
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.access_loggers: envoy.access_loggers.file, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.w
asm_access_log
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.network.application_protocols, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.upstream.dynamic_host, envoy.upstream.dy
namic_port
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.trie_matcher
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory
[2024-10-06 17:39:00.892][1][info][main] [source/server/server.cc:434]   envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.http_capsule
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.http.header_validators: envoy.http.header_validators.envoy_default
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.matching.action: envoy.matching.actions.format_string, filter-chain-name
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable                                                                                                                                                                                                                                                                                                                                   [2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.tracers: envoy.dynamic.ot, envoy.tracers.datadog, envoy.tracers.dynamic_ot, envoy.tracers.opencensus, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.fault, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.basic_auth, envoy.filter
s.http.buffer, envoy.filters.http.cache, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_system_buffer, envoy.filters.http.
gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy
.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router
[2024-10-06 17:39:00.893][1][info][main] [source/server/server.cc:434]   envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts
[2024-10-06 17:39:00.897][1][info][main] [source/server/server.cc:488] HTTP header map info:
[2024-10-06 17:39:00.898][1][info][main] [source/server/server.cc:491]   request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unm
odified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-path,x-envoy-or
iginal-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-ot-span-context,x-request-id
[2024-10-06 17:39:00.898][1][info][main] [source/server/server.cc:491]   request trailer map: 120 bytes:
[2024-10-06 17:39:00.898][1][info][main] [source/server/server.cc:491]   response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,pr
oxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id
[2024-10-06 17:39:00.898][1][info][main] [source/server/server.cc:491]   response trailer map: 144 bytes: grpc-message,grpc-status
[2024-10-06 17:39:00.914][1][info][main] [source/server/server.cc:845] runtime: layers:
  - name: base
    static_layer:
      re2.max_program_size.error_level: 1048576
[2024-10-06 17:39:00.915][1][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.2:19003
[2024-10-06 17:39:00.916][1][info][config] [source/server/configuration_impl.cc:160] loading tracing configuration
[2024-10-06 17:39:00.916][1][info][config] [source/server/configuration_impl.cc:119] loading 0 static secret(s)
[2024-10-06 17:39:00.916][1][info][config] [source/server/configuration_impl.cc:125] loading 1 cluster(s)
[2024-10-06 17:39:00.989][1][info][config] [source/server/configuration_impl.cc:129] loading 0 listener(s)
[2024-10-06 17:39:00.989][1][info][config] [source/server/configuration_impl.cc:146] loading stats configuration
[2024-10-06 17:39:00.989][1][info][runtime] [source/common/runtime/runtime_impl.cc:584] RTDS has finished initialization
[2024-10-06 17:39:00.990][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:236] cm init: initializing cds
[2024-10-06 17:39:00.990][1][warning][main] [source/server/server.cc:910] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.downstream_connections` resource monitor.
[2024-10-06 17:39:00.990][1][info][main] [source/server/server.cc:951] starting main dispatch loop
[2024-10-06 17:39:00.998][1][info][upstream] [source/common/upstream/cds_api_helper.cc:32] cds: add 3 cluster(s), remove 0 cluster(s)
[2024-10-06 17:39:01.315][1][info][upstream] [source/common/upstream/cds_api_helper.cc:71] cds: added/updated 3 cluster(s), skipped 0 unmodified cluster(s)
[2024-10-06 17:39:01.315][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:214] cm init: initializing secondary clusters
[2024-10-06 17:39:01.320][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:240] cm init: all clusters initialized
[2024-10-06 17:39:01.320][1][info][main] [source/server/server.cc:932] all clusters initialized. initializing init manager
[2024-10-06 17:39:01.327][1][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'public_listener:0.0.0.0:21601'
[2024-10-06 17:39:01.328][1][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'mysql:127.0.0.1:3306'
[2024-10-06 17:39:01.329][1][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'memcached:127.0.0.1:11211'
[2024-10-06 17:39:01.329][1][info][config] [source/common/listener_manager/listener_manager_impl.cc:926] all dependencies initialized. starting workers
[2024-10-06 17:45:14.879][1][warning][main] [source/server/server.cc:881] caught ENVOY_SIGTERM
[2024-10-06 17:45:14.885][1][info][main] [source/server/server.cc:1019] shutting down server instance
[2024-10-06 17:45:14.885][1][info][main] [source/server/server.cc:959] main dispatch loop exited
[2024-10-06 17:45:14.908][1][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:155] DeltaAggregatedResources gRPC config stream to local_agent closed: 13,
[2024-10-06 17:45:14.911][1][info][main] [source/server/server.cc:1011] exiting

@lens0021 lens0021 moved this from To do to In Progress in femiwiki.com Oct 6, 2024
@lens0021
Copy link
Member Author

lens0021 commented Oct 9, 2024

This was maybe related to the status of agent or cluster. Restarting the agent seems to work.

@lens0021 lens0021 closed this as not planned Won't fix, can't repro, duplicate, stale Oct 9, 2024
@lens0021 lens0021 removed their assignment Oct 10, 2024
@lens0021 lens0021 reopened this Oct 22, 2024
@github-project-automation github-project-automation bot moved this from In Progress to To do in femiwiki.com Oct 22, 2024
@lens0021
Copy link
Member Author

Nomad v1.9.1 includes the fix:

consul: Fixed a bug where broken Consul ACL tokens could block registration and deregistration of services and checks
-- https://github.com/hashicorp/nomad/releases/tag/v1.9.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: To do
Development

No branches or pull requests

1 participant