Adjust AI Gateway parameters to optimize performance, reliability, and security. Review each parameter's value range and impact before making changes.
Procedure
-
Only parameters shown in the console can be modified.
-
Keep values within the ranges listed on the gateway engine parameters page.
Log on to the AI Gateway console.
In the navigation pane on the left, choose Instance. In the top menu bar, select a region.
On the Instance page, click the target instance ID.
-
In the left navigation pane, choose Parameters. In the Gateway Engine Parameters area, find the target parameter, click Edit in the Actions column, set the value, and then click Confirm.
Parameter
Type
Value
Default
Description
DownstreamConnectionBufferLimits
int64
[0, 2147483647]
32768
Buffer size in bytes per gateway connection. Affects throughput and memory usage.
PathWithEscapedSlashes
string
-
KEEP_UNCHANGED
-
REJECT_REQUEST
-
UNESCAPE_AND_REDIRECT
-
UNESCAPE_AND_FORWARD
KEEP_UNCHANGED
Action for requests with escaped slashes (
%2F,%2f,%5C,%5c) in the URI path.DownstreamIdleTime
int32
[0, 600]
180
Idle timeout in seconds for client-to-gateway connections. Closes the connection if no requests arrive within this period. Requires a restart to take effect.
EnableHardwareAccelerate
bool
[true, false]
true
Offloads TLS validation and termination to hardware, improving HTTPS performance.
InitialStreamWindowSize
int64
[65535, 2147483647]
65535
Initial HTTP/2 stream-level flow-control window size.
UpstreamIdleTimeout
int32
[0, 600]
30
Idle timeout in seconds for gateway-to-upstream connections.
ZipAlgorithm
array
[gzip, brotli]
gzip
Compression algorithm (
brotliorgzip). Selecting an algorithm also enablesEnableGzipif it is disabled.EnableCustomAuthConfigPush
bool
[true, false]
false
Prevents connection drops when custom authentication rules change. Useful for WebSocket and other real-time services.
EnableProxyProtocol
bool
[true, false]
true
Enables the PROXY protocol. Required to obtain the client IP when inbound traffic passes through an NLB. Does not affect non-PROXY-protocol requests.
PreserveHeaderFormat
bool
[true, false]
false
Preserves the original case of HTTP/1.1 header names. By default, headers are lowercased for HTTP/2 compatibility.
KeepAliveHeaderTimeout
int32
[0, 600]
0
Adds a
Keep-Aliveresponse header (for example,keep-alive: timeout=10). Set to 0 to omit the header.EnableHttp3
bool
[true, false]
false
Enables HTTP/3.
AlwaysSetRequestIdInResponse
bool
[true, false]
true
Always includes the
requestIdin responses.EnableGzip
bool
[true, false]
false
Enables gzip compression for requests and responses. Reduces traffic but increases CPU usage.
InitialConnectionWindowSize
int64
[65535, 2147483647]
1048576
Initial HTTP/2 connection-level flow-control window size.
DownstreamHttp2MaxConcurrentStream
int64
[0, 2147483647]
100
Maximum concurrent streams per HTTP/2 connection.
EnableSlashMerge
bool
[true, false]
false
Merges consecutive slashes in request paths. For example,
www.a.com//bbecomeswww.a.com/b.EnableGenerateRequestId
bool
[true, false]
true
Generates a
requestIdrequest header for tracing.WebsocketTermGracePeriod
int32
[20, 900]
20
Grace period in seconds for WebSocket connections during instance upgrades or restarts.
XffTrustedNum
int32
[0, 10]
0
Number of trusted proxies in front of the gateway. Determines whether client-supplied
x-forwarded-forandx-request-idheaders are used. -