Modify AI Gateway parameters

更新时间:
复制 MD 格式

Adjust AI Gateway parameters to optimize performance, reliability, and security. Review each parameter's value range and impact before making changes.

Procedure

Note
  • Only parameters shown in the console can be modified.

  • Keep values within the ranges listed on the gateway engine parameters page.

  1. Log on to the AI Gateway console.

  2. In the navigation pane on the left, choose Instance. In the top menu bar, select a region.

  3. On the Instance page, click the target instance ID.

  4. In the left navigation pane, choose Parameters. In the Gateway Engine Parameters area, find the target parameter, click Edit in the Actions column, set the value, and then click Confirm.

    Parameter

    Type

    Value

    Default

    Description

    DownstreamConnectionBufferLimits

    int64

    [0, 2147483647]

    32768

    Buffer size in bytes per gateway connection. Affects throughput and memory usage.

    PathWithEscapedSlashes

    string

    • KEEP_UNCHANGED

    • REJECT_REQUEST

    • UNESCAPE_AND_REDIRECT

    • UNESCAPE_AND_FORWARD

    KEEP_UNCHANGED

    Action for requests with escaped slashes (%2F, %2f, %5C, %5c) in the URI path.

    DownstreamIdleTime

    int32

    [0, 600]

    180

    Idle timeout in seconds for client-to-gateway connections. Closes the connection if no requests arrive within this period. Requires a restart to take effect.

    EnableHardwareAccelerate

    bool

    [true, false]

    true

    Offloads TLS validation and termination to hardware, improving HTTPS performance.

    InitialStreamWindowSize

    int64

    [65535, 2147483647]

    65535

    Initial HTTP/2 stream-level flow-control window size.

    UpstreamIdleTimeout

    int32

    [0, 600]

    30

    Idle timeout in seconds for gateway-to-upstream connections.

    ZipAlgorithm

    array

    [gzip, brotli]

    gzip

    Compression algorithm (brotli or gzip). Selecting an algorithm also enables EnableGzip if it is disabled.

    EnableCustomAuthConfigPush

    bool

    [true, false]

    false

    Prevents connection drops when custom authentication rules change. Useful for WebSocket and other real-time services.

    EnableProxyProtocol

    bool

    [true, false]

    true

    Enables the PROXY protocol. Required to obtain the client IP when inbound traffic passes through an NLB. Does not affect non-PROXY-protocol requests.

    PreserveHeaderFormat

    bool

    [true, false]

    false

    Preserves the original case of HTTP/1.1 header names. By default, headers are lowercased for HTTP/2 compatibility.

    KeepAliveHeaderTimeout

    int32

    [0, 600]

    0

    Adds a Keep-Alive response header (for example, keep-alive: timeout=10). Set to 0 to omit the header.

    EnableHttp3

    bool

    [true, false]

    false

    Enables HTTP/3.

    AlwaysSetRequestIdInResponse

    bool

    [true, false]

    true

    Always includes the requestId in responses.

    EnableGzip

    bool

    [true, false]

    false

    Enables gzip compression for requests and responses. Reduces traffic but increases CPU usage.

    InitialConnectionWindowSize

    int64

    [65535, 2147483647]

    1048576

    Initial HTTP/2 connection-level flow-control window size.

    DownstreamHttp2MaxConcurrentStream

    int64

    [0, 2147483647]

    100

    Maximum concurrent streams per HTTP/2 connection.

    EnableSlashMerge

    bool

    [true, false]

    false

    Merges consecutive slashes in request paths. For example, www.a.com//b becomes www.a.com/b.

    EnableGenerateRequestId

    bool

    [true, false]

    true

    Generates a requestId request header for tracing.

    WebsocketTermGracePeriod

    int32

    [20, 900]

    20

    Grace period in seconds for WebSocket connections during instance upgrades or restarts.

    XffTrustedNum

    int32

    [0, 10]

    0

    Number of trusted proxies in front of the gateway. Determines whether client-supplied x-forwarded-for and x-request-id headers are used.