This reference lists the frontend node (FE) and backend node (BE) parameters for an E-MapReduce (EMR) Serverless StarRocks instance. Parameters fall into two categories: static parameters require a service restart to take effect, while dynamic parameters take effect immediately without a restart.
FE dynamic parameters
Log
Parameter | Default value | Description |
|
| Slow query threshold. Queries with a response time exceeding this value are recorded as slow queries. Unit: milliseconds. |
Metadata and instance management
Parameter | Default value | Description |
|
| Timeout for acquiring the catalog lock. Unit: milliseconds. |
|
| Maximum number of image log entries written before a new log file is created. |
|
| Whether to ignore unknown log IDs when an FE is rolled back to an earlier version. Valid values: |
|
| Whether to ignore the metadata gap. Valid values: |
|
| Maximum time allowed for a BE to rejoin after disconnecting from an FE. Unit: seconds. |
|
| Whether to delete a BE after it is decommissioned. Valid values: |
Query engine
Parameter | Default value | Description |
|
| Maximum number of IN predicates allowed in a query. |
|
| Maximum depth of an expression tree. |
|
| Maximum number of elements allowed in the IN predicate of a DELETE statement. |
|
| Maximum length of a single row. |
|
| Whether to disable the logical instance feature. Valid values: |
|
| Whether to allow creation of materialized views. Valid values: |
|
| Whether to enable the DECIMAL V3 data type. Valid values: |
|
| Whether to enable the SQL query blacklist. Valid values: Note When enabled, queries in the blacklist cannot be executed. |
|
| Interval at which the FE checks for new data and automatically creates partitions. Unit: seconds. |
|
| Whether to enable dynamic partitioning. Valid values: |
|
| Maximum number of partitions that can be created in a single batch. |
|
| Maximum number of query retries on an FE. |
|
| Maximum timeout for creating a table. Unit: seconds. |
|
| Maximum number of concurrent rollup jobs per table. |
|
| Maximum number of times the optimizer can rewrite a ScalarOperator. |
|
| Interval at which statistics-related metadata is scheduled. Unit: seconds. |
|
| Interval at which data updates are checked in automatic statistics collection tasks. Unit: seconds. |
|
| Default interval at which statistics are updated. Unit: seconds. |
|
| Number of rows to sample during statistics collection. |
|
| Whether to enable statistics collection. Valid values: |
|
| Whether the optimizer preferentially selects tablet replicas on BEs that share the same IP address as the FE. Valid values: |
|
| Maximum recursion depth for partition pruning. |
Data import and export
Parameter | Default value | Description |
|
| Maximum data import lag tolerated for a BE replica before data is cloned from another replica. Unit: seconds. |
|
| Maximum number of pending jobs. Applies to all job types, including table creation, data import, and schema change jobs. |
|
| Maximum number of concurrent data import jobs. |
|
| Maximum timeout for a data import job. Applies to all import job types. Unit: seconds. |
|
| Minimum timeout for a data import job. Applies to all import job types. Unit: seconds. |
|
| Number of concurrent instances on a single BE. |
|
| Whether to disable Hadoop data import. Valid values: |
|
| Whether to reject data import jobs when the instance encounters an error. Valid values: |
|
| Interval at which the database quota is updated. Unit: seconds. |
|
| Maximum retention period for historical jobs. Unit: seconds. |
|
| Maximum number of data import jobs retained within the period specified by |
|
| Retention period for import job labels. Unit: seconds. |
|
| Maximum number of Routine Load jobs. |
|
| Maximum number of concurrent tasks in a Routine Load job. |
|
| Maximum number of concurrent Routine Load tasks on a BE. Must be less than or equal to |
|
| Maximum amount of data imported by a single Routine Load task. |
|
| Maximum duration for a Routine Load task to consume data. Unit: seconds. |
|
| Timeout for a Routine Load task. Unit: seconds. |
|
| Maximum number of faulty BEs allowed. If exceeded, Routine Load jobs cannot be automatically recovered. |
|
| Interval at which Routine Load jobs are automatically recovered. Unit: minutes. |
|
| Timeout for a Spark Load job. Unit: seconds. |
|
| Root directory of the Spark client. |
|
| Timeout for a Stream Load job. Unit: seconds. |
|
| Maximum timeout for a Stream Load job. Unit: seconds. |
|
| Timeout for an INSERT INTO data import operation. Unit: seconds. |
|
| Timeout for a Broker Load job. Unit: seconds. |
|
| Minimum amount of data processed by a Broker Load instance. Default value: 64 MB. |
|
| Maximum number of concurrent instances for a Broker Load job. |
|
| Maximum amount of data exported from a single BE by a single export job. Default value: 256 MB. |
|
| Maximum number of concurrently running data export jobs. |
|
| Timeout for a data export job. Default value: 2 hours. Unit: seconds. |
Storage
Parameter | Default value | Description |
|
| Whether an FE checks the storage medium type of a BE during table creation. Valid values: |
|
| Disk usage upper limit on a BE. If disk usage exceeds 75%, no new table creation or cloning jobs are sent to the BE until usage drops below the threshold. |
|
| Maximum space usage of a BE directory. |
|
| Minimum remaining space in a BE directory. Default value: 2 GB. Unit: bytes. |
|
| Remaining space threshold for a BE directory. Default value: 1 GB. Unit: bytes. If remaining space falls below this value, load or restore jobs are rejected. |
|
| Space usage threshold for a BE directory. If usage exceeds this value, load or restore jobs are rejected. |
|
| Retention period of metadata in the recycle bin after a table or database is deleted. Default value: 1 day. Unit: seconds. Data cannot be restored once this period expires. |
|
| Timeout for a schema change job. Default value: 1 day. Unit: seconds. |
|
| Safe disk usage threshold for the |
|
| Load score threshold for tablet balancing. For the |
|
| Whether to disable tablet balancing. Valid values: |
|
| Maximum number of tablets that can be scheduled at the same time. If the number of tablets being scheduled exceeds this value, tablet load balancing is skipped. |
|
| Maximum number of tablets being balanced simultaneously. If this value is exceeded, load rebalancing is skipped. |
|
| Whether to disable replica balancing for colocate tables. Valid values: |
|
| Whether to replace a lost or corrupted tablet replica with an empty replica. Valid values: |
|
| Minimum timeout for cloning a tablet. Default value: 3 minutes. Unit: seconds. |
|
| Maximum timeout for cloning a tablet. Default value: 2 hours. Unit: seconds. |
|
| Timeout for creating a tablet. Unit: seconds. |
|
| Timeout for deleting a tablet. Unit: seconds. |
|
| Interval at which tablet replicas are repaired. Unit: seconds. |
|
| Hour at which the FE starts a replica consistency check. Default value: 23:00. |
|
| Hour at which the FE ends a replica consistency check. Default value: 04:00. |
|
| Timeout for a replica consistency check. Unit: seconds. |
Others
Parameter | Default value | Description |
|
| Whether to enable the plugin framework. Valid values: Note Plugins can only be installed or uninstalled on the leader FE. |
|
| Maximum number of small files that can be stored. |
|
| Maximum size of a small file. Default value: 1 MB. Unit: bytes. |
|
| Timeout for a backup job. Default value: 1 day. Unit: milliseconds. |
|
| Maximum number of disk, task, or tablet reports in the report queue. |
FE static parameters
Log
Parameter | Default value | Description |
|
| Size of a log file. Default value: 1 GB. Unit: MB. |
|
| Directory where system logs are stored. |
|
| System log level. Valid values: |
| Empty string | Modules for which system logs are generated. For example, setting this to |
|
| Interval at which system logs are rotated. |
|
| Retention period of system log files. |
|
| Maximum number of system log files retained per interval specified by |
|
| Directory where audit logs are stored. |
|
| Maximum number of audit log files retained per interval specified by |
|
| Modules for which audit logs are generated. Multiple modules can be specified, separated by a comma and a space. |
|
| Interval at which audit logs are rotated. Valid values: |
|
| Retention period of audit log files. |
|
| Directory where dump logs are stored. |
|
| Modules for which dump logs are generated. Multiple modules can be specified, separated by a comma and a space. |
|
| Interval at which dump log files are rotated. Valid values: |
|
| Maximum number of dump log files retained per interval specified by |
|
| Retention period of dump log files. |
Server process
Parameter | Default value | Description |
|
| IP address of the FE. |
| Empty string | CIDR block for the FE, such as |
|
| HTTP server port of the FE. |
|
| Backlog queue length of the HTTP server. |
|
| Name of the StarRocks instance displayed as the page title in the web UI. |
|
| Thrift server port of the FE. |
|
| Backlog queue length of the Thrift server. |
|
| Service model of the Thrift server. Valid values: |
|
| Maximum number of worker threads supported by the Thrift server. |
|
| Timeout for an idle Thrift server connection. If no requests are sent within this period, the connection is closed. Unit: milliseconds. |
|
| Maximum idle time for bRPC connections. Default value: 10 seconds. Unit: milliseconds. |
|
| MySQL server port of the FE. |
|
| Whether to enable asynchronous I/O for the MySQL server. Valid values: |
|
| Maximum number of threads for the MySQL server to process I/O events. |
|
| Backlog queue length of the MySQL server. |
|
| Maximum number of threads for the MySQL server to process tasks. |
|
| Maximum number of threads supported by the connection scheduler. |
|
| Maximum number of connections allowed per FE. |
|
| Whether to check Java version compatibility on startup. If versions are incompatible, the service fails to start. Valid values: |
Metadata and instance management
Parameter | Default value | Description |
|
| Directory where FE metadata is stored. |
|
| Number of threads for Heartbeat Manager to run heartbeat tasks. |
|
| Size of the blocking queue that stores heartbeat tasks run by Heartbeat Manager. |
|
| Whether to forcibly reset FE metadata. Note Use this parameter with caution. |
|
| Port used for communication among the leader, follower, and observer FEs. |
|
| Type of edit log. Set to |
|
| Heartbeat timeout for the BDB JE-based FE. Unit: seconds. |
|
| Lock timeout for the BDB JE-based FE. Unit: seconds. |
|
| Maximum clock offset allowed between the leader FE and follower or observer FEs. Unit: milliseconds. |
|
| Maximum number of transactions that can be rolled back. |
|
| Maximum time the leader FE waits for ACK messages from follower FEs. Unit: seconds. |
|
| Policy for the leader FE to flush logs to disk. |
|
| Policy for follower FE replicas to flush logs to disk. |
|
| Maximum lag allowed for metadata on follower and observer FEs relative to the leader FE. Unit: seconds. |
|
| ID of the StarRocks instance to which the FE belongs. FEs and BEs with the same ID belong to the same instance. The default value |
Query engine
Parameter | Default value | Description |
|
| Whether to disable colocate joins. Valid values: |
|
| Whether to enable user-defined functions (UDFs). Valid values: |
|
| Interval at which version release validation tasks are issued. Unit: milliseconds. |
|
| Maximum number of rows cached for a statistics table. |
Data import and export
Parameter | Default value | Description |
|
| Thread pool size for data import jobs. |
|
| Polling interval for data import jobs. Unit: seconds. |
|
| Interval at which completed transactions are cleaned up. Unit: seconds. |
|
| Interval at which import job labels are cleaned up. Unit: seconds. |
|
| Version of Spark Dynamic Partition Pruning (DPP). |
| Empty string | Root directory of the Spark dependency package. |
|
| Directory where Spark log files are stored. |
|
| Root directory of the YARN client package. |
|
| Directory where YARN configuration files are stored. |
|
| Polling interval for data export jobs. Unit: seconds. |
|
| Thread pool size for data export jobs. |
Storage
Parameter | Default value | Description |
|
| Interval for storage media migration. Default value: |
|
| Default storage media used when no media is specified during table or partition creation. Valid values: |
|
| Number of tablet-related jobs that can run concurrently in a BE directory. |
|
| Policy for tablet load balancing. Valid values: |
|
| Interval at which the FE retrieves tablet statistics from each BE. Default value: 5 minutes. Unit: seconds. |
Others
Parameter | Default value | Description |
|
| Directory where plugin installation packages are stored. |
|
| Root directory for small files. |
|
| Maximum number of threads in the agent task thread pool. |
|
| Base DN used to search for user authentication information in LDAP. |
|
| Administrator DN used to search for user authentication information in LDAP. |
|
| Password of the LDAP administrator used to search for user authentication information. |
|
| Host on which the LDAP server runs. |
|
| Port of the LDAP server. |
|
| Name of the attribute that identifies users in LDAP objects. |
|
| Directory for temporary files, such as those generated during backup and restore operations. |
|
| Character set used by the FE. |
|
| Maximum number of concurrent threads for loading Hive metadata. |
|
| Interval at which the cached metadata of Hive external tables is refreshed. Unit: seconds. |
|
| Time after which cached Hive external table metadata expires. Default value: 2 hours. Unit: seconds. |
|
| Timeout for a connection to Hive Metastore. Unit: seconds. |
|
| Interval at which the FE retrieves Elasticsearch indexes. Unit: seconds. |
|
| Whether to enable authentication. Valid values: |
|
| Whether to enable periodic metrics collection. Valid values: |
BE parameters
All BE parameters are static parameters and take effect only after a BE restart.
Parameter | Default value | Description |
|
| Thrift server port on the BE, used to receive requests from FEs. |
|
| bRPC port for viewing bRPC network statistics. |
|
| Number of bRPC worker threads. The default value |
| _(empty)_ | Preferred CIDR block for servers with multiple network interfaces. For example: |
|
| Heartbeat service port on the BE, used to receive heartbeats from FEs. |
|
| Number of threads for the heartbeat service. |
|
| Number of threads for creating tablets. |
|
| Number of threads for deleting tablets. |
|
| Number of threads for processing NORMAL-priority load jobs. |
|
| Number of threads for processing HIGH-priority load jobs. |
|
| Number of threads for publishing tablet versions. |
|
| Number of threads for clearing completed transactions. |
|
| Number of threads for schema change operations. |
|
| Number of threads for tablet cloning. |
|
| Number of threads for storage media migration, such as migrating hot data from SSD to HDD. |
|
| Number of threads for checking tablet replica consistency. |
|
| Concurrency for creating snapshots. Lower this value to reduce resource usage. |
| Number of vCPUs | Concurrency for uploading snapshots. Lower this value to reduce bandwidth and I/O usage. |
|
| Interval at which the BE reports job status (table creation, deletion, loading, and schema change) to the FE. Unit: seconds. |
|
| Interval at which the BE reports disk status and data volumes to the FE. Unit: seconds. |
|
| Interval at which the BE reports tablet version information to the FE. Unit: seconds. |
|
| Timeout for a schema change job on the BE. Unit: seconds. |
|
| Directory for BE system logs. |
|
| Directory for UDF files. |
|
| Minimum severity level for BE system log entries. Valid values: |
|
| Maximum log file size before rotation. Default: 1 GB. |
|
| Maximum number of system log files retained. |
| _(empty)_ | Modules for which verbose system logs are generated. For example, setting this to |
|
| Verbosity level for logs prefixed with |
| _(empty)_ | Log flush policy. By default, logs are buffered in memory. |
|
| Number of threads started per CPU core. |
|
| Whether to compress row batches in bRPC calls between BEs during query processing. Set to |
|
| Whether to serialize row batches in bRPC calls between BEs during query processing. Set to |
|
| Interval at which the BE reports query profiles to the FE. Unit: seconds. |
|
| Number of threads in the storage engine's scan thread pool. |
|
| Maximum number of scan tasks queued in the storage engine. |
|
| Granularity at which the storage engine splits query scan ranges. |
|
| Maximum number of scan tasks the storage engine supports. |
|
| Maximum number of data rows returned by each scan thread per call. |
|
| Maximum number of scan keys that can be split. |
|
| Ratio threshold for the STRING type below which dictionary compression is applied. |
|
| Size threshold for a column below which dictionary compression is applied. |
|
| Maximum memory per thread for schema change jobs. Unit: GB. |
|
| Interval at which unused cached file descriptors are evicted. Unit: seconds. |
|
| Interval at which disk status is checked. Unit: seconds. |
|
| Interval at which expired rowsets are cleared. Unit: seconds. |
| _(empty)_ | Root directory for data storage. |
|
| Maximum number of tablets per shard within each storage directory. |
|
| Maximum retention period for pending data in the storage engine. Unit: seconds. |
|
| Retention period for loaded data in incremental cloning scenarios. Unit: seconds. |
|
| Maximum interval for disk garbage collection. Unit: seconds. |
|
| Minimum interval for disk garbage collection. Unit: seconds. |
|
| Retention period for snapshots before they are deleted. Default: 48 hours. Unit: seconds. |
|
| Retention period for files in the recycle bin before they are deleted. Default: 72 hours. Unit: seconds. |
|
| Maximum number of cached file descriptors. |
|
| Minimum number of file descriptors for the BE process. |
|
| Cache capacity for Bloom filter, Min, and Max statistical information. |
|
| Maximum capacity of the page cache. |
|
| Whether to disable the page cache. Set to |
|
| Thread polling interval for base compaction. Unit: seconds. |
|
| Number of threads for base compaction per disk. |
|
| Ratio of cumulative file size to base file size that triggers a base compaction. |
|
| Minimum interval since the last base compaction that triggers another base compaction. Unit: seconds. |
|
| Thread polling interval for cumulative compaction. Unit: seconds. |
|
| Minimum number of singleton files that triggers a cumulative compaction. |
|
| Maximum number of singleton files that triggers a cumulative compaction. |
|
| Number of threads for cumulative compaction per disk. |
|
| Minimum interval before a failed tablet compaction can be rescheduled. Unit: seconds. |
|
| Maximum concurrency for base compactions and cumulative compactions combined. The default value |
|
| HTTP server port on the BE. |
|
| Number of worker threads for the BE HTTP server. |
|
| Interval at which Counter statistics are collected. Unit: milliseconds. |
|
| Retention period for files generated by small-scale load jobs. Unit: hours. |
|
| Retention period for load error log files. Unit: hours. |
|
| Number of threads for Stream Load. |
|
| Maximum file size for a single Stream Load. Unit: MB. |
|
| RPC timeout for Stream Load. Unit: seconds. |
|
| Number of initial threads for query execution. Additional threads are created dynamically as needed. |
|
| Maximum number of queries that can be queued on a single BE node. |
|
| Whether to enable partition-based aggregation. Set to |
|
| Whether to enable token-based authentication checks. Set to |
|
| Maximum memory for all load threads on a BE node. Default: 100 GB. |
|
| Maximum percentage of total memory used by all load threads on a BE node. |
|
| Whether to enable synchronous writes for tablet metadata. Set to |
|
| Timeout for Thrift RPC calls. Unit: milliseconds. |
|
| Timeout for transaction commit RPC calls. Unit: milliseconds. |
|
| Thread pool size for Routine Load. Must be greater than or equal to |
|
| Minimum number of new rowsets since the last tablet meta checkpoint before triggering a new checkpoint. |
|
| Thread polling interval for generating tablet meta checkpoints. Unit: seconds. |
|
| Maximum body size for bRPC messages. Default: 200 MB. |
|
| Maximum number of concurrent transactions supported by the storage engine. |
|
| Size of the tablet map shard. |
|
| Whether to enable the new on-disk storage format for the BITMAP type, which improves |