Configure custom task parameters-Dataphin(Dataphin)-阿里云帮助中心

Configure custom task parameters to prevent inefficient resource allocation by the computing engine.

Background

Custom task parameters let you specify settings for a computing engine. This avoids compatibility issues caused by engine-specific characteristics and improves the performance of logical table tasks.

Procedure

On the Dataphin homepage, go to Management Center > System Settings in the top menu bar.

In the left-side navigation pane, click Intelligent Engine. On the Custom Task Parameters page, configure the parameters.

Parameter

Description

Enable Custom Parameters

Select whether to enable or disable custom task parameter.

Custom Parameter Settings

Enter custom task parameters that are compatible with the computing engine connected to Dataphin.

set odps.sql.mapper.cpu=100
set odps.sql.mapper.split.size=256
set odps.sql.reducer.cpu=100
set odps.sql.joiner.cpu=100

Note

A materialization configuration at the task node level overrides the custom task parameters set in Intelligent Engine.

After you configure the parameters, click OK.
In the confirmation dialog box, click OK to save the custom task parameters.

You can also restore the default settings. On the Custom Task Parameters page, click Restore Default Settings. In the confirmation dialog box, click OK.