DataWorks enhances its scheduling capabilities with custom scheduling calendars. With this feature, you can define more flexible scheduling dates and methods for your tasks. This topic describes typical use cases for custom scheduling calendars and explains how to create and use them.
Background
Custom scheduling calendars are ideal for industries and scenarios that require flexible scheduling dates, such as:
-
In the financial industry, tasks must avoid running during market closures such as public holidays and weekends. You can create an annual scheduling calendar that includes only trading days. This lets developers easily select valid run dates and exclude non-trading days when configuring tasks.
-
You can use a custom scheduling calendar to run a task on an hourly basis but only on specific days of the week. For example, you can define a calendar where a task runs normally on Monday, Tuesday, and Wednesday, but performs a dry run on all other days. To achieve this, select the custom calendar in the task's scheduling configuration and set the task to run hourly.
Limitations
-
Only an Alibaba Cloud account, a tenant administrator, or a RAM user with the AliyunDataWorksFullAccess permission can create scheduling calendars. For more information about how to grant permissions, see Add members to a workspace.
-
This feature is available only in DataWorks Enterprise Edition.
-
Each tenant can have up to 10 scheduling calendars.
Navigate to the scheduling calendar configuration page
Go to the Operation Center page.
Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose . On the page that appears, select the desired workspace from the drop-down list and click Go to Operation Center.
-
Navigate to the scheduling calendar configuration page.
In the left-side navigation pane of the Operation Center, click Scheduling Configuration to open the Scheduling Calendars page.
Create a scheduling calendar
On the Scheduling Calendar Management page, click Create Scheduling Calendar. In the panel that appears, configure the following parameters and then click Submit.
-
Basic parameters
Parameter
Description
Name
The name of the scheduling calendar. The name must be unique within the tenant.
Owner
The owner of the scheduling calendar.
Applicable Workspace
The workspaces where this calendar can be used.
You can apply the calendar to all workspaces or only to specific ones. Tasks in the specified workspaces can then use this calendar.
Calendar Constraints
Select a constraint type to control whether the calendar requires a validity period.
-
Strong constraint: Requires a validity period. Every date within this period must be explicitly set as a scheduling day or a non-scheduling day. The system sends reminders before the validity period expires.
-
Weak constraint: Does not require a validity period. You only need to define the scheduling days.
-
-
Calendar constraint configuration
Strong constraint
Parameter
Description
Validity Period
The date range for the calendar. In the Configuration of Scheduling Days section, you must configure every date within this range for either normal scheduling or a dry run.
Expiration Notification
Configure expiration reminders. When enabled, the platform sends an SMS reminder to the calendar owner at
9:30. If no action is taken, the platform makes a reminder phone call on the last day of the validity period. The calendar is automatically disabled after it expires.Node Running Policy for Calendar Expiration
How tasks that use this calendar are scheduled after its validity period expires.
Configuration of Scheduling Days
Click dates on the calendar to define the scheduling behavior for each date. The configuration options differ for strong and weak constraints. Follow the on-screen instructions.
Weak constraint
Parameter
Description
Policy for Node Running on Unconfigured Dates
The scheduling behavior for dates that are not explicitly set as scheduling days in the Configuration of Scheduling Days section.
Configuration of Scheduling Days
Click dates on the calendar to define the scheduling behavior for each date. The configuration options differ for strong and weak constraints. Follow the on-screen instructions.
Use a scheduling calendar
In an authorized workspace, navigate to the section of a node. Change the calendar setting to Custom and select your desired calendar. DataWorks then schedules the node based on the rules defined in that calendar.
A custom scheduling calendar takes effect only when the node's scheduling type is set to Normally Scheduled.
-
If the scheduling type is Normally Scheduled, the node's scheduling behavior follows the policy in the custom scheduling calendar.
-
If the scheduling type is Pause scheduling or Empty Run Scheduling, the node's scheduling type determines its scheduling behavior, overriding the custom calendar.
View reference tasks
In the scheduling calendar list, you can click View Reference Tasks for a specific calendar to see which workspaces and tasks are using it.