Overview of data backfill tasks
Dataphin data backfill tasks can replenish historical data and write it to the corresponding time partition. If scheduling parameters are used in the code, these parameters will be automatically replaced with specific values based on the data timestamp selected during data backfill. The corresponding time data will be written to the appropriate partition combined with the business code. This helps you complete and correct missing, erroneous, duplicate, or incomplete data.
Scheduling types
Dataphin data backfill tasks support two scheduling types: timed scheduling and manual execution.
Timed scheduling: Refers to data backfill tasks that can run automatically at preset times, which can be scheduled by Day, Week, or Month. This is suitable for scenarios where scheduling policies and time points are fixed, and data backfill needs to be performed regularly. For more information, see View and manage timed scheduling data backfill tasks.
Manual execution: Refers to manually triggering the execution of data backfill tasks, generally used for temporary data completion or verification of data backfill effects. For nodes that frequently require data backfill, but where the time and data timestamp for backfill are uncertain, you can create manually executed data backfill tasks to reduce the complexity of repeated configuration. For more information, see View and manage manually executed data backfill tasks.
Data backfill task page entry
In the top menu bar of the Dataphin homepage, select Develop > O&M.
In the left navigation bar, select O&M > Data Backfill Flow to enter the Data Backfill Flow page.