This topic describes the basic capabilities of the scheduling migration tool in Lakehouse Migration.
Overview
Lakehouse Migration (LHM) allows you to quickly migrate workflows from open source schedulers and other cloud platform schedulers to DataWorks.
The scheduling migration process consists of three steps: exporting source jobs, converting heterogeneous jobs, and importing jobs into DataWorks. Intermediate results are exposed, and the entire migration process is controllable.
Flexible and configurable conversion settings support multiple compute engines including DataWorks + MaxCompute, EMR, and Hologres.
The migration tool is lightweight to deploy and requires only a JDK 17 runtime environment and network connectivity.
Data security is ensured because the entire migration process runs locally and intermediate results are not uploaded.
Scheduling migration capability matrix
The LHM tool currently supports automated migration of the following scheduler tasks to DataWorks.