Overview
Task Scheduler (TS) is a distributed task scheduling framework that enables the distributed processing of tasks. It provides standardized, automated, visual, and centralized scheduling and comprehensive operations management for tasks across different business systems in the finance industry. This ensures all tasks execute in an orderly and efficient manner, which greatly reduces development and O&M costs.
Advantages
Financial-grade high availability
Supports data center-level disaster recovery. A failure of a single machine or an entire data center does not affect running tasks. This ensures your business continues to operate normally.
High reliability and scalability
Supports unlimited horizontal scaling, eliminating performance and capacity bottlenecks. It monitors task execution to promptly detect abnormal or unexecuted tasks. You can use configurable exception handling policies to compensate for any abnormal tasks.
High performance
Its distributed and optimized underlying architecture supports a multilayer scheduling pattern, unlimited splitting, and multi-threading parallel processing. This significantly improves performance when batch processing large volumes of data.
Visualized and centralized management
You can centrally manage tens of thousands of task nodes using an easy-to-use, visual management platform. This simplifies O&M operations and improves processing efficiency.
Scenarios
Batch processing in the finance industry
This scenario requires processing specific data within a set time frame. Traditionally, this is done based on database sharding, where each machine handles one data shard. The problem with this method is that if the number of machines in the cluster exceeds the number of shards, many machines are left idle, which leads to low resource utilization. Cluster tasks allow you to split the data by breaking it down into individual index blocks. Each machine in the cluster is then allocated data to process. This approach is flexible and lets you monitor task execution.
Daily cutover in the finance industry
The daily cutover in the finance industry is a complex operation that requires multiple tasks to be executed in a specific order. Traditionally, the task execution order is hard-coded into the system. This means that when business requirements change, the code must be modified, which results in poor maintainability. You can use the task orchestration feature to easily adjust dependencies between tasks. This greatly improves maintainability and provides a clear view of the task execution status.