DataService Studio overview

Quick start in 5 minutes

Prerequisites

After purchasing the DataService Studio value-added service, you can activate Dataphin.

Feature description

The Dataphin data source feature is no longer available. You can use the Dataphin Java Database Connectivity (JDBC) Driver as an alternative. For more information, see Connect to Dataphin using JDBC.

Common data application challenges

The typical process from request to delivery includes request submission, requirement analysis, product design, development documentation, development, functional testing, online deployment, and final delivery. This entire process requires planning for iterations, development, and testing, and typically takes about two weeks. The resulting APIs are highly specific and often meet only the needs of individual business analyses. After an API is developed, you cannot monitor its online usage. If business analysis requirements change, you must submit a new request and schedule another development iteration. This process leads to the following challenges for data applications:

• Long development cycles and slow responses: Development must be scheduled in iterations. The high barrier to data access prevents data from being used on demand.

• Siloed development: Development costs are high and reusability is low because a separate data API is created for each requirement.

• No guarantee of data security or query performance: API development often focuses only on data retrieval. Data security and service stability are frequently overlooked.

• High maintenance costs: Without a centralized online management platform, you cannot monitor for exceptions or receive alerts. Online business issues are addressed only after they occur, which requires code investigation, fixes, and redeployment.

Value of DataService Studio

To address these common challenges, DataService Studio provides both a simple codeless UI and a flexible code editor for developers. This approach lowers the development barrier, improves efficiency, and standardizes code quality, which simplifies management and modifications. For business users, DataService Studio provides secure and stable access to data resources and prevents sensitive data from being exposed in applications. The service also supports operations and maintenance (O&M), monitoring, and alerting. This support allows developers and O&M engineers to promptly identify and fix issues based on abnormal data or alert notifications. The value of DataService Studio is demonstrated in two main areas:

• Data service creation:

  • Allows you to join one or more physical tables into a single logical table. You can then create APIs based on this logical table.

  • Supports a codeless UI and a code editor. You can create APIs for simple queries using the codeless UI. For complex joins, query conditions, or data processing logic, you can use the code editor to create APIs with custom query SQL.

• Management and O&M of data services:

  • Supports environment fencing for draft, development, and production states. Test queries use data from the development environment. Production queries use data from the production environment.

  • Supports service management features such as authentication and changing asset owners. This includes handling service invocation requests, authenticating data queries, and changing the owner of an Asset.

  • Supports alert configurations for service timeouts, failures, and rate limiting. You can receive alert notifications through a DingTalk robot, email, text messages, or phone calls.

  • Monitors and provides statistics on service invocation exceptions. You can view abnormal services, applications, and invocation trends.

  • Provides detailed service invocation log queries. You can view detailed error messages, the specific SQL statements that were executed, and more.

Benefits of DataService Studio

• Unified API standards: Provides unified data API standards and service metadata. This standardizes API development, reduces the integration workload for downstream applications, and improves data ingestion efficiency.

• Security and compliance: Reduces the storage and exposure of detailed and sensitive data in applications. It uses unified platform-level data security control policies. Methods such as API requests and invocations, authentication, traffic control, and whitelists help lower data security management costs.

• Service Monitoring: Supports statistics on service invocations and detailed log queries. This helps O&M engineers and developers troubleshoot issues and promptly fix service invocation exceptions.

You can use the DataService Studio platform to create data service APIs, invoke services, and perform O&M, which lets you manage the entire service lifecycle. Simple configurations on the platform automatically generate and deploy data services, which improves efficiency.

Function Introduction

DataService Studio lets you create service project groups based on physical tables from business data sources or logical tables generated in Dataphin. This helps meet various business requirements. Applications can then invoke APIs. DataService Studio also supports API management, O&M, and monitoring. This helps you promptly find and handle exceptions when you invoke APIs.

For more information about the data source types whose physical tables DataService Studio can read, see Data sources supported by Dataphin.

Scenarios

You can build an API ecosystem for your enterprise. For example, you can expose APIs to partners and developers. This helps your enterprise turn data into valuable assets.

Scenarios and workflows

Before you use DataService Studio, you must understand its scenarios and the operational flows for different roles in each scenario.