Data Studio (new version) tutorial
Learn how to use DataWorks with Spark for big data development and analysis. A user profile analysis case walks you through Data Integration, DataStudio, and Operation Center.
Case introduction
To develop effective business strategies, you can build user profiles from website activity data, such as geographical and social attributes, and analyze the profiles by time and location for fine-grained traffic operations. This case uses DataWorks with EMR Serverless Spark for data synchronization, processing, management, and consumption.
Before you begin, read Tutorial objectives and design for a workflow overview.
Data Studio
This tutorial requires the new Data Studio in DataWorks. To enable it:
-
When you create a workspace, select Use Data Studio (New Version).
-
To upgrade from an older version, click Upgrading at the top of the page.
-
After February 18, 2025, the new Data Studio is enabled by default for accounts that create their first workspace in these regions:
China (Hangzhou), China (Shanghai), China (Beijing), China (Zhangjiakou), China (Ulanqab), China (Shenzhen), China (Chengdu), China (Hong Kong), Japan (Tokyo), Singapore, Malaysia (Kuala Lumpur), Indonesia (Jakarta), Thailand (Bangkok), Germany (Frankfurt), UK (London), US (Silicon Valley), US (Virginia)
Procedure
-
Create the Spark project and DataWorks workspace required for this tutorial. Then, configure the related resource group and network configurations.
-
Configure a data synchronization task in DataWorks to synchronize the user information and access log data provided in this tutorial to a Spark computing resource. Then, query the synchronized data.
-
Use EMR Spark SQL nodes in DataWorks to process data in the user information table and access log table that are synchronized to Spark. This process generates the target user profile data.
-
Configure data quality monitoring rules for the tables generated from data processing. This helps you identify and block dirty data early to prevent its impact from spreading.
-
After the user profile analysis task is complete, data tables are created in EMR. View the generated data tables and their table lineage in the Data Map module.
-
Consume data
After the user profile analysis is complete, use the DataAnalysis module to visualize the processed data. This helps you quickly extract key information and gain insights into business trends.