Manage data sources-Dataphin(Dataphin)-阿里云帮助中心

Connect your data sources to Dataphin to read raw data and write results back. Dataphin supports a wide range of data source types, including data warehouses such as MaxCompute and Hive, and traditional databases such as MySQL and Oracle.

Permission description

Only custom global roles that have the Create Data Source Permission Point, along with the super administrator, data source administrator, module architect, and project administrator roles, can create data sources.

Feature introduction

Multiple Data Source Types Access: Dataphin provides built-in data source types covering big data storage, file, message queue, relational, and NoSQL categories. For more information, see Dataphin supported data sources.
Custom Data Source Types: If the required data source type is not available among the built-in options, you can create custom offline or real-time data source types and connect them to Dataphin. For more information, see:
- Create a new offline custom source type.
- Create a new real-time custom source type.
Production and Development Data Sources: When adding a data source, you can designate it as a production or development source. The Prod environment for Basic and Dev-Prod projects uses production data sources, while the Dev environment for Dev-Prod projects uses development data sources.
Data Source Tags: You can use custom tags to categorize data sources by business scenario or type.

Note
Sync tasks do not support dual environments for production and development. Data sources in sync tasks are treated as production data sources.

Data source management entry

On the Dataphin home page, choose Management Center > Datasource Management in the top menu bar.

View data source list

After a data source is created, you can view, edit, and delete it from the data source list.

Area	Description
①Function area	My responsibility: Select this option to show only the data sources that the current account is responsible for. Search: Enter a data source name to perform a fuzzy search. Filter: Click to filter data sources based on data source type, data source tag, and owner. Manage tags: Use tags to organize data sources by business scenario. For more information, see Manage data source tags. Create A New Data Source: Create a new data source. For more information, see Dataphin supported data sources. Refresh: Click to refresh the data source list.
②Data source card	Each data source is displayed as a card showing its name, type, application scenarios, tags, owner, description, update time, and connection information. You can also perform the following operations: view application scenarios, view creation user/creation time, view connection information, test connection, Edit, Change Owner, Delete. View application scenarios: Hover over the icon next to the data source type to view the supported application scenarios. Edit: Click Edit in the upper-right corner of a development or production data source to modify its description and connection information. You can also click Edit in the upper-right corner of a data source card to modify the data source name, tag, or encoding. Note After data source encoding is configured, it cannot be modified. After data source encoding is configured, you can preview data on the object details page of the asset directory and asset checklist. Change Owner: In the Change Owner dialog box, select an Owner and click Confirm to transfer ownership to another Dataphin member. Delete: Click Delete in the upper-right corner of a development or production data source to delete it from that environment. You can also click Delete in the upper-right corner of a data source card to delete the entire data source. Deletion is irreversible. Proceed with caution. Important When you delete a data source, the system automatically checks whether the data source is referenced in Dataphin. If referenced objects exist, we recommend that you delete the dependent objects first. If you force the deletion, proceed with caution because the operation is irreversible. The system does not check dependencies of SQL queries and Notebook files on the analysis platform when you delete a data source. Check for such dependencies before you proceed. View creation user/creation time: Hover over the icon next to the update time to view the creator and creation time. View connection information: Click Connection and then View to view or copy connection information. Test connection: Click Connection and then Test to test network connectivity in the Test Network Connectivity dialog box between the public scheduling cluster or custom cluster and the data source.
③Batch operation area	Click Enable Batch Delete Mode to select and delete multiple data sources at a time.