Configure the Salesforce input component
Configure the Salesforce input component to read data from a Salesforce data source into Dataphin for data integration and data development.
Prerequisites
Before you start, complete the following tasks:
You have created a Salesforce data source. For more information, see Create a Salesforce data source.
The account used to configure the component properties must have read-through permissions for the data source. If the permissions are missing, request them. For more information, see Request data source permissions.
Procedure
On the Dataphin home page, choose Develop > Data Integration from the top menu bar.
On the Data Integration page, select a project from the top menu bar. In Dev-Prod mode, also select an environment.
In the left navigation pane, click Offline Integration. In the Offline Integration list, click the offline pipeline that you want to develop to open its configuration page.
In the upper-right corner of the page, click Component Library to open the Component Library panel.
In the navigation pane on the left of the Component Library panel, select Input. Find the Salesforce component in the list of input components on the right and drag it to the canvas.
Click the
icon on the Salesforce input component card to open the Salesforce Input Configuration dialog box.In the Salesforce Input Configuration dialog box, configure the parameters.
Parameter
Description
Step Name
The name of the Salesforce input component. Dataphin automatically generates a step name. You can also change the name as needed. The naming convention is as follows:
The value can contain only Chinese characters, letters, underscores (_), and numbers.
The name cannot exceed 64 characters.
Datasource
The drop-down list displays all Salesforce data sources in Dataphin. Click the
icon to copy the current data source name.For a data source for which you do not have read-through permissions, click Request after the data source name to request the permissions. For more information, see Request data source permissions.
If you do not have a Salesforce data source, click Create Data Source to create one. For more information, see Create a Salesforce data source.
Object
Select the object from which to read data in the Salesforce instance. You can enter a keyword to search for the object, or enter the exact object name and click Exact Match. After you select an object, the system automatically checks its status. Click the
icon to copy the name of the selected object.Batch Read
Enable this option to use the Bulk API to read data in batches.
NoteThe batch mode does not support reading composite field types.
Input Filter (Optional)
Enter filter conditions for the input fields, for example,
ds=${bizdate}. Use the Input Filter in the following scenarios:A fixed segment of data.
Filtering with parameters.
NoteSupported comparison operators include =, !=, <, >, IN, and NOT IN.
Output Fields
The Output Fields area displays all fields from the selected object. If you do not need to output certain fields to downstream components, you can delete them:
To delete a small number of fields, you can click the
icon in the Actions column to delete the unnecessary fields.To delete many fields, click Field Management. On the Field Management page, select multiple fields, click the
icon, and move the fields from the Selected Input Fields list to the Unselected Input Fields list.
Click Confirm to save the configuration.