When you develop Application Flows, you need to access external services like models and databases. You can create reusable connections to store access credentials and configurations, and then select these connections directly in Application Flow nodes.
Model service connection
A Model Service connection manages the various model services invoked in a LangStudio workflow.
To configure a connection, go to LangStudio > Connection > Model Service, and click New Connection. The following table describes the key parameters for different connection types.
Connection type | Description |
General LLM Service | Configures an LLM service that is compatible with the OpenAI protocol.
|
General Embedding Model Service | Configures an embedding model service deployed to EAS or a third-party platform. |
General Multimodal Embedding Model Service | Configures a multimodal embedding model service deployed to EAS or a third-party platform. It supports the vectorization of multimodal data, including images and text. |
Alibaba Cloud Model Studio Service | Enter an |
DeepSeek Model Service |
|
AI Search Open Platform Model Service | You must first activate the service. Then, refer to Get Service Endpoint and Manage API Keys to configure the |
Multimodal Label Model | Enables intelligent labeling of multimodal data. |
General reranker service | Reranks the top-k documents that an embedding model returns. Only supports model services deployed from Model Gallery. |
Database connection
A Database connection stores the access configurations for various databases.
To configure a connection, go to LangStudio > Connection > Database, and click New Connection. The following table describes the key parameters.
Database | Description |
Search and Analysis Service - Elasticsearch |
|
OpenSearch |
|
Milvus |
|
Hologres |
|
ApsaraDB RDS for MySQL |
|
Search service connection
Create a connection for Alibaba Cloud IQS Internet Search to enable real-time internet search for LLM applications.
Prerequisites
Ensure that you have activated Alibaba Cloud Information Query Service. For more information, see New User Guide.
Configuration steps
Go to LangStudio and select a region and Workspace.
Go to the Connection > Search Service tab and click New Connection.
Connection Type: Select Alibaba Cloud IQS Internet Search.
api_key: Find your key on the Information Query Service - credential management page.
Custom connection
If the Model Service, Database, and Search Service connections do not meet your needs, you can create a Custom connection using a key-value pair.
Example: Configure a SerpApi connection.
Custom key: Enter
api_key.Custom value: Enter your SerpApi API Key.
You can register for an account and get an API Key from the official SerpApi website (the free plan provides 100 searches per month).
Next steps
After you create a connection, you can use it in Application Flow development.