Structured output (JSON mode) makes the model return a valid JSON string that your code can parse directly, without extra text like json that breaks downstream parsing.
Usage
To enable structured output, set response_format in your request with two requirements:
Set the
response_formatparameter to{"type": "json_object"}in the request body.Include the word "JSON" (case-insensitive) in your system message or user message. Without it, the API returns:
'messages' must contain the word 'json' in some form, to use 'response_format' of type 'json_object'.
Supported models
Qwen
Text generation models
Qwen-Max (non-thinking mode): Qwen3.6-Max series, Qwen3-Max series, Qwen-Max series
Qwen-Plus (non-thinking mode): Qwen3.7-Plus series, Qwen3.6-Plus series, Qwen3.5-Plus series, Qwen-Plus series
Qwen-Flash (non-thinking mode): Qwen3.6-Flash series, Qwen3.5-Flash series, Qwen-Flash series
Qwen-Turbo (non-thinking mode): Qwen-Turbo series
Qwen-Coder: Qwen3-Coder series
Qwen-Long: Qwen-Long series
Qwen3.6 open-source series (non-thinking mode)
Qwen3.5 open-source series (non-thinking mode)
Qwen3 open-source series (non-thinking mode)
Qwen3-Coder open-source series
Qwen2.5 open-source series (excluding math and coder models)
Multimodal models
Qwen-VL (non-thinking mode): Qwen3-VL-Plus series, Qwen3-VL-Flash series, Qwen-VL-Max series (excluding the latest and snapshot versions), Qwen-VL-Plus series (excluding the latest and snapshot versions)
Qwen-Omni: Qwen3.5-Omni-Plus series, Qwen3.5-Omni-Flash series
Qwen3-VL open-source series (non-thinking mode)
Kimi
Deployed on Alibaba Cloud Model Studio
kimi-k2-thinking
Deployed by Moonshot AI
kimi/kimi-k2.7-code-highspeed, kimi/kimi-k2.7-code, kimi/kimi-k2.6, kimi/kimi-k2.5
DeepSeek
Deployed on Alibaba Cloud Model Studio
deepseek-v4-pro, deepseek-v4-flash
Deployed by Kuaishou Wanqing
vanchin/deepseek-v3.2-think,vanchin/deepseek-v3, vanchin/deepseek-ocr
GLM
glm-5.1, glm-4.5, glm-4.5-air
Non-thinking mode: glm-5, glm-4.7, glm-4.6
Stepfun
Hybrid thinking mode: stepfun/step-3.7-flash
Getting started
This example extracts structured information from a personal profile.
Obtain an API key and export the API key as an environment variable. If you use the OpenAI SDK or DashScope SDK to make calls, install the SDK.
OpenAI compatible
Python
from openai import OpenAI
import os
client = OpenAI(
# If you haven't configured an environment variable, replace the next line with: api_key="sk-xxx"
# API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
api_key=os.getenv("DASHSCOPE_API_KEY"),
# This is the Beijing region base_url. If you use Singapore region models, replace base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1
base_url="https://dashscope.aliyuncs.com/compatible-mode/v1",
)
completion = client.chat.completions.create(
model="qwen-flash",
messages=[
{
"role": "system",
"content": "Extract the user's name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling",
},
],
response_format={"type": "json_object"}
)
json_string = completion.choices[0].message.content
print(json_string)Response
{
"Name": "Alex Brown",
"Age": 34
}Node.js
import OpenAI from "openai";
const openai = new OpenAI({
// If you haven't configured an environment variable, replace the next line with: apiKey: "sk-xxx"
// API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
apiKey: process.env.DASHSCOPE_API_KEY,
// This is the Beijing region base_url. If you use Singapore region models, replace base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1
baseURL: "https://dashscope.aliyuncs.com/compatible-mode/v1"
});
const completion = await openai.chat.completions.create({
model: "qwen-flash",
messages: [
{
role: "system",
content: "Extract the user's name and age, and return them in JSON format"
},
{
role: "user",
content: "Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling"
}
],
response_format: {
type: "json_object"
}
});
const jsonString = completion.choices[0].message.content;
console.log(jsonString);Response
{
"name": "Alex Brown",
"age": 34
}curl
# ======= Important notes =======
# API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
# This is the Beijing region base_url. If you use Singapore region models, replace base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1/chat/completions
# === Delete this comment before running ===
curl -X POST https://dashscope.aliyuncs.com/compatible-mode/v1/chat/completions \
-H "Authorization: Bearer $DASHSCOPE_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "qwen-plus",
"messages": [
{
"role": "system",
"content": "Extract the user'\''s name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'\''m 34 years old, my email is alexbrown@example.com"
}
],
"response_format": {
"type": "json_object"
}
}'Response
{
"choices": [
{
"message": {
"role": "assistant",
"content": "{\"name\":\"Alex Brown\",\"age\":\"34 years old\"}"
},
"finish_reason": "stop",
"index": 0,
"logprobs": null
}
],
"object": "chat.completion",
"usage": {
"prompt_tokens": 207,
"completion_tokens": 20,
"total_tokens": 227,
"prompt_tokens_details": {
"cached_tokens": 0
}
},
"created": 1756455080,
"system_fingerprint": null,
"model": "qwen-plus",
"id": "chatcmpl-624b665b-fb93-99e7-9ebd-bb6d86d314d2"
}DashScope
Python
import os
import dashscope
# If you use Singapore region models, uncomment the following line
# dashscope.base_http_api_url = "https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1"
messages=[
{
"role": "system",
"content": "Extract the user's name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling",
},
]
response = dashscope.Generation.call(
# If you haven't configured an environment variable, replace the next line with: api_key="sk-xxx" (Alibaba Cloud Model Studio API key),
api_key=os.getenv('DASHSCOPE_API_KEY'),
model="qwen-flash",
messages=messages,
result_format='message',
response_format={'type': 'json_object'}
)
json_string = response.output.choices[0].message.content
print(json_string)Response
{
"name": "Alex Brown",
"age": 34
}Java
DashScope Java SDK version must be 2.18.4 or higher.
// DashScope Java SDK version must be 2.18.4 or higher
import java.util.Arrays;
import java.lang.System;
import com.alibaba.dashscope.aigc.generation.Generation;
import com.alibaba.dashscope.aigc.generation.GenerationParam;
import com.alibaba.dashscope.aigc.generation.GenerationResult;
import com.alibaba.dashscope.common.Message;
import com.alibaba.dashscope.common.Role;
import com.alibaba.dashscope.exception.ApiException;
import com.alibaba.dashscope.exception.InputRequiredException;
import com.alibaba.dashscope.exception.NoApiKeyException;
import com.alibaba.dashscope.common.ResponseFormat;
import com.alibaba.dashscope.utils.Constants;
public class Main {
// If you use Singapore region models, uncomment the following line
// static {Constants.baseHttpApiUrl="https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1";}
public static GenerationResult callWithMessage() throws ApiException, NoApiKeyException, InputRequiredException {
Generation gen = new Generation();
Message systemMsg = Message.builder()
.role(Role.SYSTEM.getValue())
.content("Extract the user's name and age, and return them in JSON format")
.build();
Message userMsg = Message.builder()
.role(Role.USER.getValue())
.content("Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling")
.build();
ResponseFormat jsonMode = ResponseFormat.builder().type("json_object").build();
GenerationParam param = GenerationParam.builder()
// If you haven't configured an environment variable, replace the next line with: .apiKey("sk-xxx") (Alibaba Cloud Model Studio API key)
.apiKey(System.getenv("DASHSCOPE_API_KEY"))
.model("qwen-flash")
.messages(Arrays.asList(systemMsg, userMsg))
.resultFormat(GenerationParam.ResultFormat.MESSAGE)
.responseFormat(jsonMode)
.build();
return gen.call(param);
}
public static void main(String[] args) {
try {
GenerationResult result = callWithMessage();
System.out.println(result.getOutput().getChoices().get(0).getMessage().getContent());
} catch (ApiException | NoApiKeyException | InputRequiredException e) {
// Log the exception using a logging framework
System.err.println("An error occurred while calling the generation service: " + e.getMessage());
}
}
}Response
{
"name": "Alex Brown",
"age": 34
}curl
# ======= Important notes =======
# API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
# This is the Beijing region URL. If you use Singapore region models, replace the URL with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1/services/aigc/text-generation/generation
# === Delete this comment before running ===
curl -X POST https://dashscope.aliyuncs.com/api/v1/services/aigc/text-generation/generation \
-H "Authorization: Bearer $DASHSCOPE_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "qwen-flash",
"input": {
"messages": [
{
"role": "system",
"content": "Extract the user'\''s name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'\''m 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling"
}
]
},
"parameters": {
"result_format": "message",
"response_format": {
"type": "json_object"
}
}
}'Response
{
"name": "Alex Brown",
"age": 34
}Image and video data processing
Multimodal models also support structured output for images and videos. Use JSON mode to extract structured data from visual content, such as field values from receipts, object locations in images, or events in video.
For image and video file limits, see Image and video understanding .
OpenAI compatible
Python
import os
from openai import OpenAI
client = OpenAI(
# If you haven't configured an environment variable, replace the next line with: api_key="sk-xxx" (Alibaba Cloud Model Studio API key),
# API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
api_key=os.getenv("DASHSCOPE_API_KEY"),
# This is the Beijing region base_url. If you use Singapore region models, replace base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1
base_url="https://dashscope.aliyuncs.com/compatible-mode/v1",
)
completion = client.chat.completions.create(
model="qwen3-vl-plus",
messages=[
{
"role": "system",
"content": [{"type": "text", "text": "You are a helpful assistant."}],
},
{
"role": "user",
"content": [
{
"type": "image_url",
"image_url": {
"url": "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"
},
},
{"type": "text", "text": "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"},
],
},
],
response_format={"type": "json_object"}
)
json_string = completion.choices[0].message.content
print(json_string)Response
{
"ticket": [
{
"travel_date": "2013-06-29",
"trains": "stream",
"seat_num": "371",
"arrival_site": "Development Zone",
"price": "8.00"
}
],
"invoice": [
{
"invoice_code": "221021325353",
"invoice_number": "10283819"
}
]
}Node.js
import OpenAI from "openai";
const openai = new OpenAI({
// If you haven't configured an environment variable, replace the next line with: apiKey: "sk-xxx" (Model Studio API key)
// API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
apiKey: process.env.DASHSCOPE_API_KEY,
// This is the Beijing region base_url. If you use Singapore region models, replace base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1
baseURL: "https://dashscope.aliyuncs.com/compatible-mode/v1"
});
async function main() {
const response = await openai.chat.completions.create({
model: "qwen3-vl-plus",
messages: [{
role: "system",
content: [{
type: "text",
text: "You are a helpful assistant."
}]
},
{
role: "user",
content: [{
type: "image_url",
image_url: {
"url": "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"
}
},
{
type: "text",
text: "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"
}
]
}
],
response_format: {type: "json_object"}
});
console.log(response.choices[0].message.content);
}
main()Response
{
"ticket": [
{
"travel_date": "2013-06-29",
"trains": "stream",
"seat_num": "371",
"arrival_site": "Development Zone",
"price": "8.00"
}
],
"invoice": [
{
"invoice_code": "221021325353",
"invoice_number": "10283819"
}
]
}curl
# ======= Important notes =======
# API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
# This is the Beijing region base_url. If you use Singapore region models, replace base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1/chat/completions
# === Delete this comment before running ===
curl --location 'https://dashscope.aliyuncs.com/compatible-mode/v1/chat/completions' \
--header "Authorization: Bearer $DASHSCOPE_API_KEY" \
--header 'Content-Type: application/json' \
--data '{
"model": "qwen3-vl-plus",
"messages": [
{"role":"system",
"content":[
{"type": "text", "text": "You are a helpful assistant."}]},
{
"role": "user",
"content": [
{"type": "image_url", "image_url": {"url": "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"}},
{"type": "text", "text": "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"}
]
}],
"response_format":{"type": "json_object"}
}'Response
{
"ticket": [
{
"travel_date": "2013-06-29",
"trains": "stream",
"seat_num": "371",
"arrival_site": "Development Zone",
"price": "8.00"
}
],
"invoice": [
{
"invoice_code": "221021325353",
"invoice_number": "10283819"
}
]
}DashScope
Python
import os
import dashscope
# If you use Singapore region models, uncomment the following line
# dashscope.base_http_api_url = "https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1"
messages = [
{
"role": "system",
"content": [
{"text": "You are a helpful assistant."}]
},
{
"role": "user",
"content": [
{"image": "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"},
{"text": "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"}]
}]
response = dashscope.MultiModalConversation.call(
# If you haven't configured an environment variable, replace the next line with: api_key ="sk-xxx" (Model Studio API key)
api_key = os.getenv('DASHSCOPE_API_KEY'),
model = 'qwen3-vl-plus',
messages = messages,
response_format={'type': 'json_object'}
)
json_string = response.output.choices[0].message.content[0]["text"]
print(json_string)import os
import dashscope
# For Beijing region models, replace the URL with: https://dashscope.aliyuncs.com/api/v1
dashscope.base_http_api_url = 'https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1'
messages = [
{
"role": "system",
"content": [
{"text": "You are a helpful assistant."}]
},
{
"role": "user",
"content": [
{"image": "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"},
{"text": "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"}]
}]
response = dashscope.MultiModalConversation.call(
# If you haven't configured an environment variable, replace the next line with: api_key ="sk-xxx" (Model Studio API key)
api_key = os.getenv('DASHSCOPE_API_KEY'),
model = 'qwen3-vl-plus',
messages = messages,
response_format={'type': 'json_object'}
)
json_string = response.output.choices[0].message.content[0]["text"]
print(json_string)Response
{
"ticket": [
{
"travel_date": "2013-06-29",
"trains": "Liushui",
"seat_num": "371",
"arrival_site": "Development Zone",
"price": "8.00"
}
],
"invoice": [
{
"invoice_code": "221021325353",
"invoice_number": "10283819"
}
]
}Java
// DashScope Java SDK version must be 2.21.4 or higher
import java.util.Arrays;
import java.util.Collections;
import com.alibaba.dashscope.aigc.multimodalconversation.MultiModalConversation;
import com.alibaba.dashscope.aigc.multimodalconversation.MultiModalConversationParam;
import com.alibaba.dashscope.aigc.multimodalconversation.MultiModalConversationResult;
import com.alibaba.dashscope.common.MultiModalMessage;
import com.alibaba.dashscope.common.Role;
import com.alibaba.dashscope.exception.ApiException;
import com.alibaba.dashscope.exception.NoApiKeyException;
import com.alibaba.dashscope.exception.UploadFileException;
import com.alibaba.dashscope.common.ResponseFormat;
import com.alibaba.dashscope.utils.Constants;
public class Main {
// If you use Singapore region models, uncomment the following line
// static {Constants.baseHttpApiUrl="https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1";}
public static void simpleMultiModalConversationCall()
throws ApiException, NoApiKeyException, UploadFileException {
MultiModalConversation conv = new MultiModalConversation();
MultiModalMessage systemMessage = MultiModalMessage.builder().role(Role.SYSTEM.getValue())
.content(Arrays.asList(
Collections.singletonMap("text", "You are a helpful assistant."))).build();
MultiModalMessage userMessage = MultiModalMessage.builder().role(Role.USER.getValue())
.content(Arrays.asList(
Collections.singletonMap("image", "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"),
Collections.singletonMap("text", "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"))).build();
ResponseFormat jsonMode = ResponseFormat.builder().type("json_object").build();
MultiModalConversationParam param = MultiModalConversationParam.builder()
// If you haven't configured an environment variable, replace the next line with: .apiKey("sk-xxx") (Model Studio API key)
.apiKey(System.getenv("DASHSCOPE_API_KEY"))
.model("qwen3-vl-plus")
.messages(Arrays.asList(systemMessage, userMessage))
.responseFormat(jsonMode)
.build();
MultiModalConversationResult result = conv.call(param);
System.out.println(result.getOutput().getChoices().get(0).getMessage().getContent().get(0).get("text"));
}
public static void main(String[] args) {
try {
simpleMultiModalConversationCall();
} catch (ApiException | NoApiKeyException | UploadFileException e) {
System.out.println(e.getMessage());
}
}
}Response
{
"ticket": [
{
"travel_date": "2013-06-29",
"trains": "stream",
"seat_num": "371",
"arrival_site": "Development Zone",
"price": "8.00"
}
],
"invoice": [
{
"invoice_code": "221021325353",
"invoice_number": "10283819"
}
]
}curl
# ======= Important notes =======
# API keys differ by region. Get an API key: https://help.aliyun.com/en/model-studio/get-api-key
# This is the Beijing region URL. If you use Singapore region models, replace the URL with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
# === Delete this comment before running ===
curl -X POST https://dashscope.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation \
-H "Authorization: Bearer $DASHSCOPE_API_KEY" \
-H 'Content-Type: application/json' \
-d '{
"model": "qwen3-vl-plus",
"input":{
"messages":[
{"role": "system",
"content": [
{"text": "You are a helpful assistant."}]},
{
"role": "user",
"content": [
{"image": "http://duguang-labelling.oss-cn-shanghai.aliyuncs.com/demo_ocr/receipt_zh_demo.jpg"},
{"text": "Extract ticket (array type, including travel_date, trains, seat_num, arrival_site, price) and invoice information (array type, including invoice_code and invoice_number) from the image. Output a JSON containing both ticket and invoice arrays"}
]
}
]
},
"parameters": {
"response_format": {"type": "json_object"}
}
}'Response
{
"output": {
"choices": [
{
"message": {
"content": [
{
"text": "{\n \"ticket\": [\n {\n \"travel_date\": \"2013-06-29\",\n \"trains\": \"train number\",\n \"seat_num\": \"371\",\n \"arrival_site\": \"Development Zone\",\n \"price\": \"8.00\"\n }\n ],\n \"invoice\": [\n {\n \"invoice_code\": \"221021325353\",\n \"invoice_number\": \"10283819\"\n }\n ]\n}"
}
],
"role": "assistant"
},
"finish_reason": "stop"
}
]
},
"usage": {
"total_tokens": 598,
"input_tokens_details": {
"image_tokens": 418,
"text_tokens": 68
},
"output_tokens": 112,
"input_tokens": 486,
"output_tokens_details": {
"text_tokens": 112
},
"image_tokens": 418
},
"request_id": "b129dce1-0d5d-4772-b8b5-bd3a1d5cde63"
}Structured output for thinking models
When structured output is enabled for thinking models, the model reasons first and then generates JSON. This typically produces more accurate results than non-thinking models. Only glm-4.5, glm-4.5-air, and kimi-k2-thinking support this feature.
OpenAI compatible
Python
Sample code
from openai import OpenAI
import os
# Initialize the OpenAI client
client = OpenAI(
# If you haven't configured an environment variable, replace with: api_key="sk-xxx" (Alibaba Cloud Model Studio API key)
api_key=os.getenv("DASHSCOPE_API_KEY"),
base_url="https://dashscope.aliyuncs.com/compatible-mode/v1",
)
messages=[
{
"role": "system",
"content": "Extract the user's name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling",
},
]
completion = client.chat.completions.create(
model="kimi-k2-thinking",
messages=messages,
extra_body={"enable_thinking": True},
stream=True,
stream_options={
"include_usage": True
},
response_format={"type": "json_object"}
)
reasoning_content = "" # Full reasoning process
answer_content = "" # Full response
is_answering = False # Whether the response phase has started
print("\n" + "=" * 20 + "Reasoning process" + "=" * 20 + "\n")
for chunk in completion:
if not chunk.choices:
print("\nUsage:")
print(chunk.usage)
continue
delta = chunk.choices[0].delta
# Collect only reasoning content
if hasattr(delta, "reasoning_content") and delta.reasoning_content is not None:
if not is_answering:
print(delta.reasoning_content, end="", flush=True)
reasoning_content += delta.reasoning_content
# Received content, start responding
if hasattr(delta, "content") and delta.content:
if not is_answering:
print("\n" + "=" * 20 + "Full response" + "=" * 20 + "\n")
is_answering = True
print(delta.content, end="", flush=True)
answer_content += delta.contentResponse
==================== Reasoning Process ====================
The user requests that you extract the name and age information and return it in JSON format.
From the text, you can see:
- Name: Alex Brown
- Age: 34
- Mailbox: alexbrown@example.com (but the user requests only the name and age)
- Hobbies: playing basketball and traveling (but the user requests only the name and age)
Per the requirements, you need to extract only the name and age information and return it in JSON format.
The JSON format should be:
{
"name": "Alex Brown",
"age": 34
}
Or using Chinese keys:
{
"姓名": "刘五",
"年龄": 34
}
Because the user's request is in Chinese, using Chinese keys may be more appropriate. However, using English keys for JSON is a common practice. In this case, English keys are used because the instruction is technical and follows standard JSON conventions.
Final output:
{
"name": "Alex Brown",
"age": 34
}
==================== Complete Response ====================
{"name":"Alex Brown","age":34}
Usage:
CompletionUsage(completion_tokens=203, prompt_tokens=48, total_tokens=251, completion_tokens_details=CompletionTokensDetails(accepted_prediction_tokens=None, audio_tokens=None, reasoning_tokens=190, rejected_prediction_tokens=None), prompt_tokens_details=None)Node.js
Sample code
import OpenAI from "openai";
import process from 'process';
// Initialize the OpenAI client
const openai = new OpenAI({
apiKey: process.env.DASHSCOPE_API_KEY, // Read from the environment variable
baseURL: 'https://dashscope.aliyuncs.com/compatible-mode/v1'
});
let reasoningContent = '';
let answerContent = '';
let isAnswering = false;
async function main() {
try {
const messages = [
{
"role": "system",
"content": "Extract the user's name and age information and return it in JSON format"
},
{
"role": "user",
"content": "Hello everyone, my name is Alex Brown, I am 34 years old, my email address is alexbrown@example.com, and I enjoy playing basketball and traveling",
},
];
const stream = await openai.chat.completions.create({
model: 'glm-4.5',
messages,
stream: true,
enable_thinking: true,
response_format: {type: 'json_object'},
});
console.log('\n' + '='.repeat(20) + 'Reasoning Process' + '='.repeat(20) + '\n');
for await (const chunk of stream) {
if (!chunk.choices?.length) {
console.log('\nUsage:');
console.log(chunk.usage);
continue;
}
const delta = chunk.choices[0].delta;
// Collect only reasoning content
if (delta.reasoning_content !== undefined && delta.reasoning_content !== null) {
if (!isAnswering) {
process.stdout.write(delta.reasoning_content);
}
reasoningContent += delta.reasoning_content;
}
// When content is received, start generating the response
if (delta.content !== undefined && delta.content) {
if (!isAnswering) {
console.log('\n' + '='.repeat(20) + 'Complete Response' + '='.repeat(20) + '\n');
isAnswering = true;
}
process.stdout.write(delta.content);
answerContent += delta.content;
}
}
} catch (error) {
console.error('Error:', error);
}
}
main();Response
====================Reasoning process====================
The user requests extracting name and age information and returning it in JSON format.
From the text:
- Name: Alex Brown
- Age: 34
- Email: alexbrown@example.com (but the user only requested name and age)
- Hobbies: playing basketball and traveling (but the user only requested name and age)
According to the request, only extract name and age information and return it in JSON format.
The JSON format should be:
{
"name": "Alex Brown",
"age": 34
}
Or using English keys:
{
"name": "Alex Brown",
"age": 34
}
Although the user's instruction was in Chinese, using English keys for JSON is standard practice. Therefore, I will use English keys for the JSON output.
Final output:
{
"name": "Alex Brown",
"age": 34
}
====================Full response====================
{"name":"Alex Brown","age":34}
Usage:
CompletionUsage(completion_tokens=203, prompt_tokens=48, total_tokens=251, completion_tokens_details=CompletionTokensDetails(accepted_prediction_tokens=None, audio_tokens=None, reasoning_tokens=190, rejected_prediction_tokens=None), prompt_tokens_details=None)HTTP
Sample code
curl
curl -X POST https://dashscope.aliyuncs.com/compatible-mode/v1/chat/completions \
-H "Authorization: Bearer $DASHSCOPE_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "glm-4.5",
"messages": [
{
"role": "system",
"content": "Extract the user'\''s name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'\''m 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling"
}
],
"stream": true,
"stream_options": {
"include_usage": true
},
"enable_thinking": true,
"response_format": {
"type": "json_object"
}
}'DashScope
Python
Sample code
import os
from dashscope import Generation
import dashscope
messages = [
{
"role": "system",
"content": "Extract the user's name and age, and return them in JSON format"
},
{"role": "user", "content": "Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling"}
]
completion = Generation.call(
# If you haven't configured an environment variable, replace the next line with: api_key = "sk-xxx" (Alibaba Cloud Model Studio API key),
api_key=os.getenv("DASHSCOPE_API_KEY"),
model="glm-4.5",
messages=messages,
result_format="message",
enable_thinking=True,
response_format={"type": "json_object"},
stream=True,
incremental_output=True
)
# Define full reasoning process
reasoning_content = ""
# Define full response
answer_content = ""
# Determine if reasoning has ended and response has started
is_answering = False
print("=" * 20 + "Reasoning process" + "=" * 20)
for chunk in completion:
# Ignore if both reasoning and response are empty
if (
chunk.output.choices[0].message.content == ""
and chunk.output.choices[0].message.reasoning_content == ""
):
pass
else:
# If currently in reasoning process
if (
chunk.output.choices[0].message.reasoning_content != ""
and chunk.output.choices[0].message.content == ""
):
print(chunk.output.choices[0].message.reasoning_content, end="", flush=True)
reasoning_content += chunk.output.choices[0].message.reasoning_content
# If currently in response
elif chunk.output.choices[0].message.content != "":
if not is_answering:
print("\n" + "=" * 20 + "Full response" + "=" * 20)
is_answering = True
print(chunk.output.choices[0].message.content, end="", flush=True)
answer_content += chunk.output.choices[0].message.content
Response
====================Thinking Process====================
1. **Identify the user's goal:** The user wants me to extract specific information (name and age) from their sentence and return it in a specific format (JSON).
...
7. **Final Review:**
* Does the JSON contain the name "Alex Brown"? Yes.
* Does the JSON contain the age 34? Yes.
* Is the format valid JSON? Yes.
* Does it directly answer the user's request? Yes.
This process is simple because it is a direct information extraction task. The key is to parse the Chinese sentence to find patterns ("My name is...", "... years old this year"), and then correctly format the extracted data as required.
====================Complete Response====================
{ "Name": "Alex Brown",
"Age": 34
}Java
Sample code
// DashScope SDK version >= 2.19.4
import com.alibaba.dashscope.aigc.generation.Generation;
import com.alibaba.dashscope.aigc.generation.GenerationParam;
import com.alibaba.dashscope.aigc.generation.GenerationResult;
import com.alibaba.dashscope.common.Message;
import com.alibaba.dashscope.common.Role;
import com.alibaba.dashscope.exception.ApiException;
import com.alibaba.dashscope.exception.InputRequiredException;
import com.alibaba.dashscope.exception.NoApiKeyException;
import io.reactivex.Flowable;
import java.lang.System;
import java.util.Arrays;
import java.util.List;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import com.alibaba.dashscope.common.ResponseFormat;
public class Main {
private static final Logger logger = LoggerFactory.getLogger(Main.class);
private static StringBuilder reasoningContent = new StringBuilder();
private static StringBuilder finalContent = new StringBuilder();
private static boolean isFirstPrint = true;
private static void handleGenerationResult(GenerationResult message) {
String reasoning = message.getOutput().getChoices().get(0).getMessage().getReasoningContent();
String content = message.getOutput().getChoices().get(0).getMessage().getContent();
if (!reasoning.isEmpty()) {
reasoningContent.append(reasoning);
if (isFirstPrint) {
System.out.println("====================Reasoning process====================");
isFirstPrint = false;
}
System.out.print(reasoning);
}
if (!content.isEmpty()) {
finalContent.append(content);
if (!isFirstPrint) {
System.out.println("\n====================Full response====================");
isFirstPrint = true;
}
System.out.print(content);
}
}
private static GenerationParam buildGenerationParam(List<Message> msgs) {
ResponseFormat jsonMode = ResponseFormat.builder().type("json_object").build();
return GenerationParam.builder()
// If you haven't configured an environment variable, replace the next line with: .apiKey("sk-xxx") (Alibaba Cloud Model Studio API key)
.apiKey(System.getenv("DASHSCOPE_API_KEY"))
.model("glm-4.5")
.enableThinking(true)
.incrementalOutput(true)
.resultFormat("message")
.messages(msgs)
.responseFormat(jsonMode)
.build();
}
public static void streamCallWithMessage(Generation gen, List<Message> msgs)
throws NoApiKeyException, ApiException, InputRequiredException {
GenerationParam param = buildGenerationParam(msgs);
Flowable<GenerationResult> result = gen.streamCall(param);
result.blockingForEach(message -> handleGenerationResult(message));
}
public static void main(String[] args) {
try {
Generation gen = new Generation();
Message systemMsg = Message.builder().role(Role.SYSTEM.getValue()).content("Extract the user's name and age, and return them in JSON format").build();
Message userMsg = Message.builder().role(Role.USER.getValue()).content("Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling").build();
List<Message> msgs = Arrays.asList(systemMsg, userMsg);
streamCallWithMessage(gen, msgs);
} catch (ApiException | NoApiKeyException | InputRequiredException e) {
logger.error("An exception occurred: {}", e.getMessage());
}
}
}Response
====================Reasoning process====================
1. **Identify the user's goal:** The user wants me to extract specific information (name and age) from their sentence and return it in a specific format (JSON).
...
7. **Final review:**
* Does the JSON contain the name "Alex Brown"? Yes.
* Does the JSON contain the age 34? Yes.
* Is the format valid JSON? Yes.
* Does it directly answer the user's request? Yes.
This process is straightforward because it's a direct information extraction task. The key is parsing the Chinese sentence to find patterns ("My name is...", "I'm ... years old") and then formatting the extracted data correctly as requested.
====================Full response====================
{ "name": "Alex Brown",
"age": 34
}HTTP
Sample code
curl
curl -X POST "https://dashscope.aliyuncs.com/api/v1/services/aigc/text-generation/generation" \
-H "Authorization: Bearer $DASHSCOPE_API_KEY" \
-H "Content-Type: application/json" \
-H "X-DashScope-SSE: enable" \
-d '{
"model": "glm-4.5",
"input":{
"messages":[
{
"role": "system",
"content": "Extract the user'\''s name and age, and return them in JSON format"
},
{
"role": "user",
"content": "Hi everyone, my name is Alex Brown, I'\''m 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling"
}
]
},
"parameters":{
"enable_thinking": true,
"incremental_output": true,
"result_format": "message",
"response_format": {
"type": "json_object"
}
}
}'Optimize prompts
Ambiguous prompts like "return user information" lead to unpredictable output structures. For reliable results, describe the expected schema in your prompt: specify field names, types, required vs. optional status, format constraints (such as date format), and include examples.
OpenAI compatible
Python
from openai import OpenAI
import os
import json
import textwrap # Used to handle the indentation of multi-line strings and improve code readability.
# Predefine example responses to show the model the expected output format.
# Example 1: A complete response that contains all fields.
example1_response = json.dumps(
{
"info": {"name": "John Doe", "age": "25 years old", "email": "johndoe@example.com"},
"hobby": ["singing"]
},
ensure_ascii=False
)
# Example 2: A response that contains multiple hobbies.
example2_response = json.dumps(
{
"info": {"name": "Jane Smith", "age": "30 years old", "email": "janesmith@example.com"},
"hobby": ["dancing", "swimming"]
},
ensure_ascii=False
)
# Example 3: A response that does not contain the hobby field (hobby is optional).
example3_response = json.dumps(
{
"info": {"name": "Alex Ray", "age": "28 years old", "email": "alexray@example.com"}
},
ensure_ascii=False
)
# Example 4: Another response that does not contain the hobby field.
example4_response = json.dumps(
{
"info": {"name": "Sam Wilson", "age": "35 years old", "email": "samwilson@example.com"}
},
ensure_ascii=False
)
# Initialize the OpenAI client.
client = OpenAI(
# If you have not configured the environment variable, replace the following line with: api_key="sk-xxx"
# API keys vary by region. To obtain an API key, see https://help.aliyun.com/en/model-studio/get-api-key
api_key=os.getenv("DASHSCOPE_API_KEY"),
# The following is the base_url for the Beijing region. If you use a model in the Singapore region, replace the base_url with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1
base_url="https://dashscope.aliyuncs.com/compatible-mode/v1",
)
# The dedent function removes common leading whitespace from every line in a string.
# This lets you indent strings in your code for better readability without including the indentation in the runtime string.
system_prompt = textwrap.dedent(f"""\
Please extract personal information from the user input and output it in the specified JSON Schema format.
[Output Format Requirements]
The output must strictly follow the JSON structure below:
{{
"info": {{
"name": "String, required. The user's name.",
"age": "String, required. The format must be '<number> years old', for example, '25 years old'.",
"email": "String, required. A standard email format, for example, 'user@example.com'."
}},
"hobby": ["Array of strings, optional. Contains all of the user's hobbies. If no hobbies are mentioned, do not include this field in the output."]
}}
[Field Extraction Rules]
1. name: Identify the user's name from the text. This field is required.
2. age: Identify the age and convert it to the '<number> years old' format. This field is required.
3. email: Identify the email address and keep its original format. This field is required.
4. hobby: Identify the user's hobbies and output them as an array of strings. If no hobbies are mentioned, completely omit the hobby field.
[Reference Examples]
Example 1 (with hobbies):
Q: My name is John Doe, I am 25 years old, my email is johndoe@example.com, and my hobby is singing.
A: {example1_response}
Example 2 (with multiple hobbies):
Q: My name is Jane Smith, I am 30 years old, and I like dancing and swimming.
A: {example2_response}
Example 3 (without hobbies):
Q: My name is Alex Ray, I am 28 years old, and my email is alexray@example.com.
A: {example3_response}
Example 4 (without hobbies):
Q: I am Sam Wilson, 35 years old, email samwilson@example.com.
A: {example4_response}
Please strictly follow the format and rules above to extract information and output the JSON. If the user does not mention any hobbies, do not include the hobby field in the output.\
""")
# Call the model API to perform information extraction.
completion = client.chat.completions.create(
model="qwen-plus",
messages=[
{
"role": "system",
"content": system_prompt
},
{
"role": "user",
"content": "Hello everyone, my name is Chris Lee, I am 34 years old, my email is chrislee@example.com, and I enjoy playing basketball and traveling.",
},
],
response_format={"type": "json_object"}, # Specify the response format as JSON.
)
# Extract and print the JSON result generated by the model.
json_string = completion.choices[0].message.content
print(json_string)Response
{
"info": {
"name": "Alex Brown",
"age": "34 years old",
"email": "alexbrown@example.com"
},
"hobby": ["Basketball", "Traveling"]
}Node.js
import OpenAI from "openai";
// Predefined example responses (to demonstrate the expected output format to the model)
// Example 1: Complete response containing all fields
const example1Response = JSON.stringify({
info: { name: "Alice", age: "25 years old", email: "alice@example.com" },
hobby: ["singing"]
}, null, 2);
// Example 2: Response containing multiple hobbies
const example2Response = JSON.stringify({
info: { name: "Bob", age: "30 years old", email: "bob@example.com" },
hobby: ["dancing", "swimming"]
}, null, 2);
// Example 3: Response without the hobby field (hobby is optional)
const example3Response = JSON.stringify({
info: { name: "Dave", age: "28 years old", email: "dave@example.com" }
}, null, 2);
// Example 4: Another response without the hobby field
const example4Response = JSON.stringify({
info: { name: "Sun Qi", age: "35 years old", email: "sunqi@example.com" }
}, null, 2);
// Initialize the OpenAI client configuration
const openai = new OpenAI({
// If environment variables are not configured, replace the following line with your Model Studio API key: apiKey: "sk-xxx"
// API keys vary by region. To obtain an API key, see https://help.aliyun.com/en/model-studio/get-api-key
apiKey: process.env.DASHSCOPE_API_KEY,
// The following is the base URL for the Beijing region. If you use a model in the Singapore region, replace the base URL with: https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1
baseURL: "https://dashscope.aliyuncs.com/compatible-mode/v1"
});
// Create a chat completion request using a structured prompt to improve output accuracy
const completion = await openai.chat.completions.create({
model: "qwen-plus",
messages: [
{
role: "system",
content: `Extract personal information from the user input and output it in the specified JSON Schema format:
Output format requirements
The output must strictly follow this JSON structure:
{
"info": {
"name": "String type, required field, user's name",
"age": "String type, required field, formatted as 'number + years old', for example, '25 years old'",
"email": "String type, required field, standard email format, for example, 'user@example.com'"
},
"hobby": ["String array type, optional field, contains all user hobbies; omit this field entirely if hobbies are not mentioned"]
}
Field extraction rules
1. name: Identify the user's name from the text; this field is required
2. age: Identify the age information and convert it to the 'number + years old' format; this field is required
3. email: Identify the email address and retain its original format; this field is required
4. hobby: Identify the user's hobbies and output them as a string array; omit the hobby field entirely if no hobbies are mentioned
Reference examples
Example 1 (with hobbies):
Q: My name is Alice, I am 25 years old, my email is alice@example.com, and my hobby is singing
A: ${example1Response}
Example 2 (with multiple hobbies):
Q: My name is Bob, I am 30 years old, my email is bob@example.com, and I enjoy dancing and swimming
A: ${example2Response}
Example 3 (without hobbies):
Q: My name is Dave, I am 28 years old, and my email is dave@example.com
A: ${example3Response}
Example 4 (without hobbies):
Q: I am Sun Qi, 35 years old, and my email is sunqi@example.com
A: ${example4Response}
Strictly follow the above format and rules to extract information and output JSON. If the user does not mention hobbies, do not include the hobby field in the output.`
},
{
role: "user",
content: "Hello everyone, my name is Alex Brown, I am 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling"
}
],
response_format: {
type: "json_object"
}
});
// Extract and print the JSON result generated by the model
const jsonString = completion.choices[0].message.content;
console.log(jsonString);Response
{
"info": {
"name": "Alex Brown",
"age": "34 years old",
"email": "alexbrown@example.com"
},
"hobby": [
"playing basketball",
"traveling"
]
}DashScope
Python
import os
import json
import dashscope
# If you use a model in the Singapore region, uncomment the following line.
# dashscope.base_http_api_url = "https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1"
# Predefined sample responses (to show the model the expected output format).
example1_response = json.dumps(
{
"info": {"name": "Alice", "age": "25 years old", "email": "alice@example.com"},
"hobby": ["singing"]
},
ensure_ascii=False
)
example2_response = json.dumps(
{
"info": {"name": "Bob", "age": "30 years old", "email": "bob@example.com"},
"hobby": ["dancing", "swimming"]
},
ensure_ascii=False
)
example3_response = json.dumps(
{
"info": {"name": "Charlie", "age": "40 years old", "email": "charlie@example.com"},
"hobby": ["Rap", "basketball"]
},
ensure_ascii=False
)
messages=[
{
"role": "system",
"content": f"""Please extract personal information from the user input and output it in the specified JSON Schema format:
[Output Format Requirements]
The output must strictly follow the JSON structure below:
{{
"info": {{
"name": "String type, required field, user's name",
"age": "String type, required field, format is 'number years old', for example, '25 years old'",
"email": "String type, required field, standard email format, for example, 'user@example.com'"
}},
"hobby": ["String array type, optional field, contains all of the user's hobbies. If not mentioned, this field should be completely omitted from the output."]
}}
[Field Extraction Rules]
1. name: Identify the user's name from the text. This is a required field.
2. age: Identify the age information and convert it to the 'number years old' format. This is a required field.
3. email: Identify the email address and keep its original format. This is a required field.
4. hobby: Identify the user's hobbies and output them as a string array. If no hobbies are mentioned, omit the hobby field entirely.
[Reference Examples]
Example 1 (includes a hobby):
Q: My name is Alice, I am 25 years old, my email is alice@example.com, and my hobby is singing.
A: {example1_response}
Example 2 (includes multiple hobbies):
Q: My name is Bob, I am 30 years old, my email is bob@example.com, and I like dancing and swimming.
A: {example2_response}
Example 3 (includes multiple hobbies):
Q: My email is charlie@example.com, I am 40 years old, my name is Charlie, and I can rap and play basketball.
A: {example3_response}
Please strictly follow the format and rules above to extract information and output it in JSON format. If the user does not mention any hobbies, do not include the hobby field in the output."""
},
{
"role": "user",
"content": "Hello everyone, my name is Alex Brown, I am 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling.",
},
]
response = dashscope.Generation.call(
# If you have not configured the environment variable, replace the following line with your Alibaba Cloud Model Studio API key: api_key="sk-xxx",
api_key=os.getenv('DASHSCOPE_API_KEY'),
model="qwen-plus",
messages=messages,
result_format='message',
response_format={'type': 'json_object'}
)
json_string = response.output.choices[0].message.content
print(json_string)Response
{
"info": {
"name": "Alex Brown",
"age": "34 years old",
"email": "alexbrown@example.com"
},
"hobby": [
"playing basketball",
"traveling"
]
}Java
import java.util.Arrays;
import java.lang.System;
import com.alibaba.dashscope.aigc.generation.Generation;
import com.alibaba.dashscope.aigc.generation.GenerationParam;
import com.alibaba.dashscope.aigc.generation.GenerationResult;
import com.alibaba.dashscope.common.Message;
import com.alibaba.dashscope.common.Role;
import com.alibaba.dashscope.exception.ApiException;
import com.alibaba.dashscope.exception.InputRequiredException;
import com.alibaba.dashscope.exception.NoApiKeyException;
import com.alibaba.dashscope.common.ResponseFormat;
import com.alibaba.dashscope.utils.Constants;
public class Main {
// If you are using a model in the Singapore region, uncomment the following line.
// static {Constants.baseHttpApiUrl="https://{WorkspaceId}.ap-southeast-1.maas.aliyuncs.com/api/v1";}
public static GenerationResult callWithMessage() throws ApiException, NoApiKeyException, InputRequiredException {
Generation gen = new Generation();
Message systemMsg = Message.builder()
.role(Role.SYSTEM.getValue())
.content("""
Extract personal information from the user input and output it in the specified JSON Schema format:
[Output Format Requirements]
The output must strictly follow this JSON structure:
{
"info": {
"name": "String type. Required field. User's name.",
"age": "String type. Required field. Format: 'number followed by years old', for example, '25 years old'.",
"email": "String type. Required field. Standard mailbox format, for example, 'user@example.com'."
},
"hobby": ["Array of strings. Optional field. Contains all user hobbies. Omit this field entirely if not mentioned."]
}
[Field Extraction Rules]
1. name: Detect the user's name from the text. This field is required.
2. age: Detect age information and convert it to the format 'number followed by years old'. This field is required.
3. email: Detect the mailbox address and retain the original format. This field is required.
4. hobby: Detect user hobbies and output them as an array of strings. Omit the hobby field entirely if hobby information is not mentioned.
[Reference Examples]
Example 1 (with hobbies):
Q: Hello, my name is Alice, I am 25 years old, my mailbox is alice@example.com, and my hobby is singing.
A: {"info":{"name":"Alice","age":"25 years old","email":"alice@example.com"},"hobby":["singing"]}
Example 2 (with multiple hobbies):
Q: Hello, my name is Bob, I am 30 years old, my mailbox is bob@example.com, and I usually enjoy dancing and swimming.
A: {"info":{"name":"Bob","age":"30 years old","email":"bob@example.com"},"hobby":["dancing","swimming"]}
Example 3 (without hobbies):
Q: Hello, my name is Charlie, my mailbox is charlie@example.com, and I am 40 years old.
A: {"info":{"name":"Charlie","age":"40 years old","email":"charlie@example.com"}}""")
.build();
Message userMsg = Message.builder()
.role(Role.USER.getValue())
.content("Hello, my name is Alex Brown, I am 34 years old, my mailbox is alexbrown@example.com, and I usually enjoy playing basketball and traveling.")
.build();
ResponseFormat jsonMode = ResponseFormat.builder().type("json_object").build();
GenerationParam param = GenerationParam.builder()
// If you have not configured an environment variable, replace the following line with your Model Studio API key: .apiKey("sk-xxx")
.apiKey(System.getenv("DASHSCOPE_API_KEY"))
.model("qwen-plus")
.messages(Arrays.asList(systemMsg, userMsg))
.resultFormat(GenerationParam.ResultFormat.MESSAGE)
.responseFormat(jsonMode)
.build();
return gen.call(param);
}
public static void main(String[] args) {
try {
GenerationResult result = callWithMessage();
System.out.println(result.getOutput().getChoices().get(0).getMessage().getContent());
} catch (ApiException | NoApiKeyException | InputRequiredException e) {
// Use a logging framework to record exception information.
System.err.println("An error occurred while calling the generation service: " + e.getMessage());
}
}
}Response
{
"info": {
"name": "Alex Brown",
"age": "34 years old",
"email": "alexbrown@example.com"
},
"hobby": [
"Playing basketball",
"Traveling"
]
}Going live
Validate before passing downstream
Always validate the JSON output before passing it to downstream services. Use a library such as jsonschema (Python), Ajv (JavaScript), or Everit (Java) to check for missing fields, type errors, or format issues. If validation fails, retry the request or use a second model to fix the output.
Do not set max_tokens
Do not set
max_tokenswhen structured output is enabled. This parameter caps the number of output tokens and defaults to the model's maximum. Setting it may truncate the JSON string mid-output, producing invalid JSON that fails to parse.
FAQ
Q: How does Qwen's thinking mode model produce structured output?
Qwen's thinking mode models do not support structured output directly. To get a valid JSON string from a thinking mode model, use a two-step approach: first call the thinking model to get high-quality output, then pass any malformed JSON through a model that supports JSON mode to fix it.
Get output from the thinking mode model
Call the thinking mode model. The result may not be valid JSON.
Do not set the
response_formatparameter to{"type": "json_object"}when enabling thinking mode, or you will encounter an error.completion = client.chat.completions.create( model="qwen-plus", messages=[ {"role": "system", "content": system_prompt}, { "role": "user", "content": "Hi everyone, my name is Alex Brown, I'm 34 years old, my email is alexbrown@example.com, and I enjoy playing basketball and traveling", }, ], # Enable thinking mode; do not set response_format parameter to {"type": "json_object"}, or you will get an error extra_body={"enable_thinking": True}, # Streaming output is required in thinking mode stream=True ) # Extract and print the model-generated JSON result json_string = "" for chunk in completion: if chunk.choices[0].delta.content is not None: json_string += chunk.choices[0].delta.contentValidate and fix the output
Try to parse the
json_stringfrom the previous step:If the model returned valid JSON, parse and use it directly.
If the model returned invalid JSON, call a model that supports structured output (a fast, low-cost model such as qwen-flash in non-thinking mode works well) to fix the format.
import json from openai import OpenAI import os # Initialize the OpenAI client (if the client variable isn't defined in the previous code block, uncomment the lines below) # client = OpenAI( # api_key=os.getenv("DASHSCOPE_API_KEY"), # base_url="https://dashscope.aliyuncs.com/compatible-mode/v1", # ) try: json_object_from_thinking_model = json.loads(json_string) print("Generated standard JSON string") except json.JSONDecodeError: print("Did not generate standard JSON string; fixing with a model that supports structured output") completion = client.chat.completions.create( model="qwen-flash", messages=[ { "role": "system", "content": "You are a JSON format expert. Fix the user's JSON string to standard format", }, { "role": "user", "content": json_string, }, ], response_format={"type": "json_object"}, ) json_object_from_thinking_model = json.loads(completion.choices[0].message.content)
Error codes
If the model call fails and returns an error message, see Error codes for resolution.