调用CLI命令创建Logtail采集配置

注意事项

在使用CLI命令之前，您需要注意以下事项：

• 已开通日志服务。

• 已安装日志服务CLI安装与配置。

• 已创建日志服务Project和Logstore。

命令格式

aliyun sls create-logtail-pipeline-config --project=<value> --config-name=<value> --inputs=<value> [--processors=<value>] --flushers=<value> [--log-sample=<value>]

命令参数

该命令的必选和特有参数描述如下。

关于该命令的全局参数，请参见全局参数。

aliyun sls create-logtail-pipeline-config --project="aliyun-test-project" \
  --config-name json-log-config \
  --inputs '{"Type":"input_file","FilePaths":["/app/**/output.json"],"EnableContainerDiscovery":false,"MaxDirSearchDepth":1,"FileEncoding":"utf8"}' \
  --processors '{"Type":"processor_parse_json_native","SourceKey":"content"}' \
  --flushers '{"Type":"flusher_sls","Logstore":"aliyun-test-logstore","TelemetryType":"logs","Region":"cn-hangzhou","Endpoint":"cn-hangzhou-intranet.log.aliyuncs.com"}' \
  --log-sample '{"status": 200, "latency": 4152, "method": "GetUserConfig"}'

aliyun sls create-logtail-pipeline-config --project="aliyun-test-project" \
  --config-name delimiter-log-config \
  --inputs '{"Type":"input_file","FilePaths":["/app/**/access.log"],"EnableContainerDiscovery":false,"MaxDirSearchDepth":1,"FileEncoding":"utf8"}' \
  --processors '{"Type":"processor_parse_delimiter_native","SourceKey":"content","Separator":"|","Quote":"\\u0000","KeepingSourceWhenParseFail":true,"Keys":["remote_addr","time_iso8601","method","uri","protocol","status","sent_bytes","user_agent","latency"]}' \
  --flushers '{"Type":"flusher_sls","Logstore":"aliyun-test-logstore","TelemetryType":"logs","Region":"cn-hangzhou","Endpoint":"cn-hangzhou-intranet.log.aliyuncs.com"}'

# 创建配置文件
cat > /tmp/processor_regex.json << 'EOF'
{
  "Type": "processor_parse_regex_native",
  "SourceKey": "content",
  "Regex": "(\\d+-\\d+-\\d+\\s\\S+)\\s\\S+\\s\\[(\\w+)]\\s\\S+\\s(\\w+)\\s\\S+\\s(\\S+)\\s\\S+\\s(.*)",
  "Keys": ["time", "level", "func", "class", "content"]
}
EOF

cat > /tmp/processor_time.json << 'EOF'
{
  "Type": "processor_parse_timestamp_native",
  "SourceKey": "time",
  "SourceFormat": "%Y-%m-%d %H:%M:%S,%f"
}
EOF

# 创建采集配置
aliyun sls create-logtail-pipeline-config --project="aliyun-test-project" \
  --config-name regex-time-config \
  --inputs '{"Type":"input_file","FilePaths":["/app/**/app.log"],"EnableContainerDiscovery":false,"MaxDirSearchDepth":1,"FileEncoding":"utf8"}' \
  --processors "$(cat /tmp/processor_regex.json)" \
  --processors "$(cat /tmp/processor_time.json)" \
  --flushers '{"Type":"flusher_sls","Logstore":"aliyun-test-logstore","TelemetryType":"logs","Region":"cn-hangzhou","Endpoint":"cn-hangzhou-intranet.log.aliyuncs.com"}'