阿里云首页

Dataphin集成任务同步失败报错:"同步数据出现业务脏数据情况,数据类型转换错误"

问题描述

Dataphin集成任务同步失败报错:"同步数据出现业务脏数据情况,数据类型转换错误"。

2021-10-12 11:44:46.696 [0-0-0-writer] ERROR DlinkTaskPluginCollector - 脏数据: {"exception":"Code:[Common-01], Describe:[同步数据出现业务脏数据情况,数据类型转换错误 .] - String[\"SYSTEM\"]不能转为Long .","message":"写入 ODPS 目的表时遇到了脏数据: 第[36]个字段的数据出现错误,请检查该数据并作出修改 或者您可以增大阀值,忽略这条记录.","record":[{"byteSize":4,"index":0,"rawData":3854,"type":"LONG"},{"byteSize":14,"index":1,"rawData":"14106116000027","type":"STRING"},{"byteSize":16,"index":2,"rawData":"NT21W 台面盆 单孔\t 素坯","type":"STRING"},{"byteSize":3,"index":3,"rawData":"0.0","type":"DOUBLE"},{"byteSize":4,"index":4,"rawData":"1004","type":"STRING"},{"byteSize":0,"index":5,"type":"STRING"},{"byteSize":3,"index":6,"rawData":"PCS","type":"STRING"},{"byteSize":1,"index":7,"rawData":1,"type":"LONG"},{"byteSize":0,"index":8,"type":"STRING"},{"byteSize":3,"index":9,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":10,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":11,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":12,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":13,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":14,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":15,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":16,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":17,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":18,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":19,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":20,"rawData":"0.0","type":"DOUBLE"},{"byteSize":1,"index":21,"rawData":0,"type":"LONG"},{"byteSize":0,"index":22,"type":"STRING"},{"byteSize":3,"index":23,"rawData":"0.0","type":"DOUBLE"},{"byteSize":3,"index":24,"rawData":"0.0","type":"DOUBLE"},{"byteSize":1,"index":25,"rawData":1,"type":"LONG"},{"byteSize":0,"index":26,"type":"STRING"},{"byteSize":1,"index":27,"rawData":0,"type":"LONG"},{"byteSize":0,"index":28,"type":"STRING"},{"byteSize":1,"index":29,"rawData":0,"type":"LONG"},{"byteSize":1,"index":30,"rawData":0,"type":"LONG"},{"byteSize":1,"index":31,"rawData":0,"type":"LONG"},{"byteSize":0,"index":32,"type":"LONG"},{"byteSize":0,"index":33,"type":"STRING"},{"byteSize":0,"index":34,"type":"STRING"},{"byteSize":8,"index":35,"rawData":1542594715000,"type":"DATE"},{"byteSize":6,"index":36,"rawData":"SYSTEM","type":"STRING"},{"byteSize":9,"index":37,"rawData":"NT21W-4-1","type":"STRING"},{"byteSize":1,"index":38,"rawData":1,"type":"LONG"},{"byteSize":1,"index":39,"rawData":0,"type":"LONG"},{"byteSize":0,"index":40,"type":"LONG"},{"byteSize":0,"index":41,"type":"LONG"},{"byteSize":1,"index":42,"rawData":0,"type":"LONG"},{"byteSize":0,"index":43,"type":"DOUBLE"},{"byteSize":3,"index":44,"rawData":"5分厂","type":"STRING"},{"byteSize":4,"index":45,"rawData":"高明基地","type":"STRING"}],"type":"writer"}
2021/10/12 11:44:46 - MicrosoftSQLServer_5.0 - 完成处理 (I=5569, O=0, R=0, W=5569, U=0, E=0)
2021-10-12 11:44:46.719 [DlinkTrans - MicrosoftSQLServer_5] INFO  DlinkLogbackListener - MicrosoftSQLServer_5 - 完成处理 (I=5569, O=0, R=0, W=5569, U=0, E=0)

问题原因

字段计算组件的字段顺序不一致导致的。

解决方案

有一个组件的字段顺序不一致,也就是第37个字段,对应odps的是long类型,但是输入是字符串,需要调整下字段顺序就可以了。

适用于

  • Dataphin
首页 Dataphin集成任务同步失败报错:"同步数据出现业务脏数据情况,数据类型转换错误"