Dataphin代码任务查询分区表报错“com.alibaba.dt.oneservice.api.exception.OsBizException: Tables(dmp_psrc_dev.busi_data_1, pos: line 3, col 6) is full scan with all partitions, please specify partition predicates”
更新时间:2022-10-18 10:11:46
问题描述
Dataphin中计算引擎是AnalyticDB PostgreSQL,代码任务全表查询分区表数据,报错“com.alibaba.dt.oneservice.api.exception.OsBizException: Tables(dmp_psrc_dev.busi_data_1, pos: line 3, col 6) is full scan with all partitions, please specify partition predicates”
。完整的报错信息如下:
-------------------------------------------------------------------------------------
2022-10-10 09:33:34.471 ## TRACE_ID ## :
------------------------------------!!SQL Failed!!-----------------------------------
Error Code: DPN.Os.FullScanException
Error Message: Tables(dmp_psrc_dev.busi_data_1, pos: line 3, col 6) is full scan with all partitions, please specify partition predicates.
com.alibaba.dt.oneservice.api.exception.OsBizException: Tables(dmp_psrc_dev.busi_data_1, pos: line 3, col 6) is full scan with all partitions, please specify partition predicates.
at com.alibaba.dt.oneservice.server.domain.model.parser.filter.filters.SqlVerifyFilter.buildException(SqlVerifyFilter.java:126)
at com.alibaba.dt.oneservice.server.domain.model.parser.filter.filters.SqlVerifyFilter.doFilter(SqlVerifyFilter.java:73)
at com.alibaba.dt.oneservice.server.domain.model.parser.filter.filters.SqlVerifyFilter.doFilter(SqlVerifyFilter.java:39)
问题原因
AnalyticDB PostgreSQL计算源没有控制全表扫描的开关,SQL语句不指定分区条件默认就是全表扫描。该问题是因为Dataphin智能引擎中设置了“禁止全表扫描”导致。
解决方案
在Dataphin“管理中心”-“智能引擎”-“查询引擎设置”中设置“禁止全表扫描“ 为否即可:
适用于
- Dataphin3.6
该文章对您有帮助吗?
- 本页导读
- 问题描述
- 问题原因
- 解决方案
- 适用于