Data synchronization

This article summarizes how to deal with issues related to data synchronization, so that you can quickly locate the cause and complete the repair.

Question 1: Data synchronization dynamic partition error reporting

Solution

Click on the job Configuration, select Advanced Definition in the resource configuration, and add custom JSON parameter configuration "hive.exec.dynamic.partition.mode": "nonstrict"

Question 2: Error when adding static value in data synchronization

Solution

注意这里要使用单引号

Question 3: String or binary data would be truncated.

SQL Server execution exception

String or binary data would be truncated.

Solution

检查数据库中字段的长度是否受限制，比如varchar(10)太短，需要改成varchar(2000)

alter table users
    alter column username varchar(2000) null
go