github/DataX
5
0
Fork 0
mirror of https://github.com/alibaba/DataX.git synced 2025-05-02 07:40:30 +08:00
Code Issues Packages Projects Releases Wiki Activity

batchSizeRows

Browse Source 
batchSizeRows
This commit is contained in:
jiafeng.zhang 2022-10-09 15:40:33 +08:00
parent 15cca65722
commit 91306ad586
2 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
doriswriter/doc/doriswriter.md
View File

@ -140,15 +140,15 @@ DorisWriter 通过Doris原生支持Stream load方式导入数据， DorisWriter
- 默认值：无 - 默认值：无
* **maxBatchRows** * **batchSizeRows**
- 描述：每批次导入数据的最大行数。和 **maxBatchByteSize** 共同控制每批次的导入数量。每批次数据达到两个阈值之一，即开始导入这一批次的数据。 - 描述：每批次导入数据的最大行数。和 **batchByteSize** 共同控制每批次的导入数量。每批次数据达到两个阈值之一，即开始导入这一批次的数据。
- 必选：否 - 必选：否
- 默认值：500000 - 默认值：500000
* **batchByteSize** * **batchByteSize**
- 描述：每批次导入数据的最大数据量。和 ** maxBatchRows** 共同控制每批次的导入数量。每批次数据达到两个阈值之一，即开始导入这一批次的数据。 - 描述：每批次导入数据的最大数据量。和 **batchSizeRows** 共同控制每批次的导入数量。每批次数据达到两个阈值之一，即开始导入这一批次的数据。
- 必选：否 - 必选：否
- 默认值：104857600 - 默认值：104857600

4
doriswriter/src/main/java/com/alibaba/datax/plugin/writer/doriswriter/Key.java
View File

@ -48,7 +48,7 @@ public class Key implements Serializable {
public static final String LOAD_PROPS_LINE_DELIMITER = "line_delimiter"; public static final String LOAD_PROPS_LINE_DELIMITER = "line_delimiter";
public static final String LOAD_PROPS_COLUMN_SEPARATOR = "column_separator"; public static final String LOAD_PROPS_COLUMN_SEPARATOR = "column_separator";
public static final String MAX_BATCH_ROWS = "maxBatchRows"; public static final String MAX_BATCH_ROWS = "batchSizeRows";
public static final String BATCH_BYTE_SIZE = "batchByteSize"; public static final String BATCH_BYTE_SIZE = "batchByteSize";
public static final String MAX_RETRIES = "maxRetries"; public static final String MAX_RETRIES = "maxRetries";
public static final String LABEL_PREFIX = "labelPrefix"; public static final String LABEL_PREFIX = "labelPrefix";
@ -56,7 +56,7 @@ public class Key implements Serializable {
public static final String CONNECT_TIMEOUT = "connectTimeout"; public static final String CONNECT_TIMEOUT = "connectTimeout";
private final Configuration options; private final Configuration options;
private static final long DEFAULT_MAX_BATCH_ROWS = 50_0000; private static final long DEFAULT_MAX_BATCH_ROWS = 500000;
private static final long DEFAULT_BATCH_BYTE_SIZE = 90 * 1024 * 1024; private static final long DEFAULT_BATCH_BYTE_SIZE = 90 * 1024 * 1024;
private static final int DEFAULT_MAX_RETRIES = 0; private static final int DEFAULT_MAX_RETRIES = 0;