开发者

Bulkloader CSV size error

开发者 https://www.devze.com 2023-03-05 19:45 出处:网络
Bulkloader raises the following error when importing a CSV file with large cells: [ERROR] Error in data source thread: field larger than field limit (131072)

Bulkloader raises the following error when importing a CSV file with large cells:

[ERROR   ] Error in data source thread: field larger than field limit (131072)

This is a common problem for the csv mo开发者_如何学JAVAdule, which can be fixed with:

csv.field_size_limit(sys.maxint)

How can I make bulkloader execute this?


Try this:

In bulkloader.yaml add:

python_preamble:
- import: csv_fix
... # the rest of your imports

In csv_fix.py add:

import csv, sys
csv.field_size_limit(sys.maxint)
0

精彩评论

暂无评论...
验证码 换一张
取 消