Bulkloader raises the following error when importing a CSV file with large cells:
[ERROR ] Error in data source thread: field larger than field limit (131072)
This is a common problem for the csv mo开发者_如何学JAVAdule, which can be fixed with:
csv.field_size_limit(sys.maxint)
How can I make bulkloader execute this?
Try this:
In bulkloader.yaml add:
python_preamble:
- import: csv_fix
... # the rest of your imports
In csv_fix.py add:
import csv, sys
csv.field_size_limit(sys.maxint)
精彩评论