开发者

mySql: reasonable limitations on bulk inserts

开发者 https://www.devze.com 2023-02-28 21:34 出处:网络
I am receiving a large amount of CSV data from a cl开发者_高级运维ient that I plan to insert into a mySql database and process the data within my application. There are about 10 tables involved. The r

I am receiving a large amount of CSV data from a cl开发者_高级运维ient that I plan to insert into a mySql database and process the data within my application. There are about 10 tables involved. The rows are less than 1k bytes each. What limits should I obey in individual insertions? I have quite a few millions of rows in each table to insert.

Let me know if there are salient data I should provide, such as the schema.


If you use load data infile to input the data into your tables, there is no limit that you need to obey.

Link: http://dev.mysql.com/doc/refman/5.1/en/load-data.html


If you have large number of insertions than you can use INSERT DELAYED query of MySQL or you can increase bulk_insert_buffer_size which is a system variable. Click bulk_insert_buffer_size.

For INSERT DELAYED syntax Click here

0

精彩评论

暂无评论...
验证码 换一张
取 消