I am receiving a large amount of CSV data from a cl开发者_高级运维ient that I plan to insert into a mySql database and process the data within my application. There are about 10 tables involved. The rows are less than 1k bytes each. What limits should I obey in individual insertions? I have quite a few millions of rows in each table to insert.
Let me know if there are salient data I should provide, such as the schema.
If you use load data infile
to input the data into your tables, there is no limit that you need to obey.
Link: http://dev.mysql.com/doc/refman/5.1/en/load-data.html
If you have large number of insertions than you can use INSERT DELAYED query of MySQL or you can increase bulk_insert_buffer_size which is a system variable. Click bulk_insert_buffer_size.
For INSERT DELAYED syntax Click here
精彩评论