开发者

Doing a large number of upserts as fast as possible

开发者 https://www.devze.com 2023-02-04 15:29 出处:网络
My app (which uses MySQL) is doing a large number of subsequent upserts. Right now my SQL looks like this:

My app (which uses MySQL) is doing a large number of subsequent upserts. Right now my SQL looks like this:

INSERT IGNORE INTO customer (name,customer_number,social_sec开发者_C百科urity_number,phone) VALUES ('VICTOR H KINDELL','123','123','123')
INSERT IGNORE INTO customer (name,customer_number,social_security_number,phone) VALUES ('VICTOR H KINDELL','123','123','123')
INSERT IGNORE INTO customer (name,customer_number,social_security_number,phone) VALUES ('VICTOR H KINDELL OR','123','123','123')
INSERT IGNORE INTO customer (name,customer_number,social_security_number,phone) VALUES ('TRACY L WALTER PERSONAL REP FOR','123','123','123')
INSERT IGNORE INTO customer (name,customer_number,social_security_number,phone) VALUES ('TRACY L WALTER PERSONAL REP FOR','123','123','123')

So far I've found INSERT IGNORE to be the fastest way to achieve upserts. Selecting a record to see if it exists and then either updating it or inserting a new one is too slow. Even this is not as fast as I'd like because I need to do a separate statement for each record. Sometimes I'll have around 50,000 of these statements in a row.

Is there a way to take care of all of these in just one statement, without deleting any existing records?


You can put everything in 1 insert INSERT IGNORE INTO table_1 (field1, field2) VALUES ('val1', 'val2'), ('val3', 'val4'), etc. You may also want to check INSERT ... ON DUPLICATE KEY UPDATE if you need to either updater or insert a record.

0

精彩评论

暂无评论...
验证码 换一张
取 消