Paid Project

[holyearth]

Hi,

If I have posted this in the wrong section, please feel free to move it.

I am in need of a MySQL specialist who can help solve my problem…

The problem is that I need a way to import 20-30 million rows into a MySQL table on a frequent basis. The import must be FAST! I am currently importing at 500 per second using PHP, but I need something faster. Speed is the problem.

Please PM me to discuss the project, timeline, and price.

Thanks in advance for your time and assistance.

[mwallace]

questions, as always…

Can you use mysql’s direct import to do it?
What qualifies as ‘fast’.
What qualifies as ‘frequent’?
How much data are you importing each time?
Are you logging the transactions?
Which storage engine are you using?

[mwallace]

Also, where is the current bottleneck?
Are you waiting on disk while the db writes the new data? Are you stuck in CPU? Is the PHP app pushing data as quickly as it can? Etc.