Skip to content Skip to sidebar Skip to footer

Multiprocessing/multithreading For Database Query In Python

I have millions of records in database and I want to read it through Python and store it in pandas data frame . The problem is the select query processing time is very high. To red

Solution 1:

You can use multi-threading only if the underlying database engine supports it. You should check for that. For your question, I think the attached link will help you: see this If the answer helps you then help the community by selecting it as the best answer.

Solution 2:

The below link helped me Multiprocessing with JDBC connection and pooling I can get around 25% gain on my local.machine.

Post a Comment for "Multiprocessing/multithreading For Database Query In Python"