Skip to content Skip to sidebar Skip to footer

Unable To Fetch Complete Records From Salesforce Using Python

I am trying to fetch the data from salesforce using the simple_salesforce library in python. I am able to get the correct count of records while running the count query. But while

Solution 1:

Salesforce API returns stuff in chunks, default is 2000 records at a time. If it'd return to you 1M records it could kill your memory usage. Retrieve a chunk, process it (save to file?), request next chunk.

It's straight on the project's homepage:

If, due to an especially large result, Salesforce adds a nextRecordsUrl to your query result, such as "nextRecordsUrl" : "/services/data/v26.0/query/01gD0000002HU6KIAW-2000", you can pull the additional results with either the ID or the full URL (if using the full URL, you must pass ‘True’ as your second argument)

sf.query_more("01gD0000002HU6KIAW-2000")
sf.query_more("/services/data/v26.0/query/01gD0000002HU6KIAW-2000", True)

As a convenience, to retrieve all of the results in a single local method call use

sf.query_all("SELECT Id, Email FROM Contact WHERE LastName = 'Jones'")

Post a Comment for "Unable To Fetch Complete Records From Salesforce Using Python"