controlling the fetching of a large set of rows/records when batch processing
Posted: Mon 20 Nov 2006 18:01
This is a follow-up on my previous post.
My app batch processes a large number of records and when it
runs, after active = true using TSQLQuery, memory bloats so
much that the program can use too much memory and abort.
What is the best way to control batch processing / fetching? What I'd like to do is grab the first X records, process them, grab another X, etc. I've looked at the parameters at my disposal and at a loss as to how best to do this.
I would prefer not to use clientdatasets. Setting fetchall to false looks promising, but how do you set it to fetch X vs All and not just 1?
Any recommendations?
Thanks very much for your help, Cheers!
My app batch processes a large number of records and when it
runs, after active = true using TSQLQuery, memory bloats so
much that the program can use too much memory and abort.
What is the best way to control batch processing / fetching? What I'd like to do is grab the first X records, process them, grab another X, etc. I've looked at the parameters at my disposal and at a loss as to how best to do this.
I would prefer not to use clientdatasets. Setting fetchall to false looks promising, but how do you set it to fetch X vs All and not just 1?
Any recommendations?
Thanks very much for your help, Cheers!