Page 1 of 1

Data export with large dataset

Posted: Fri 12 Oct 2018 09:05
by adetogni
Hi
When you run a query and select export results, it exports only the current page (so, for example, the first 1000 rows). However, for testing large dataset, I need to export ALL the results.
The only way I found was to disable the pagination, but the issue with this is that when you want to export you have to wait for dbForce to load the ENTIRE result in memory and then export.

Is there a way to run a query and tell it to NOT load in memory but just save to disk as CSV?

Thanks

Re: Data export with large dataset

Posted: Fri 12 Oct 2018 09:06
by adetogni
Just to clarify: I know I can right click "export" on a table, but that exports the entire Table.

And one option could be to create a view and then run an export of that view: but that works only on databases where you have a CREATE VIEW, not the ones on read only.

Re: Data export with large dataset

Posted: Fri 12 Oct 2018 10:16
by alexa
You could create a view basing on the query, right-click it in Database Explorer, select 'Export Data...' from the popup menu and complete the wizard.

Re: Data export with large dataset

Posted: Fri 12 Oct 2018 12:24
by adetogni
alexa wrote: Fri 12 Oct 2018 10:16 You could create a view basing on the query, right-click it in Database Explorer, select 'Export Data...' from the popup menu and complete the wizard.
As I wrote before this works only for databases where you have a CREATE VIEW. In databases where your credential is read only, this can't be done.

Re: Data export with large dataset

Posted: Tue 16 Oct 2018 09:24
by alexa
Unfortunately, we can't suggest you anything else on this.