Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to fetch more than 100 000 data points / 10 000 aggregated datapoints #495

Open
muradsater opened this issue Mar 11, 2021 · 0 comments

Comments

@muradsater
Copy link
Contributor

muradsater commented Mar 11, 2021

This SDK does not have the same functionality as the Python SDK when it comes to fetching large number of datapoints.

When working directly with the REST api, or when developing an SDK, you will likely come across the need for paginating datapoints.

In our application we the analysts are working with datasets for typically the last 10 years, and are frequently wanting to export the full dataset to a CSV file for further processing.

Needs:

  • Export >100k datapoints from a time series (>10 years of data)
  • Export of synthetic time series (same requirement for time frame)
  • Calculate a custom graph, not supported in CDF, like a duration curve

The requirement for export of single time series has been implemented in Gearbox. For other requirements we need to have complex paging logic in our frontend react application, it would be much better to have it in the SDK.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants
@muradsater and others