I think that the problem encountered in #64 is likely somewhat common.
There are 2 ways (in my view) that we could help users make larger queries:
-
Create functionality to split up or "chunk" large requests and submit separate queries either in series or parallel to the web service and then return one large merged data frame. This would be handy for the user, but at the cost of increasing the complexity of what is intended to be a fairly thin and simple package.
-
We can create a few examples of how one might write some code to do the "chunking" of large queries themselves, and wrap existing dataretrieval functions within a for-loop or similar. This documentation could be referenced in the 414 error message we return, and would not make the package itself any more complex. This option keeps the package light-weight and simple by offloading the complexity associated with large queries to the user.
Thoughts?
I think that the problem encountered in #64 is likely somewhat common.
There are 2 ways (in my view) that we could help users make larger queries:
Create functionality to split up or "chunk" large requests and submit separate queries either in series or parallel to the web service and then return one large merged data frame. This would be handy for the user, but at the cost of increasing the complexity of what is intended to be a fairly thin and simple package.
We can create a few examples of how one might write some code to do the "chunking" of large queries themselves, and wrap existing
dataretrievalfunctions within a for-loop or similar. This documentation could be referenced in the 414 error message we return, and would not make the package itself any more complex. This option keeps the package light-weight and simple by offloading the complexity associated with large queries to the user.Thoughts?