Skip to content

Merge changes from forked repo#2

Draft
joaopamaral wants to merge 5 commits into
masterfrom
merge_changes_from_forked_repo
Draft

Merge changes from forked repo#2
joaopamaral wants to merge 5 commits into
masterfrom
merge_changes_from_forked_repo

Conversation

@joaopamaral
Copy link
Copy Markdown

Description of change

(write a short description or paste a link to JIRA)

Manual QA steps

Risks

Rollback steps

  • revert this branch

Andy Lu and others added 5 commits May 9, 2023 09:39
* Allow discovery of commitless repos

* Allow `commits` stream sync to continue when we hit an empty repo

* Revert "Allow discovery of commitless repos"

This reverts commit efcd42f.

* Add a stream to the verify call so `raise_for_error` works

* Make pylint happy

* Fix bookmarks test by pinning window

The tap syncs from the start_date/bookmark until now() and we don't have
new test data on the test repo. This causes tests to fail after a while.
The ability to shift the bookmark, on a per-stream basis, was already put
in place so we use it to make the state work with the data we have.

`Commits` only has two days of data, so we need to put the start date
before the first day and the bookmark on the second day in order for the
second sync to pull less data

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Fix pagination test by excluding streams without enough data

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Make the test log which version of the test failed

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Fix start_date test by specifying the date for `issues` and `pull_requests`

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Force `calculated_states_by_stream` to take start_date

This was initially an optional param, but this is the only test to use the
function, so we can update its signature everywhere

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* TDL-22816 style changes (singer-io#188) [skip ci]

* Whitespace clean up

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Params get their own lines

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Comments go above code

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Fix long lines

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Update logger to info [skip-ci]

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Trigger CI

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

* Bump version, update changelog

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>

---------

Co-authored-by: Dylan Sprayberry <28106103+dsprayberry@users.noreply.github.com>
* to avoid api rate limit error, tap will sleep for the seconds mentioned in header - X-RateLimit-Remaining

* recursively call the function(afterwards) if the tap is paused for sometime.

* fix the existing unit tests

* fixed pylint issue

* update comments

* setup and changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants