Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

source-amazon-seller-partner: Add VendorOrdersStatus stream #55195

Open
wants to merge 8 commits into
base: master
Choose a base branch
from

Conversation

GtheSheep
Copy link

What

Add VendorOrdersStatus stream to source Amazon Seller Partner, closes #46331

How

Added stream and testing to mimic VendorOrders stream

Review guide

manifest
test_vendor_status_orders.py
others...

It's quite difficult to know if I've covered all relevant files? Please guide me if not! 😅

User Impact

New stream available for Amazon Seller Partner

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Copy link

vercel bot commented Mar 4, 2025

@GtheSheep is attempting to deploy a commit to the Airbyte Growth Team on Vercel.

A member of the Team first needs to authorize it.

@natikgadzhi
Copy link
Contributor

@artem1205 can pretty please review this?

Copy link
Collaborator

@artem1205 artem1205 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work!

please check the comments!

Comment on lines +338 to +339
datetime: "{{ format_datetime( max(config.get('replication_start_date', (now_utc() - duration('P730D')).strftime('%Y-%m-%dT%H:%M:%SZ') ), (now_utc() - duration('P730D')).strftime('%Y-%m-%dT%H:%M:%SZ')), '%Y-%m-%dT%H:%M:%SZ') }}"
datetime_format: "%Y-%m-%dT%H:%M:%SZ"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From docs:

Warning

Returns purchase order statuses based on the filters that you specify. Date range to search must not be more than 7 days.

Please check it and cover with the test if possible

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is that not covered by the step: "P7D" arg? Then the above is just the start date for the initial run?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is that not covered by the step: "P7D" arg?

not really. step_size is used during slicing, e.g.
we have start_date == 1 February, end_date=today 5 March, step= 7 days. so our datetimeCursor will create roughly 5 slices (1-7 Feb, 7-14 Feb, 14-21 Feb ....) and will read them concurrently.

Then the above is just the start date for the initial run?

Exactly, we'll have to check that start date is not more than 7 days in the past (and forcefully move if it is)

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The docs seem to be referring to the start/end date window size per request, rather than the availability to lookback? It's referred to the same way in purchaseOrders

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you are correct @GtheSheep. The doc seems to be referring to each request, not the lookback. This looks to be good to go! :)

Copy link

vercel bot commented Mar 5, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 8, 2025 3:46am

@GtheSheep
Copy link
Author

When I click through the "Connectors CI tests", all seems fine?
Can't see anything on the other CI job though...?

@natikgadzhi
Copy link
Contributor

CI requires manual approval of maintainers after each commit from a non-member of the org, security-shchmecurity.

Kicked it off again.

@natikgadzhi natikgadzhi requested a review from agarctfi March 8, 2025 03:42
@natikgadzhi
Copy link
Contributor

@agarctfi give this a review to ;)

@GtheSheep
Copy link
Author

@artem1205 @natikgadzhi - anything I can do here at the moment? thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation community connectors/source/amazon-seller-partner
Projects
Status: Waiting Contributor
Development

Successfully merging this pull request may close these issues.

[source-amazon-seller-partner] add stream VendorOrdersStatus
5 participants