zyte-test-websites contains websites that can be used by spiders to test scraping of websites of a specific kind. It currently contains an e-commerce website and a job postings website.

Features:

• A page with top-level product categories with pagination.
• Pages with products and/or subcategories in a category with pagination.
• Pages with single product details.
• A search form with results pagination.

Run it with:

$ python -m zyte_test_websites.main ecommerce 8888

You can access it at http://localhost:8888.

Features:

• A page with job categories with pagination.
• Pages with jobs in a category with pagination.
• Pages with single job details.
• A search form with results pagination.

Run it with:

$ python -m zyte_test_websites.main jobs 8888

You can access it at http://localhost:8888.

zyte-test-websites also includes page objects that can be used to extract zyte-common-items objects from the provided websites.

• zyte_test_websites.ecommerce.extraction.TestProductPage
• zyte_test_websites.ecommerce.extraction.TestProductListPage
• zyte_test_websites.ecommerce.extraction.TestProductNavigationPage

• zyte_test_websites.jobs.extraction.TestJobPostingPage
• zyte_test_websites.jobs.extraction.TestJobPostingNavigationPage

• Python >= 3.9
• aiohttp