Skip to content

Parameter "pages" sometimes is not honored #7

@wang27jing

Description

@wang27jing

Using the playground to test use. I have the following request. It is clear that this ASIN has a lot of reviews (actually ~190 reviews as I tested). I have received 8 reviews/page * 10 pages = ~80 reviews. Any reason the scraping stopped early at page 10 when "pages" is explicitly set to 20?
Result is attached: data.json

payload = {
'source': 'amazon_reviews',
'query': 'B0BPN4NL4R',
'parse': True,
'domain': 'com',
'pages': '20',
'start_page': '1'
}

response = requests.request(
'POST',
'https://realtime.oxylabs.io/v1/queries',
auth=('YOUR_USERNAME', 'YOUR_PASSWORD'), #Your credentials go here
json=payload,
)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions