Skip to content

DataExtentions not working as expected #99

@nadeem-codex

Description

@nadeem-codex
2025-06-24 10:30:09,254Z    tap - INFO Making RETRIEVE call to 'DataExtension' endpoint with filters '{'SimpleOperator': 'equals', 'Property': 'CustomerKey', 'Value': '9FDE6054-8D67-4029-AF4B-C0639656B125'}'.
2025-06-24 10:30:09,254Z target - INFO Serializing batch with 1 messages for table data_extension.Mobile_Push
2025-06-24 10:30:09,254Z target - INFO Sending batch of 1278 bytes to https://api.stitchdata.com/v2/import/batch
2025-06-24 10:30:09,259Z target - INFO replicated 1 records from "data_extension.Mobile_Push" endpoint
2025-06-24 10:30:09,462Z    tap - INFO Got 1 results from DataExtension endpoint.
2025-06-24 10:30:09,463Z    tap - INFO Fetching data_extension._MobileLineAddress from 2024-06-24T00:00:00Z to 2024-07-01T00:00:00Z
2025-06-24 10:30:09,791Z    tap - ERROR Request failed with 'Error: The Request Property(s) ModifiedBy  do not match with the fields of DataExtensionObject retrieve'
2025-06-24 10:30:09,791Z    tap - Traceback (most recent call last):
2025-06-24 10:30:09,791Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/__init__.py", line 148, in do_sync
2025-06-24 10:30:09,791Z    tap -     stream_accessor.sync()
2025-06-24 10:30:09,792Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/dao.py", line 132, in sync
2025-06-24 10:30:09,792Z    tap -     return self.sync_data()
2025-06-24 10:30:09,792Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/backoff/_sync.py", line 94, in retry
2025-06-24 10:30:09,792Z    tap -     ret = target(*args, **kwargs)
2025-06-24 10:30:09,792Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/dao.py", line 44, in wrapper
2025-06-24 10:30:09,792Z    tap -     return fnc(*args, **kwargs)
2025-06-24 10:30:09,792Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/endpoints/data_extensions.py", line 380, in sync_data
2025-06-24 10:30:09,793Z    tap -     replication_key=replication_key)
2025-06-24 10:30:09,793Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/backoff/_sync.py", line 94, in retry
2025-06-24 10:30:09,793Z    tap -     ret = target(*args, **kwargs)
2025-06-24 10:30:09,793Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/dao.py", line 44, in wrapper
2025-06-24 10:30:09,793Z    tap -     return fnc(*args, **kwargs)
2025-06-24 10:30:09,793Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/endpoints/data_extensions.py", line 306, in _replicate
2025-06-24 10:30:09,793Z    tap -     for row in result:
2025-06-24 10:30:09,794Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_exacttarget/client.py", line 148, in request_from_cursor
2025-06-24 10:30:09,794Z    tap -     .format(response.message))
2025-06-24 10:30:09,794Z    tap - RuntimeError: Request failed with 'Error: The Request Property(s) ModifiedBy  do not match with the fields of DataExtensionObject retrieve'
2025-06-24 10:30:09,794Z    tap - ERROR Failed to sync endpoint, moving on!
2025-06-24 10:30:09,794Z    tap - INFO Run failed, exiting.
2025-06-24 10:30:10,060Z target - INFO Requests complete, stopping loop
2025-06-24 10:30:10,123Z   main - INFO Target exited normally with status 0
2025-06-24 10:30:10,128Z   main - INFO No tunnel subprocess to tear down
2025-06-24 10:30:10,128Z   main - INFO Exit status is: Discovery succeeded. Tap failed with code 1. Target succeeded.

Unable to remove the modifiedby property in the schema metadata on stitch platform, can we fix this by using the metadata over the schema
https://github.com/singer-io/tap-exacttarget/blob/master/tap_exacttarget/dao.py#L121

I can be reached at slack: https://singer-io.slack.com/archives/C2TGFCZEV/p1750763417979849 or here

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions