Skip to content

Commit 7385b9d

Browse files
committed
DynamoDBStorage.store() method will call store_latest() if use_latest flag is True.
1 parent 8eb2e08 commit 7385b9d

File tree

1 file changed

+8
-5
lines changed

1 file changed

+8
-5
lines changed

ingester/datalake_ingester/storage.py

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -59,11 +59,14 @@ def _latest_table(self):
5959
return Table(self.latest_table_name, connection=self._connection)
6060

6161
def store(self, record):
62-
try:
63-
self._table.put_item(data=record)
64-
except ConditionalCheckFailedException:
65-
# Tolerate duplicate stores
66-
pass
62+
if self.use_latest:
63+
self._latest_table.store_latest(record)
64+
else:
65+
try:
66+
self._table.put_item(data=record)
67+
except ConditionalCheckFailedException:
68+
# Tolerate duplicate stores
69+
pass
6770

6871
def update(self, record):
6972
self._table.put_item(data=record, overwrite=True)

0 commit comments

Comments
 (0)