Skip to content

is it possible to add cache expiration feature?Β #3305

@ophiry

Description

@ophiry

The idea is add the possibility to define a cache expiration period
to avoid confusion, is seems the best solution is to consider the cache expiration based on the task definition of the reading process

API:
add a new cache_expiration parameter to flytekit.task

@task(cache=True, cache_version='v1', cache_expiration=timedelta(days=7))

will define a task that will only use the cache, if the cache is less then a week old

Discussed in #3238

Originally posted by ophiry January 16, 2023
that is - include in the task decorator a parameter which will control for how long the cache will be considered valid

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions