Skip to content

[New Feature]: Implement parallel input URL localization from NISAR PCM #1316

@RKuttruff

Description

@RKuttruff

Checked for duplicates

Yes - I've already checked

Alternatives considered

Yes - and alternatives don't suffice

Related problems

Some jobs with large input datasets like DISP-S1 and DIST-S1 can spend a lot of time localizing input files. In the case of DIST-S1, this has even led to spot termination before the SAS even began executing.

Describe the feature request

@pymonger provided this snippet from NISAR PCM that localizes input URLs in parallel. Let's use this for OPERA

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestneeds triageIssue that requires triage

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions