S1 to RTC-S1 Tool

[LucaCinquini]

We need a tool that, given an S1 granule, will look for the RTC-S1 product that we have generated using that granule. If no RTC-S1 product is found, we need to flag that S1 input as missing.
Eventually, we want to use the RTC-S1 native ids to trigger generation of DSWx-S1

[LucaCinquini]

This is the list of S1 granules that we need to track to RTC-S1:

S1A_IW_SLC__1SDV_20220310T121213_20220310T121240_042259_050962_1662
S1A_IW_SLC__1SDV_20220326T001026_20220326T001053_042485_051115_D32A
S1A_IW_SLC__1SDV_20220710T171836_20220710T171854_044041_0541C3_2C8D
S1A_IW_SLC__1SDV_20220305T223724_20220305T223753_042192_050737_DB6B
S1A_IW_SLC__1SDV_20220809T045826_20220809T045853_044471_054E88_4C2C
S1A_IW_SLC__1SDV_20220629T044831_20220629T044858_043873_053CCA_C5DF
S1A_IW_SLC__1SDV_20220727T154758_20220727T154825_044288_054932_85DD
S1A_IW_SLC__1SDV_20220328T035038_20220328T035108_042516_05122D_7835
S1A_IW_SLC__1SDV_20211216T011611_20211216T011638_041027_04DFA5_BE6E
S1A_IW_SLC__1SDV_20220314T100506_20220314T100533_042316_050B55_6539
S1A_IW_SLC__1SDV_20220331T091904_20220331T091931_042563_0513BE_4CD7
S1A_IW_SLC__1SDV_20220224T235903_20220224T235931_042062_0502BE_B8C2
S1A_IW_SLC__1SDV_20220726T215755_20220726T215822_044277_0548E4_B27B
S1A_IW_SLC__1SDV_20220219T061816_20220219T061844_041978_04FFD4_D196
S1A_IW_SLC__1SDV_20220320T195706_20220320T195734_042409_050E8B_E4B7
S1A_IW_SLC__1SDV_20220412T232348_20220412T232415_042747_0519E5_BBBD
S1A_IW_SLC__1SDV_20220317T164652_20220317T164719_042363_050D06_39EB
S1B_IW_SLC__1SDV_20211026T100721_20211026T100747_029305_037F51_0A11
S1A_IW_SLC__1SDV_20211221T104502_20211221T104530_041106_04E238_C7C5
S1A_IW_SLC__1SDV_20220322T043002_20220322T043029_042429_050F30_EE17
S1A_IW_SLC__1SDV_20220329T205140_20220329T205207_042541_051312_6195
S1A_IW_SLC__1SDV_20220319T002025_20220319T002053_042383_050DA2_9478
S1A_IW_SLC__1SDV_20220106T151008_20220106T151035_041342_04EA32_C03F
S1A_IW_SLC__1SDV_20220322T004002_20220322T004029_042427_050F21_9B64
S1A_IW_SLC__1SDV_20220317T010717_20220317T010744_042354_050CAE_4B61
S1A_IW_SLC__1SDV_20220321T004039_20220321T004106_042412_050E9F_EA35
S1A_IW_SLC__1SDV_20220821T083429_20220821T083456_044648_055485_5331
S1A_IW_SLC__1SDV_20220317T193035_20220317T193101_042365_050D17_B77E
S1A_IW_SLC__1SDV_20220306T173743_20220306T173810_042204_050794_3B3E
S1A_IW_SLC__1SDV_20211217T201343_20211217T201410_041053_04E091_68BF
S1A_IW_SLC__1SDV_20220824T162030_20220824T162057_044696_055618_595F
S1A_EW_SLC__1SDH_20220718T111650_20220718T111754_044154_05452F_65E3
S1A_IW_SLC__1SDV_20220901T190507_20220901T190535_044815_055A27_4EC0
S1A_IW_SLC__1SDV_20220318T235614_20220318T235642_042382_050DA1_AEE7
S1A_IW_SLC__1SDV_20220128T183503_20220128T183530_041665_04F4FF_D050
S1A_IW_SLC__1SDV_20220821T012507_20220821T012534_044644_055458_9D3E
S1A_IW_SLC__1SDV_20211012T215217_20211012T215243_040092_04BF4F_F1C4
S1A_IW_SLC__1SDV_20230401T033243_20230401T033310_047897_05C15B_D328
S1A_IW_SLC__1SDV_20220531T031625_20220531T031652_043449_053025_13ED
S1A_IW_SLC__1SDV_20220607T081232_20220607T081259_043554_053352_5465
S1A_IW_SLC__1SDV_20220502T225104_20220502T225131_043038_052396_DDD6
S1A_IW_SLC__1SDV_20220605T000226_20220605T000253_043520_05323C_6E0B
S1A_IW_SLC__1SDV_20220529T001022_20220529T001049_043418_052F44_1B41
S1A_IW_SLC__1SDV_20220609T103027_20220609T103055_043585_05342E_079B
S1A_IW_SLC__1SDV_20220611T182738_20220611T182806_043619_05352D_13B9
S1A_IW_SLC__1SDV_20220612T062615_20220612T062642_043626_053561_EC56
S1A_IW_SLC__1SDV_20220611T182738_20220611T182806_043619_05352D_13B9
S1A_IW_SLC__1SDV_20220607T012635_20220607T012705_043550_053333_1FE1
S1A_IW_SLC__1SDV_20220611T091908_20220611T091935_043613_053505_3A40
S1A_IW_SLC__1SDV_20220604T133510_20220604T133540_043514_05320D_8CFA
S1A_IW_SLC__1SDV_20220501T015305_20220501T015332_043011_0522A4_29F5
S1A_IW_SLC__1SDV_20220613T134434_20220613T134502_043645_0535F7_5F7B
S1A_IW_SLC__1SDV_20220612T030717_20220612T030745_043624_053550_2FE4
S1A_IW_SLC__1SDV_20220607T043346_20220607T043413_043552_053340_CE4C
S1A_IW_SLC__1SDV_20220607T043321_20220607T043348_043552_053340_CCE9
S1A_IW_SLC__1SDV_20220527T002005_20220527T002035_043389_052E6E_19BE
S1A_IW_SLC__1SDV_20220825T171540_20220825T171607_044712_05569A_E345
S1B_IW_SLC__1SDV_20210818T013810_20210818T013837_028294_036033_A037
S1A_IW_SLC__1SDV_20220616T020859_20220616T020927_043682_053710_EDBD
S1A_IW_SLC__1SDV_20220518T165045_20220518T165112_043268_052ACD_CDCA
S1A_EW_SLC__1SDH_20210829T151304_20210829T151403_039446_04A901_F04F
S1B_IW_SLC__1SDV_20210831T004402_20210831T004429_028483_036626_ECC3
S1B_EW_SLC__1SDH_20210829T110638_20210829T110741_028460_03656D_9B0D
S1B_EW_SLC__1SDH_20210905T123708_20210905T123810_028563_036899_A8B3
S1A_IW_SLC__1SDV_20220610T032320_20220610T032347_043595_05347F_96C2
S1A_IW_SLC__1SDV_20220507T155606_20220507T155634_043107_0525DB_194D
S1A_IW_SLC__1SDV_20220426T000225_20220426T000252_042937_052034_0F5C
S1A_IW_SLC__1SDV_20220616T023833_20220616T023900_043682_053711_7E3E
S1A_IW_SLC__1SDV_20210922T112624_20210922T112651_039794_04B4ED_E856
S1A_IW_SLC__1SDV_20220618T090805_20220618T090832_043715_053815_411D
S1A_IW_SLC__1SDV_20200404T050601_20200404T050629_031973_03B14B_2E59
S1A_IW_SLC__1SDV_20220505T110444_20220505T110511_043075_0524D5_0B9F
S1A_IW_SLC__1SDV_20210816T113027_20210816T113054_039254_04A277_343C
S1A_IW_SLC__1SDV_20220609T124234_20220609T124302_043586_05343C_7F2E
S1A_IW_SLC__1SDV_20220622T083425_20220622T083452_043773_0539DD_F186
S1A_IW_SLC__1SDV_20220513T000618_20220513T000645_043185_05284D_CAD2
S1A_IW_SLC__1SDV_20220607T004905_20220607T004932_043550_05332F_66C6
S1A_IW_SLC__1SDV_20220615T125607_20220615T125634_043674_0536DA_D67C
S1A_IW_SLC__1SDV_20220613T003543_20220613T003610_043637_0535BC_65EB
S1A_IW_SLC__1SDV_20231218T004310_20231218T004337_051702_063E6B_3F3B
S1A_IW_SLC__1SDV_20231219T132724_20231219T132750_051724_063F40_ED93
S1A_IW_SLC__1SDV_20231220T231459_20231220T231526_051744_063FE5_4F53
S1A_IW_SLC__1SDV_20231215T150812_20231215T150842_051667_063D2E_6B18
S1A_IW_SLC__1SDV_20231224T020303_20231224T020330_051790_064170_1C04
S1A_IW_SLC__1SDV_20230623T134131_20230623T134158_049114_05E7E3_2F7C
S1A_IW_SLC__1SDV_20230827T120945_20230827T121012_050061_060611_2EA8
S1A_IW_SLC__1SDV_20221112T232619_20221112T232649_045867_057CDD_22C7

[kevinmarlis]

@LucaCinquini what would be the ideal output format for this? I'm seeing up to ~30 RTC products per S1 input granule. Currently I have a json that outputs some summary metadata along with mappings of S1 granule to RTC products, but that can change to whatever is most useful. Here's a sample of the json output, including a mapping where no RTC granule is found:

{
  "mappings": [
    {
      "s1_granule": "S1A_IW_SLC__1SDV_20220310T121213_20220310T121240_042259_050962_1662",
      "rtc_granules": [
        "OPERA_L2_RTC-S1_T012-023745-IW2_20220310T121213Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023745-IW1_20220310T121213Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023745-IW3_20220310T121214Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023746-IW1_20220310T121215Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023746-IW2_20220310T121216Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023746-IW3_20220310T121217Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023747-IW1_20220310T121218Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023747-IW2_20220310T121219Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023747-IW3_20220310T121220Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023748-IW1_20220310T121221Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023748-IW2_20220310T121222Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023748-IW3_20220310T121223Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023749-IW1_20220310T121224Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023749-IW2_20220310T121225Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023749-IW3_20220310T121225Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023750-IW1_20220310T121226Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023750-IW2_20220310T121227Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023750-IW3_20220310T121228Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023751-IW1_20220310T121229Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023751-IW2_20220310T121230Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023751-IW3_20220310T121231Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023752-IW1_20220310T121232Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023752-IW2_20220310T121233Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023752-IW3_20220310T121234Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023753-IW1_20220310T121235Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023753-IW2_20220310T121236Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023753-IW3_20220310T121237Z_20241225T000650Z_S1A_30_v1.0",
        "OPERA_L2_RTC-S1_T012-023754-IW1_20220310T121237Z_20241225T000650Z_S1A_30_v1.0"
      ],
      "rtc_count": 28,
      "found": true,
      "error": null
    },
    ...,
    {
      "s1_granule": "S1A_EW_SLC__1SDH_20220718T111650_20220718T111754_044154_05452F_65E3",
      "rtc_granules": [],
      "rtc_count": 0,
      "found": false,
      "error": null
    },
    ...,
    ],
  "summary": {
    "total_s1_granules": 87,
    "s1_with_rtc": 83,
    "s1_without_rtc": 4,
    "total_rtc_granules": 2326
  }
}

[LucaCinquini]

@kevinmarlis : that makes sense, because an S1 SAFE file contains around 27 burst. @LalaP : if Kevin was to give you a list of RTC-S1 like the one above, do we have a tool to reduce the list to a smaller number of DSWx-S1 jobs, so that we only trigger each job once?

[hhlee445]

yes. we do have a tool to reduce the list.

https://github.com/nasa/opera-sds-pcm/blob/develop/tools/ops/data_subscriber/data_subscriber_client.py

[LucaCinquini]

Thank you. That being the case, what Kevin has now should be enough… Thanks Kevin! L From: Hyun Lee ***@***.***> Date: Wednesday, December 3, 2025 at 12:27 To: nasa/opera-sds ***@***.***> Cc: Cinquini, Luca (US 398A) ***@***.***>, Mention ***@***.***> Subject: [EXTERNAL] Re: [nasa/opera-sds] S1 to RTC-S1 Tool (Issue #127) [https://avatars.githubusercontent.com/u/47543396?s=20&v=4]hhlee445 left a comment (nasa/opera-sds#127)<https://urldefense.us/v3/__https://github.com/nasa/opera-sds/issues/127*issuecomment-3608705862__;Iw!!PvBDto6Hs4WbVuu7!IR19hg-yhQ7bfQSuE0Uy4roilIXbejHnzAtsEO08GsrJB_No0t_vkHDLsbHZcCrkqtZ9nWfivHIs47MWSCuf1__S6GD0v5Pdpg$> yes. we do have a tool to reduce the list. https://github.com/nasa/opera-sds-pcm/blob/develop/tools/ops/data_subscriber/data_subscriber_client.py<https://urldefense.us/v3/__https://github.com/nasa/opera-sds-pcm/blob/develop/tools/ops/data_subscriber/data_subscriber_client.py__;!!PvBDto6Hs4WbVuu7!IR19hg-yhQ7bfQSuE0Uy4roilIXbejHnzAtsEO08GsrJB_No0t_vkHDLsbHZcCrkqtZ9nWfivHIs47MWSCuf1__S6GDMmMVVhA$> — Reply to this email directly, view it on GitHub<https://urldefense.us/v3/__https://github.com/nasa/opera-sds/issues/127*issuecomment-3608705862__;Iw!!PvBDto6Hs4WbVuu7!IR19hg-yhQ7bfQSuE0Uy4roilIXbejHnzAtsEO08GsrJB_No0t_vkHDLsbHZcCrkqtZ9nWfivHIs47MWSCuf1__S6GD0v5Pdpg$>, or unsubscribe<https://urldefense.us/v3/__https://github.com/notifications/unsubscribe-auth/AAE3RA5DTI53LNUPULNG5HT375BRBAVCNFSM6AAAAACN2YM6XCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTMMBYG4YDKOBWGI__;!!PvBDto6Hs4WbVuu7!IR19hg-yhQ7bfQSuE0Uy4roilIXbejHnzAtsEO08GsrJB_No0t_vkHDLsbHZcCrkqtZ9nWfivHIs47MWSCuf1__S6GCnldubKg$>. You are receiving this because you were mentioned.