Also sync products that are no longer sold ("obsolete")

[raphodn]

Story

Some products that are added on Open Prices appear as "no longer sold" on Open Food Facts.
But the OFF API only returns "currently sold" products, so we don't fetch any information for the "no longer sold" / archived products.

Example

For example : 3596710346561 : Open Food Facts / Open Prices

Related issues

• ProductDataset: allow downloading the products obsolete dump openfoodfacts-python#278
• Add products_obsolete to mongo export and JSONL openfoodfacts-server#8338
• Fetch non-food product data from Open Product Facts & Open Beauty Facts #114

[stephanegigandet]

@raphodn products that are marked "no longer sold" are returned by the API: https://world.openfoodfacts.org/api/v3/product/3596710346561/sauce-tomate-poivron-aubergine-auchan

[raphodn]

@raphodn products that are marked "no longer sold" are returned by the API: https://world.openfoodfacts.org/api/v3/product/3596710346561/sauce-tomate-poivron-aubergine-auchan

After discussion on Slack, the obsolete products are indeed available in the API and in the CSV export, but not in the JSONL export. And there is no easy way to identify them.

An idea would be to have a seperate export with only obsolete products : see openfoodfacts/openfoodfacts-server#8338

[raphodn]

This issue is not blocked anymore !

• openfoodfacts-server : dump is now available : https://static.openfoodfacts.org/data/openfoodfacts-products_obsolete.jsonl.gz
• openfoodfacts-python was updated to support it