videos: transform doi and collections #262
Conversation
cds_migrator_kit/videos/weblecture_migration/transform/xml_processing/rules/base.py
Show resolved
Hide resolved
| @for_each_value | ||
| def collection_tags(self, key, value): | ||
| """Translates collection_tags.""" | ||
| collection_mapping = { |
There was a problem hiding this comment.
We have also this collection and records are identified there with the following query: 490:'CERN Accelerator School' and 690C:'TALK'. For these records, we will need to add also the extra tag
There was a problem hiding this comment.
So we'll check the 490:'CERN Accelerator School' and 690C:'TALK' and add the tag for this collection?
There was a problem hiding this comment.
490 is Series and it doesn’t have a rule yet, I'm adding this to my TODO, and add it later with 490 is it okay? And do we need to check both 490 and 690 or only 490 is enough?
There was a problem hiding this comment.
hmm because our search query gives back only video content, having only the 490 check should be enough. You can verify that you get all the records of the above collection.
There was a problem hiding this comment.
@ntarocco any comment on how to store the collection tags? Do you think it would be better to keep somewhat the tree structure e.g tags: ['Lectures/Academic training lectures'] or a flat representation is enough e.g tags: ['Lectures', 'Academic training lectures']
There was a problem hiding this comment.
@zzacharo I checked the collection and 350/396 record is in our search query, 20 of them doesn’t have video files. I don’t know the rest 26 records😅
There was a problem hiding this comment.
For the 20 missing, maybe ask Rene to see if they can retrieve the video, otherwise we will need to import them as metadata only or in a format that we could potentially in the future edit them. For the missing 26 records, we need to understand why...
| if doi.startswith("10.17181"): | ||
| return doi |
There was a problem hiding this comment.
We just use the same DOI value and this DOI is keeping the cds record. It's redirecting to cds record, and after migration cds record will redirect to videos. Is this okay or do we need to update datacite? @zzacharo
There was a problem hiding this comment.
It would be nice to gather all the related records and update datacite in fact
There was a problem hiding this comment.
If I'm not missing we have only one record with 10.17181 doi.
There was a problem hiding this comment.
but we have more with a different DOI?
There was a problem hiding this comment.
Yes but I guess those records don’t have videos
search
There was a problem hiding this comment.
Note the list down to see what we will do with these records, maybe add an issue or worth actually sending the list to Jens. Btw, https://cds.cern.ch/record/276197 this one also has a link to CERN library catalogue so if we migrate them we need to keep the link!
zubeydecivelek
force-pushed
the
new-rules
branch
4 times, most recently
from
d8052cd to
d832319
Compare
| "TP": "Lectures,Talks Seminars and Other Events,Teacher Programmes", | ||
| "e-learning": "Lectures,E-learning modules", | ||
| "E-LEARNING": "Lectures,E-learning modules", | ||
| "Restricted_ATLAS_Talks": "Lectures,Restricted ATLAS Talks", |
There was a problem hiding this comment.
I am thinking that this can be just
| "Restricted_ATLAS_Talks": "Lectures,Restricted ATLAS Talks", | |
| "Restricted_ATLAS_Talks": "Lectures, ATLAS Talks", |
with just the proper restrisctions but let's leave it like this for now and discuss it when see the collection tree
zubeydecivelek
force-pushed
the
new-rules
branch
2 times, most recently
from
dbb8965 to
5dcb91b
Compare
zubeydecivelek
force-pushed
the
new-rules
branch
from
5dcb91b to
9fe5632
Compare
closes CERNDocumentServer/cds-videos#2041
closes CERNDocumentServer/cds-videos#2042
New rules
0247(DOI) transformed as DOI if it's starting with10.17.181, or alternate_identifiers withDOIscheme.980collections transformed ascollections964transformed as_curation.964with marc tags (964__a:....)853transformed as_curation.853with marc tags (853__a:....)336transformed as_curation.336with marc tags (336__a:....)Improvements
269(imprint)bname of publication transformed as contributor with roleProducer041(language) if we have multiple languages, first one used as a main language and others added asadditional_languages