Is an up to date Wikidata QLever instance possible?

[dpriskorn]

Hi
I just found out that the changes to Wikidata can now be consumed via EventStreams, see https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Wikidata_RDF_change_stream
RDF schema is here https://schema.wikimedia.org/repositories/primary/jsonschema/mediawiki/wikibase/entity/rdf_change/2.0.0
Example stream content
I read https://github.com/ad-freiburg/qlever/wiki/QLever-support-for-SPARQL-1.1-Update
Is it possible to consume the RDF change diff and ingest in QLever using SPARQL Update 1.1?
Has anyone tried creating an up to date QLever instance with the Wikidata dump + ingestion from the stream?
Open questions:

1. Lets say I load the latest dump, how do I get the diffs from that dump until now?
2. Has anyone written any code to ingest the stream into QLever?

[hannahbast]

@dpriskorn This is not only possible but it is already implemented and running for quite some time.

Here is the pull request for the qlever command: qlever-dev/qlever-control#158 . It is very easy to use, in the folder with the Qleverfile and the Wikidata index, you just write qlever update-wikidata.

The endpoint also contains special triples, from which you can see when the data was first modified and last modified, and until when updates have been fully ingested: https://qlever.cs.uni-freiburg.de/wikidata/OoKng8 . The endpoint at https://qlever.cs.uni-freiburg.de/wikidata is usually up to date

[dpriskorn]

This is fantastic news!
I'm curious how you implemented this given that we only have weekly dumps at the moment.
I found this qlever-dev/qlever-control@1fcd9b4 and see that you solved filling the gap between a dumpfile generation time and the current time by SPARQL of course 😀