memory allocation issue

[valentinedwv]

hitting the memory allocation issue

Error processing query

Tried to allocate 148 MB, but only 25.2 MB were available

PREFIX schema: <https://schema.org/>
PREFIX sschema: <https://schema.org/>
PREFIX bds: <http://www.bigdata.com/rdf/search#>
PREFIX ql: <http://qlever.cs.uni-freiburg.de/builtin-functions/>
PREFIX xsd: <http://www.w3.org/2001/XMLSchema#>

SELECT DISTINCT ?subj ?name ?description ?url ?datep ?pubname ?temporalCoverage  (GROUP_CONCAT(DISTINCT ?url; SEPARATOR=", ") AS ?disurl)   (GROUP_CONCAT(DISTINCT ?placename; SEPARATOR=", ") AS ?placenames)   (GROUP_CONCAT(DISTINCT ?kw_u; SEPARATOR=", ") AS ?kw)   (GROUP_CONCAT(DISTINCT ?resourceType_u; SEPARATOR=", ") AS ?resourceType)  
WHERE {
  ?subj schema:keywords|sschema:keywords "ALS" .
  GRAPH ?g {
    VALUES ?sosType {
      sschema:Dataset
      schema:Dataset
    }
    ?subj a ?sosType .
    ?subj schema:name|sschema:name ?name .
    ?subj schema:description|sschema:description ?description .
  }
  VALUES (?type ?resourceType_u) {
    (schema:Dataset "data")
    (sschema:Dataset "data")
    (schema:ResearchProject "researchProject")
    (sschema:ResearchProject "researchProject")
    (schema:SoftwareApplication "tool")
    (sschema:SoftwareApplication "tool")
    (schema:Person "person")
    (sschema:Person "person")
    (schema:Event "event")
    (sschema:Event "event")
    (schema:Award "award")
    (sschema:Award "award")
    (schema:DataCatalog "DataCatalog")
    (sschema:DataCatalog "DataCatalog")
  }
  ?subj a ?type .
  OPTIONAL {?subj sschema:distribution/sschema:url|sschema:subjectOf/sschema:url|schema:distribution/schema:url|schema:subjectOf/schema:url ?url1 .}
  OPTIONAL {?subj schema:datePublished|sschema:datePublished ?datep1 .}
  OPTIONAL {?subj schema:dateCreated|sschema:dateCreated ?datec .}
  OPTIONAL {?subj schema:dateModified|sschema:dateModified ?datem .}
  OPTIONAL {?subj schema:temporalCoverage|sschema:temporalCoverage ?temporalCoverage .}
  OPTIONAL {?subj schema:publisher/schema:name|sschema:publisher/sschema:name|schema:publisher/schema:legalName|sschema:publisher/sschema:legalName ?pub_name .}
  OPTIONAL {?subj schema:spatialCoverage/schema:name|sschema:spatialCoverage/sschema:name|sschema:sdPublisher ?place_name .}
  OPTIONAL {?subj schema:keywords|sschema:keywords ?kwu .}

 

  BIND (COALESCE(?datec,?datem,?datep1) AS ?datep)
  BIND (IF(BOUND(?pub_name), ?pub_name, "No Publisher") AS ?pubname)
  BIND (IF(BOUND(?place_name), ?place_name, "No Placenames") AS ?placename)
}
GROUP BY ?g ?subj  ?placename  ?datep ?pubname ?url  ?name ?description ?type  ?temporalCoverage ?kw  ?resourceType
LIMIT 100
OFFSET 0

qlever file

# Qleverfile for Earthcube Decoder/Geocodes, use with https://github.com/ad-freiburg/qlever-control
#
# qlever get-data  # downloads .zip file of size 13 MB, uncompressed to 323 MB
# qlever index     # takes ~10 seconds and ~1 GB RAM (on an AMD Ryzen 9 5900X)
# qlever start     # starts the server (instant)
# removed from ui section: UI_CONFIG = eco

[data]
NAME              = facetsearch
SOURCES           = geocodes_examples geocodes_demo_datasets iris magic earthchem r2r opentopography iedadata wifire cchdo ssdbiodp osmc obis wodb emodnet
BASE_URL          = https://oss.geocodes-aws.earthcube.org/decoder/graphs/latest
GET_DATA_CMD      = for source in ${SOURCES}; do curl -sLo $${source}_release.nq -C - ${BASE_URL}/$${source}_release.nq; done
DESCRIPTION       = eco ${NAME} ${BASE_URL}
TEXT_DESCRIPTION  = eco release graph for ${NAME} sources: ${SOURCES}
FORMAT            = nq


[index]
INPUT_FILES     = *_release.nq
CAT_INPUT_FILES = cat ${INPUT_FILES}
VOCABULARY_TYPE = on-disk-compressed-geo-split
SETTINGS_JSON   = { "add-text-index": true, "ascii-prefixes-only": false, "num-triples-per-batch": 100000 }
#SETTINGS_JSON   = { "add-text-index": true, "ascii-prefixes-only": false, "num-triples-per-batch": 100000, "vocabulary-type": "on-disk-compressed-geo-split" }
[server]
PORT               = 7019
ACCESS_TOKEN       = ${data:NAME}_7643543846_6dMISzlPrD7i
MEMORY_FOR_QUERIES = 25G
CACHE_MAX_SIZE     = 20G
TIMEOUT            = 240s

[runtime]
SYSTEM = native
IMAGE  = docker.io/adfreiburg/qlever:latest

[ui]
UI_CONFIG = default

[valentinedwv]

Is there some way I can help with the development of an issue?
is there some warmup that might help solve this?

If I do a keyword where we have count of like 1000
?subj schema:keywords|sschema:keywords "Subduction Zone" .
i get results, consistently

Some keywords with many possible results, (45k), work
?subj schema:keywords|sschema:keywords "Observation" .

Others, do not
?subj schema:keywords|sschema:keywords "Lidar" .

some are inconsistent:
?subj schema:keywords|sschema:keywords "ALS" .

[hannahbast]

@valentinedwv I just tried your query with the Qleverfile you provided and it worked fine. Are you using the latest version of QLever?

Also, I got the following warnings, which indicate that your query needs revision:

Variable ?url was used by GROUP BY, but is not defined in the query body.
Variable ?kw was used by GROUP BY, but is not defined in the query body.
Variable ?resourceType was used by GROUP BY, but is not defined in the query body.
Variable ?url was used by SELECT in expression "GROUP_CONCAT(DISTINCT ?url; SEPARATOR=", ")", but is not defined in the query body.
Variable ?kw_u was used by SELECT in expression "GROUP_CONCAT(DISTINCT ?kw_u; SEPARATOR=", ")", but is not defined in the query body.

P.S. In general, whenever you encounter a problem, try to find a minimal query that triggers it. It makes it much easier for us to help