Qlever Binary via Yggdrasil #582

jeremiahpslewis · 2022-02-07T10:57:54Z

jeremiahpslewis
Feb 7, 2022

Temporary build file: https://github.com/jeremiahpslewis/qlever_jll.jl

jeremiahpslewis · 2022-02-07T10:58:37Z

jeremiahpslewis
Feb 7, 2022
Author

Index Build script:

using Pkg; Pkg.add(["XZ_jll", "JSON"]); Pkg.add(url="https://github.com/jeremiahpslewis/qlever_jll.jl.git")
# Install: https://github.com/jeremiahpslewis/qlever_jll.jl.git
using QLever_jll
using XZ_jll
using Downloads
using JSON

olympics_data_url = "https://github.com/ad-freiburg/qlever/blob/64eb86f9fa30404df56fdae50475d0eb505cbc26/examples/olympics.nt.xz?raw=true"

mktempdir() do tdir
    olympics_data_path = joinpath(tdir, "olympics.nt.xz")
    Downloads.download(olympics_data_url, olympics_data_path)

    settings_path = joinpath(tdir, "settings.json")
    open(settings_path,"w") do f
        JSON.print(f, Dict("num-triples-per-partial-vocab" => Int(5e7), "ignore-punctuation" => 1)) # "ascii-prefixes-only" => true
    end
    
    run(pipeline(`$(xz()) -d -c $olympics_data_path`, `$(IndexBuilderMain()) -F nt -f - -l -i olympics -s $settings_path`))
end

0 replies

jeremiahpslewis · 2022-02-07T11:03:04Z

jeremiahpslewis
Feb 7, 2022
Author

Linux works:

2022-02-07 10:55:53.869	- INFO:  QLever IndexBuilder, compiled on Feb  6 2022 14:33:29
2022-02-07 10:55:53.869	- INFO:  You specified the input format: NT
2022-02-07 10:55:53.869	- DEBUG: Parsing uncompressed N-Triples from: /dev/stdin (using the Turtle parser)
2022-02-07 10:55:53.869	- INFO:  Locale was not specified in settings file, default is en_US
2022-02-07 10:55:53.869	- INFO:  You specified "locale = en_US" and "ignore-punctuation = 0"
2022-02-07 10:55:53.869	- INFO:  You specified "num-triples-per-partial-vocab = 50,000,000", choose a lower value if the index builder runs out of memory
2022-02-07 10:55:53.869	- DEBUG: Using the Google RE2 library for tokenization
2022-02-07 10:55:53.869	- INFO:  Processing input triples from /dev/stdin ...
2022-02-07 10:55:53.871	- DEBUG: Initialize parallel Turtle Parsing from uncompressed file or stream /dev/stdin
2022-02-07 10:56:06.252	- DEBUG: Input triples read in this section: 1,781,625
2022-02-07 10:56:06.252	- DEBUG: Triples processed, also counting internal triples added by QLever: 2,055,677
2022-02-07 10:56:20.414	- DEBUG: Writing partial vocabulary to: olympics.tmp.partial-vocabulary.0
2022-02-07 10:56:20.580	- DEBUG: Done writing partial vocabulary
2022-02-07 10:56:21.021	- DEBUG: Writing partial vocabulary to: olympics.tmp.for-prefix-compression..tmp.partial-vocabulary.0
2022-02-07 10:56:21.184	- DEBUG: Done writing partial vocabulary
2022-02-07 10:56:21.264	- INFO:  Done, total number of triples read: 1,781,625 [may contain duplicates]
2022-02-07 10:56:21.264	- INFO:  Number of QLever-internal triples created: 274,052 [may contain duplicates]
2022-02-07 10:56:21.264	- INFO:  Merging partial vocabularies in byte order (internal only) ...
2022-02-07 10:56:21.718	- DEBUG: Finished writing batch of merged words
2022-02-07 10:56:21.734	- INFO:  Number of words in internal vocabulary: 544,174
2022-02-07 10:56:21.735	- INFO:  Merging partial vocabularies in Unicode order (internal and external) ...
2022-02-07 10:56:21.969	- DEBUG: Finished writing batch of merged words
2022-02-07 10:56:21.991	- DEBUG: Finished merging partial vocabularies
2022-02-07 10:56:21.991	- INFO:  Number of words in external vocabulary: 0
2022-02-07 10:56:21.991	- INFO:  Removing temporary files ...
2022-02-07 10:56:22.016	- DEBUG: Number of words in internal and external vocabulary: 544,174
2022-02-07 10:56:22.016	- INFO:  Converting external vocabulary to binary format ...
2022-02-07 10:56:22.020	- INFO:  Converting triples from local IDs to global IDs ...
2022-02-07 10:56:22.020	- DEBUG: Triples per partial vocabulary: 100,000,000
2022-02-07 10:56:22.020	- DEBUG: Reading ID map from: olympics.tmp.partial-ids-mmap.0
2022-02-07 10:56:22.361	- INFO:  Done, total number of triples converted: 2,055,677
2022-02-07 10:56:22.361	- INFO:  Building prefix tree from internal vocabulary ...
2022-02-07 10:56:22.648	- INFO:  Computing maximally compressing prefixes (greedy algorithm) ...
2022-02-07 10:56:22.661	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/ with number of bytes gained: 17,081,358
2022-02-07 10:56:22.671	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ with number of bytes gained: 2,426,616
2022-02-07 10:56:22.679	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/athlete/ with number of bytes gained: 1,077,832
2022-02-07 10:56:22.686	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens with number of bytes gained: 350,441
2022-02-07 10:56:22.694	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Gymnastics with number of bytes gained: 267,060
2022-02-07 10:56:22.701	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Swimming with number of bytes gained: 185,552
2022-02-07 10:56:22.708	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsWomens with number of bytes gained: 174,975
2022-02-07 10:56:22.715	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CrossCountrySkiing with number of bytes gained: 164,376
2022-02-07 10:56:22.723	- DEBUG: Found prefix " with number of bytes gained: 137,022
2022-02-07 10:56:22.729	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FootballMensFootball/ with number of bytes gained: 120,372
2022-02-07 10:56:22.736	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/IceHockeyMensIceHockey/ with number of bytes gained: 109,503
2022-02-07 10:56:22.744	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AlpineSkiing with number of bytes gained: 105,936
2022-02-07 10:56:22.751	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CyclingMens with number of bytes gained: 103,719
2022-02-07 10:56:22.759	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingMens with number of bytes gained: 96,074
2022-02-07 10:56:22.766	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShootingMens with number of bytes gained: 94,716
2022-02-07 10:56:22.773	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/WrestlingMens with number of bytes gained: 89,037
2022-02-07 10:56:22.781	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/EquestrianismM with number of bytes gained: 88,732
2022-02-07 10:56:22.788	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/RowingMens with number of bytes gained: 83,870
2022-02-07 10:56:22.795	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BasketballMensBasketball/ with number of bytes gained: 81,975
2022-02-07 10:56:22.803	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/WaterPoloMensWaterPolo/ with number of bytes gained: 77,211
2022-02-07 10:56:22.810	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMens with number of bytes gained: 70,308
2022-02-07 10:56:22.817	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SpeedSkating with number of bytes gained: 67,344
2022-02-07 10:56:22.825	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/HockeyMensHockey/ with number of bytes gained: 67,218
2022-02-07 10:56:22.832	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BoxingMens with number of bytes gained: 59,740
2022-02-07 10:56:22.840	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingWomens with number of bytes gained: 59,094
2022-02-07 10:56:22.847	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/WeightliftingMens with number of bytes gained: 59,041
2022-02-07 10:56:22.854	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CanoeingMens with number of bytes gained: 57,480
2022-02-07 10:56:22.862	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CyclingMensRoadRaceIndividual/ with number of bytes gained: 55,974
2022-02-07 10:56:22.869	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsWomens with number of bytes gained: 54,768
2022-02-07 10:56:22.876	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens with number of bytes gained: 53,376
2022-02-07 10:56:22.883	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensIndividualAllAround with number of bytes gained: 52,782
2022-02-07 10:56:22.891	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SailingMixed with number of bytes gained: 52,296
2022-02-07 10:56:22.898	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/HandballMensHandball/ with number of bytes gained: 47,523
2022-02-07 10:56:22.906	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/VolleyballMensVolleyball/ with number of bytes gained: 46,500
2022-02-07 10:56:22.914	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ArtCompetitionsMixed with number of bytes gained: 44,840
2022-02-07 10:56:22.922	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/VolleyballWomensVolleyball/ with number of bytes gained: 41,634
2022-02-07 10:56:22.930	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SkiJumpingMensNormalHillIndividual/ with number of bytes gained: 40,250
2022-02-07 10:56:22.937	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens4x200metresFreestyleRelay/ with number of bytes gained: 40,092
2022-02-07 10:56:22.945	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Biathlon with number of bytes gained: 39,136
2022-02-07 10:56:22.953	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BobsleighMens with number of bytes gained: 37,882
2022-02-07 10:56:22.961	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensTeamAllAround with number of bytes gained: 35,139
2022-02-07 10:56:22.968	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BasketballWomensBasketball/ with number of bytes gained: 33,885
2022-02-07 10:56:22.975	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShortTrackSpeedSkating with number of bytes gained: 33,594
2022-02-07 10:56:22.982	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens4x100metresRelay/ with number of bytes gained: 32,453
2022-02-07 10:56:22.989	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/HandballWomensHandball/ with number of bytes gained: 32,200
2022-02-07 10:56:22.996	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingWomens4x100metresFreestyleRelay/ with number of bytes gained: 31,824
2022-02-07 10:56:23.003	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ModernPentathlonMensIndividual/ with number of bytes gained: 31,155
2022-02-07 10:56:23.010	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens100metres with number of bytes gained: 31,068
2022-02-07 10:56:23.017	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CyclingMens100kilometresTeamTimeTrial/19 with number of bytes gained: 30,972
2022-02-07 10:56:23.024	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsWomensIndividualAllAround/ with number of bytes gained: 30,760
2022-02-07 10:56:23.031	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensPommelledHorse/ with number of bytes gained: 30,450
2022-02-07 10:56:23.038	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CyclingMensTeamPursuit4000metres/ with number of bytes gained: 30,008
2022-02-07 10:56:23.045	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FigureSkating with number of bytes gained: 29,861
2022-02-07 10:56:23.052	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens4x400metresRelay/ with number of bytes gained: 29,716
2022-02-07 10:56:23.060	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/RowingMensCoxedEights/ with number of bytes gained: 29,064
2022-02-07 10:56:23.067	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens200metres with number of bytes gained: 28,575
2022-02-07 10:56:23.074	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensHorizontalBar/ with number of bytes gained: 28,560
2022-02-07 10:56:23.080	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens4x100metresMedleyRelay/ with number of bytes gained: 28,543
2022-02-07 10:56:23.087	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Shooting with number of bytes gained: 28,416
2022-02-07 10:56:23.094	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SkiJumpingMensLargeHill with number of bytes gained: 28,037
2022-02-07 10:56:23.101	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/HockeyWomensHockey/ with number of bytes gained: 27,702
2022-02-07 10:56:23.108	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShootingMensSmallBoreRifleProne50metres/ with number of bytes gained: 27,160
2022-02-07 10:56:23.115	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CrossCountrySkiingMens4x10kilometresRelay/ with number of bytes gained: 26,712
2022-02-07 10:56:23.123	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensParallelBars/ with number of bytes gained: 26,624
2022-02-07 10:56:23.130	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensFloorExercise/ with number of bytes gained: 26,306
2022-02-07 10:56:23.138	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/RowingWomens with number of bytes gained: 26,304
2022-02-07 10:56:23.145	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CanoeingWomensKayak with number of bytes gained: 26,201
2022-02-07 10:56:23.152	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingWomens with number of bytes gained: 25,987
2022-02-07 10:56:23.159	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/EquestrianismMixedThreeDayEvent with number of bytes gained: 25,857
2022-02-07 10:56:23.166	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingWomens100metres with number of bytes gained: 24,651
2022-02-07 10:56:23.173	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingMensepeeIndividual/19 with number of bytes gained: 24,633
2022-02-07 10:56:23.181	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AlpineSkiingMensGiantSlalom/ with number of bytes gained: 24,544
2022-02-07 10:56:23.188	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingWomens4x100metresMedleyRelay/ with number of bytes gained: 24,357
2022-02-07 10:56:23.195	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens4x100metresFreestyleRelay/ with number of bytes gained: 24,336
2022-02-07 10:56:23.203	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/NordicCombinedMens with number of bytes gained: 24,174
2022-02-07 10:56:23.210	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SynchronizedSwimmingWomens with number of bytes gained: 23,608
2022-02-07 10:56:23.218	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FootballWomensFootball/ with number of bytes gained: 23,253
2022-02-07 10:56:23.225	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShootingMensSmallBoreRifleThreePositions50metres/ with number of bytes gained: 22,866
2022-02-07 10:56:23.232	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/EquestrianismMixedJumpingIndividual/ with number of bytes gained: 22,374
2022-02-07 10:56:23.238	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/JudoMens with number of bytes gained: 21,656
2022-02-07 10:56:23.246	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/TableTennis with number of bytes gained: 21,494
2022-02-07 10:56:23.252	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsWomensFloorExercise/ with number of bytes gained: 21,364
2022-02-07 10:56:23.259	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsMensHorseVault/19 with number of bytes gained: 21,359
2022-02-07 10:56:23.266	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BiathlonMens4x75kilometresRelay/ with number of bytes gained: 21,192
2022-02-07 10:56:23.273	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingWomens200metres with number of bytes gained: 21,141
2022-02-07 10:56:23.279	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsWomensTeamAllAround/ with number of bytes gained: 20,762
2022-02-07 10:56:23.286	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AlpineSkiingWomens with number of bytes gained: 20,382
2022-02-07 10:56:23.293	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingMensFoilIndividual/ with number of bytes gained: 20,340
2022-02-07 10:56:23.301	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CrossCountrySkiingWomens with number of bytes gained: 20,304
2022-02-07 10:56:23.308	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens400metres with number of bytes gained: 20,133
2022-02-07 10:56:23.315	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsWomens4x100metresRelay/ with number of bytes gained: 19,941
2022-02-07 10:56:23.322	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingMensSabreIndividual/ with number of bytes gained: 19,664
2022-02-07 10:56:23.329	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens100metres/ with number of bytes gained: 19,350
2022-02-07 10:56:23.335	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SailingMixedThreePersonKeelboat/19 with number of bytes gained: 19,316
2022-02-07 10:56:23.342	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShootingMensFreeRifleThreePositions300metres with number of bytes gained: 19,104
2022-02-07 10:56:23.349	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMensMarathon/ with number of bytes gained: 18,828
2022-02-07 10:56:23.357	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/IceHockeyWomensIceHockey/ with number of bytes gained: 18,825
2022-02-07 10:56:23.364	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BaseballMensBaseball/ with number of bytes gained: 18,753
2022-02-07 10:56:23.372	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CrossCountrySkiingMens50kilometres/ with number of bytes gained: 18,683
2022-02-07 10:56:23.379	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsWomensBalanceBeam/ with number of bytes gained: 18,360
2022-02-07 10:56:23.386	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CyclingWomens with number of bytes gained: 18,109
2022-02-07 10:56:23.393	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BiathlonMens10kilometresSprint/ with number of bytes gained: 17,756
2022-02-07 10:56:23.400	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/SwimmingMens400metresFreestyle/ with number of bytes gained: 17,613
2022-02-07 10:56:23.408	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CanoeingMensKayakFours1000metres/ with number of bytes gained: 17,535
2022-02-07 10:56:23.416	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AlpineSkiingMensSlalom/ with number of bytes gained: 17,512
2022-02-07 10:56:23.423	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/BiathlonMens20kilometres/ with number of bytes gained: 17,289
2022-02-07 10:56:23.430	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Tennis with number of bytes gained: 17,166
2022-02-07 10:56:23.437	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingMensepeeTeam/19 with number of bytes gained: 17,094
2022-02-07 10:56:23.445	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Diving with number of bytes gained: 17,046
2022-02-07 10:56:23.452	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CrossCountrySkiingMens15kilometres/ with number of bytes gained: 16,983
2022-02-07 10:56:23.459	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/GymnasticsWomensUnevenBars/ with number of bytes gained: 16,819
2022-02-07 10:56:23.466	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens3000metresSteeplechase/ with number of bytes gained: 16,675
2022-02-07 10:56:23.473	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShootingMensFreePistol50metres with number of bytes gained: 16,578
2022-02-07 10:56:23.479	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Archery with number of bytes gained: 16,331
2022-02-07 10:56:23.486	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/RhythmicGymnasticsWomens with number of bytes gained: 15,768
2022-02-07 10:56:23.493	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CanoeingMensKayakDoubles1000metres/ with number of bytes gained: 15,663
2022-02-07 10:56:23.500	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CrossCountrySkiingMens30kilometres/19 with number of bytes gained: 15,447
2022-02-07 10:56:23.508	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/RowingMensCoxedFours/19 with number of bytes gained: 15,405
2022-02-07 10:56:23.516	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/CanoeingMensCanadianDoubles with number of bytes gained: 15,255
2022-02-07 10:56:23.524	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens110metresHurdles/ with number of bytes gained: 15,215
2022-02-07 10:56:23.531	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AlpineSkiingMensDownhill/ with number of bytes gained: 15,119
2022-02-07 10:56:23.538	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/Sailing with number of bytes gained: 14,959
2022-02-07 10:56:23.545	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/AthleticsMens200metres/ with number of bytes gained: 14,940
2022-02-07 10:56:23.552	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/ShootingMensRapidFirePistol25metres/ with number of bytes gained: 14,928
2022-02-07 10:56:23.559	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/EquestrianismMixedDressageIndividual/ with number of bytes gained: 14,927
2022-02-07 10:56:23.566	- DEBUG: Found prefix <http://wallscope.co.uk/resource/olympics/instance/FencingMensSabreTeam/19 with number of bytes gained: 14,688
2022-02-07 10:56:23.566	- DEBUG: Total number of bytes : 41,773,253
2022-02-07 10:56:23.566	- DEBUG: Total chars compressed : 25,355,182
2022-02-07 10:56:23.566	- INFO:  Reduction of size of internal vocabulary: 61%
2022-02-07 10:56:23.600	- INFO:  Writing compressed vocabulary to disk ...
2022-02-07 10:56:23.874	- DEBUG: Finished writing compressed vocabulary
2022-02-07 10:56:23.908	- INFO:  Sorting for PSO permutation ...
2022-02-07 10:56:24.441	- DEBUG: Sort done
2022-02-07 10:56:24.441	- INFO:  Removing duplicate triples ...
2022-02-07 10:56:24.562	- INFO:  Done, number of distinct triples is: 2,055,674
2022-02-07 10:56:24.562	- INFO:  Creating a pair of index permutations ...
2022-02-07 10:56:25.349	- INFO:  Statistics for PSO: #relations = 18, #blocks = 3, #triples = 2,055,674
2022-02-07 10:56:25.349	- INFO:  Statistics for POS: #relations = 18, #blocks = 3, #triples = 2,055,674
2022-02-07 10:56:25.349	- INFO:  Exchanging multiplicities for PSO and POS ...
2022-02-07 10:56:25.349	- INFO:  Writing meta data for PSO and POS ...
2022-02-07 10:56:25.349	- INFO:  Sorting for SPO permutation ...
2022-02-07 10:56:25.773	- DEBUG: Sort done
2022-02-07 10:56:25.808	- INFO:  Creating a pair of index permutations ...
2022-02-07 10:56:26.238	- INFO:  Statistics for SPO: #relations = 543,723, #blocks = 3, #triples = 2,055,674
2022-02-07 10:56:26.238	- INFO:  Statistics for SOP: #relations = 543,723, #blocks = 3, #triples = 2,055,674
2022-02-07 10:56:26.238	- DEBUG: Triples are already sorted by SPO for pattern creation
2022-02-07 10:56:26.238	- INFO:  Computing predicate patterns ...
2022-02-07 10:56:26.324	- DEBUG: Number of distinct pattens: 16
2022-02-07 10:56:26.324	- DEBUG: Number of entities for which a pattern was found: 543,722
2022-02-07 10:56:26.324	- DEBUG: Sorting patterns after all insertions
2022-02-07 10:56:26.324	- DEBUG: Number of sorted patterns: 16
2022-02-07 10:56:26.324	- DEBUG: Pattern set size: 16
2022-02-07 10:56:26.422	- DEBUG: Number of entity-has-pattern entries: 543,723
2022-02-07 10:56:26.422	- DEBUG: Number of entity-has-relation entries: 0
2022-02-07 10:56:26.422	- INFO:  Number of patterns: 16
2022-02-07 10:56:26.422	- INFO:  Number of subjects with pattern: 543,723 [all]
2022-02-07 10:56:26.422	- INFO:  Total number of distinct subject-predicate pairs: 1,859,773
2022-02-07 10:56:26.422	- INFO:  Average number of predicates per subject: 3.4
2022-02-07 10:56:26.422	- INFO:  Average number of subjects per predicate: 109,398
2022-02-07 10:56:26.439	- INFO:  Exchanging multiplicities for SPO and SOP ...
2022-02-07 10:56:26.461	- INFO:  Writing meta data for SPO and SOP ...
2022-02-07 10:56:26.465	- INFO:  Sorting for OSP permutation ...
2022-02-07 10:56:26.935	- DEBUG: Sort done
2022-02-07 10:56:26.969	- INFO:  Creating a pair of index permutations ...
2022-02-07 10:56:27.480	- INFO:  Statistics for OSP: #relations = 274,301, #blocks = 3, #triples = 2,055,674
2022-02-07 10:56:27.480	- INFO:  Statistics for OPS: #relations = 274,301, #blocks = 3, #triples = 2,055,674
2022-02-07 10:56:27.480	- INFO:  Exchanging multiplicities for OSP and OPS ...
2022-02-07 10:56:27.493	- INFO:  Writing meta data for OSP and OPS ...
2022-02-07 10:56:27.495	- INFO:  Finished writing permutations
2022-02-07 10:56:27.496	- INFO:  Index build completed

0 replies

jeremiahpslewis · 2022-02-07T11:05:52Z

jeremiahpslewis
Feb 7, 2022
Author

Mac (arm) fails:

2022-02-07 12:03:36.343	- INFO:  QLever IndexBuilder, compiled on Feb  6 2022 13:07:09
2022-02-07 12:03:36.344	- INFO:  You specified the input format: NT
2022-02-07 12:03:36.344	- DEBUG: Parsing uncompressed N-Triples from: /dev/stdin (using the Turtle parser)
2022-02-07 12:03:36.344	- INFO:  Locale was not specified in settings file, default is en_US
2022-02-07 12:03:36.344	- INFO:  You specified "locale = en_US" and "ignore-punctuation = 0"
2022-02-07 12:03:36.345	- INFO:  You specified "num-triples-per-partial-vocab = 50,000,000", choose a lower value if the index builder runs out of memory
2022-02-07 12:03:36.345	- DEBUG: Using the Google RE2 library for tokenization
2022-02-07 12:03:36.345	- INFO:  Processing input triples from /dev/stdin ...
2022-02-07 12:03:36.346	- DEBUG: Initialize parallel Turtle Parsing from uncompressed file or stream /dev/stdin
2022-02-07 12:03:40.064	- DEBUG: Input triples read in this section: 1,781,625
2022-02-07 12:03:40.064	- DEBUG: Triples processed, also counting internal triples added by QLever: 2,055,677
2022-02-07 12:03:45.223	- DEBUG: Writing partial vocabulary to: olympics.tmp.partial-vocabulary.0
2022-02-07 12:03:45.273	- DEBUG: Done writing partial vocabulary
2022-02-07 12:03:45.369	- DEBUG: Writing partial vocabulary to: olympics.tmp.for-prefix-compression..tmp.partial-vocabulary.0
2022-02-07 12:03:45.418	- DEBUG: Done writing partial vocabulary
2022-02-07 12:03:45.439	- INFO:  Done, total number of triples read: 1,781,625 [may contain duplicates]
2022-02-07 12:03:45.439	- INFO:  Number of QLever-internal triples created: 274,052 [may contain duplicates]
2022-02-07 12:03:45.439	- INFO:  Merging partial vocabularies in byte order (internal only) ...
2022-02-07 12:03:45.574	- DEBUG: Finished writing batch of merged words
2022-02-07 12:03:45.580	- INFO:  Number of words in internal vocabulary: 544,174
2022-02-07 12:03:45.580	- INFO:  Merging partial vocabularies in Unicode order (internal and external) ...
2022-02-07 12:03:45.679	- DEBUG: Finished writing batch of merged words
2022-02-07 12:03:45.688	- DEBUG: Finished merging partial vocabularies
2022-02-07 12:03:45.688	- INFO:  Number of words in external vocabulary: 0
2022-02-07 12:03:45.688	- INFO:  Removing temporary files ...
2022-02-07 12:03:45.705	- DEBUG: Number of words in internal and external vocabulary: 544,174
2022-02-07 12:03:45.705	- INFO:  Converting external vocabulary to binary format ...
2022-02-07 12:03:45.711	- INFO:  Converting triples from local IDs to global IDs ...
2022-02-07 12:03:45.711	- DEBUG: Triples per partial vocabulary: 100,000,000
2022-02-07 12:03:45.711	- DEBUG: Reading ID map from: olympics.tmp.partial-ids-mmap.0
ERROR: failed process: Process(setenv(`/Users/jpslewis/.julia/artifacts/b22fd12dac02addfa20f6106fcb9085714665bf5/bin/IndexBuilderMain -F nt -f - -l -i olympics -s /var/folders/7c/hm96b6vx3r9dc4_s5f6y9m1r0000gn/T/jl_kLqCkb/settings.json`,["XPC_FLAGS=0x0", "FRED_API_KEY=d51fb3f80db731df3c328a2c39cf0cc5", "COMMAND_MODE=unix2003", "PATH=/Users/jpslewis/.julia/artifacts/c541cd69f8d066d3ba76cd1bd2541985cfa0d06c/bin:/Users/jpslewis/.julia/artifacts/b22fd12dac02addfa20f6106fcb9085714665bf5/bin:/opt/homebrew/bin:/opt/homebrew:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/MacGPG2/bin", "PWD=/Users/jpslewis/git", "XPC_SERVICE_NAME=0", "TERM_PROGRAM=iTerm.app", "SHELL=/opt/homebrew/bin/fish", "DYLD_FALLBACK_LIBRARY_PATH=/Users/jpslewis/.julia/artifacts/c541cd69f8d066d3ba76cd1bd2541985cfa0d06c/lib:/Users/jpslewis/.julia/artifacts/0eb0e4fe1782c3b7e0a3f7bc2bcc5639792d2c79/lib:/Users/jpslewis/.julia/artifacts/3b5a95bd7377ec19fb45dfd35c05d09f525a49f6/lib:/Users/jpslewis/.julia/artifacts/43f282a759387d3278773d33d1c7df3101b4f168/lib:/Users/jpslewis/git/julia/usr/bin/../lib/julia:/Users/jpslewis/git/julia/usr/bin/../lib:/Users/jpslewis/lib:/usr/local/lib:/lib:/usr/lib", "__CF_USER_TEXT_ENCODING=0x1F5:0x0:0x0"  …  "LC_TERMINAL=iTerm2", "SSH_AUTH_SOCK=/private/tmp/com.apple.launchd.GP3cVXZlzh/Listeners", "OMF_PATH=/Users/jpslewis/.local/share/omf", "STARSHIP_SHELL=fish", "USER=jpslewis", "ITERM_SESSION_ID=w0t1p0:95EF8B4E-DB78-4391-A657-CA1FB8B14541", "TERM=xterm-256color", "HOME=/Users/jpslewis", "TERM_PROGRAM_VERSION=3.4.14", "COLORTERM=truecolor"]), ProcessSignaled(11)) [0]

0 replies

jeremiahpslewis · 2022-02-07T11:06:56Z

jeremiahpslewis
Feb 7, 2022
Author

Mac (x86 via Rosetta) fails:

2022-02-07 12:06:07.438	- INFO:  QLever IndexBuilder, compiled on Feb  6 2022 14:09:25
2022-02-07 12:06:07.439	- INFO:  You specified the input format: NT
2022-02-07 12:06:07.439	- DEBUG: Parsing uncompressed N-Triples from: /dev/stdin (using the Turtle parser)
2022-02-07 12:06:07.441	- INFO:  Locale was not specified in settings file, default is en_US
2022-02-07 12:06:07.441	- INFO:  You specified "locale = en_US" and "ignore-punctuation = 0"
2022-02-07 12:06:07.441	- INFO:  You specified "num-triples-per-partial-vocab = 50,000,000", choose a lower value if the index builder runs out of memory
2022-02-07 12:06:07.441	- DEBUG: Using the Google RE2 library for tokenization
2022-02-07 12:06:07.442	- INFO:  Processing input triples from /dev/stdin ...
2022-02-07 12:06:07.445	- DEBUG: Initialize parallel Turtle Parsing from uncompressed file or stream /dev/stdin
2022-02-07 12:06:13.589	- DEBUG: Input triples read in this section: 1,781,625
2022-02-07 12:06:13.589	- DEBUG: Triples processed, also counting internal triples added by QLever: 2,055,677
2022-02-07 12:06:30.184	- DEBUG: Writing partial vocabulary to: olympics.tmp.partial-vocabulary.0
2022-02-07 12:06:30.302	- DEBUG: Done writing partial vocabulary
2022-02-07 12:06:30.459	- DEBUG: Writing partial vocabulary to: olympics.tmp.for-prefix-compression..tmp.partial-vocabulary.0
2022-02-07 12:06:30.574	- DEBUG: Done writing partial vocabulary
2022-02-07 12:06:30.612	- INFO:  Done, total number of triples read: 1,781,625 [may contain duplicates]
2022-02-07 12:06:30.612	- INFO:  Number of QLever-internal triples created: 274,052 [may contain duplicates]
2022-02-07 12:06:30.612	- INFO:  Merging partial vocabularies in byte order (internal only) ...
2022-02-07 12:06:30.925	- DEBUG: Finished writing batch of merged words
2022-02-07 12:06:30.934	- INFO:  Number of words in internal vocabulary: 544,174
2022-02-07 12:06:30.934	- INFO:  Merging partial vocabularies in Unicode order (internal and external) ...
2022-02-07 12:06:31.159	- DEBUG: Finished writing batch of merged words
2022-02-07 12:06:31.172	- DEBUG: Finished merging partial vocabularies
2022-02-07 12:06:31.172	- INFO:  Number of words in external vocabulary: 0
2022-02-07 12:06:31.172	- INFO:  Removing temporary files ...
2022-02-07 12:06:31.209	- DEBUG: Number of words in internal and external vocabulary: 544,174
2022-02-07 12:06:31.209	- INFO:  Converting external vocabulary to binary format ...
2022-02-07 12:06:31.228	- INFO:  Converting triples from local IDs to global IDs ...
2022-02-07 12:06:31.228	- DEBUG: Triples per partial vocabulary: 100,000,000
2022-02-07 12:06:31.228	- DEBUG: Reading ID map from: olympics.tmp.partial-ids-mmap.0
ERROR: failed process: Process(setenv(`/Users/jpslewis/.julia/artifacts/a3f202324bb853b549e7b8490962433d73e0baa9/bin/IndexBuilderMain -F nt -f - -l -i olympics -s /var/folders/7c/hm96b6vx3r9dc4_s5f6y9m1r0000gn/T/jl_T8Z4JQ/settings.json`,["XPC_FLAGS=0x0", "FRED_API_KEY=d51fb3f80db731df3c328a2c39cf0cc5", "COMMAND_MODE=unix2003", "PATH=/Users/jpslewis/.julia/artifacts/1a79fec48d13175c17d7ee3ed8c60aca6770514e/bin:/Users/jpslewis/.julia/artifacts/a3f202324bb853b549e7b8490962433d73e0baa9/bin:/opt/homebrew/bin:/opt/homebrew:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/MacGPG2/bin", "PWD=/Users/jpslewis/git", "XPC_SERVICE_NAME=0", "TERM_PROGRAM=iTerm.app", "SHELL=/opt/homebrew/bin/fish", "DYLD_FALLBACK_LIBRARY_PATH=/Users/jpslewis/.julia/artifacts/1a79fec48d13175c17d7ee3ed8c60aca6770514e/lib:/Users/jpslewis/.julia/artifacts/9fd8cbeaa10466b38726fc4d2a31399bb1cdcd81/lib:/Users/jpslewis/.julia/artifacts/5f2577b73c446bbc37f4064430089a025dc64b56/lib:/Users/jpslewis/.julia/artifacts/6c4e1f0b343ceb88dbeaea2218461649122c5072/lib:/Applications/Julia-1.7 2.app/Contents/Resources/julia/bin/../lib/julia:/Applications/Julia-1.7 2.app/Contents/Resources/julia/bin/../lib:/Users/jpslewis/lib:/usr/local/lib:/lib:/usr/lib", "__CF_USER_TEXT_ENCODING=0x1F5:0x0:0x0"  …  "SSH_AUTH_SOCK=/private/tmp/com.apple.launchd.GP3cVXZlzh/Listeners", "OMF_PATH=/Users/jpslewis/.local/share/omf", "STARSHIP_SHELL=fish", "USER=jpslewis", "ITERM_SESSION_ID=w0t1p0:95EF8B4E-DB78-4391-A657-CA1FB8B14541", "TERM=xterm-256color", "HOME=/Users/jpslewis", "TERM_PROGRAM_VERSION=3.4.14", "OPENBLAS_MAIN_FREE=1", "COLORTERM=truecolor"]), ProcessSignaled(10)) [0]

3 replies

joka921 Feb 7, 2022
Maintainer

Ok, so what I found during a very short research, is that the Signal 10 (kernel signal) seems to be the SIGBUS signal (Bus error):

Bus Error (also known as SIGBUS and is usually signal 10) occur when a process is trying to access memory that the CPU cannot physically address.In other words the memory tried to access by the program is not a valid memory address.It caused due to alignment issues with the CPU (eg. trying to read a long from an address which isn’t a multiple of 4). SIGBUS is abbreviation for “Bus Error”.
SIGBUS signal occurs in below cases,
-> Program instructs the CPU to read or write a specific physical memory address which is not valid / Requested physical address is unrecognized by the whole computer system.
-> Unaligned access of memory (For example, if multi-byte accesses must be 16 bit-aligned, addresses (given in bytes) at 0, 2, 4, 6, and so on would be considered aligned and therefore accessible, while addresses 1, 3, 5, and so on would be considered unaligned.)

So in general I have the suspiccion, that the mmap business that is going on here is somehow broken when being used with a mac.

The first steps I would try to further pin this down:
a) I am assuming, that this happened in the x86 binary, which was run using rosetta on an M1 maching (if not, tell me, and completely skip b) and c).
b) What happens, if you run the M1 binary natively?
c) What happens, if you run the x86 binary on a native x86 mac?

Unfortunately (on purpose) I don't own Apple Macs, so I cannot try this myself. My brother owns several x86 macs but he's not living with me, currently rather stressed, and not a computer science guy, so this would take some time, until I could try it there. But I think b) is something you could try out for completenes.s.

jeremiahpslewis Feb 7, 2022
Author

It happens via x86 (rosetta) and m1 natively. This is the output for native run: #582 (comment)

I can try the x86 native run later today.

jeremiahpslewis Feb 7, 2022
Author

Just retried with a real x86 Mac, same issue, same output (see below)

jeremiahpslewis · 2022-02-07T11:41:13Z

jeremiahpslewis
Feb 7, 2022
Author

@joka921 maybe these articles are useful?

https://www.sublimetext.com/blog/articles/use-mmap-with-care
https://news.ycombinator.com/item?id=19805675 (comments about the first one)

0 replies

jeremiahpslewis · 2022-02-07T19:45:27Z

jeremiahpslewis
Feb 7, 2022
Author

Mac x86 (real x86) fails

julia> mktempdir() do tdir
           olympics_data_path = joinpath(tdir, "olympics.nt.xz")
           Downloads.download(olympics_data_url, olympics_data_path)

           settings_path = joinpath(tdir, "settings.json")
           open(settings_path,"w") do f
               JSON.print(f, Dict("num-triples-per-partial-vocab" => Int(5e7), "ignore-punctuation" => 1)) # "ascii-prefixes-only" => true
           end
           
           run(pipeline(`$(xz()) -d -c $olympics_data_path`, `$(IndexBuilderMain()) -F nt -f - -l -i olympics -s $settings_path`))
       end
2022-02-07 20:03:36.241	- INFO:  QLever IndexBuilder, compiled on Feb  6 2022 14:09:25
2022-02-07 20:03:36.244	- INFO:  You specified the input format: NT
2022-02-07 20:03:36.244	- DEBUG: Parsing uncompressed N-Triples from: /dev/stdin (using the Turtle parser)
2022-02-07 20:03:36.244	- INFO:  Locale was not specified in settings file, default is en_US
2022-02-07 20:03:36.244	- INFO:  You specified "locale = en_US" and "ignore-punctuation = 0"
2022-02-07 20:03:36.245	- INFO:  You specified "num-triples-per-partial-vocab = 50,000,000", choose a lower value if the index builder runs out of memory
2022-02-07 20:03:36.245	- DEBUG: Using the Google RE2 library for tokenization
2022-02-07 20:03:36.245	- INFO:  Processing input triples from /dev/stdin ...
2022-02-07 20:03:36.246	- DEBUG: Initialize parallel Turtle Parsing from uncompressed file or stream /dev/stdin
2022-02-07 20:03:43.135	- DEBUG: Input triples read in this section: 1,781,625
2022-02-07 20:03:43.135	- DEBUG: Triples processed, also counting internal triples added by QLever: 2,055,677
2022-02-07 20:03:46.683	- DEBUG: Writing partial vocabulary to: olympics.tmp.partial-vocabulary.0
2022-02-07 20:03:46.915	- DEBUG: Done writing partial vocabulary
2022-02-07 20:03:47.110	- DEBUG: Writing partial vocabulary to: olympics.tmp.for-prefix-compression..tmp.partial-vocabulary.0
2022-02-07 20:03:47.340	- DEBUG: Done writing partial vocabulary
2022-02-07 20:03:47.422	- INFO:  Done, total number of triples read: 1,781,625 [may contain duplicates]
2022-02-07 20:03:47.422	- INFO:  Number of QLever-internal triples created: 274,052 [may contain duplicates]
2022-02-07 20:03:47.422	- INFO:  Merging partial vocabularies in byte order (internal only) ...
2022-02-07 20:03:47.783	- DEBUG: Finished writing batch of merged words
2022-02-07 20:03:47.795	- INFO:  Number of words in internal vocabulary: 544,174
2022-02-07 20:03:47.799	- INFO:  Merging partial vocabularies in Unicode order (internal and external) ...
2022-02-07 20:03:48.105	- DEBUG: Finished writing batch of merged words
2022-02-07 20:03:48.138	- DEBUG: Finished merging partial vocabularies
2022-02-07 20:03:48.138	- INFO:  Number of words in external vocabulary: 0
2022-02-07 20:03:48.138	- INFO:  Removing temporary files ...
2022-02-07 20:03:48.162	- DEBUG: Number of words in internal and external vocabulary: 544,174
2022-02-07 20:03:48.162	- INFO:  Converting external vocabulary to binary format ...
2022-02-07 20:03:48.171	- INFO:  Converting triples from local IDs to global IDs ...
2022-02-07 20:03:48.171	- DEBUG: Triples per partial vocabulary: 100,000,000
2022-02-07 20:03:48.171	- DEBUG: Reading ID map from: olympics.tmp.partial-ids-mmap.0
2022-02-07 20:03:48.230	- INFO:  Not found in partial vocabulary: 6,656
2022-02-07 20:03:48.238	- ERROR: ASSERT FAILED (false; in /workspace/srcdir/QLever/src/index/Index.cpp, line 382, function void Index::convertPartialToGlobalIds(Index::TripleVec &, const vector<size_t> &, size_t))
ERROR: failed process: Process(setenv(`/Users/florianstrob/.julia/artifacts/a3f202324bb853b549e7b8490962433d73e0baa9/bin/IndexBuilderMain -F nt -f - -l -i olympics -s /var/folders/b6/dd7vlzp1721dmln7z5m5hy340000gn/T/jl_rZ6SIG/settings.json`,["XPC_FLAGS=0x0", "PATH=/Users/florianstrob/.julia/artifacts/1a79fec48d13175c17d7ee3ed8c60aca6770514e/bin:/Users/florianstrob/.julia/artifacts/a3f202324bb853b549e7b8490962433d73e0baa9/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin", "PWD=/Users/florianstrob", "XPC_SERVICE_NAME=0", "TERM_PROGRAM=Apple_Terminal", "SHELL=/bin/bash", "DYLD_FALLBACK_LIBRARY_PATH=/Users/florianstrob/.julia/artifacts/1a79fec48d13175c17d7ee3ed8c60aca6770514e/lib:/Users/florianstrob/.julia/artifacts/9fd8cbeaa10466b38726fc4d2a31399bb1cdcd81/lib:/Users/florianstrob/.julia/artifacts/5f2577b73c446bbc37f4064430089a025dc64b56/lib:/Users/florianstrob/.julia/artifacts/6c4e1f0b343ceb88dbeaea2218461649122c5072/lib:/private/var/folders/b6/dd7vlzp1721dmln7z5m5hy340000gn/T/AppTranslocation/E612FF6B-BEC6-44BB-AF4A-4BAE985B4585/d/Julia-1.7.app/Contents/Resources/julia/bin/../lib/julia:/private/var/folders/b6/dd7vlzp1721dmln7z5m5hy340000gn/T/AppTranslocation/E612FF6B-BEC6-44BB-AF4A-4BAE985B4585/d/Julia-1.7.app/Contents/Resources/julia/bin/../lib:/Users/florianstrob/lib:/usr/local/lib:/lib:/usr/lib", "__CF_USER_TEXT_ENCODING=0x1F5:0x0:0x3", "__CFBundleIdentifier=com.apple.Terminal", "TMPDIR=/var/folders/b6/dd7vlzp1721dmln7z5m5hy340000gn/T/", "LANG=de_DE.UTF-8", "SHLVL=0", "LOGNAME=florianstrob", "TERM_SESSION_ID=8CE7280A-2CEA-4F07-9ACD-BAB653131903", "SSH_AUTH_SOCK=/private/tmp/com.apple.launchd.wFzrUGM4j3/Listeners", "USER=florianstrob", "TERM=xterm-256color", "HOME=/Users/florianstrob", "TERM_PROGRAM_VERSION=443", "OPENBLAS_MAIN_FREE=1"]), ProcessExited(2)) [2]

Stacktrace:
 [1] pipeline_error(procs::Base.ProcessChain)
   @ Base ./process.jl:544
 [2] run(::Base.OrCmds; wait::Bool)
   @ Base ./process.jl:446
 [3] run
   @ ./process.jl:444 [inlined]
 [4] (::var"#1#3")(tdir::String)
   @ Main ./REPL[7]:10
 [5] mktempdir(fn::var"#1#3", parent::String; prefix::String)
   @ Base.Filesystem ./file.jl:750
 [6] mktempdir(fn::Function, parent::String) (repeats 2 times)
   @ Base.Filesystem ./file.jl:748
 [7] top-level scope
   @ REPL[7]:1

0 replies

Qlever Binary via Yggdrasil #582

Uh oh!

jeremiahpslewis Feb 7, 2022

Replies: 7 comments · 3 replies

Uh oh!

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

joka921 Feb 7, 2022 Maintainer

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

Uh oh!

jeremiahpslewis Feb 7, 2022 Author

jeremiahpslewis
Feb 7, 2022

Replies: 7 comments 3 replies

jeremiahpslewis
Feb 7, 2022
Author

jeremiahpslewis
Feb 7, 2022
Author

jeremiahpslewis
Feb 7, 2022
Author

jeremiahpslewis
Feb 7, 2022
Author

joka921 Feb 7, 2022
Maintainer

jeremiahpslewis Feb 7, 2022
Author

jeremiahpslewis Feb 7, 2022
Author

jeremiahpslewis
Feb 7, 2022
Author

jeremiahpslewis
Feb 7, 2022
Author