Skip to content

A framework to implement your own multilingual mapping engines based on mapping algebra

License

Notifications You must be signed in to change notification settings

RMLio/algemaploom-rs

Repository files navigation


AlgeMapLoom: Weaving Mapping Languages with Algebraic Operators

About The Project

Mapping algebra provides operational semantics to the mapping process, opening the door to study of complexity and expressiveness of existing mapping languages. This project provides the CLI translator from RML and ShExML to mapping algebra.

Prerequisites

To compile the project on your own, you'll need to have Rust toolchain installed.

For Linux-based users:

  • Rust
    curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

For the visualization of the generated mapping plans, you'll need python version >= 3.10 and the following packages:

  1. graphviz

Running

  1. Download this repo
  2. Run cargo build at the root this repo
    cd {repo dir}
    cargo build --release
  3. Run the CLI translator app from the compiled translator binary
    cd ./target/release/
    ./translator  file  <RML_DOCUMENT>
    For more information/options of CLI app:
    ./translator  -h
  4. Visualize the created mapping plan
    dot -Tpng {generated dot file} > output.png
  5. Simple plain text format of the mapping plan for parsing
    dot -Tplain {generated dot file} > output.txt

    (back to top)

Test cases

RML

Currently, the translator generates valid mapping plans for the official RML test cases with mapping plans for CSV data sources (all test cases ending in CSV).

The generated mapping plans for the test cases are inside the /resources/csv-testcases.

ShExML

The translator can partially translate ShExML documents. The translator will make a best-effort translation if the ShExML document uses the following unsupported features. It will still generate a mapping plan which could be executed but the results won't be complete.

The following features are not supported in translation yet:

  1. Autoincrements
  2. Query statements
  3. Joins
  4. Functions
  5. Conditionals

Bindings

AlgeMapLoom provides bindings for Java, Python and Node.js. These can be enabled with the features jni, pyo3 and neon respectively.

If you build from source, you can run the build_java.sh, build_python.sh and build_nodejs.sh scripts respectively.

For usage, check out the src/java, src/python, and src/nodejs folders.

Acknowledgement

This software makes use of sophia_rs crate!

(back to top)

About

A framework to implement your own multilingual mapping engines based on mapping algebra

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages