Skip to content

Commit 9ae3906

Browse files
committed
deploy: 0a06c3e
1 parent 337c6be commit 9ae3906

File tree

25 files changed

+1287
-765
lines changed

25 files changed

+1287
-765
lines changed

api/iceberg/all.html

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

api/iceberg/arrow/index.html

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
1-
<!DOCTYPE html><html lang="en"><head><meta charset="utf-8"><meta name="viewport" content="width=device-width, initial-scale=1.0"><meta name="generator" content="rustdoc"><meta name="description" content="Conversion between Iceberg and Arrow schema"><title>iceberg::arrow - Rust</title><script>if(window.location.protocol!=="file:")document.head.insertAdjacentHTML("beforeend","SourceSerif4-Regular-6b053e98.ttf.woff2,FiraSans-Italic-81dc35de.woff2,FiraSans-Regular-0fe48ade.woff2,FiraSans-MediumItalic-ccf7e434.woff2,FiraSans-Medium-e1aa3f0a.woff2,SourceCodePro-Regular-8badfe75.ttf.woff2,SourceCodePro-Semibold-aa29a496.ttf.woff2".split(",").map(f=>`<link rel="preload" as="font" type="font/woff2" crossorigin href="../../static.files/${f}">`).join(""))</script><link rel="stylesheet" href="../../static.files/normalize-9960930a.css"><link rel="stylesheet" href="../../static.files/rustdoc-916cea96.css"><meta name="rustdoc-vars" data-root-path="../../" data-static-root-path="../../static.files/" data-current-crate="iceberg" data-themes="" data-resource-suffix="" data-rustdoc-version="1.87.0-nightly (3f5502370 2025-03-27)" data-channel="nightly" data-search-js="search-e7298875.js" data-settings-js="settings-d72f25bb.js" ><script src="../../static.files/storage-82c7156e.js"></script><script defer src="../sidebar-items.js"></script><script defer src="../../static.files/main-fb8c74a8.js"></script><noscript><link rel="stylesheet" href="../../static.files/noscript-893ab5e7.css"></noscript><link rel="alternate icon" type="image/png" href="../../static.files/favicon-32x32-6580c154.png"><link rel="icon" type="image/svg+xml" href="../../static.files/favicon-044be391.svg"></head><body class="rustdoc mod"><!--[if lte IE 11]><div class="warning">This old browser is unsupported and will most likely display funky things.</div><![endif]--><nav class="mobile-topbar"><button class="sidebar-menu-toggle" title="show sidebar"></button></nav><nav class="sidebar"><div class="sidebar-crate"><h2><a href="../../iceberg/index.html">iceberg</a><span class="version">0.7.0</span></h2></div><div class="sidebar-elems"><section id="rustdoc-toc"><h2 class="location"><a href="#">Module arrow</a></h2><h3><a href="#modules">Module Items</a></h3><ul class="block"><li><a href="#modules" title="Modules">Modules</a></li><li><a href="#structs" title="Structs">Structs</a></li><li><a href="#enums" title="Enums">Enums</a></li><li><a href="#constants" title="Constants">Constants</a></li><li><a href="#traits" title="Traits">Traits</a></li><li><a href="#functions" title="Functions">Functions</a></li></ul></section><div id="rustdoc-modnav"><h2 class="in-crate"><a href="../index.html">In crate iceberg</a></h2></div></div></nav><div class="sidebar-resizer"></div><main><div class="width-limiter"><rustdoc-search></rustdoc-search><section id="main-content" class="content"><div class="main-heading"><div class="rustdoc-breadcrumbs"><a href="../index.html">iceberg</a></div><h1>Module <span>arrow</span><button id="copy-path" title="Copy item path to clipboard">Copy item path</button></h1><rustdoc-toolbar></rustdoc-toolbar><span class="sub-heading"><a class="src" href="../../src/iceberg/arrow/mod.rs.html#18-38">Source</a> </span></div><details class="toggle top-doc" open><summary class="hideme"><span>Expand description</span></summary><div class="docblock"><p>Conversion between Iceberg and Arrow schema</p>
2-
</div></details><h2 id="modules" class="section-header">Modules<a href="#modules" class="anchor">§</a></h2><dl class="item-table"><dt><a class="mod" href="delete_file_loader/index.html" title="mod iceberg::arrow::delete_file_loader">delete_<wbr>file_<wbr>loader</a></dt><dd>Delete File loader</dd><dt><a class="mod" href="record_batch_projector/index.html" title="mod iceberg::arrow::record_batch_projector">record_<wbr>batch_<wbr>projector</a></dt><dd>RecordBatch projection utilities</dd></dl><h2 id="structs" class="section-header">Structs<a href="#structs" class="anchor">§</a></h2><dl class="item-table"><dt><a class="struct" href="struct.ArrowArrayAccessor.html" title="struct iceberg::arrow::ArrowArrayAccessor">Arrow<wbr>Array<wbr>Accessor</a></dt><dd>Partner type representing accessing and walking arrow arrays alongside iceberg schema</dd><dt><a class="struct" href="struct.ArrowFileReader.html" title="struct iceberg::arrow::ArrowFileReader">Arrow<wbr>File<wbr>Reader</a></dt><dd>ArrowFileReader is a wrapper around a FileRead that impls parquets AsyncFileReader.</dd><dt><a class="struct" href="struct.ArrowReader.html" title="struct iceberg::arrow::ArrowReader">Arrow<wbr>Reader</a></dt><dd>Reads data from Parquet files</dd><dt><a class="struct" href="struct.ArrowReaderBuilder.html" title="struct iceberg::arrow::ArrowReaderBuilder">Arrow<wbr>Reader<wbr>Builder</a></dt><dd>Builder to create ArrowReader</dd></dl><h2 id="enums" class="section-header">Enums<a href="#enums" class="anchor">§</a></h2><dl class="item-table"><dt><a class="enum" href="enum.FieldMatchMode.html" title="enum iceberg::arrow::FieldMatchMode">Field<wbr>Match<wbr>Mode</a></dt><dd>Defines how Arrow fields are matched with Iceberg fields when converting data.</dd></dl><h2 id="constants" class="section-header">Constants<a href="#constants" class="anchor">§</a></h2><dl class="item-table"><dt><a class="constant" href="constant.DEFAULT_MAP_FIELD_NAME.html" title="constant iceberg::arrow::DEFAULT_MAP_FIELD_NAME">DEFAULT_<wbr>MAP_<wbr>FIELD_<wbr>NAME</a></dt><dd>When iceberg map type convert to Arrow map type, the default map field name is “key_value”.</dd><dt><a class="constant" href="constant.UTC_TIME_ZONE.html" title="constant iceberg::arrow::UTC_TIME_ZONE">UTC_<wbr>TIME_<wbr>ZONE</a></dt><dd>UTC time zone for Arrow timestamp type.</dd></dl><h2 id="traits" class="section-header">Traits<a href="#traits" class="anchor">§</a></h2><dl class="item-table"><dt><a class="trait" href="trait.ArrowSchemaVisitor.html" title="trait iceberg::arrow::ArrowSchemaVisitor">Arrow<wbr>Schema<wbr>Visitor</a></dt><dd>A post order arrow schema visitor.</dd></dl><h2 id="functions" class="section-header">Functions<a href="#functions" class="anchor">§</a></h2><dl class="item-table"><dt><a class="fn" href="fn.arrow_primitive_to_literal.html" title="fn iceberg::arrow::arrow_primitive_to_literal">arrow_<wbr>primitive_<wbr>to_<wbr>literal</a></dt><dd>Convert arrow primitive array to iceberg primitive value array.
1+
<!DOCTYPE html><html lang="en"><head><meta charset="utf-8"><meta name="viewport" content="width=device-width, initial-scale=1.0"><meta name="generator" content="rustdoc"><meta name="description" content="Conversion between Iceberg and Arrow schema"><title>iceberg::arrow - Rust</title><script>if(window.location.protocol!=="file:")document.head.insertAdjacentHTML("beforeend","SourceSerif4-Regular-6b053e98.ttf.woff2,FiraSans-Italic-81dc35de.woff2,FiraSans-Regular-0fe48ade.woff2,FiraSans-MediumItalic-ccf7e434.woff2,FiraSans-Medium-e1aa3f0a.woff2,SourceCodePro-Regular-8badfe75.ttf.woff2,SourceCodePro-Semibold-aa29a496.ttf.woff2".split(",").map(f=>`<link rel="preload" as="font" type="font/woff2" crossorigin href="../../static.files/${f}">`).join(""))</script><link rel="stylesheet" href="../../static.files/normalize-9960930a.css"><link rel="stylesheet" href="../../static.files/rustdoc-916cea96.css"><meta name="rustdoc-vars" data-root-path="../../" data-static-root-path="../../static.files/" data-current-crate="iceberg" data-themes="" data-resource-suffix="" data-rustdoc-version="1.87.0-nightly (3f5502370 2025-03-27)" data-channel="nightly" data-search-js="search-e7298875.js" data-settings-js="settings-d72f25bb.js" ><script src="../../static.files/storage-82c7156e.js"></script><script defer src="../sidebar-items.js"></script><script defer src="../../static.files/main-fb8c74a8.js"></script><noscript><link rel="stylesheet" href="../../static.files/noscript-893ab5e7.css"></noscript><link rel="alternate icon" type="image/png" href="../../static.files/favicon-32x32-6580c154.png"><link rel="icon" type="image/svg+xml" href="../../static.files/favicon-044be391.svg"></head><body class="rustdoc mod"><!--[if lte IE 11]><div class="warning">This old browser is unsupported and will most likely display funky things.</div><![endif]--><nav class="mobile-topbar"><button class="sidebar-menu-toggle" title="show sidebar"></button></nav><nav class="sidebar"><div class="sidebar-crate"><h2><a href="../../iceberg/index.html">iceberg</a><span class="version">0.7.0</span></h2></div><div class="sidebar-elems"><section id="rustdoc-toc"><h2 class="location"><a href="#">Module arrow</a></h2><h3><a href="#modules">Module Items</a></h3><ul class="block"><li><a href="#modules" title="Modules">Modules</a></li><li><a href="#structs" title="Structs">Structs</a></li><li><a href="#enums" title="Enums">Enums</a></li><li><a href="#constants" title="Constants">Constants</a></li><li><a href="#traits" title="Traits">Traits</a></li><li><a href="#functions" title="Functions">Functions</a></li></ul></section><div id="rustdoc-modnav"><h2 class="in-crate"><a href="../index.html">In crate iceberg</a></h2></div></div></nav><div class="sidebar-resizer"></div><main><div class="width-limiter"><rustdoc-search></rustdoc-search><section id="main-content" class="content"><div class="main-heading"><div class="rustdoc-breadcrumbs"><a href="../index.html">iceberg</a></div><h1>Module <span>arrow</span><button id="copy-path" title="Copy item path to clipboard">Copy item path</button></h1><rustdoc-toolbar></rustdoc-toolbar><span class="sub-heading"><a class="src" href="../../src/iceberg/arrow/mod.rs.html#18-43">Source</a> </span></div><details class="toggle top-doc" open><summary class="hideme"><span>Expand description</span></summary><div class="docblock"><p>Conversion between Iceberg and Arrow schema</p>
2+
</div></details><h2 id="reexports" class="section-header">Re-exports<a href="#reexports" class="anchor">§</a></h2><dl class="item-table reexports"><dt><code>pub use <a class="mod" href="partition_value_calculator/index.html" title="mod iceberg::arrow::partition_value_calculator">partition_value_calculator</a>::*;</code></dt><dt><code>pub use <a class="mod" href="record_batch_partition_splitter/index.html" title="mod iceberg::arrow::record_batch_partition_splitter">record_batch_partition_splitter</a>::*;</code></dt></dl><h2 id="modules" class="section-header">Modules<a href="#modules" class="anchor">§</a></h2><dl class="item-table"><dt><a class="mod" href="delete_file_loader/index.html" title="mod iceberg::arrow::delete_file_loader">delete_<wbr>file_<wbr>loader</a></dt><dd>Delete File loader</dd><dt><a class="mod" href="partition_value_calculator/index.html" title="mod iceberg::arrow::partition_value_calculator">partition_<wbr>value_<wbr>calculator</a></dt><dd>Partition value calculator for computing partition values
3+
Partition value calculation for Iceberg tables.</dd><dt><a class="mod" href="record_batch_partition_splitter/index.html" title="mod iceberg::arrow::record_batch_partition_splitter">record_<wbr>batch_<wbr>partition_<wbr>splitter</a></dt><dd>Record batch partition splitter for partitioned tables</dd><dt><a class="mod" href="record_batch_projector/index.html" title="mod iceberg::arrow::record_batch_projector">record_<wbr>batch_<wbr>projector</a></dt><dd>RecordBatch projection utilities</dd></dl><h2 id="structs" class="section-header">Structs<a href="#structs" class="anchor">§</a></h2><dl class="item-table"><dt><a class="struct" href="struct.ArrowArrayAccessor.html" title="struct iceberg::arrow::ArrowArrayAccessor">Arrow<wbr>Array<wbr>Accessor</a></dt><dd>Partner type representing accessing and walking arrow arrays alongside iceberg schema</dd><dt><a class="struct" href="struct.ArrowFileReader.html" title="struct iceberg::arrow::ArrowFileReader">Arrow<wbr>File<wbr>Reader</a></dt><dd>ArrowFileReader is a wrapper around a FileRead that impls parquets AsyncFileReader.</dd><dt><a class="struct" href="struct.ArrowReader.html" title="struct iceberg::arrow::ArrowReader">Arrow<wbr>Reader</a></dt><dd>Reads data from Parquet files</dd><dt><a class="struct" href="struct.ArrowReaderBuilder.html" title="struct iceberg::arrow::ArrowReaderBuilder">Arrow<wbr>Reader<wbr>Builder</a></dt><dd>Builder to create ArrowReader</dd></dl><h2 id="enums" class="section-header">Enums<a href="#enums" class="anchor">§</a></h2><dl class="item-table"><dt><a class="enum" href="enum.FieldMatchMode.html" title="enum iceberg::arrow::FieldMatchMode">Field<wbr>Match<wbr>Mode</a></dt><dd>Defines how Arrow fields are matched with Iceberg fields when converting data.</dd></dl><h2 id="constants" class="section-header">Constants<a href="#constants" class="anchor">§</a></h2><dl class="item-table"><dt><a class="constant" href="constant.DEFAULT_MAP_FIELD_NAME.html" title="constant iceberg::arrow::DEFAULT_MAP_FIELD_NAME">DEFAULT_<wbr>MAP_<wbr>FIELD_<wbr>NAME</a></dt><dd>When iceberg map type convert to Arrow map type, the default map field name is “key_value”.</dd><dt><a class="constant" href="constant.UTC_TIME_ZONE.html" title="constant iceberg::arrow::UTC_TIME_ZONE">UTC_<wbr>TIME_<wbr>ZONE</a></dt><dd>UTC time zone for Arrow timestamp type.</dd></dl><h2 id="traits" class="section-header">Traits<a href="#traits" class="anchor">§</a></h2><dl class="item-table"><dt><a class="trait" href="trait.ArrowSchemaVisitor.html" title="trait iceberg::arrow::ArrowSchemaVisitor">Arrow<wbr>Schema<wbr>Visitor</a></dt><dd>A post order arrow schema visitor.</dd></dl><h2 id="functions" class="section-header">Functions<a href="#functions" class="anchor">§</a></h2><dl class="item-table"><dt><a class="fn" href="fn.arrow_primitive_to_literal.html" title="fn iceberg::arrow::arrow_primitive_to_literal">arrow_<wbr>primitive_<wbr>to_<wbr>literal</a></dt><dd>Convert arrow primitive array to iceberg primitive value array.
34
This function will assume the schema of arrow struct array is the same as iceberg struct type.</dd><dt><a class="fn" href="fn.arrow_schema_to_schema.html" title="fn iceberg::arrow::arrow_schema_to_schema">arrow_<wbr>schema_<wbr>to_<wbr>schema</a></dt><dd>Convert Arrow schema to Iceberg schema.</dd><dt><a class="fn" href="fn.arrow_struct_to_literal.html" title="fn iceberg::arrow::arrow_struct_to_literal">arrow_<wbr>struct_<wbr>to_<wbr>literal</a></dt><dd>Convert arrow struct array to iceberg struct value array.
45
This function will assume the schema of arrow struct array is the same as iceberg struct type.</dd><dt><a class="fn" href="fn.arrow_type_to_type.html" title="fn iceberg::arrow::arrow_type_to_type">arrow_<wbr>type_<wbr>to_<wbr>type</a></dt><dd>Convert Arrow type to iceberg type.</dd><dt><a class="fn" href="fn.schema_to_arrow_schema.html" title="fn iceberg::arrow::schema_to_arrow_schema">schema_<wbr>to_<wbr>arrow_<wbr>schema</a></dt><dd>Convert iceberg schema to an arrow schema.</dd><dt><a class="fn" href="fn.type_to_arrow_type.html" title="fn iceberg::arrow::type_to_arrow_type">type_<wbr>to_<wbr>arrow_<wbr>type</a></dt><dd>Convert iceberg type to an arrow type.</dd></dl></section></div></main></body></html>
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
<!DOCTYPE html><html lang="en"><head><meta charset="utf-8"><meta name="viewport" content="width=device-width, initial-scale=1.0"><meta name="generator" content="rustdoc"><meta name="description" content="Partition value calculator for computing partition values Partition value calculation for Iceberg tables."><title>iceberg::arrow::partition_value_calculator - Rust</title><script>if(window.location.protocol!=="file:")document.head.insertAdjacentHTML("beforeend","SourceSerif4-Regular-6b053e98.ttf.woff2,FiraSans-Italic-81dc35de.woff2,FiraSans-Regular-0fe48ade.woff2,FiraSans-MediumItalic-ccf7e434.woff2,FiraSans-Medium-e1aa3f0a.woff2,SourceCodePro-Regular-8badfe75.ttf.woff2,SourceCodePro-Semibold-aa29a496.ttf.woff2".split(",").map(f=>`<link rel="preload" as="font" type="font/woff2" crossorigin href="../../../static.files/${f}">`).join(""))</script><link rel="stylesheet" href="../../../static.files/normalize-9960930a.css"><link rel="stylesheet" href="../../../static.files/rustdoc-916cea96.css"><meta name="rustdoc-vars" data-root-path="../../../" data-static-root-path="../../../static.files/" data-current-crate="iceberg" data-themes="" data-resource-suffix="" data-rustdoc-version="1.87.0-nightly (3f5502370 2025-03-27)" data-channel="nightly" data-search-js="search-e7298875.js" data-settings-js="settings-d72f25bb.js" ><script src="../../../static.files/storage-82c7156e.js"></script><script defer src="../sidebar-items.js"></script><script defer src="../../../static.files/main-fb8c74a8.js"></script><noscript><link rel="stylesheet" href="../../../static.files/noscript-893ab5e7.css"></noscript><link rel="alternate icon" type="image/png" href="../../../static.files/favicon-32x32-6580c154.png"><link rel="icon" type="image/svg+xml" href="../../../static.files/favicon-044be391.svg"></head><body class="rustdoc mod"><!--[if lte IE 11]><div class="warning">This old browser is unsupported and will most likely display funky things.</div><![endif]--><nav class="mobile-topbar"><button class="sidebar-menu-toggle" title="show sidebar"></button></nav><nav class="sidebar"><div class="sidebar-crate"><h2><a href="../../../iceberg/index.html">iceberg</a><span class="version">0.7.0</span></h2></div><div class="sidebar-elems"><section id="rustdoc-toc"><h2 class="location"><a href="#">Module partition_<wbr>value_<wbr>calculator</a></h2><h3><a href="#structs">Module Items</a></h3><ul class="block"><li><a href="#structs" title="Structs">Structs</a></li></ul></section><div id="rustdoc-modnav"><h2><a href="../index.html">In iceberg::<wbr>arrow</a></h2></div></div></nav><div class="sidebar-resizer"></div><main><div class="width-limiter"><rustdoc-search></rustdoc-search><section id="main-content" class="content"><div class="main-heading"><div class="rustdoc-breadcrumbs"><a href="../../index.html">iceberg</a>::<wbr><a href="../index.html">arrow</a></div><h1>Module <span>partition_value_calculator</span><button id="copy-path" title="Copy item path to clipboard">Copy item path</button></h1><rustdoc-toolbar></rustdoc-toolbar><span class="sub-heading"><a class="src" href="../../../src/iceberg/arrow/partition_value_calculator.rs.html#18-254">Source</a> </span></div><details class="toggle top-doc" open><summary class="hideme"><span>Expand description</span></summary><div class="docblock"><p>Partition value calculator for computing partition values
2+
Partition value calculation for Iceberg tables.</p>
3+
<p>This module provides utilities for calculating partition values from record batches
4+
based on a partition specification.</p>
5+
</div></details><h2 id="structs" class="section-header">Structs<a href="#structs" class="anchor">§</a></h2><dl class="item-table"><dt><a class="struct" href="struct.PartitionValueCalculator.html" title="struct iceberg::arrow::partition_value_calculator::PartitionValueCalculator">Partition<wbr>Value<wbr>Calculator</a></dt><dd>Calculator for partition values in Iceberg tables.</dd></dl></section></div></main></body></html>
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
window.SIDEBAR_ITEMS = {"struct":["PartitionValueCalculator"]};

0 commit comments

Comments
 (0)