Releases: risingwavelabs/risingwave
v0.19.1
release v0.19.1
v0.19.0
For installation and running instructions, see Get started.
Main changes
Installation
- Now, you can easily install RisingWave on your local machine with Homebrew by running
brew install risingwave
.
Administration
- Adds the
pg_indexes
anddattablespace
system catalogs. #9844, #9822 - Now, the
SHOW PARAMETERS
command will display the mutability of each system parameter. #9526
SQL features
- Experimental features: Adds support for 256-bit integer. #9146, #9184, #9186, #9191, #9217
- Indexes can be created on expressions. #9142
- Adds support for expressions in aggregate function arguments. #9955
- Adds support for
VALUES
clause. #8751 - Adds support for generated columns, which are special columns computed from other columns in a table or source. #8700, #9580
- Adds support for using expressions in the
ORDER BY
andPARTITION BY
clauses. #9827 - New SQL commands
CREATE CONNECTION
andSHOW CONNECTIONS
: Creates an AWS PrivateLink connection and show all available connections. #8907DROP CONNECTION
: Drops a connection. #9128SHOW FUNCTIONS
: Shows existing user-defined functions. #9398DROP FUNCTIONS
: Drops a user-defined function. #9561SHOW CREATE SOURCE
andSHOW CREATE SINK
: Shows the SQL statement used to create a source or sink. #9083SHOW INDEXES
: Shows all indexes on a particular table. #9835
- SQL functions
- Adds support for trigonometric functions. #8838, #8918, #9064, #9203, #9259
- Adds support for degrees and radians functions. #9108
- Adds support for the
lag()
andlead()
window functions and theOVER()
andEMIT ON WINDOW CLOSE
clause. #9597, #9622, #9701 - Adds support for new aggregate functions, including
bool_and
,bool_or
,jsonb_agg
, andjsonb_object_agg
. #9452 - Adds support for
max()
,min()
, andcount()
for timestamptz data. #9165 - Adds support for microseconds and milliseconds for
to_char()
andto_timestamp()
. #9257 - Adds support for multibyte Unicode in
overlay()
andascii()
functions. #9321 - Adds support for the
string_to_array()
function. #9289 - Adds support for
array_positions()
. #9152 - Adds support for
cardinality()
. #8867 - Adds support for
array_remove()
. #9116 - Adds support for
trim_array()
. #9265 - Adds support for array range access. #9362
- Adds support for JSONB in UDF. #9103
- Adds support for
btrim()
and updatestrim()
to PostgreSQL standard syntax. #8985 - Adds support for
date_part()
. #8830 - Expands
extract()
with more fields. #8830 - Adds support for
proctime()
, which returns the system time with time zone when a record is processed. #9088 - Adds support for
translate()
,@()
, andceiling()
. #8998 - Adds support for
encode()
anddecode()
. #9351 - Adds support for the
intersect
operator. #9573 - Adds support for the default escape
\
in alike
expression. #9624 - Adds support for the
IS [NOT] UNKNOWN
comparison predicate. #9965 - Adds support for the
starts_with()
string function and^@
. #9967 - Adds support for unary
trunc
,ln
,log10
(log
),exp
,cbrt
(||/
) mathematical functions. #9991
Connectors
- Adds support for ingesting CDC data from TiDB and sinking data to TiDB with the JDBC connector. #8708
- Adds support for ingesting CDC data from Citus. #8988
- Adds support for loading Pulsar secret key file from AWS S3. #8428, #8222
- Adds support for using an established AWS PrivateLink connection in a
CREATE SOURCE
,CREATE TABLE
, orCREATE SINK
statement for a Kafka source/sink. #9119, #9128, #9728, #9263 - Deprecates the
use_transaction
field in the Kafka sink connector. #9207 - Adds support for zstd compression type for Kafka connector. #9297
- Deprecates the
upsert
property in the Kafka connector as it can be inferred from the row format. #9457 - Adds a new field
properties.sync.call.timeout
in the WITH clause of the Kafka source connector to control the timeout. #9005 - Adds support for a new row format
DEBEZIUM_MONGO_JSON
in the Kafka source connector. #9250 - Adds CSV format support for the Kafka source connector. #9875
Cluster configuration changes
--data_directory
and--state_store
must be specified on CLI of the meta node, or the cluster will fail to start. #9170- Clusters will refuse to start if the specified object store URL identified by
state_store
anddata_directory
is occupied by another instance. Do not share the object store URL between multiple clusters. #9642
Full Changelog: v0.18.0...v0.19.0
v0.18.0
For installation and running instructions, see Get started.
Main changes
Starting from this version, we’ll respect semantic versioning conventions by using the middle number (y
, instead of z,
in x.y.z
) to indicate minor versions. That is why this is v0.18.0, not v0.1.18.
Administration and troubleshooting
- Improves error messages by including the location of the statement in question. #8646
- Initial values of immutable system parameters can be specified via the meta-node command line. The initial values provided in the configuration file will be ignored. #8366
SQL features
- Adds initial support for user-defined functions. #8597 #8644 #8255 #7943
- Adds support for JSONB data type. #8256 #8181
- Adds support for
NULLS { FIRST | LAST }
inORDER BY
clauses. #8485 - New commands:
- New functions:
array_length
: Returns the length of an array. #8636- String functions implemented with the help of chatGPT. #8767 #8839
chr(integer)
-> varcharstarts_with(varchar, varchar)
-> booleaninitcap(varchar)
-> varcharlpad(varchar, integer)
-> varcharlpad(varchar, integer, varchar)
-> varcharrpad(varchar, integer)
-> varcharrpad(varchar, integer, varchar)
-> varcharreverse(varchar)
-> varcharstrpos(varchar, varchar)
-> integerto_ascii(varchar)
-> varcharto_hex(integer)
-> varcharto_hex(bigint)
-> varchar)
- Improves the data type values of columns returned by
DESCRIBE
. #8819 UPDATE
commands cannot update primary key columns. #8569- Adds support for microsecond precision for intervals. #8501
- Adds an optional parameter
offset
totumble()
andhop()
functions. #8490 - Data records that has null time values will be ignored by time window functions. #8146
- Improves the behaviors of the
exp
operator when the operand is too large or small. #8309 - Supports process time temporal join, which enables the joining of an append-only stream (such as Kafka) with a temporal table (e.g. a materialized view backed by MySQL CDC). This feature ensures that any updates made to the temporal table will not affect previous results obtained from the temporal join. Supports
FOR SYSTEM_TIME AS OF NOW()
syntax to express process time temporal join. #8480
Connectors
- Adds a new field
basetime
to the load generator connector for generating timestamp data. The load generator will take this field asnow
and generates data accordingly. #8619 - Empty cells in CSV are now parsed as null. #8709
- Adds the Iceberg connector. #8508
- Adds support for the upsert type to the Kafka sink connector. #8168
- Removes the message name parameter for Avro data. #8124
- Adds support for AWS PrivateLink for Kafka source connector. #8247
Full Changelog: v0.1.17...v0.18.0
v0.1.17
For installation and running instructions, see Get started.
Main changes
Administration
- Adds a system catalog view
rw_catalog.rw_ddl_progress
, with which users can view the progress of aCREATE INDEX
,CREATE SINK
, orCREATE MATERIALIZED VIEW
statement. #7914 - Adds the
pg_conversion
andpg_enum
system catalogs. #7964, #7706
SQL features
- Adds the
exp()
function. #7971 - Adds the
pow()
function. #7789 - Adds support for displaying primary keys in
EXPLAIN
statements. #7590 - Adds support for descending order in
CREATE INDEX
statements. #7822 - Adds
SHOW PARAMETERS
andALTER SYSTEM
commands to display and update system parameters. #7882, #7913
Connectors
- Adds a new parameter
match_pattern
to the S3 connector. With the new parameter, users can specify the pattern to filter files that they want to ingest from S3 buckets. For documentation updates, see Ingest data from S3 buckets. #7565 - Adds the PostgreSQL CDC connector. Users can use this connector to ingest data and CDC events from PostgreSQL directly. For documentation updates, see Ingest data from PostgreSQL CDC. [#6869](#6869, #7133
- Adds the MySQL CDC connector. Users can use this connector to ingest data and CDC events from MySQL directly. For documentation updates, see Ingest data from MySQL CDC. #6689, #6345, #6481, #7133
- Adds the JDBC sink connector, with which users can sink data to MySQL, PostgreSQL, or other databases that are compliant with JDBC. #6493
- Add new parameters to the Kafka sink connector.
Full Changelog: v0.1.16...v0.1.17
v0.1.16
For installation and running instructions, see Get started.
Main changes
Administration
- Adds support for aborting a query in local mode with
Ctrl + C
. #7444
SQL features
- Adds support for the
to_timestamp
function. #7060 - Adds support for the
RETURNING
clause in DML statements. #7094 - Breaking change: Deprecates
CREATE MATERIALIZED SOURCE
. To create a materialized source, create a table and include the newly added connector settings. #7281, #7110 - Adds support for the
c
andi
flags inregex_match()
andregex_matches()
functions. #7135 - Adds support for
SHOW CREATE TABLE
. You can use this statement to show the definition of a table. #7152 - Adds support for the
pg_stat_activity
system catalog and several system functions. #7274 - Adds the
_rw_kafka_timestamp
parameter to show the timestamps of Kafka messages. Users can now specify the scope of Kafka messages by timestamps. #7275, #7150 - Adds support for displaying PostgreSQL and RisingWave versions in
version()
. #7314 - Adds support for displaying internal tables using the
SHOW INTERNAL TABLES
statement. #7348 - Adds support for
SET VISIBILITY_MODE
You can use this session variable to configure whether only checkpoint data is readable for batch query. #5850 - Adds support for
SET STREAMING_PARALLELISM
. You can use this session variable to configure parallelism for streaming queries. #7370
Connectors
- Adds support for generating array and struct data using the datagen connector. #7099
- Adds the S3 source connector, with which users can ingest data in CSV format from S3 locations. For data ingestion from files, CSV is the only supported format and the files must be placed on S3. #6846
Full Changelog: v0.1.15...v0.1.16
v0.1.15
For installation and running instructions, see Get started.
Main changes
Installation and deployment
- Parallelism and available memory of compute nodes are now command-line arguments and removed from the configuration file. #6767
- The default barrier interval is set to 1 second. #6553
- Adds support for meta store backup and recovery. #6737
SQL features
- Adds support for
SHOW CREATE MATERIALIZED VIEW
andSHOW CREATE VIEW
to show how materialized and non-materialized views are defined. #6921 - Adds support for
CREATE TABLE IF NOT EXISTS
. #6643 - A sink can be created from a SELECT query. #6648
- Adds support for struct casting and comparison. #6552
- Adds pg_catalog views and system functions. #6982
- Adds support for
CREATE TABLE AS
. #6798 - Ads the initial support for batch query on Kafka source. #6474
- Adds support for
SET QUERY_EPOCH
to query historical data based on meta backup. #6840
Connectors
- Improves the handling of schema errors for Avro and Protobuf data. #6821
- Adds two options to the datagen connector to make it possible to generate increasing timestamp values. #6591
Observability
- Adds metrics for the backup manager in Grafana. #6898
- RisingWave Dashboard can now fetch data from Prometheus and visualize it in charts. #6602
Full Changelog: v0.1.14...v0.1.15
v0.1.14
For installation and running instructions, see Get started.
Main changes
SQL features
PRIMARY KEY
constraint checks can be performed on materialized sources and tables but not on non-materialized sources. For tables or materialized sources that enabledPRIMARY KEY
constraints, if you insert data to an existing key, the new data will overwrite the old data. #6320 #6435- Adds support for timestamp with time zone data type. You can use this data type in time window functions, and convert between it and timestamp (without time zone). #5855 #5910 #5968
- Adds support for
UNION
andUNION ALL
operators. #6363 #6397 - Implements the
rank()
function to support a different mode of Top-N queries. #6383 - Adds support for logical views (
CREATE VIEW
). #6023 - Adds the
data_trunc()
function. #6365 - Adds the system catalog schema. #6227
- Displays error messages when users enter conflicting or redundant command options. #5933
Connectors
- Adds support for the Maxwell Change Data Capture (CDC) format. #6057
- Protobuf schema files can be loaded from Web locations in
s3://
,http://
, orhttps://
formats. #6114 #5964 - Adds support for Confluent Schema Registry for Kafka data in Avro and Protobuf formats. #6289
- Adds two options to the Kinesis connector. Users can specify the startup mode and optionally the sequence number to start with. #6317
Full Changelog: v0.1.13...v0.1.14
v0.1.13
For installation and running instructions, see Get started.
Main changes
SQL features
-
SQL commands:
- Improves the formatting of response messages of
EXPLAIN
statements. #5541
- Improves the formatting of response messages of
-
SQL functions:
-
to_char()
now supports specifying output format in lowercase. #5032to_char(timestamp '2006-01-02 15:04:05', 'yyyy-mm-dd hh24:mi:ss')
→2006-01-02 15:04:05
-
generate_series
now supports negative steps. #5231SELECT * FROM generate_series(5,1,-2); generate_series ----------------- 5 3 1 (3 rows)
-
Adds support for sum/min/max functions over interval-type data. #5105, #5549
-
Adds support for specifying empty arrays. #5402
-
Casting from array to varchar is now supported. #5081
array[1,2]::varchar
→{1,2}
-
Casting from varchar to integer allows leading and trailing spaces. #5452
' 1 '::int
→1
-
-
Adds new system catalog and psql meta-commands. #5127, #5742
\d
: Lists all relations in the current database. (Materialized) sources are not supported yet.\dt
: Lists all tables in the current database.\dm
: Lists all materialized views in the current database.\di
: Lists all indexes in the current database.pg_catalog.pg_index
: Contains information about indexes.
Connectors
- Nested columns are now supported for the datagen connector. #5550
What's Changed
What's Changed
- chore(docs): update the binary version with new tag by @huangjw806 in #4297
- feat(frontend): support user alter by @cnissnzg in #4261
- feat(meta): pause concurrent checkpoint by @BugenZhao in #4269
- build(toolchain): bump to 20220729 by @TennyZhuang in #4292
- fix: add retry in wait_epoch by @hzxa21 in #4287
- feat(frontend): Add pg_catalog.pg_class by @Graphcalibur in #4293
- feat(sqlsmith): ensure panicked queries are reproducible by @kwannoel in #4228
- fix(binder): Fix ambiguous column name error message by @Graphcalibur in #4282
- chore(planner test): upgrade serde_yaml to 0.9 & remove yq by @xxchan in #4307
- fix(frontend): fix display pk of stream table scan by @chenzl25 in #4279
- refactor(meta): provide SST id to worker id mapping in commit_epoch. by @zwang28 in #4285
- feat(batch): support delimiter argument in batch
string_agg
by @richardchien in #4298 - feat(object store): add list method by @zwang28 in #4257
- chore(streaming): remove table id in arrange node by @wcy-fdu in #4281
- fix: refine error prompting by @neverchanje in #4227
- feat(S3_bench): Add s3_bench by @xxhZs in #4299
- feat(metrics): add metrics for barrier latency at each stage by @xxhZs in #3965
- feat(sqlsmith): enable sub-query generation by @marvenlee2486 in #4216
- fix: Messages should be skipped after parsing failure by @shanicky in #4317
- feat(stream): support
delim
argument in streamingstring_agg
by @richardchien in #4321 - feat(sqlsmith): print e2e errors by @kwannoel in #4310
- fix(optimizer): ApplyValues. by @likg227 in #4323
- feat(frontend): expose
Vnode
function as__rw_vnode
for easy debugging by @richardchien in #4327 - fix(frontend): only schedule dml to cn which contain table source writer by @yezizp2012 in #4329
- feat(risedev): support 3 compute nodes in playground by @BugenZhao in #4332
- fix(compaction): Skip compaction task assignment check for trivial move tasks by @hzxa21 in #4333
- refactor(batch): refactor hash join by @wzzzzd in #4017
- fix(risedev): cannot
d
after adding shared in-memory hummock support by @BugenZhao in #4353 - refactor(frontend): rename
__rw_vnode
torw_vnode
by @richardchien in #4342 - feat:binary format serializer by @ZENOTME in #4284
- chore: add metric for sink executor by @tabVersion in #4337
- fix: use correct column indices for chain & batch lookup join by @BugenZhao in #4346
- refactor(storage): get new SST id in batch by @zwang28 in #4308
- feat(compaction): optimize iterator and sstable builder for compaction speed by @Little-Wallace in #4034
- feat(sqlsmith): test stream queries by @kwannoel in #4361
- feat(frontend): support acl column in pg_namespace by @cnissnzg in #4326
- feat(planner): Use explain verbose for all planner tests by @jon-chuang in #4359
- feat(batch): apply row-based encoding for materialize executor and batch mode by @wcy-fdu in #4335
- fix(batch): Stop polling after data stream returns
None
by @liurenjie1024 in #4371 - refactor(streaming): apply row-based encoding for append_only top_n by @wcy-fdu in #4373
- refactor(batch): unify scan type in batch scan by @wcy-fdu in #4375
- fix(storage): fix manual_compaction for l0 sub_compaction by @Li0k in #4334
- fix(common): use smaller upperbound for generators to avoid range overflow by @wzzzzd in #4377
- feat(meta): support manual compaction for specific sst ids from CN by @soundOfDestiny in #4338
- feat(storage): provide prefix_iter for prefix_bloom_filter by @Li0k in #4316
- feat(storage): introduce filter_key_extractor_manager by @Li0k in #4347
- refactor(frontend): simplify ConditionDisplay by @xxchan in #4382
- feat(compaction): collect remote io time for every compaction task by @xinchengxx in #4320
- refactor(batch): remove
append_chunk
in nested loop join and hash join by @wzzzzd in #4381 - feat(planner): Bind Natural Join by @jon-chuang in #4349
- feat(optimizer): support 2-phase streaming agg by @richardchien in #4341
- fix(parser): parse negative numbers by @kwannoel in #4356
- fix: add pair number check in startup msg by @yezizp2012 in #4393
- feat: generator row id using vnode in source executor by @yezizp2012 in #4362
- chore(developer-docs): add note on compilation bottlenecks by @kwannoel in #4395
- refactor(lru): use on_release event listener to capture owned key/value when entries evicted or erased by @MrCroxx in #4396
- feat(optimizer): Implement
ProjectJoin
rule by @jon-chuang in #4385 - refactor(meta): eliminate usages of
RwError
by @HuaHuaY in #4364 - feat: support current_schema and session_user by @neverchanje in https://github.com/risingwavela...
v0.1.12
For installation and running instructions, see Get started.
Main changes
SQL features
- SQL commands:
EXPLAIN
now supports specifying options. Supported options:trace
,verbose
, andtype
. Unlike PostgreSQL, each option should be separated by a comma and wrapped by parentheses as a whole. #4730- Adds support for
ALTER USER
. #4261 CREATE/ALTER USER
now has new optionsCREATEUSER
andNOCREATEUSER
, which specifiy whether or not the user has the privilege to create, alter, or drop other users. #4447- Adds support for
EXPLAIN CREATE SINK
. #4430
- SQL functions:
- Adds support for new system information functions:
current_schema
,current_schema()
, andsession_user
. #4358
- Adds support for new system information functions:
- The
pg_namespace
catalog now has a new namespace columnnspacl
for storing access privileges. #4326
Connectors
-
Some connector parameters were renamed. The old parameter names are still functional but may be deprecated in the future. #4503
-
Kafka & Redpanda
kafka.brokers
->properties.bootstrap.server
kafka.topic
->topic
kafka.scan.startup.mode
->scan.starup.mode
kafka.time.offset
->scan.startup.timestamp_millis
kafka.consumer.group
->consumer.group.id
-
Kinesis
kinesis.stream.name
->stream
kinesis.stream.region
->aws.region
kinesis.endpoint
->endpoint
kinesis.credentials.access
->aws.credentials.access_key_id
kinesis.credentials.secret
->aws.credentials.secret_access_key
kinesis.credentials.session_token
->aws.credentials.session_token
kinesis.assumerole.arn
->aws.credentials.role.arn
kinesis.assumerole.external_id
->aws.credentials.role.external_id
-
Pulsar
pulsar.topic
->topic
pulsar.admin.url
->admin.url
pulsar.service.url
->service.url
pulsar.scan.startup.mode
->scan.startup.mode
pulsar.time.offset
->scan.startup.timestamp_millis
-
-
The row format name,
debezium json
, for CDC stream sources, has been renamed todebezium_json
. #4494
Configuration changes
- The default batch query execution mode was changed from distributed to local. #4789
New Contributors
- @xinchengxx made their first contribution in #4320
- @wanglei4687 made their first contribution in #4477
- @guzzit made their first contribution in #3781
- @KveinAxel made their first contribution in #4675
Full Changelog: v0.1.11...v0.1.12
What's Changed
What's Changed
- chore(docs): update the binary version with new tag by @huangjw806 in #4297
- feat(frontend): support user alter by @cnissnzg in #4261
- feat(meta): pause concurrent checkpoint by @BugenZhao in #4269
- build(toolchain): bump to 20220729 by @TennyZhuang in #4292
- fix: add retry in wait_epoch by @hzxa21 in #4287
- feat(frontend): Add pg_catalog.pg_class by @Graphcalibur in #4293
- feat(sqlsmith): ensure panicked queries are reproducible by @kwannoel in #4228
- fix(binder): Fix ambiguous column name error message by @Graphcalibur in #4282
- chore(planner test): upgrade serde_yaml to 0.9 & remove yq by @xxchan in #4307
- fix(frontend): fix display pk of stream table scan by @chenzl25 in #4279
- refactor(meta): provide SST id to worker id mapping in commit_epoch. by @zwang28 in #4285
- feat(batch): support delimiter argument in batch
string_agg
by @richardchien in #4298 - feat(object store): add list method by @zwang28 in #4257
- chore(streaming): remove table id in arrange node by @wcy-fdu in #4281
- fix: refine error prompting by @neverchanje in #4227
- feat(S3_bench): Add s3_bench by @xxhZs in #4299
- feat(metrics): add metrics for barrier latency at each stage by @xxhZs in #3965
- feat(sqlsmith): enable sub-query generation by @marvenlee2486 in #4216
- fix: Messages should be skipped after parsing failure by @shanicky in #4317
- feat(stream): support
delim
argument in streamingstring_agg
by @richardchien in #4321 - feat(sqlsmith): print e2e errors by @kwannoel in #4310
- fix(optimizer): ApplyValues. by @likg227 in #4323
- feat(frontend): expose
Vnode
function as__rw_vnode
for easy debugging by @richardchien in #4327 - fix(frontend): only schedule dml to cn which contain table source writer by @yezizp2012 in #4329
- feat(risedev): support 3 compute nodes in playground by @BugenZhao in #4332
- fix(compaction): Skip compaction task assignment check for trivial move tasks by @hzxa21 in #4333
- refactor(batch): refactor hash join by @wzzzzd in #4017
- fix(risedev): cannot
d
after adding shared in-memory hummock support by @BugenZhao in #4353 - refactor(frontend): rename
__rw_vnode
torw_vnode
by @richardchien in #4342 - feat:binary format serializer by @ZENOTME in #4284
- chore: add metric for sink executor by @tabVersion in #4337
- fix: use correct column indices for chain & batch lookup join by @BugenZhao in #4346
- refactor(storage): get new SST id in batch by @zwang28 in #4308
- feat(compaction): optimize iterator and sstable builder for compaction speed by @Little-Wallace in #4034
- feat(sqlsmith): test stream queries by @kwannoel in #4361
- feat(frontend): support acl column in pg_namespace by @cnissnzg in #4326
- feat(planner): Use explain verbose for all planner tests by @jon-chuang in #4359
- feat(batch): apply row-based encoding for materialize executor and batch mode by @wcy-fdu in #4335
- fix(batch): Stop polling after data stream returns
None
by @liurenjie1024 in #4371 - refactor(streaming): apply row-based encoding for append_only top_n by @wcy-fdu in #4373
- refactor(batch): unify scan type in batch scan by @wcy-fdu in #4375
- fix(storage): fix manual_compaction for l0 sub_compaction by @Li0k in #4334
- fix(common): use smaller upperbound for generators to avoid range overflow by @wzzzzd in #4377
- feat(meta): support manual compaction for specific sst ids from CN by @soundOfDestiny in #4338
- feat(storage): provide prefix_iter for prefix_bloom_filter by @Li0k in #4316
- feat(storage): introduce filter_key_extractor_manager by @Li0k in #4347
- refactor(frontend): simplify ConditionDisplay by @xxchan in #4382
- feat(compaction): collect remote io time for every compaction task by @xinchengxx in #4320
- refactor(batch): remove
append_chunk
in nested loop join and hash join by @wzzzzd in #4381 - feat(planner): Bind Natural Join by @jon-chuang in #4349
- feat(optimizer): support 2-phase streaming agg by @richardchien in https://github.com/risingwavelabs/risingwave/pu...
v0.1.11
What's Changed
- test(nexmark): rewrite flinksql function to the corresponding pg one by @TennyZhuang in #3654
- refactor: remove OrderedColumnDesc from proto by @xxchan in #3642
- feat(meta): do not use watermark as expire time of TTL by @Little-Wallace in #3633
- fix(lookup): fix the semantics of arrange_order_rules by @BowenXiao1999 in #3655
- chore(docs): update the binary version to v0.1.10 by @huangjw806 in #3661
- test(batch): add micro benchmark for NestedLoopJoinExecutor by @wzzzzd in #3652
- feat(meta): no pause checkpoint with building actor by @xxhZs in #3511
- feat: expand operator by @likg227 in #3563
- fix(meta): fix internal_table persisted by @Li0k in #3659
- feat(frontend): support show config by @yezizp2012 in #3664
- feat(frontend):
StreamDynamicFilter
by @jon-chuang in #3515 - feat(storage): support vnode hint in storage table by @BugenZhao in #3628
- refactor:introduce per crate error for batch executors by @ZENOTME in #3658
- fix(docs): fix regress test input file path by @lmatz in #3667
- test(nexmark): support explain nexmark q15 and q20 by @TennyZhuang in #3660
- fix(metrics): use iter_in_process_count to replace iter_count_duration by @Li0k in #3678
- fix(expr, executor): Remove
RowExpression
: useeval_row
andunwrap_or(false)
onDatum
, not panic on Null/None by @jon-chuang in #3587 - feat(meta): do not persist data on etcd for pin_snapshot by @Little-Wallace in #3557
- refactor(streaming): better source executor & split change by @BugenZhao in #3669
- fix: avoid unnecessary cells in max/min (not-append only) by @BowenXiao1999 in #3630
- perf(hummock manager): apply version delta from version checkpoint by @soundOfDestiny in #3567
- chore(ci): use random seed for sqlsmith cron test by @huangjw806 in #3688
- feat: add overlay string function by @ALeitert in #3671
- feat(batch): enable parallel table scan by @xxchan in #3670
- refactor(storage): remove async_trait for MergeIteratorNext by @KivenChen in #3673
- chore(doc): rename cell-based table to storage table by @wcy-fdu in #3691
- feat(metrics): add metrics for compact task splits count by @Li0k in #3693
- feat(frontend): support show all (#3665) by @chenzl25 in #3694
- chore: fix rustdoc for prost by @xxchan in #3699
- refactor: consolidate duplicated logic in PlanRoot by @xiangjinwu in #3554
- feat(expr): support regexp_match by @TennyZhuang in #3702
- chore(deps): bump openssl-src from 111.20.0+1.1.1o to 111.22.0+1.1.1q by @dependabot in #3701
- doc: add some comments for keys & rename keys -> key by @xxchan in #3700
- feat(streaming): allow pause source by @skyzh in #3697
- feat(meta): allow set parallel degree in config by @skyzh in #3703
- feat(batch): Implement LookupJoinExecutor by @Graphcalibur in #3614
- fix(array): ListRef Display by @nanderstabel in #3705
- feat(meta): add monitoring meta process metrics by @wenym1 in #3706
- fix: reduce logging in the critical path by @neverchanje in #3704
- refactor(optimizer): cleanup LogicalAgg::prune_col by @xiangjinwu in #3663
- fix: correctly implement check_state_consistency by @zwang28 in #3711
- feat(storage): default block size = 1024 by @skyzh in #3463
- feat(batch): prune scan partition according to scan_range by @xxchan in #3698
- test(nexmark): explain q16 q17 by @TennyZhuang in #3715
- doc: add relational table schema doc + move files by @BowenXiao1999 in #3712
- fix: fix heartbeat req field and meta client impl by @yezizp2012 in #3716
- fix(metrics): use current actor id for backpressure by @skyzh in #3721
- test(streaming): enable streaming e2e test for tpch q4, q18, q20 by @yuhao-su in #3718
- chore(deps): bump dependencies by @skyzh in #3725
- feat(executor): Basic in-application-memory
DynamicFilterExecutor
, pass tpch q11, q22 e2e tests by @jon-chuang in #3681 - refactor(sqlparser): rename
parse_string_agg
toparse_string_concat
by @richardchien in #3733 - fix(risedev): Revert Makefile.toml changes by @Graphcalibur in #3732
- fix: support decimal mul interval by @neverchanje in #3734
- refactor(storage): remove cell_based serialize/deserialize from serde by @wcy-fdu in #3722
- fix(sqlsmith): completely cover all exprs by @neverchanje in #3737
- fix(ci): use header fix action for license check by @skyzh in #3739
- chore(risedev): update grafana version by @wcy-fdu in #3731
- test(nexmark): add nexmark q10 q14 e2e test by @TennyZhuang in #3740
- refactor(streaming): use table catalog in hash join by @yuhao-su in #3707
- fix(batch): fix batch scan distribution & handle more than one table scans in one stage by @xxchan in #3736
- feat(optimizer): support two phase topn and limit in batch mode by @chenzl25 in #3719
- feat: deprecate catalog ref id by @yezizp2012 in #3745
- refactor(streaming): use table catalog for materialize executor by @wcy-fdu in #3742
- refactor(meta): improve create mview / scheduler readability by @BugenZhao in #3748
- feat(metrics): Add Fragment Level Exchange Metrics by @marvenlee2486 in #3696
- fix(risedev): unexpected rebuilds on Linux by @skyzh in #3761
- perf(hummmock manager): remove unnecessary hummock version deltas by @soundOfDestiny in #3689
- fix: sync compaction group correctly by @zwang28 in #3743
- feat(common): move observer_manager to common service by @xxhZs in #3754
- refactor: remove vnode_mappings in CompactTask and GroupedSstableBuilder by @hzxa21 in #3764
- refactor(batch): say goodbye to the state machine in NLJ by @wzzzzd in #3724
- feat(common): add is_set to BitmapBuilder by @wzzzzd in #3768
- fix(batch): add first-match optimization for left semi join by @wzzzzd in #3773
- feat(streaming): use multiple dispatcher for mview creation by @BugenZhao in #3758
- refactor(stream): refactor state of topN executor to one state table by @StrikeW in #3747
- chore(storage): remove value meta by @Li0k in #3779
- feat(executor): Use
TableCatalog
andStateTable
inDynamicFilter
(only writes) by @jon-chuang in #3757 - fix(batch): fix order_by with struct table by @StrikeW in htt...