Vitess v22.0.1

Release of Vitess v22.0.1

The entire changelog for this release can be found here.

The release includes 19 merged Pull Requests.

Thanks to all our contributors: @GuptaManan100, @app/vitess-bot, @vitess-bot

Vitess v21.0.5

Release of Vitess v21.0.5

The entire changelog for this release can be found here.

The release includes 14 merged Pull Requests.

Thanks to all our contributors: @GuptaManan100, @app/vitess-bot, @frouioui, @harshit-gangal, @systay, @vitess-bot

Vitess v20.0.8

Release of Vitess v20.0.8

The entire changelog for this release can be found here.

The release includes 11 merged Pull Requests.

Thanks to all our contributors: @GuptaManan100, @app/vitess-bot, @frouioui

Vitess v22.0.0

Release of Vitess v22.0.0

Summary

Table of Contents

• Major Changes
  • Deprecations
    • Metrics
    • CLI Flags
  • Deletions
    • Metrics
    • CLI Flags
    • gh-ost and pt-osc Online DDL strategies
  • New Metrics
    • VTGate
    • VTTablet
  • Config File Changes
    • VTOrc
    • VTGate
  • VTOrc
    • Stalled Disk Recovery
    • KeyRanges in --clusters_to_watch
  • New Default Versions
    • MySQL 8.0.40
    • Docker vitess/lite images with Debian Bookworm
  • New Support
    • More Efficient JSON Replication
    • LAST_INSERT_ID(x)
    • Maximum Idle Connections in the Pool
    • Filtering Query logs on Error
    • MultiQuery RPC in vtgate
    • Unsharded CREATE PROCEDURE support
  • Optimization
    • Prepared Statement
  • New VtctldServer RPC
  • Prefer not promoting a replica that is currently taking a backup
  • Semi-sync monitor in vttablet
  • Wrapped fatal transaction errors
• Minor Changes
  • Topology read concurrency behaviour changes
  • VTTablet
    • CLI Flags
    • ACL enforcement and reloading
  • VTAdmin
    • Updated to node v22.13.1

Major Changes

Deprecations

Metrics

Component	Metric Name	Deprecation PR
vtgate	QueriesProcessed	#17727
vtgate	QueriesRouted	#17727
vtgate	QueriesProcessedByTable	#17727
vtgate	QueriesRoutedByTable	#17727

CLI Flags

Component	Flag Name	Notes	Deprecation PR
vttablet	twopc_enable	Usage of TwoPC commit will be determined by the transaction_mode set on VTGate via flag or session variable.	#17279
vtgate	grpc-send-session-in-streaming	Session will always be sent as part of the response from the StreamExecute RPC.	#17907

---

Deletions

Metrics

Component	Metric Name	Was Deprecated In	Deletion PR
vttablet	QueryCacheLength	v21.0.0	#16289
vttablet	QueryCacheSize	v21.0.0	#16289
vttablet	QueryCacheCapacity	v21.0.0	#16289
vttablet	QueryCacheEvictions	v21.0.0	#16289
vttablet	QueryCacheHits	v21.0.0	#16289
vttablet	QueryCacheMisses	v21.0.0	#16289

CLI Flags

Component	Flag Name	Was Deprecated In	Deletion PR
vttablet	queryserver-enable-settings-pool	v21.0.0	#16280
vttablet	remove-sharded-auto-increment	v21.0.0	#16860
vttablet	disable_active_reparents	v20.0.0	#14871
vtgate, vtcombo, vtctld	healthcheck-dial-concurrency	v21.0.0	#16378

gh-ost and pt-osc Online DDL strategies

Vitess no longer recognizes the gh-ost and pt-osc (pt-online-schema-change) Online DDL strategies. The vitess strategy is the recommended way to make schema changes at scale. mysql and direct strategies continue to be supported.

These vttablet flags have been removed:

• --gh-ost-path
• --pt-osc-path

Attempting to use gh-ost or pt-osc as --ddl-strategy will yield an error:

$ vtctldclient ApplySchema --ddl-strategy="gh-ost" ...
$ vtctldclient ApplySchema --ddl-strategy="pt-osc" ...

---

New Metrics

VTGate

Name	Dimensions	Description	PR
QueryExecutions	Query, Plan, Tablet	Number of queries executed.	#17727
QueryRoutes	Query, Plan, Tablet	Number of vttablets the query was executed on.	#17727
QueryExecutionsByTable	Query, Table	Queries executed by vtgate, with counts recorded per table.	#17727
VStreamsCount	Keyspace, ShardName, TabletType	Number of active vstreams.	#17858
VStreamsEventsStreamed	Keyspace, ShardName, TabletType	Number of events sent across all vstreams.	#17858
VStreamsEndedWithErrors	Keyspace, ShardName, TabletType	Number of vstreams that ended with errors.	#17858
CommitModeTimings	Mode	Timing metrics for commit (Single, Multi, TwoPC).	#16939
CommitUnresolved	N/A	Counter for 2PC transaction failures after Prepare.	#16939

The work done in #17727 introduces new metrics for queries. Via this work we have deprecated several vtgate metrics, please see the Deprecated Metrics section. Here is an example of how the new metrics are calculated:

Query: select t1.a, t2.b from t1 join t2 on t1.id = t2.id
Shards: 2
Sharding Key: id for both tables

Metrics Published:
1. QueryExecutions – {select, scatter, primary}, 1
2. QueryRoutes – {select, scatter, primary}, 2
3. QueryExecutionsByTable – {select, t1}, 1 and {select, t2}, 1

VTTablet

Name	Dimensions	Description	PR
TableRows	Table	Estimated number of rows in the table.	#17570
TableClusteredIndexSize	Table	Byte size of the clustered index (i.e. row data).	#17570
IndexCardinality	Table, Index	Estimated number of unique values in the index	#17570
IndexBytes	Table, Index	Byte size of the index.	#17570
UnresolvedTransaction	ManagerType	Current number of unresolved transactions.	#16939
...

Vitess v22.0.0-rc3

Release of Vitess v22.0.0

Summary

Table of Contents

• Major Changes
  • Deprecations
    • Metrics
    • CLI Flags
  • Deletions
    • Metrics
    • CLI Flags
    • gh-ost and pt-osc Online DDL strategies
  • New Metrics
    • VTGate
    • VTTablet
  • Config File Changes
    • VTOrc
    • VTGate
  • VTOrc
    • Stalled Disk Recovery
    • KeyRanges in --clusters_to_watch
  • New Default Versions
    • MySQL 8.0.40
    • Docker vitess/lite images with Debian Bookworm
  • New Support
    • More Efficient JSON Replication
    • LAST_INSERT_ID(x)
    • Maximum Idle Connections in the Pool
    • Filtering Query logs on Error
    • MultiQuery RPC in vtgate
    • Unsharded CREATE PROCEDURE support
  • Optimization
    • Prepared Statement
  • New VtctldServer RPC
  • Prefer not promoting a replica that is currently taking a backup
  • Semi-sync monitor in vttablet
  • Wrapped fatal transaction errors
• Minor Changes
  • Topology read concurrency behaviour changes
  • VTTablet
    • CLI Flags
    • ACL enforcement and reloading
  • VTAdmin
    • Updated to node v22.13.1

Major Changes

Deprecations

Metrics

Component	Metric Name	Deprecation PR
vtgate	QueriesProcessed	#17727
vtgate	QueriesRouted	#17727
vtgate	QueriesProcessedByTable	#17727
vtgate	QueriesRoutedByTable	#17727

CLI Flags

Component	Flag Name	Notes	Deprecation PR
vttablet	twopc_enable	Usage of TwoPC commit will be determined by the transaction_mode set on VTGate via flag or session variable.	#17279
vtgate	grpc-send-session-in-streaming	Session will always be sent as part of the response from the StreamExecute RPC.	#17907

---

Deletions

Metrics

Component	Metric Name	Was Deprecated In	Deletion PR
vttablet	QueryCacheLength	v21.0.0	#16289
vttablet	QueryCacheSize	v21.0.0	#16289
vttablet	QueryCacheCapacity	v21.0.0	#16289
vttablet	QueryCacheEvictions	v21.0.0	#16289
vttablet	QueryCacheHits	v21.0.0	#16289
vttablet	QueryCacheMisses	v21.0.0	#16289

CLI Flags

Component	Flag Name	Was Deprecated In	Deletion PR
vttablet	queryserver-enable-settings-pool	v21.0.0	#16280
vttablet	remove-sharded-auto-increment	v21.0.0	#16860
vttablet	disable_active_reparents	v20.0.0	#14871
vtgate, vtcombo, vtctld	healthcheck-dial-concurrency	v21.0.0	#16378

gh-ost and pt-osc Online DDL strategies

Vitess no longer recognizes the gh-ost and pt-osc (pt-online-schema-change) Online DDL strategies. The vitess strategy is the recommended way to make schema changes at scale. mysql and direct strategies continue to be supported.

These vttablet flags have been removed:

• --gh-ost-path
• --pt-osc-path

Attempting to use gh-ost or pt-osc as --ddl-strategy will yield an error:

$ vtctldclient ApplySchema --ddl-strategy="gh-ost" ...
$ vtctldclient ApplySchema --ddl-strategy="pt-osc" ...

---

New Metrics

VTGate

Name	Dimensions	Description	PR
QueryExecutions	Query, Plan, Tablet	Number of queries executed.	#17727
QueryRoutes	Query, Plan, Tablet	Number of vttablets the query was executed on.	#17727
QueryExecutionsByTable	Query, Table	Queries executed by vtgate, with counts recorded per table.	#17727
VStreamsCount	Keyspace, ShardName, TabletType	Number of active vstreams.	#17858
VStreamsEventsStreamed	Keyspace, ShardName, TabletType	Number of events sent across all vstreams.	#17858
VStreamsEndedWithErrors	Keyspace, ShardName, TabletType	Number of vstreams that ended with errors.	#17858
CommitModeTimings	Mode	Timing metrics for commit (Single, Multi, TwoPC).	#16939
CommitUnresolved	N/A	Counter for 2PC transaction failures after Prepare.	#16939

The work done in #17727 introduces new metrics for queries. Via this work we have deprecated several vtgate metrics, please see the Deprecated Metrics section. Here is an example of how the new metrics are calculated:

Query: select t1.a, t2.b from t1 join t2 on t1.id = t2.id
Shards: 2
Sharding Key: id for both tables

Metrics Published:
1. QueryExecutions – {select, scatter, primary}, 1
2. QueryRoutes – {select, scatter, primary}, 2
3. QueryExecutionsByTable – {select, t1}, 1 and {select, t2}, 1

VTTablet

Name	Dimensions	Description	PR
TableRows	Table	Estimated number of rows in the table.	#17570
TableClusteredIndexSize	Table	Byte size of the clustered index (i.e. row data).	#17570
IndexCardinality	Table, Index	Estimated number of unique values in the index	#17570
IndexBytes	Table, Index	Byte size of the index.	#17570
UnresolvedTransaction	ManagerType	Current number of unresolved transactions.	#16939
...

Vitess v22.0.0-rc2

Release of Vitess v22.0.0

Summary

Table of Contents

• Major Changes
  • Deprecations
    • Metrics
    • CLI Flags
  • Deletions
    • Metrics
    • CLI Flags
    • gh-ost and pt-osc Online DDL strategies
  • New Metrics
    • VTGate
    • VTTablet
  • Config File Changes
    • VTOrc
    • VTGate
  • VTOrc
    • Stalled Disk Recovery
    • KeyRanges in --clusters_to_watch
  • New Default Versions
    • MySQL 8.0.40
    • Docker vitess/lite images with Debian Bookworm
  • New Support
    • More Efficient JSON Replication
    • LAST_INSERT_ID(x)
    • Maximum Idle Connections in the Pool
    • Filtering Query logs on Error
    • MultiQuery RPC in vtgate
    • Unsharded CREATE PROCEDURE support
  • Optimization
    • Prepared Statement
  • RPC Changes
  • Prefer not promoting a replica that is currently taking a backup
  • Semi-sync monitor in vttablet
  • Wrapped fatal transaction errors
• Minor Changes
  • Topology read concurrency behaviour changes
  • VTTablet
    • CLI Flags
    • ACL enforcement and reloading
  • VTAdmin
    • Updated to node v22.13.1

Major Changes

Deprecations

Metrics

Component	Metric Name	Deprecation PR
vtgate	QueriesProcessed	#17727
vtgate	QueriesRouted	#17727
vtgate	QueriesProcessedByTable	#17727
vtgate	QueriesRoutedByTable	#17727

CLI Flags

Component	Flag Name	Notes	Deprecation PR
vttablet	twopc_enable	Usage of TwoPC commit will be determined by the transaction_mode set on VTGate via flag or session variable.	#17279
vtgate	grpc-send-session-in-streaming	Session will be sent as part of response on StreamExecute API call.	#17907

---

Deletions

Metrics

Component	Metric Name	Was Deprecated In	Deprecation PR
vttablet	QueryCacheLength	v21.0.0	#16289
vttablet	QueryCacheSize	v21.0.0	#16289
vttablet	QueryCacheCapacity	v21.0.0	#16289
vttablet	QueryCacheEvictions	v21.0.0	#16289
vttablet	QueryCacheHits	v21.0.0	#16289
vttablet	QueryCacheMisses	v21.0.0	#16289

CLI Flags

Component	Flag Name	Was Deprecated In	Deprecation PR
vttablet	queryserver-enable-settings-pool	v21.0.0	#16280
vttablet	remove-sharded-auto-increment	v21.0.0	#16860
vttablet	disable_active_reparents	v20.0.0	#14871
vtgate, vtcombo, vtctld	healthcheck-dial-concurrency	v21.0.0	#16378

gh-ost and pt-osc Online DDL strategies

Vitess no longer recognizes the gh-ost and pt-osc (pt-online-schema-change) Online DDL strategies. The vitess strategy is the recommended way to make schema changes at scale. mysql and direct strategies continue to be supported.

These vttablet flags have been removed:

• --gh-ost-path
• --pt-osc-path

The use of gh-ost and pt-osc as strategies as follows, yields an error:

$ vtctldclient ApplySchema --ddl-strategy="gh-ost" ...
$ vtctldclient ApplySchema --ddl-strategy="pt-osc" ...

---

New Metrics

VTGate

Name	Dimensions	Description	PR
QueryExecutions	Query, Plan, Tablet	Number of queries executed.	#17727
QueryRoutes	Query, Plan, Tablet	Number of vttablets the query was executed on.	#17727
QueryExecutionsByTable	Query, Table	Queries executed at vtgate, with counts recorded per table.	#17727
VStreamsCount	Keyspace, ShardName, TabletType	Number of active vstream.	#17858
VStreamsEventsStreamed	Keyspace, ShardName, TabletType	Number of events sent across all vstreams.	#17858
VStreamsEndedWithErrors	Keyspace, ShardName, TabletType	Number of vstreams that ended with errors.	#17858
CommitModeTimings	Mode	Timing metrics for commit (Single, Multi, TwoPC).	#16939
CommitUnresolved	N/A	Counter for failure after Prepare.	#16939

The work done in #17727 introduces new metrics for queries. Via this work we have deprecated several vtgate metrics, please see the Deprecated Metrics section. Here is an example on how to use them:

Query: select t1.a, t2.b from t1 join t2 on t1.id = t2.id
Shards: 2
Sharding Key: id for both tables

Metrics Published:
1. QueryExecutions – {select, scatter, primary}, 1
2. QueryRoutes – {select, scatter, primary}, 2
3. QueryExecutionsByTable – {select, t1}, 1 and {select, t2}, 1

VTTablet

Name	Dimensions	Description	PR
TableRows	Table	Estimated number of rows in the table.	#17570
TableClusteredIndexSize	Table	Byte size of the clustered index (i.e. row data).	#17570
IndexCardinality	Table, Index	Estimated number of unique values in the index	#17570
IndexBytes	Table, Index	Byte size of the index.	#17570
UnresolvedTransaction	ManagerType	Number of events sent across all vstreams.	#16939
CommitPreparedFail	`...

Vitess v21.0.4

Release of Vitess v21.0.4

The entire changelog for this release can be found here.

The release includes 35 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @dbussink, @frouioui, @harshit-gangal, @mattlord, @systay, @vitess-bot

Vitess v20.0.7

Release of Vitess v20.0.7

The entire changelog for this release can be found here.

The release includes 27 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @dbussink, @harshit-gangal, @systay, @vitess-bot

Vitess v22.0.0-rc1

Release of Vitess v22.0.0

Summary

Table of Contents

• Major Changes
  • Deprecations
    • Metrics
    • CLI Flags
  • Deletions
    • Metrics
    • CLI Flags
    • gh-ost and pt-osc Online DDL strategies
  • New Metrics
    • VTGate
    • VTTablet
  • Config File Changes
    • VTOrc
    • VTGate
  • VTOrc
    • Stalled Disk Recovery
    • KeyRanges in --clusters_to_watch
  • New Default Versions
    • MySQL 8.0.40
    • Docker vitess/lite images with Debian Bookworm
  • New Support
    • More Efficient JSON Replication
    • LAST_INSERT_ID(x)
    • Maximum Idle Connections in the Pool
    • Filtering Query logs on Error
  • Optimization
    • Prepared Statement
  • RPC Changes
  • Prefer not promoting a replica that is currently taking a backup
  • Semi-sync monitor in vttablet
  • Wrapped fatal transaction errors
• Minor Changes
  • Topology read concurrency behaviour changes
  • VTTablet
    • CLI Flags
    • ACL enforcement and reloading
  • VTAdmin
    • Updated to node v22.13.1

Major Changes

Deprecations

Metrics

Component	Metric Name	Deprecation PR
vtgate	QueriesProcessed	#17727
vtgate	QueriesRouted	#17727
vtgate	QueriesProcessedByTable	#17727
vtgate	QueriesRoutedByTable	#17727

CLI Flags

Component	Flag Name	Notes	Deprecation PR
vttablet	twopc_enable	Usage of TwoPC commit will be determined by the transaction_mode set on VTGate via flag or session variable.	#17279
vtgate	grpc-send-session-in-streaming	Session will be sent as part of response on StreamExecute API call.	#17907

---

Deletions

Metrics

Component	Metric Name	Was Deprecated In	Deprecation PR
vttablet	QueryCacheLength	v21.0.0	#16289
vttablet	QueryCacheSize	v21.0.0	#16289
vttablet	QueryCacheCapacity	v21.0.0	#16289
vttablet	QueryCacheEvictions	v21.0.0	#16289
vttablet	QueryCacheHits	v21.0.0	#16289
vttablet	QueryCacheMisses	v21.0.0	#16289

CLI Flags

Component	Flag Name	Was Deprecated In	Deprecation PR
vttablet	queryserver-enable-settings-pool	v21.0.0	#16280
vttablet	remove-sharded-auto-increment	v21.0.0	#16860
vttablet	disable_active_reparents	v20.0.0	#14871
vtgate, vtcombo, vtctld	healthcheck-dial-concurrency	v21.0.0	#16378

gh-ost and pt-osc Online DDL strategies

Vitess no longer recognizes the gh-ost and pt-osc (pt-online-schema-change) Online DDL strategies. The vitess strategy is the recommended way to make schema changes at scale. mysql and direct strategies continue to be supported.

These vttablet flags have been removed:

• --gh-ost-path
• --pt-osc-path

The use of gh-ost and pt-osc as strategies as follows, yields an error:

$ vtctldclient ApplySchema --ddl-strategy="gh-ost" ...
$ vtctldclient ApplySchema --ddl-strategy="pt-osc" ...

---

New Metrics

VTGate

Name	Dimensions	Description	PR
QueryExecutions	Query, Plan, Tablet	Number of queries executed.	#17727
QueryRoutes	Query, Plan, Tablet	Number of vttablets the query was executed on.	#17727
QueryExecutionsByTable	Query, Table	Queries executed at vtgate, with counts recorded per table.	#17727
VStreamsCount	Keyspace, ShardName, TabletType	Number of active vstream.	#17858
VStreamsEventsStreamed	Keyspace, ShardName, TabletType	Number of events sent across all vstreams.	#17858
VStreamsEndedWithErrors	Keyspace, ShardName, TabletType	Number of vstreams that ended with errors.	#17858
CommitModeTimings	Mode	Timing metrics for commit (Single, Multi, TwoPC).	#16939
CommitUnresolved	N/A	Counter for failure after Prepare.	#16939

The work done in #17727 introduces new metrics for queries. Via this work we have deprecated several vtgate metrics, please see the Deprecated Metrics section. Here is an example on how to use them:

Query: select t1.a, t2.b from t1 join t2 on t1.id = t2.id
Shards: 2
Sharding Key: id for both tables

Metrics Published:
1. QueryExecutions – {select, scatter, primary}, 1
2. QueryRoutes – {select, scatter, primary}, 2
3. QueryExecutionsByTable – {select, t1}, 1 and {select, t2}, 1

VTTablet

Name	Dimensions	Description	PR
TableRows	Table	Estimated number of rows in the table.	#17570
TableClusteredIndexSize	Table	Byte size of the clustered index (i.e. row data).	#17570
IndexCardinality	Table, Index	Estimated number of unique values in the index	#17570
IndexBytes	Table, Index	Byte size of the index.	#17570
UnresolvedTransaction	ManagerType	Number of events sent across all vstreams.	#16939
CommitPreparedFail	FailureType	Number of vstreams that ended with errors.	[#16939](https://github.com/vitessio/vit...

Vitess v21.0.3

Release of Vitess v21.0.3

The entire changelog for this release can be found here.

The release includes 13 merged Pull Requests.

Thanks to all our contributors: @GuptaManan100, @app/vitess-bot, @vitess-bot