v0.17.0

[romange]

Dragonfly v0.17.0

This is probably the last version before the 1.0 GA release.

• Multiple performance & stability improvements around transactions and lua scripts.
• helm scripts support password-based authentication
• Improve memory introspection tooling to be able to track memory usage in production easier
• Switched to dragonfly-specific snapshotting format (Dragonfly still supports saving/loading rdb files).
• Backport to Dragonfly lua functions that were deprecated after lua version 5.1 (getn, unpack)
• A new docs site was launched: https://dragonflydb.io/docs
• Dragonfly can now emulate cluster-mode by exposing itself as a single-shard cluster. See cluster_mode flag for more details.
• Experimental support for SADDEX/HSETEX commands that allow setting a TTL on SET/HASH members. This solves a 8-year-old feature request existing in the Redis project: Proposal: new commands HSETEX, HMSETEX redis/redis#2905

Huge thanks to all the contributors! ❤️

What's Changed

• feat(server): replication should not evict items by @adiholden in feat(server): replication should not evict items #743
• feat(list): Add BLMove command by @romange in feat(list): Add BLMove command #753
• fix(regression-tests): sentinel_test.py: Ditch docker whcih is complex on CI in favour of local redis binary by @ashotland in fix(regression-tests): sentinel_test.py: Ditch docker whcih is complex on CI in favour of local redis binary #755
• feat(server): add latency statistics for lua script calls by @romange in feat(server): add latency statistics for lua script calls #758
• bug(server): fix deadlock in BufferedStreamerBase notify all producers by @adiholden in bug(server): fix deadlock in BufferedStreamerBase notify all producers #760
• bug(replication): BLPOP fix write to shard journal of popped key by @adiholden in bug(replication): BLPOP fix write to shard journal of popped key #761
• feat(server): add total_connections_received statistics by @romange in feat(server): add total_connections_received statistics #757
• bug(transaction): local result needs to be reset on InitByArgs Fixes … by @adiholden in bug(transaction): local result needs to be reset on InitByArgs Fixes … #762
• chore(server): track ooo transactions via metrics. by @romange in chore(server): track ooo transactions via metrics. #763
• feat(server): Pool lua interpreters by @dranikpg in feat(server): Pool lua interpreters #765
• bug(replica): execute expire within multi command only if its belong … by @adiholden in bug(replica): execute expire within multi command only if its belong … #766
• Update transaction and enable OOO for regular transactions by @dranikpg in Update transaction and enable OOO for regular transactions #769
• feat(server): Extend malloc-stats command functionality. by @romange in feat(server): Extend malloc-stats command functionality. #775
• feat(server): Async unlock multi by @dranikpg in feat(server): Async unlock multi #774
• feat(server): track pipeline requests cache capacity by @romange in feat(server): track pipeline requests cache capacity #776
• Update README.md by @ashotland in Update README.md #778
• test(server): adding unit tests for reply builder by @boazsade in test(server): adding unit tests for reply builder #764
• fix(server): monitor lua at script execution by @boazsade in fix(server): monitor lua at script execution #767
• feat(server): add dfly replica offset command by @adiholden in feat(server): add dfly replica offset command #780
• feat(replica): add debug command - replica offset by @adiholden in feat(replica): add debug command - replica offset #786
• fix(server): Fix transaction bug by @dranikpg in fix(server): Fix transaction bug #787
• Refactor initialization phase of transaction by @dranikpg in Refactor initialization phase of transaction #790
• fix(server): Fix bugs by @dranikpg in fix(server): Fix bugs #797
• feat(server): Enable overriding --requirepass form env var by @ashotland in feat(server): Enable overriding --requirepass form env var #792
• test(regression-tests): stop regression-tests schedual run by @adiholden in test(regression-tests): stop regression-tests schedual run #795
• fix(replica) : replica will not sync execution multi shard commands as default by @adiholden in fix(replica) : replica will not sync execution multi shard commands as default #800
• feat(facade): Limit request cache using runtime flag by @romange in feat(facade): Limit request cache using runtime flag #793
• update readme by @worldsoup in update readme #794
• feat(server): save dragonfly snapshot in a new format by default by @romange in feat(server): save dragonfly snapshot in a new format by default #802
• feat(server): write journal record with optional await based on flag… by @adiholden in feat(server): write journal record with optional await based on flag… #791
• fix(pytest): SAVE to SAVE RDB by @dranikpg in fix(pytest): SAVE to SAVE RDB #803
• fix(pytest): fix periodic test by @dranikpg in fix(pytest): fix periodic test #804
• fix(regression-tests): increase timeout of regression-tests by @adiholden in fix(regression-tests): increase timeout of regression-tests #806
• chore(server): reduce number of allocations with multi-exec commands by @romange in chore(server): reduce number of allocations with multi-exec commands #807
• chore(regressions-tests): Update regression-tests.yml by @ashotland in chore(regressions-tests): Update regression-tests.yml #805
• tests(server): Add multi_test by @dranikpg in tests(server): Add multi_test #810
• feat(core): Add Ttl semantics to string_map by @romange in feat(core): Add Ttl semantics to string_map #813
• feat(server): Check locks in heartbeat, allow multiple tx in replica by @dranikpg in feat(server): Check locks in heartbeat, allow multiple tx in replica #815
• feat(charts): Update helm chart to support password from secret by @ashotland in feat(charts): Update helm chart to support password from secret #799
• Fix(regression-tests): Sentinel test - wait for sentinel termination by @ashotland in Fix(regression-tests): Sentinel test - wait for sentinel termination  #816
• Basic multi modes for MULTI/EXEC by @dranikpg in Basic multi modes for MULTI/EXEC #796
• fix(zset): Make count optional for ZPOP{MIN,MAX} by @alisaifee in fix(zset): Make count optional for ZPOP{MIN,MAX} #821
• feat(server): add debug information about running transactions by @romange in feat(server): add debug information about running transactions #820
• EVAL multi modes + non atomic modes by @dranikpg in EVAL multi modes + non atomic modes #818
• fix(regression-test): Sentinel test stabilization by @ashotland in fix(regression-test): Sentinel test stabilization #826
• bug(snapshot): Fix unwriten entries in multiple snapshotting Fixes Multiple snapshots at the same time skips serializing some entries #823 by @adiholden in bug(snapshot): Fix unwriten entries in multiple snapshotting Fixes #823 #825
• docs: Add how to build dragonfly on Fedora by @romange in docs: Add how to build dragonfly on Fedora #822
• feat(tests): Add rotating master test by @dranikpg in feat(tests): Add rotating master test #828
• fix(docs):attos -> dragonflydb by @ashotland in fix(docs):attos -> dragonflydb #830
• feat(server): add lru data structure by @romange in feat(server): add lru data structure #831
• Update transaction.md by @dranikpg in Update transaction.md #808
• feat(server): Add HSETEX command by @romange in feat(server): Add HSETEX command #817
• docs(dashtable): Fix image URL for expiration by @Pothulapati in docs(dashtable): Fix image URL for expiration  #870
• fix(server): JSON.RESP path arg should be optional (JSON.RESP path arg should be optional  #852) by @iko1 in fix(server): JSON.RESP path arg should be optional (#852) #865
• fix(server): Fix lua reply builder by @dranikpg in fix(server): Fix lua reply builder #871
• fix(helio): get helio fix in uring_socket by @adiholden in fix(helio): get helio fix in uring_socket #827
• fix(server): Reorder ExecuteAsync callback seqlock check by @dranikpg in fix(server): Reorder ExecuteAsync callback seqlock check #873
• fix(server): fix JSON.ARRTRIM implementation (JSON.ARRTRIM semantics is reversed #844) by @iko1 in fix(server): fix JSON.ARRTRIM implementation (#844) #864
• feat(tests): Script pytests by @dranikpg in feat(tests): Script pytests #872
• bug(snapshot) : Do not preempt inside OnDbChange issue Snapshot preemption on OnDbChange #829 by @adiholden in bug(snapshot) : Do not preempt inside OnDbChange issue #829 #868
• feat(db slice): add fiber atomic gaurd by @adiholden in feat(db slice): add fiber atomic gaurd #878
• feat(Docker) : add redis tools to docker by @adiholden in feat(Docker) : add redis tools to docker #877
• fix(server): Fix replication logs by @dranikpg in fix(server): Fix replication logs #883
• feat(chart): add golden file output rendering tests by @Pothulapati in feat(chart): add golden file output rendering tests #882
• fix(charts): Use Release.Namespace everywhere by @Pothulapati in fix(charts): Use Release.Namespace everywhere #884
• feat: support cluster mode emulation by @lsvmello in feat: support cluster mode emulation #492
• test(helm): Add command to update golden files by @Pothulapati in test(helm): Add command to update golden files #890
• fix: ci by @romange in fix: ci #893
• feat(zset_family): support zscan match and count optional params issue by @adiholden in feat(zset_family): support zscan match and count optional params issue #891
• Support script configuration by @dranikpg in Support script configuration #889
• fix: resize buffer correctly when checking for http header line by @romange in fix: resize buffer correctly when checking for http header line #894
• Add basic replicaiton from redis test by @ashotland in Add basic replicaiton from redis test #895
• bug(snapshot) : enforce order when pushing to channel when needed issue On replica snapshotting records pushed to channel can be OOO  #879 by @adiholden in bug(snapshot) : enforce order when pushing to channel when needed issue #879 #886
• bug(replica): call add entry outside DCHECK by @adiholden in bug(replica): call add entry outside DCHECK #896
• bug(list_family): fix BPopPusher command replication by @adiholden in bug(list_family): fix BPopPusher command replication #899
• feat(regression test) : add regression test that run in optimiztion mode by @adiholden in feat(regression test) : add regression test that run in optimiztion mode #900
• fix(server):Return an error, instead of crashing, for requests trying to rename a key to the same key. by @chakaz in fix(server):Return an error, instead of crashing, for requests trying to rename a key to the same key. #897
• fix(server): fix JSON.MGET implementation (JSON.MGET not working as intended  #849) by @iko1 in fix(server): fix JSON.MGET implementation (#849) #876
• chore(deps): Update outdated golang test dependencies by @Pothulapati in chore(deps): Update outdated golang test dependencies #904
• chore(server): pass coordinator thread to a transaction object by @romange in chore(server): pass coordinator thread to a transaction object #905
• fix(server): Add deprecated/removed lua table functions by @dranikpg in fix(server): Add deprecated/removed lua table functions #901

New Contributors

• @worldsoup made their first contribution in update readme #794
• @Pothulapati made their first contribution in docs(dashtable): Fix image URL for expiration  #870
• @chakaz made their first contribution in fix(server):Return an error, instead of crashing, for requests trying to rename a key to the same key. #897

Full Changelog: v0.15.0...v0.17.0

---

This discussion was created from the release v0.17.0.