v1.19.0

[romange]

Dragonfly v1.19.0

Some prominent changes include:

• SPOP and SRANDMEMBER return truly randomized results (fix(set): fix random in SRANDMEMBER and SPOP commands #3022)
• Fix memory blowup in some cases during replication (fix(replication): fullsync phase write to sync on noop #3084 bug(server): fix replication stuck in full sync #3103)
• Snapshotting works with data tiering (feat(tiering): Simple snapshotting #3073)
• Fix incompatibility issue of RDB snapshot with Redis 6.x (fix(server): fix compatibility with rdb snapshot #3121)
• Memory utilization improvements + better introspection of memory usage via /metrics

What's Changed

• chore: update versions and remove caching code by @romange in chore: update versions and remove caching code #3030
• chore: fix macos tiering by @dranikpg in chore: fix macos tiering #3032
• feat: support subrange expressions in jsonpathv2 by @romange in feat: support subrange expressions in jsonpathv2 #3036
• fix: reduce delay when stop replica replicaof no one on returns after long time while running memtier on master #3020 by @BorysTheDev in fix: reduce delay when stop replica #3020 #3028
• fix(set): fix random in SRANDMEMBER and SPOP commands by @BagritsevichStepan in fix(set): fix random in SRANDMEMBER and SPOP commands #3022
• chore: prevent updating gcc on macos by @romange in chore: prevent updating gcc on macos #3037
• chore: add half-range indices by @romange in chore: add half-range indices #3041
• chore: update helio together with new mimalloc version by @romange in chore: update helio together with new mimalloc version #3040
• fix: header for oom_errors_total by @romange in fix: header for oom_errors_total #3043
• chore: reset enable_direct_fd to avoid socket leakage in kernel by @romange in chore: reset enable_direct_fd to avoid socket leakage in kernel #3051
• chore: update deprecated actions by @romange in chore: update deprecated actions #3052
• chore: remove unneeded check-fails by @romange in chore: remove unneeded check-fails #3054
• chore: Export replication memory stats by @romange in chore: Export replication memory stats #3062
• !: Update grafana panel by @MaoMaoCake in <chore>!: Update grafana panel  #3064
• chore: add replication memory stats to the dashboard by @romange in chore: add replication memory stats to the dashboard #3065
• chore: bpop prints by @dranikpg in chore: bpop prints #3076
• fix(tiering): wait for IO before test teardown by @dranikpg in fix(tiering): wait for IO before test teardown #3079
• chore: small replayer fixes by @dranikpg in chore: small replayer fixes #3081
• fix: increase lua stack limit to 8KB by @romange in fix: increase lua stack limit to 8KB #3080
• chore: minor fixes by @romange in chore: minor fixes #3082
• fix: fix cluster incorrect keys status by @BorysTheDev in fix: fix cluster incorrect keys status #3083
• fix(acl): return -NOPERM instead of response error by @kostasrim in fix(acl): return -NOPERM instead of response error #3049
• feat(server): Expose serialization bytes via INFO and /metrics by @chakaz in feat(server): Expose serialization bytes via INFO and /metrics #3087
• chore(streams): Some refactoring by @dranikpg in chore(streams): Some refactoring #3088
• feat(server): remove multi shard sync from replication by @adiholden in feat(server): remove multi shard sync from replication #3085
• fix(replication): fullsync phase write to sync on noop by @adiholden in fix(replication): fullsync phase write to sync on noop #3084
• fix(tiering): Async delete for small bins by @dranikpg in fix(tiering): Async delete for small bins #3068
• fix: prevent crashing if error happened during snapshot moving by @BorysTheDev in fix: prevent crashing if error happened during snapshot moving #3092
• fix: add timeout for DFLYMIGRATE ACK to prevent deadlock by @BorysTheDev in fix: add timeout for DFLYMIGRATE ACK to prevent deadlock #3093
• chore: improve Migration() by @kostasrim in chore: improve Migration() #3033
• feat(streams): Stream optimizations by @dranikpg in feat(streams): Stream optimizations #3091
• feat(tiering): Defragmentation by @dranikpg in feat(tiering): Defragmentation #3021
• fix: bit shift of kTagMask by @haodongnj in fix: bit shift of kTagMask #3099
• feat(cluster_mgr): Allow attaching replicas by @chakaz in feat(cluster_mgr): Allow attaching replicas #3105
• bug(server): fix replication stuck in full sync by @adiholden in bug(server): fix replication stuck in full sync #3103
• fix(server): Sync FLUSH with tiering by @dranikpg in fix(server): Sync FLUSH with tiering #3098
• chore: export pipeline related metrics by @romange in chore: export pipeline related metrics #3104
• chore: zset error log (from 1.18 branch) by @dranikpg in chore: zset error log (from 1.18 branch) #3109
• New test for cluster migration: connection issue by @BorysTheDev in New test for cluster migration: connection issue #3102
• chore: minor fixes + remove redundant DCHECK by @romange in chore: minor fixes + remove redundant DCHECK #3115
• fix: fix cluster_fuzzy_migration test by @BorysTheDev in fix: fix cluster_fuzzy_migration test #3116
• feat(server): Pipeline and dispatch on /metrics by @chakaz in feat(server): Pipeline and dispatch on /metrics #3117
• chore: pull helio add test for tls deadlock by @kostasrim in chore: pull helio add test for tls deadlock #3111
• feat(cluster_mgr): Improvements to cluster_mgr.py by @chakaz in feat(cluster_mgr): Improvements to cluster_mgr.py #3118
• refactor client tracking, fix atomicity, squashing and multi/exec by @kostasrim in refactor client tracking, fix atomicity, squashing and multi/exec #2970
• fix(server): fix compatibility with rdb snapshot by @adiholden in fix(server): fix compatibility with rdb snapshot #3121
• Revert "refactor client tracking, fix atomicity, squashing and multi/… by @adiholden in Revert "refactor client tracking, fix atomicity, squashing and multi/… #3122
• feat(cluster_mgr): Take over command by @chakaz in feat(cluster_mgr): Take over command #3120
• fix: fix RestoreStreamer to prevent buckets skipping python tests fix #2830 by @BorysTheDev in fix: fix RestoreStreamer to prevent buckets skipping #2830 #3119
• feat(cluster_mgr): Fix migration action by @chakaz in feat(cluster_mgr): Fix migration action #3124
• chore: prevent Dispatch fiber to be launched during migration by @romange in chore: prevent Dispatch fiber to be launched during migration #3123
• feat(tiering): Simple snapshotting by @dranikpg in feat(tiering): Simple snapshotting #3073
• fix: upload action in version release by @romange in fix: upload action in version release #3127

New Contributors

• @MaoMaoCake made their first contribution in <chore>!: Update grafana panel  #3064
• @haodongnj made their first contribution in fix: bit shift of kTagMask #3099

Huge thanks to all the contributors! ❤️

Full Changelog: v1.18.0...v1.19.0

---

This discussion was created from the release v1.19.0.