Forest v0.14.0 "Hakuna Matata"

Notable updates

• Added NV21 (Watermelon) support for the calibration network.
• Fixed a bug in the ForestCAR encoder that would cause corrupted archives if a hash-collision happened.

Detailed changelog

• chore: take new release of unsigned-varint by @hanabi1224 in #3475
• chore(deps): unify bytes crate version in dependency tree by @hanabi1224 in #3476
• Remove unused benchmark/metrics script files that were moved to forest-iac by @jdjaustin in #3483
• [Feature] Unordered parallel graph walk V3 by @ruseinov in #3474
• Replace generate_hash_maps method with Arbitrary implementation by @jdjaustin in #3469
• chore(deps): unify cfg-if version by upgrading raw_sync by @hanabi1224 in #3477
• chore(deps): bump docker/build-push-action from 4 to 5 by @dependabot in #3491
• chore: rename Block to CarBlock by @lemmih in #3493
• chore(deps): bump docker/setup-qemu-action from 2 to 3 by @dependabot in #3495
• fix: disable flaky migration test by @lemmih in #3494
• chore: use nonempty vector to eliminate unwraps in tipset groups by @lemmih in #3497
• feat: download snapshots from CloudFlare by @lemmih in #3492
• Add CarWriter sink by @elmattic in #3461
• chore(deps): bump mimalloc from 0.1.38 to 0.1.39 by @dependabot in #3501
• fix: Lazy<Vec> should just be &[&str] by @hanabi1224 in #3503
• chore(deps): upgrade fvm deps by @hanabi1224 in #3481
• chore: remove stream seek constraint by @lemmih in #3505
• refactor: cid_collections by @aatifsyed in #3502
• fix: truncated actor bundles #3485 by @aatifsyed in #3488
• chore: remove unused RPCState field by @lemmih in #3496
• chore: re-organize chain muxer tests by @lemmih in #3506
• docs: state diagrams for the chain muxer and tipset processor by @lemmih in #3507
• fix(ci): fix RUSTSEC-2023-0063 to unblock CI by @hanabi1224 in #3513
• Use the new CarWriter sink by @elmattic in #3487
• chore: refactor futures in the ChainMuxer and TipsetProcessor by @lemmih in #3508
• fix db migration test by @ruseinov in #3517
• chore(deps): bump tokio-util from 0.7.8 to 0.7.9 by @dependabot in #3515
• chore(deps): bump tungstenite from 0.20.0 to 0.20.1 by @dependabot in #3519
• chore(deps): upgrade non-fvm deps by @hanabi1224 in #3521
• refactor: use bigint directly rather than from the fvm by @lemmih in #3522
• fvm4 shim types by @hanabi1224 in #3520
• ci: use fuzzy as an action runner by @lemmih in #3514
• ci: send db-migration output to stdout rather than a file by @lemmih in #3528
• migration declaration as macro by @LesnyRumcajs in #3530
• [Fix] create_migrations macro. by @ruseinov in #3533
• Monthly update of snapshot checkpoints by @jdjaustin in #3535
• chore(deps): bump clap from 4.4.5 to 4.4.6 by @dependabot in #3536
• fix: return early for out-of-bounds mmap reads by @lemmih in #3448
• write bundle path to stdout by @LesnyRumcajs in #3542
• refactor: manifest by @aatifsyed in #3545
• remove banned deps lint by @LesnyRumcajs in #3544
• chore: take ownership of command arguments by @lemmih in #3539
• refactor: anyhow usage by @aatifsyed in #3546
• chore: bump rust toolchain to 1.73 by @hanabi1224 in #3553
• fix: refactor TipsetRangeSyncerFuture into idiomatic futures by @hanabi1224 in #3554
• chore(deps): bump libc from 0.2.148 to 0.2.149 by @dependabot in #3559
• chore: configure update groups for dependabot by @hanabi1224 in #3561
• chore(deps): bump memmap2 from 0.8.0 to 0.9.0 by @dependabot in #3563
• chore(deps): bump num-derive from 0.4.0 to 0.4.1 by @dependabot in #3566
• remove flaky rolling db test by @LesnyRumcajs in #3568
• fix(ci): use local FS for sccache on fuzzy by @hanabi1224 in #3564
• chore(deps): bump byteorder from 1.4.3 to 1.5.0 by @dependabot in #3569
• chore(deps): bump lru from 0.11.1 to 0.12.0 by @dependabot in #3574
• feat: custom lints by @aatifsyed in #3552
• refactor: use zerocopy for IndexHeader instead of manually slicing by @aatifsyed in #3580
• chore: trace verbose coverage report by @aatifsyed in #3582
• feat: lint TODO comments by @aatifsyed in #3560
• wibble: fix RPC parameter in ci_check script by @lemmih in #3583
• fix: don't drop colliding keys from ForestCAR by @lemmih in #3590
• NV21 Watermelon 🍉 support by @LesnyRumcajs in #3541
• Prepare release v0.14.0 "Hakuna Matata" 🐗 🦁 by @LesnyRumcajs in #3594

Full Changelog: v0.13.0...v0.14.0

Forest v0.13.0 "Holocron"

Notable Updates

• New binary: forest-tool
• Significant performance improvements when using .forest.car.zst files.
• Exporting snapshots is multi-threaded rather than single-threaded, yielding ~40% better performance.

Forest v0.12.1 "Carp++"

Notable Updates

• Reduce memory required to export a mainnet snapshot from 14GiB to 7GiB.

Forest v0.12.0 "Carp"

Notable Updates

• Support for .forest.car.zst files.
• Support for diff snapshots.

What's changed?

Breaking

• #3189: Changed the database
  organisation to use multiple columns. The database will need to be recreated.
• #3220: Removed the
  forest-cli chain validate-tipset-checkpoints and
  forest-cli chain tipset-hash commands.

Added

• #3167: Added a new option
  --validate-tipsets for forest-cli snapshot validate.
• #3166: Add
  forest-cli archive info command for inspecting archives.
• #3159: Add
  forest-cli archive export -e=X command for exporting archives.
• #3150:
  forest-cli car concat subcommand for concatenating .car files.
• #3148: add save_to_file
  option to forest-cli state fetch command.
• #3213: Add support for
  loading forest.car.zst files.
• #3284: Add --diff flag to
  archive export.
• #3292: Add net info
  subcommand to forest-cli.

Changed

• #3126: Bail on database
  lookup errors instead of silently ignoring them.
• #2999: Restored --tipset
  flag to forest-cli snapshot export to allow export at a specific tipset.
• #3283: All generated car
  files use the new forest.car.zst format.

Removed

Fixed

• #3248: Fixed Forest being
  unable to re-create its libp2p keypair from file and always changing its
  PeerId.

Forest v0.11.1 "Dagny Taggart"

Patch release due to a tagging mishap. No user-visible changes to Forest.

Forest v0.11.0 "Hypersonic"

Notable Updates

CAR files can be directly used as databases. This dramatically improves performance but is only used in forest-cli snapshot validate for now.

Fixed a state-root mismatch triggered by null-tipsets.

Forest v0.11.0 "Hypersonic"

Breaking

• #3048: Remove support for
  rocksdb
• #3047: Remove support for
  compiling with delegated consensus
• #3086:
  forest-cli snapshot validate no longer supports URLs. Download the snapshot
  and then run the command.

Added

• #2816: Support 2k devnet.
• #3026: Expose
  forest-cli state diff ...
• #3086:
  forest-cli snapshot validate is faster and uses less disk space, operating
  directly on the snapshot rather than loading through a database.
• #2983: Added state
  migration support for NV17.
• #3107: Introduced 'head'
  parameter for snapshot validation.

Fixed

• #3005: Fix incorrect
  progress reported when importing compressed snapshots.

• #3122: Fix state-root
  mismatch around null tipsets.

Forest v0.10.0 "Premature"

Notable Updates

Breaking

• #3007: Optimize DB
  parameters. This requires all existing databases to be re-initialized.

Fixed

• #3006: Fix premature end
  error when exporting a snapshot.

What's Changed

• chore: minor clean up after re-org by @lemmih in #3001
• [Enhancement] Introduce a dry-run param for fetch-params for easier testing. by @ruseinov in #3003
• fix: use valid yaml list in template for recurrent checkpoint task by @lemmih in #3004
• feat: Refactor Manifest by @hanabi1224 in #3000
• feat: add fn new_dag_cbor_default to Cid by @hanabi1224 in #2909
• chore: fix checkbox syntax in issue template by @lemmih in #3009
• chore: reword readme to focus on features rather than design philosophy by @lemmih in #3002
• chore: enable the preimage flag for paritydb by @lemmih in #3007
• chore(deps): bump serde_with from 2.3.3 to 3.0.0 by @dependabot in #3016
• [Fix] Premature end for exported snapshots by @ruseinov in #3015
• chore: avoid the risk of collisions in CidHashSet by @lemmih in #3010
• Updated known snapshot checkpoint by @sudo-shashank in #3024
• feat: add deferred migrator for nv17 state migration by @hanabi1224 in #3030
• chore: update changelog for the preimage changes by @lemmih in #3033
• feat: state diff subcommand by @aatifsyed in #3026
• feat: private doctests by @aatifsyed in #3012
• [Release] 0.10.0 Premature by @ruseinov in #3035
• [Fix] Cargo.toml for publishing by @ruseinov in #3040

Full Changelog: v0.9.0...v0.10.0

Forest v0.9.0 "Fellowship"

Notable updates:

• --compressed option removed from CLI, snapshots are now always compressed.
• The dir, list, prune and remove snapshot commands have been removed from the CLI.
• Snapshots are fetched to current directory by default.
• Added new subcommand forest-cli info show.
• Filecoin.ChainSetHead RPC endpoint and forest-cli chain set-head subcommand are now implemented.
• IPLD graph can now be downloaded via bitswap.
• sendFIL function has been updated to match recent changes in the Forest send command.
• FIL amount parsing/printing has been improved and 2 new options are added to forest-cli wallet list (--no-round and --no-abbrev).

Forest v0.8.2 "The Way"

Notable updates

• Configurable number of default recent state roots included in memory/snapshots.
• Fixed issue when running Forest on calibnet using a configuration file only.
• NV19 and NV20 patches.

What's Changed

• doc: Update release checklist on including Cargo.lock by @hanabi1224 in #2794
• re-enable calibnet checks by @LesnyRumcajs in #2795
• Try waiting for more blocks by @elmattic in #2797
• fix: work-around for address parsing bug in the FVM by @lemmih in #2804
• Add print of message after sending by @elmattic in #2798
• fix agent name by @LesnyRumcajs in #2803
• use correct bundle for actors v11 by @LesnyRumcajs in #2805
• Fix Forest when using a config file to run calibnet by @elmattic in #2796
• chore: update fil-actor-states dependency to get new actor cids by @lemmih in #2807
• fix: allow --config and --chain to be used at the same time by @lemmih in #2808
• Comment check of the send test by @elmattic in #2806
• fix: create tmp file at the same mount point during snapshot export by @hanabi1224 in #2815
• chore: minor code clean-up by @lemmih in #2809
• Remove hand-written escape codes by @jdjaustin in #2783
• fix: BufWriter flush issue in AsyncWriterWithCheckSum by @hanabi1224 in #2782
• feat: add --compressed to forest-cli snapshot export by @hanabi1224 in #2754
• Replace usage of time crate with chrono by @jdjaustin in #2812
• fix: snapshot fetch without aria2 by @hanabi1224 in #2814
• chore: add Aatif as a codeowner by @lemmih in #2818
• Align Forest and Lotus send behavior by @jdjaustin in #2700
• Code clean-up by @elmattic in #2819
• chore: fvm-3.3.1 is required for syncing to calibnet by @lemmih in #2824
• fix: move block skipping logic into walk_snapshot by @hanabi1224 in #2717
• parametrize recent state roots by @LesnyRumcajs in #2780
• feat: increase the message request batch size from 4 to 8 by @lemmih in #2825
• feat: track estimated db records in meta.yaml by @hanabi1224 in #2823
• move bootstrap peers to seperate files by @LesnyRumcajs in #2828
• prepare release v0.8.2 by @LesnyRumcajs in #2829

Full Changelog: v0.8.1...v0.8.2

Forest v0.8.1 "Cold Exposure"

Notable updates

• Move back to the upstream ref-fvm and bump the dependency version to include the latest critical patch. This fixes NV19 and NV20 support.

What's Changed

• chore: upgrade rust toolchain by @hanabi1224 in #2784
• temporariy disable calibnet checks by @LesnyRumcajs in #2791
• transmit defined forest agent instead of default rust-ipfs by @LesnyRumcajs in #2790
• chore: copy fvm fixes into forest by @lemmih in #2788
• chore(deps): bump regex from 1.7.3 to 1.8.1 by @dependabot in #2792
• release v0.8.1 by @LesnyRumcajs in #2793

Full Changelog: v0.8.0...v0.8.1