Skip to content

Tests update 17.0: Reorganization
Compare
Choose a tag to compare
@winsvega winsvega released this 13 Mar 09:47
· 22 commits to develop since this release
v17.0
81862e4

The recent tests changes:

Remove Pyspec versions of tests to avoid confusion
Remove EIPTests folder
Fill in fixture-format in tests _info section
Pack all fixtures into fixtures tarball

From now on there would be no new test vectors in this repository and existing ones will slowly be converted into https://github.com/ethereum/execution-spec-tests.
NOTE: Pyspecs doesn't cover all the vectors from this repo, but has many new vectors that are not covered in ethereum/tests
Eventually there will be only ethereum/legacytests repo with all .json tests from Frontier to Cancun.
And ethereum/execution-spec-tests will handle all the official ethereum testing vectors for all the froks.

Announcement

New docker instructions for all t8n supported clients: https://github.com/ethereum/retesteth/tree/develop#docker-instructions
The test process diagram: https://tinyurl.com/y525ezs7
Reminder of a brand new web interface for test debugging: http://retesteth.ethdevops.io/web/
Tests stats on latest builds: http://retesteth.ethdevops.io/
(implement test RPC support or t8ntool protocol to apply for the page. https://ethereum-tests.readthedocs.io/en/latest/t8ntool-ref.html)
Previous release link: https://github.com/ethereum/tests/releases/tag/v15.0

Test format

Tests Fillers

EIPTests folders are deleted
Pyspecs folders are deleted

GeneralStateTests/BlockchainTests Filled

EIPTests folders are deleted
Pyspecs folders are deleted
_info section has fixture-format field of values state_test, blockchain_test
pack all the fixtures separately into tarball

Test Regeneration

Update all:

  • Remove EIP tests support
    PR #1466

  • Remove Pyspec tests support
    PR #1467

  • Documentation

TESTS

  • Pack tests to fixtures tarball
    PR #1469
    PR #1471

  • Move bigint test vectors to a separate folder
    To keep track of it later
    PR #1470

Converted to python Tests

  • Delete converted EOF JUMPF stack overflow tests
    PR #1463

  • delete converted EOF unreachable instructions tests
    PR #1461

  • delete converted EOF RJUMPV tests
    PR #1458

Cosmetic

  • Remove test with empty account from the legacy tests
    PR #1464

  • Fill in fixture-format field in _info section
    PR #1468

Upcoming changes:

Convert .json .yml yo .py

Assets 4
Loading