Tests not working

[aip-jovanovski]

I built the project successfully, but the tests: arith_loop.json, arith_loop_write_mapping.json, arith_loop_write_storage.json in fuzzing/eth-tests/ aren't working

erc20_mint.json and erc20_transfer.json work, and the result seems correct, but the time is weird:

for the mint:

GPU kernel finished
{"accounts":[{"address": "0x1111111111111111111111111111111111111111", "balance": "0x00000000000000fffffffffffffffffffffffffffffffffffffffffffffbc472", "nonce": 1, "codeHash": "0xc5d2460186f7233c927e7db2dcc703c0e500b653ca82273b7bfad8045d85a470", "storage":{}},{"address": "0xcccccccccccccccccccccccccccccccccccccccc", "balance": "0x0000000000000100000000000000000000000000000000000000000000000000", "nonce": 0, "codeHash": "0x22d07cc0bd7e3d80834ef7fbb801243c27d7fa83a0ade4314d4f760a31256565", "storage":{"0x8eec1c9afb183a84aac7003cf8e730bfb6385f6e43761d6425fba4265de3a9eb": "0x0000000000000000000000000000000000000000000000000000000000000000" ,"0x0000000000000000000000000000000000000000000000000000000000000000": "0x0000000000000000000000000000000000000000000000000000000000000000" }},{"address": "0x0000000000000000000000000000000000c0ffee", "balance": "0x0000000000000000000000000000000000000000000000000000000000000000", "nonce": 0, "codeHash": "0xc5d2460186f7233c927e7db2dcc703c0e500b653ca82273b7bfad8045d85a470", "storage":{}}]}
GPU EVM finished
Main GPU kernel execution took 0.000000 ms
Freeing the memory ...

and transfer:

GPU kernel finished
{"accounts":[{"address": "0x1111111111111111111111111111111111111111", "balance": "0x00000000000000fffffffffffffffffffffffffffffffffffffffffffff58602", "nonce": 1, "codeHash": "0xc5d2460186f7233c927e7db2dcc703c0e500b653ca82273b7bfad8045d85a470", "storage":{}},{"address": "0xcccccccccccccccccccccccccccccccccccccccc", "balance": "0x0000000000000100000000000000000000000000000000000000000000000000", "nonce": 0, "codeHash": "0x22d07cc0bd7e3d80834ef7fbb801243c27d7fa83a0ade4314d4f760a31256565", "storage":{"0x8eec1c9afb183a84aac7003cf8e730bfb6385f6e43761d6425fba4265de3a9eb": "0xfffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffe00" ,"0xcc69885fda6bcc1a4ace058b4a62bf5e179ea78fd58a1ccd71c22cc9b688792f": "0x0000000000000000000000000000000000000000000000000000000000000200" }},{"address": "0x0000000000000000000000000000000000c0ffee", "balance": "0x0000000000000000000000000000000000000000000000000000000000000000", "nonce": 0, "codeHash": "0xc5d2460186f7233c927e7db2dcc703c0e500b653ca82273b7bfad8045d85a470", "storage":{}}]}
GPU EVM finished
Main GPU kernel execution took 0.000000 ms
Freeing the memory ...

[minhhn2910]

Hi @aip-jovanovski , thanks for trying out our project.
The current code is deprecated, especially the fuzzing folder. We have developed V2 with much higher throughput and a new library mode designed to integrate with the Medusa fuzzer. We will release a new version next week. Please come back and try it out soon.

[aip-jovanovski]

Hi @minhhn2910, have to say in advance, love the project.
Any news on when the new release is going to be?

[minhhn2910]

Hi, apologies for the slow response. Due to some internal constraints, we decided to defer the software release by 2 more months. In the meantime, I will answer your questions above according to the existing V1 code:

1. The kernel measurement time is not implemented in the binary mode, so please ignore the printing when you run cuevm_GPU.
2. We have two modes: One with EIP3155 enabled to print trace for correctness testing, and one without it (this applies to the CuEVM V2 that yet to be released). You can toggle the mode by changing the CMAKE flag: -DENABLE_EIP_3155=ON / OFF. The arith_loop.json and some tests inside fuzzing/eth-tests will need a very long time to output the trace (due to printing delay). For testing we recommend you to take a look at the official eth-tests section in our README . If you still want to test those json files, simply use the binary with -DENABLE_EIP_3155=OFF, it will just run the EVM emulator without outputting anything though.
3. You can use the sample in fuzzing folder to test the library mode which also report kernel running time: First compile CuEVM in this mode:

cmake -S . -B build -DTESTS=OFF -DGPU=ON -DCPU=OFF  -DBUILD_LIBRARY=ON -DCUDA_COMPUTE_CAPABILITY=86  -DENABLE_EIP_3155_OPTIONAL=OFF   -DENABLE_EIP_3155=OFF -DENABLE_PAIRING_CODE=OFF 

Then you can run fuzzing/test_library.py:

python test_library.py --input eth-tests/erc20_mint.json --num_instances 1000

Please feel free to continue this thread if you need more clarification.