From 0e14e7f650072178532092ae61eafc766c6bb15e Mon Sep 17 00:00:00 2001 From: Victor Baranov Date: Fri, 30 May 2025 14:40:06 +0300 Subject: [PATCH 1/2] Rename vars for multichain search export --- setup/env-variables/backend-envs-integrations.md | 10 +++++----- setup/env-variables/deprecated-env-variables/README.md | 7 ++++++- 2 files changed, 11 insertions(+), 6 deletions(-) diff --git a/setup/env-variables/backend-envs-integrations.md b/setup/env-variables/backend-envs-integrations.md index 9074e659..ddd12b3e 100644 --- a/setup/env-variables/backend-envs-integrations.md +++ b/setup/env-variables/backend-envs-integrations.md @@ -104,11 +104,11 @@ Multichain Search is the single point of search of the data in the all blockchai | `MICROSERVICE_MULTICHAIN_SEARCH_API_KEY` | Multichain Search Service API key. Implemented in [#11139](https://github.com/blockscout/blockscout/pull/11139) |

Version: v6.10.0+
Default: (empty)
Applications: API, Indexer

| | `MICROSERVICE_MULTICHAIN_SEARCH_ADDRESSES_CHUNK_SIZE` | Chunk size of addresses while exporting to Multichain Search DB. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377) |

Version: v8.1.0+
Default: 7000
Applications: API, Indexer

| | `MIGRATION_BACKFILL_MULTICHAIN_SEARCH_BATCH_SIZE` | Batch size of backfilling Multichain Search Service DB. Implemented in [#11139](https://github.com/blockscout/blockscout/pull/11139) |

Version: v6.10.0+
Default: 10
Applications: Indexer

| -| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_FETCHER` | If `true`, `retry` multichain search export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: false
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_BATCH_SIZE` | Batch size for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 10
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_CONCURRENCY` | Concurrency for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 10
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to `retry` multichain search export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1s
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_MAX_QUEUE_SIZE` | Maximum size of `retry` multichain search export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1000
Applications: Indexer

| +| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_FETCHER` | If `true`, `retry` multichain search export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: false
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_BATCH_SIZE` | Batch size for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1000
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_CONCURRENCY` | Concurrency for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 10
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to `retry` multichain search export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1s
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_MAX_QUEUE_SIZE` | Maximum size of `retry` multichain search export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1000
Applications: Indexer

| ## TAC Operation Lifecycle Service diff --git a/setup/env-variables/deprecated-env-variables/README.md b/setup/env-variables/deprecated-env-variables/README.md index d476b334..cd1e1399 100644 --- a/setup/env-variables/deprecated-env-variables/README.md +++ b/setup/env-variables/deprecated-env-variables/README.md @@ -149,4 +149,9 @@ This table is horizontally scrollable, version information is located in the las | `EXCHANGE_RATES_CRYPTORANK_API_KEY` | | Cryptorank API key. Current implementation uses dedicated beta Cryptorank API endpoint. If you want to integrate Cryptorank price fetching you should contact Cryptorank to receive an API key. Implemented in [#10550](https://github.com/blockscout/blockscout/pull/10550). Replaced with `MARKET_CRYPTORANK_API_KEY` | (empty) | v6.8.0+ | | v8.0.0 | | `EXCHANGE_RATES_CRYPTORANK_COIN_ID` | | Sets Cryptorank coin ID. Implemented in [#10550](https://github.com/blockscout/blockscout/pull/10550). Replaced with `MARKET_CRYPTORANK_COIN_ID` | (empty) | v6.8.0+ | | v8.0.0 | | `CACHE_EXCHANGE_RATES_PERIOD` | | Value to tune the time to live of exchange rates. [Time format](backend-env-variables.md#time-format). Implemented in [#5671](https://github.com/blockscout/blockscout/pull/5671). | `10m` | v4.1.5+ | | v8.0.0 | -| `DISABLE_EXCHANGE_RATES` | | Disables or enables fetching of coin price from Coingecko API. Replaced with `DISABLE_MARKET` | `false` | v3.1.2+ | | v8.0.0 | \ No newline at end of file +| `DISABLE_EXCHANGE_RATES` | | Disables or enables fetching of coin price from Coingecko API. Replaced with `DISABLE_MARKET` | `false` | v3.1.2+ | | v8.0.0 | +| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_FETCHER` | If `true`, `retry` multichain search export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_FETCHER`. |`false` | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_BATCH_SIZE` | Batch size for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_BATCH_SIZE`. | 10 | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_CONCURRENCY` | Concurrency for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_CONCURRENCY`. | 10 | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to `retry` multichain search export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT`. | 1s | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_MAX_QUEUE_SIZE` | Maximum size of `retry` multichain search export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_MAX_QUEUE_SIZE`. | 1000 | v8.1.0+ | | master | \ No newline at end of file From 603d39313cf43dc856adc03e3d14134f26313e72 Mon Sep 17 00:00:00 2001 From: Victor Baranov Date: Wed, 11 Jun 2025 17:00:32 +0300 Subject: [PATCH 2/2] Add variables to manage multichain export balances export queue --- cspell.json | 1 + setup/env-variables/backend-envs-integrations.md | 15 ++++++++++----- .../deprecated-env-variables/README.md | 10 +++++----- 3 files changed, 16 insertions(+), 10 deletions(-) diff --git a/cspell.json b/cspell.json index df75351f..bb7b31c3 100644 --- a/cspell.json +++ b/cspell.json @@ -57,6 +57,7 @@ "Nonfungible", "Noves", "poanetwork", + "recaptcha", "REINDEX", "reindexing", "remasc", diff --git a/setup/env-variables/backend-envs-integrations.md b/setup/env-variables/backend-envs-integrations.md index ddd12b3e..34a0c561 100644 --- a/setup/env-variables/backend-envs-integrations.md +++ b/setup/env-variables/backend-envs-integrations.md @@ -104,11 +104,16 @@ Multichain Search is the single point of search of the data in the all blockchai | `MICROSERVICE_MULTICHAIN_SEARCH_API_KEY` | Multichain Search Service API key. Implemented in [#11139](https://github.com/blockscout/blockscout/pull/11139) |

Version: v6.10.0+
Default: (empty)
Applications: API, Indexer

| | `MICROSERVICE_MULTICHAIN_SEARCH_ADDRESSES_CHUNK_SIZE` | Chunk size of addresses while exporting to Multichain Search DB. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377) |

Version: v8.1.0+
Default: 7000
Applications: API, Indexer

| | `MIGRATION_BACKFILL_MULTICHAIN_SEARCH_BATCH_SIZE` | Batch size of backfilling Multichain Search Service DB. Implemented in [#11139](https://github.com/blockscout/blockscout/pull/11139) |

Version: v6.10.0+
Default: 10
Applications: Indexer

| -| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_FETCHER` | If `true`, `retry` multichain search export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: false
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_BATCH_SIZE` | Batch size for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1000
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_CONCURRENCY` | Concurrency for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 10
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to `retry` multichain search export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1s
Applications: Indexer

| -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_MAX_QUEUE_SIZE` | Maximum size of `retry` multichain search export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: v8.1.0+
Default: 1000
Applications: Indexer

| +| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_FETCHER` | If `true`, multichain DB main (blocks, transactions, addresses) export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: master
Default: false
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_BATCH_SIZE` | Batch size for multichain DB main (blocks, transactions, addresses) export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: master
Default: 1000
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_CONCURRENCY` | Concurrency for multichain DB main (blocks, transactions, addresses) export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: master
Default: 10
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to multichain DB main (blocks, transactions, addresses) export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: master
Default: 1s
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_MAX_QUEUE_SIZE` | Maximum size of multichain DB main (blocks, transactions, addresses) export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). |

Version: master
Default: 1000
Applications: Indexer

| +| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_BALANCES_QUEUE_PROCESSOR_FETCHER` | If `true`, multichain DB balances export fetcher doesn't run. Implemented in [#12580](https://github.com/blockscout/blockscout/pull/12580). |

Version: master
Default: false
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_BALANCES_QUEUE_PROCESSOR_BATCH_SIZE` | Batch size for multichain DB balances export fetcher. Implemented in [#12580](https://github.com/blockscout/blockscout/pull/12580). |

Version: master
Default: 1000
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_BALANCES_QUEUE_PROCESSOR_CONCURRENCY` | Concurrency for multichain DB balances export fetcher. Implemented in [#12580](https://github.com/blockscout/blockscout/pull/12580). |

Version: master
Default: 10
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_BALANCES_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to multichain DB balances export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12580](https://github.com/blockscout/blockscout/pull/12580). |

Version: master
Default: 1s
Applications: Indexer

| +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_BALANCES_QUEUE_PROCESSOR_MAX_QUEUE_SIZE` | Maximum size of multichain DB balances export queue. Implemented in [#12580](https://github.com/blockscout/blockscout/pull/12580). |

Version: master
Default: 1000
Applications: Indexer

| ## TAC Operation Lifecycle Service diff --git a/setup/env-variables/deprecated-env-variables/README.md b/setup/env-variables/deprecated-env-variables/README.md index cd1e1399..0b34e6e0 100644 --- a/setup/env-variables/deprecated-env-variables/README.md +++ b/setup/env-variables/deprecated-env-variables/README.md @@ -150,8 +150,8 @@ This table is horizontally scrollable, version information is located in the las | `EXCHANGE_RATES_CRYPTORANK_COIN_ID` | | Sets Cryptorank coin ID. Implemented in [#10550](https://github.com/blockscout/blockscout/pull/10550). Replaced with `MARKET_CRYPTORANK_COIN_ID` | (empty) | v6.8.0+ | | v8.0.0 | | `CACHE_EXCHANGE_RATES_PERIOD` | | Value to tune the time to live of exchange rates. [Time format](backend-env-variables.md#time-format). Implemented in [#5671](https://github.com/blockscout/blockscout/pull/5671). | `10m` | v4.1.5+ | | v8.0.0 | | `DISABLE_EXCHANGE_RATES` | | Disables or enables fetching of coin price from Coingecko API. Replaced with `DISABLE_MARKET` | `false` | v3.1.2+ | | v8.0.0 | -| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_FETCHER` | If `true`, `retry` multichain search export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_FETCHER`. |`false` | v8.1.0+ | | master | -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_BATCH_SIZE` | Batch size for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_BATCH_SIZE`. | 10 | v8.1.0+ | | master | -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_CONCURRENCY` | Concurrency for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_CONCURRENCY`. | 10 | v8.1.0+ | | master | -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to `retry` multichain search export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT`. | 1s | v8.1.0+ | | master | -| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_MAX_QUEUE_SIZE` | Maximum size of `retry` multichain search export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_QUEUE_PROCESSOR_MAX_QUEUE_SIZE`. | 1000 | v8.1.0+ | | master | \ No newline at end of file +| `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_FETCHER` | If `true`, `retry` multichain search export fetcher doesn't run. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_DISABLE_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_FETCHER`. |`false` | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_BATCH_SIZE` | Batch size for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_BATCH_SIZE`. | 10 | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_CONCURRENCY` | Concurrency for `retry` multichain search export fetcher. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_CONCURRENCY`. | 10 | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_ENQUEUE_BUSY_WAITING_TIMEOUT` | Timeout before new attempt to append item to `retry` multichain search export queue if it's full. [Time format](backend-env-variables.md#time-format). Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_ENQUEUE_BUSY_WAITING_TIMEOUT`. | 1s | v8.1.0+ | | master | +| `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_RETRY_MAX_QUEUE_SIZE` | Maximum size of `retry` multichain search export queue. Implemented in [#12377](https://github.com/blockscout/blockscout/pull/12377). Replaced with `INDEXER_MULTICHAIN_SEARCH_DB_EXPORT_MAIN_QUEUE_PROCESSOR_MAX_QUEUE_SIZE`. | 1000 | v8.1.0+ | | master | \ No newline at end of file