v0.10.2

What's Changed

• chore: fix some comments by @jimmycathy in #1484
• engine: fix bug where in-line selects can be revoked by @brennanjl in #1487
• add readme to engine by @brennanjl in #1486
• Numeric cast by @brennanjl in #1488
• Reenable bridge by @brennanjl in #1483

New Contributors

• @jimmycathy made their first contribution in #1484

Full Changelog: v0.10.1...v0.10.2

v0.10.1

What's Changed

• engine: fix conn busy error by @brennanjl in #1464
• test: multi-key stress tool by @jchappelow in #1467
• engine: fix actions returning many decimals by @brennanjl in #1468
• testing: detect new execution error field in testing framework by @brennanjl in #1469
• add v0.10 release notes, and corresponding repo clean-up (DO NOT SQUASH) by @jchappelow in #1470
• Fix the contention on the DB read accesses by @charithabandi in #1473
• fix poor use of DB getting height for account and numAccounts RPCS by @jchappelow in #1472
• testing: fix error return bug by @brennanjl in #1476
• Transaction size limits for mempool by @charithabandi in #1474
• erc20-bridge: fix ignoring error in nested extension call by @brennanjl in #1479
• client,kwil-cli: skip auth option for query by @jchappelow in #1478
• tx send queue per peer by @jchappelow in #1475
• engine: add greatest, least, nullif by @brennanjl in #1480
• fix(bridge): multiple issues by @Yaiba in #1465
• disable erc20 bridge by @brennanjl in #1482
• prepare v0.10.1 by @jchappelow in #1481

Full Changelog: v0.10.0...v0.10.1

v0.10.0

Kwil v0.10

This is the largest release of Kwil DB to-date. Much of the protocol has been redesigned from the ground up to dramatically improve throughput and scalability.

The highlights are:

• New in-house consensus engine (Roadrunner) prioritizing high throughput and fast transaction finality
• New SQL smart contract language
• New action execution engine using an interpreter in Kwil rather than prepared procedures within PostgreSQL
• A network-wide database owner rather than an open multi-tenant database
• A native ERC20 bridge and rewards system (experimental)
• New peer-to-peer (P2P) layer using libp2p protocols
• New block store
• Removed the kwil-admin tool, merging its functionality with kwild in new sub-commands
• New 'chain' RPC service for querying blockchain data
• OpenTelemetry metrics (experimental)

Contents

• Important Upgrading Notes
• Requirements and Dependencies
• Security Policy
• Notable Features and Changes
  • New consensus engine (Roadrunner)
  • New SQL smart contract language
  • Native ERC20 bridge and reward system
  • New peer-to-peer (P2P) layer using libp2p protocols
  • New block store
  • New 'chain' RPC service for querying blockchain data
• Breaking Changes
• Minor Features and Changes
• Diff summary

Important Upgrading Notes

This release has redesigned most aspects of the Kwil DB node. As such, there are major breaking changes in several areas that require: (a) rewriting database schema definitions into the new SQL language, (b) redeploying new chains, and (c) updating client code for the new SDK APIs and kwil-cli commands.

For information on the new SQL smart contract language, see the Kwil database language documentation.

For the new clients, see both the SDK and CLI documentation.

For node configuration and deployment, see the Kwil DB Node documentation pages. The database schema formats are entirely incompatible both in terms of the schema definition language and the data layout within PostgreSQL. As such, no native migration process is possible at present; the DB owner must repopulate the database via batch insert transactions after genesis.

Requirements and Dependencies

• The minimum required Go version is now 1.23.
• Builds and tests use Go 1.23.
• Supported versions of PostgreSQL are 16.x. The recommended version is 16.8.
• Supported architectures are amd64 and arm64.
• Supported operating systems are linux and darwin.

Security Policy

The supported versions of Kwil are now as follows:

Version	Supported
Latest beta or release candidate	✓
v0.10.x	✓
v0.9.x	✓
< v0.9	❌

See SECURITY.md for details.

Notable Features and Changes

New consensus engine (Roadrunner)

To overcome the throughput limitations and long transaction finality times of the previous consensus engine, a new in-house consensus engine called "Roadrunner" has been developed.

Most notably, Roadrunner is designed for quick block production and validation in a federated network. It involves a "leader" node that is responsible for proposing blocks, and validators that are used to confirm the execution results of the proposed blocks.

For details, see the Roadrunner documentation.

New SQL smart contract language

Kwil's SQL language and execution engine have been redesigned from the ground up to be more flexible and performant.

In terms of the language itself, it now looks and feels more similar to SQL. Kwil database administrators still define tables and actions, but instead of discrete and immutable "schemas", actions and tables can be created and deleted piecemeal.
A "namespace" is used to group related actions and tables.

Whereas deploying a schema previously meant specifying the schema as a whole in a structured format, now the schema is defined implicitly by a set of Kwil SQL statements.

Statement parsing is now part of the Kwil node's execution engine, rather than a client-side operation that previously translated a Kuneiform text file into the structured format before being sent to the node.
As such, deploying (or dropping) a schema is now part of a more general purpose 'raw_statement' transaction payload, where the statements contain various CREATE directives. Such a transaction can contain multiple statements that are executed atomically.

Permissions for what kinds of statements may be executed by a user are dictated by a ROLE, which is a new concept in Kwil. Roles are assigned to users by the database owner, which is itself the special 'owner' role. Various permissions are granted to roles, and users can be assigned to one or more roles.

As before, executing a mutable action uses an 'execute' transaction type, and a read-only action with the view modifier is called with the 'user.call' RPC request rather than a transaction.

This feature was introduced in commit c21d062.

Native ERC20 bridge and reward system

Kwil now has a native ERC20 bridge, allowing protocols to transfer ERC20 tokens to, from, and within a Kwil database. Tokens are deposited into a database by locking them up in an escrow contract. Tokens are released from the escrow contract by a multisig. Each key in the multisig runs a Kwil node to listen to the network and authorize withdrawals from the bridge. Each Kwil network has its own multisig and escrow contract, and thus can choose its own token, threshold, and EVM chain.

See commits: 577a1c9, c812c47, 2a7bdce, 5ba8870, 8891cc7, and 3f95602.

New peer-to-peer (P2P) layer using libp2p protocols

Nodes now communicate with each other using the libp2p protocol stack.

Custom protocols are defined for:

• the new consensus messages used by the Roadrunner consensus mechanism
• retrieval and gossip of block and transaction data
• peer exchange
• snapshot advertisement and retrieval

The protocols are individually versioned, but are considered internal details of the Kwil node implementation, which are not intended for external use.

As a consequence of the new peer-to-peer layer, a new network crawler has been developed to replace the cometseed application. The crawler is usable via the node/peers/seeder package or the kwild seed command.

A new address book format is also defined to support dynamic peer discovery as well as peer filtering.

New block store

The serialization format of block data and outcomes of the consensus process are now defined by Kwil.
Thus, the Kwil node now has a new block store, which is an embedded database containing the raw block data (as opposed to the state DB, which is the role of PostgreSQL).
This is the 'blockstore' directory in the node's root directory.

New 'chain' RPC service for querying blockchain data

To query blockchain data, a 'chain' RPC service (a set of methods in the 'chain' namespace) has been added.
By default this service's methods are available alongside the existing 'user' methods on the node's public RPC server on port 8484.

Breaking Changes

As described above, much of Kwil's core functionality has been redesigned. This translates to a number of breaking changes:

• Kwil's SQL language is new. Previous Kuneiform schemas must be rewritten in the new SQL language. In most cases, this is straightforward and intuitive. Note the new concepts and syntax documented in the SQL language documentation.
• For the new consensus engine, it is now required to designate a network leader in the genesis.json file. See the genesis file documentation for details. The leader is part of the validator set, and the setup testnet command makes the first validator the leader.
• The entire config.toml file has new sections and fields. This is on account of the new consensus engine, p2p layer, block store, mempool, logger, and telemetry. See the config.toml documentation for details.
• The Go SDK and Client types have been updated with new methods to interact with the new DB engine. In particular, there are no longer deploy or drop methods; these are now part of the 'raw_statement' transaction type that is created and broadcast by the ExecuteSQL method.
• An important conceptual change is that regular users are no longer able to deploy schemas. This is now done by the database owner. Users may be assigned to roles that are granted CREATE permissions, but only the DB owner has this permission by default.
• The kwil-admin tool's functionality ha...

v0.10.0 RC1

This is the first release candidate for Kwil v0.10.0.

This github release has been created to distribute the binaries. Changelog and install notes TODO.

v0.9.4

What's Changed

• testing: added log waiting by @brennanjl in #1185
• hoisted pg connection config in testing [v0.9] by @brennanjl in #1192
• [v0.9] remove orderSchemas, update postgres docker image by @jchappelow in #1413

Full Changelog: v0.9.3...v0.9.4

v0.10.0 beta 3

This is a pre-release. The changelog is coming soon.

v0.10.0 beta 2

Release notes pending

v0.10.0-beta-1

Release notes pending

v0.9.3

What's Changed

• fix: deprecated extension config map not set properly by @brennanjl in #1090
• services/jsonrpc: compress middleware by @jchappelow in #1093
• jsonrpc/usersvc: use best block height/time in view call by @jchappelow in #1095
• update cometbft dep for security alert by @jchappelow in #1098
• add all-scalar flag by @brennanjl in #1101
• fix csv parsing issue by @jchappelow in #1108
• version: update self-report tag for vanilla builds by @jchappelow in #1114

Full Changelog: v0.9.2...v0.9.3

v0.9.2

What's Changed

• added max db connections config by @brennanjl in #1069
• pg: recognize streaming prepared tx msg by @brennanjl in #1073
• sql,pg: catch db backend failure by @jchappelow in #1082
• expose TrustPeriod flag for snapshots by @jchappelow in #1083
• engine/generate: fix repeated numbered arg typecast by @brennanjl in #1077

Full Changelog: v0.9.1...v0.9.2