Skip to content

Optimize current reading#1

Draft
glomdom wants to merge 37 commits intomasterfrom
feat/span-reading
Draft

Optimize current reading#1
glomdom wants to merge 37 commits intomasterfrom
feat/span-reading

Conversation

@glomdom
Copy link
Owner

@glomdom glomdom commented Nov 12, 2025

Optimize reading method to a segmenting approach. Separate const-sized fields into constant segments where we can determine the size of bytes required to read, allowing us to use a single I/O call to read into a buffer, and use Span slicing to assign the fields. For dynamic-sized fields, such as arrays with no provided const size, use a dynamic segment with an ArrayPool of bytes, allowing reuse of the buffer.

@glomdom glomdom added this to the v0.1.0 milestone Nov 12, 2025
@glomdom glomdom self-assigned this Nov 12, 2025
@glomdom glomdom added enhancement New feature or request performance Increases performance labels Nov 12, 2025
@glomdom glomdom marked this pull request as draft November 12, 2025 16:50
@glomdom glomdom linked an issue Nov 12, 2025 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request performance Increases performance

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Segmenting nested reads

1 participant

Comments