Hello first of all thanks for your great project.
Why is update_cache commented out? Without it, doesn't this mean there's no token-wise caching for the single_stream blocks? Essentially, only the last line of this code block is actually effective, and all the preceding computations are unused.
Hello first of all thanks for your great project.
Why is update_cache commented out? Without it, doesn't this mean there's no token-wise caching for the single_stream blocks? Essentially, only the last line of this code block is actually effective, and all the preceding computations are unused.