Skip to content

feat: streaming Copilot responses with caching#26

Merged
aslaker merged 3 commits intomainfrom
aslaker/copilot-speed-boost
Jan 22, 2026
Merged

feat: streaming Copilot responses with caching#26
aslaker merged 3 commits intomainfrom
aslaker/copilot-speed-boost

Conversation

@aslaker
Copy link
Owner

@aslaker aslaker commented Jan 21, 2026

Summary

Implements progressive streaming responses for the Copilot feature with performance optimizations. Users now see AI responses appear incrementally as tokens arrive. Added smart caching for ISS position data (60s TTL) and TLE orbital elements (24h TTL) to reduce API latency.

Key Changes

  • Server-side streaming via async generators for real-time response display
  • ISS position and TLE data caching to avoid redundant external API calls
  • Improved UX: lazy message creation on first chunk, "Thinking..." placeholder
  • All changes tested locally and builds successfully

🤖 Generated with Claude Code

aslaker and others added 3 commits January 21, 2026 13:14
…tions

- Add server-side streaming via async generators for progressive AI responses
- Implement ISS position caching (60s TTL) to avoid redundant API calls
- Implement TLE data caching (24h TTL) for orbital element calculations
- Add streaming message handling with lazy creation on first chunk
- Improve UX: "Thinking..." placeholder replaces empty timestamp display
- Messages now created only when first content chunk arrives

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
- Sort imports alphabetically in agent.ts
- Replace non-null assertions with optional chaining in agent.test.ts

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Add explicit null checks after toBeDefined() assertions to satisfy
TypeScript's type narrowing while avoiding non-null assertions that
biome flags.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@aslaker aslaker merged commit c270399 into main Jan 22, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant