Add /monitor-job command and optimize /jobs with smart caching #39
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pragyan-amp
reviewed
Nov 3, 2025
pragyan-amp
reviewed
Nov 3, 2025
chuck_data/commands/monitor_job.py
Outdated
| message += f"\nCredits: {credits}" | ||
| return CommandResult(True, message=message, data=job_data) | ||
|
|
||
| if normalized_state in ["failed", "error"]: |
Contributor
There was a problem hiding this comment.
The backend can return :unauthorized we should have if normalized_state in ["failed", "error", "unauthorized"]:
pragyan-amp
reviewed
Nov 3, 2025
pragyan-amp
reviewed
Nov 3, 2025
pragyan-amp
reviewed
Nov 3, 2025
pragyan-amp
approved these changes
Nov 3, 2025
Contributor
pragyan-amp
left a comment
pragyan-amp
left a comment
There was a problem hiding this comment.
Overall it looks great.. I have added my comments... Most critical one being adding support to escape them monitoring command when it is running... rest are just small things... Approving it to merge.. 
punit-naik-amp
force-pushed
the
CHUCK-3-continuously-monitor-stitch-job
branch
from
9de6d12 to
04beb50
Compare
- Add `/monitor-job` command for real-time job monitoring - Monitors Chuck jobs until completion with live progress updates - Shows elapsed time, record count, and credits upon completion - Calculates elapsed time from actual job start (not monitoring start) - Supports monitoring via --job-id or --run-id - Falls back to last cached job if no parameters provided - Default 30-second poll interval, 30-minute timeout - Implement smart caching for job status data - Terminal state jobs (succeeded, failed, error, unknown) served from cache - Reduces API calls from 16 to 0 for fully cached jobs - Execution time drops from ~7s to <0.1s on subsequent runs - Cache UNKNOWN state for 404/error responses to prevent retry loops - Add diagnostic logging (cache hits/misses, timing metrics) - Add "Started" date column (format: YYYY-Mon-DD HH:MM) - Sort jobs by date in descending order (most recent first) - Implement timezone-aware datetime handling for proper sorting - Display total credits used across all jobs - Extend job_cache.py to store full job data (state, records, credits, timestamps) - Add cache_job() calls for terminal states in handle_list_jobs - Remove unnecessary cached_at field (use job's own timestamps) - Add 7 comprehensive tests for /jobs caching behavior - Cache hits for terminal states - Fresh data fetching for running jobs - UNKNOWN state caching on 404/errors - Mixed cache/fetch scenarios - All 71 job status tests pass - All 8 job cache tests pass Improves developer experience with faster job listing and real-time monitoring
punit-naik-amp
force-pushed
the
CHUCK-3-continuously-monitor-stitch-job
branch
from
04beb50 to
e1864cc
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add
/monitor-jobcommand for real-time job monitoringImplement smart caching for job status data
Cache UNKNOWN state for 404/error responses to prevent retry loops
Add diagnostic logging (cache hits/misses, timing metrics)
Add "Started" date column (format: YYYY-Mon-DD HH:MM)
Sort jobs by date in descending order (most recent first)
Implement timezone-aware datetime handling for proper sorting
Display total credits used across all jobs
Extend job_cache.py to store full job data (state, records, credits, timestamps)
Add cache_job() calls for terminal states in handle_list_jobs
Remove unnecessary cached_at field (use job's own timestamps)
Add 7 comprehensive tests for /jobs caching behavior
All 71 job status tests pass
All 8 job cache tests pass
Usage:
Improves developer experience with faster job listing and real-time monitoring