Job status command improvements #38
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…egration Core Features: - Add job_cache.py with LRU eviction (last 5 jobs) and persistence - Cache job_id/run_id pairs on launch, enable parameterless /job-status queries - Fallback to cached run_id when Chuck backend returns UNSET_DATABRICKS_RUN_ID - Parameterless queries auto-enable live Databricks data when cached run_id exists Display Improvements: - Refactor to boxed output format with Unicode borders (┌─┐│└┘) - Add status symbols: ✓ (succeeded), ✗ (failed), ◷ (running/other) - Change "Processing" to "Processed" for completed jobs (SUCCEEDED/FAILED) - Expand box width dynamically to accommodate full Databricks URLs on single line - Fix Databricks section to only show with --live flag (except parameterless queries) - Match Databricks section format to --run-id output (Status, Run ID, Name, Creator, Execution, Tasks, View) - Fix duration calculation to use Chuck timestamps (start-time to end-time) - Preserve full Databricks state object with life_cycle_state and result_state fields Testing: - Add 17 unit tests for caching and fallback functionality - Add 2 tests for dynamic box width and URL display - All 348 tests passing Fixes: - URL wrapping issue where clicking wrapped URLs only opened partial links - Duration now correctly uses Chuck job timestamps instead of Databricks execution time - Databricks section no longer appears without --live flag
Implements a new /jobs command that displays a table of recently launched jobs from the cache (last 5 jobs). The command fetches full job details from the Chuck API and displays them in a formatted markdown table. Features: - List recent jobs with status symbols (✓ Success, ✗ Failed, ◷ Running) - Display job ID, status, record count, and credits - Format record counts with comma separators (e.g., 50,000) - Show total credits used across all listed jobs - Graceful fallback when authentication unavailable (shows job IDs only) - Handle API errors and missing jobs gracefully Implementation: - Added handle_list_jobs() to job_status.py for main command handler - Added _format_jobs_table() for full table formatting with details - Added _format_jobs_table_minimal() for unauthenticated display - Moved list jobs functionality to job_status.py (collocated with Chuck job commands) - Registered LIST_JOBS_DEFINITION in command registry Display behavior: - Missing records show as "-" - Missing credits show as "-" - Total credits line only appears when credits > 0 - Box width dynamically expands for long Databricks URLs (from earlier commits) Testing: - Added 11 comprehensive unit tests covering all scenarios - Tests moved to test_job_status.py alongside implementation - All 359 tests passing
Replace deprecated datetime.utcnow() with timezone-aware datetime.now(timezone.utc) to address Python 3.12+ deprecation warnings. The new format produces ISO 8601 timestamps with explicit UTC indicator (+00:00) and is fully backwards compatible.
pragyan-amp
approved these changes
Oct 31, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Major improvements to Chuck job status tracking and display, including new
/jobscommand, job caching, enhanced status display, and bug fixes.Key Features
/jobscommand: List up to 20 recent cached jobs with status, records, and credit trackingTechnical Changes
Test Coverage
Examples:
Without passing the job-id, fetches the last run chuck job along with databricks run status:
Fetching chuck job status:
Fetching databricks run status:
Job running:
Job running but no chuck telemetry:
Job succeeded:
Job succeeded but no chuck telemetry:
Print recent jobs: