Skip to content

Improve XHand Franka evaluation with configurable session duration#2

Open
Hly-123 wants to merge 10 commits intomainfrom
eval_test
Open

Improve XHand Franka evaluation with configurable session duration#2
Hly-123 wants to merge 10 commits intomainfrom
eval_test

Conversation

@Hly-123
Copy link
Collaborator

@Hly-123 Hly-123 commented Sep 12, 2025

Summary

  • Adds configurable session duration parameter instead of hardcoded 20-second sessions
  • Improves model configuration display showing input modalities (FSR, proprioception)
  • Fixes coordinate reference frame handling during inference
  • Adds comprehensive debugging output for action verification and execution tracking
  • Enhances shell script with countdown and better user experience

Technical Changes

Core Improvements

  • Configurable Session Duration: New --session_duration parameter allows flexible inference session lengths
  • Model Configuration Display: Shows FSR enable status, proprioception skipping, and global condition dimensions
  • Fixed Coordinate Reference: Uses inference start pose as reference frame instead of current frame for relative transforms
  • Action Verification: Comprehensive debug output including action magnitude checking and execution verification

Script Enhancements

  • User Experience: Added countdown timer and better status messages
  • Environment Setup: Proper PYTHONPATH configuration
  • Parameter Display: Shows all configuration parameters before execution

Test Plan

  • Test with vision-only model configuration
  • Verify proper model configuration display
  • Test configurable session duration parameter
  • Validate coordinate reference frame fixes
  • Test with full vision+tactile+proprioception models
  • Verify execution verification warnings work correctly

Impact

This improves the robustness and usability of the XHand Franka evaluation system by making it more configurable and providing better debugging information for troubleshooting inference issues.

🤖 Generated with Claude Code

gray-wei and others added 10 commits September 2, 2025 14:20
- Fix thread-safe camera collection with per-camera locks
- Add pickle-to-zarr conversion for training compatibility
- Add comprehensive data quality check system
- Include interactive visualizer and export tools

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
- Add session_duration parameter to control inference duration
- Add model configuration display with input modality info
- Improve coordinate reference frame handling in inference
- Add comprehensive debug output for action verification
- Update shell script with better user experience and countdown
- Fix proprioception handling based on model config

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants