Skip to content

Conversation

@techno-anthropology
Copy link

Add timeout parameter to run_experiment and async task execution to allow
users to configure task timeouts beyond the default 120 seconds.

Changes:

  • Add timeout parameter to AsyncExecutor with default value of 120 seconds
  • Expose timeout parameter in get_executor_on_sync_context function
  • Add timeout parameter to run_experiment and evaluate_experiment functions
  • Expose timeout in public API via ArizeDatasetsClient.run_experiment method
  • Add test_timeout_parameter to verify timeout functionality
  • Update all docstrings to document the new timeout parameter

The timeout parameter is now configurable at all levels while maintaining
backward compatibility with existing code. Users can specify custom timeout
values for long-running tasks and evaluators when calling run_experiment().

Fixes issue where users could not configure timeout for async tasks that
require more than 120 seconds to complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feature Request: Expose configurable timeout parameter for experiment task execution in run_experiment

2 participants