SessionRunner#

Module: agent_framework_evaluator.runtime.session_runner

class agent_framework_evaluator.runtime.session_runner.SessionRunner(env_path, *, host_factory=None)[source]#

Bases: object

Parameters:

  • env_path (str | Path)

  • host_factory (HostFactory | None)

run_once(*, agent_id, prompt, setup_path=None, user_comm=None, runtime_tracer=None, session_id=None, on_first_llm_call=None, agent_model_override=None, agent_model_override_scope='root_only')[source]#
Parameters:

  • agent_id (str)

  • prompt (str)

  • setup_path (Path | None)

  • user_comm (Any | None)

  • runtime_tracer (Any | None)

  • session_id (str | None)

  • on_first_llm_call (Callable[[Any], None] | None)

  • agent_model_override (str | tuple[str, ...] | None)

  • agent_model_override_scope (str)

Return type:

dict[str, object]

suite_teardown_if_any()[source]#

Invoke suite_teardown on the last loaded setup module, if present.

Return type:

None