agent_inspect.metrics.adapters package

Submodules

class agent_inspect.metrics.adapters.base_adapter.BaseAdapter[source]

Bases: ABC

Abstract base class for converting external agent trace formats to AgentDialogueTrace format.

abstract convert_to_agent_trace(conversation_data)[source]

Convert external conversation format to AgentDialogueTrace format.

Parameters:: conversation_data (List[Dict[str, Any]]) – List of conversation turns in external format.
Return type:: AgentDialogueTrace
Returns:: Converted agent trace.

class agent_inspect.metrics.adapters.tau2bench_adapter.Tau2BenchAdapter[source]

Adapter for converting tau2bench conversation format to AgentDialogueTrace format.

convert_to_agent_trace(conversation_data)[source]

Convert tau2bench conversation format to AgentDialogueTrace format.

Parameters:: conversation_data (List[Dict[str, Any]]) – List of conversation turns, each containing role-based messages.
Return type:: AgentDialogueTrace
Returns:: Converted agent trace.

class agent_inspect.metrics.adapters.toolsandbox_adapter.ToolsandboxAdapter[source]

Adapter for converting toolsandbox conversation format to AgentDialogueTrace format.

convert_to_agent_trace(conversation_data)[source]

Convert tool_sandbox conversation format to AgentDialogueTrace format.

Parameters:: conversation_data (List[Dict[str, Any]]) – List of conversation turns, each containing role-based messages.
Return type:: AgentDialogueTrace
Returns:: Converted agent trace.

class agent_inspect.metrics.adapters.BaseAdapter[source]

Bases: ABC

Abstract base class for converting external agent trace formats to AgentDialogueTrace format.

abstract convert_to_agent_trace(conversation_data)[source]

Convert external conversation format to AgentDialogueTrace format.

Parameters:: conversation_data (List[Dict[str, Any]]) – List of conversation turns in external format.
Return type:: AgentDialogueTrace
Returns:: Converted agent trace.

class agent_inspect.metrics.adapters.Tau2BenchAdapter[source]

Adapter for converting tau2bench conversation format to AgentDialogueTrace format.

convert_to_agent_trace(conversation_data)[source]

Convert tau2bench conversation format to AgentDialogueTrace format.

Parameters:: conversation_data (List[Dict[str, Any]]) – List of conversation turns, each containing role-based messages.
Return type:: AgentDialogueTrace
Returns:: Converted agent trace.

class agent_inspect.metrics.adapters.ToolsandboxAdapter[source]

Adapter for converting toolsandbox conversation format to AgentDialogueTrace format.

convert_to_agent_trace(conversation_data)[source]

Convert tool_sandbox conversation format to AgentDialogueTrace format.

Parameters:: conversation_data (List[Dict[str, Any]]) – List of conversation turns, each containing role-based messages.
Return type:: AgentDialogueTrace
Returns:: Converted agent trace.