soev-inspectReference
Commands
soev-inspect: list, export and inspect the threads of a trace store, in the browser or as text.
A store is a trace file, a directory of trace files, a SQLite file (.db) or a Postgres trace store
(postgresql://…?schema=NAME). An inspect command replays each model call with the agents --agents names, in
this process: the code in this environment builds the requests.
soev-inspect
soev-inspect [-h] {serve,list,export,export-call,outline,call,message,diff,search} ...soev-inspect serve
List and show threads in the browser
soev-inspect serve [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL]
[--port PORT] [--no-browser] [--reload]
[source] [thread_id]| Argument | Default | Description |
|---|---|---|
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
source | the first source; more can be added in the page | |
thread_id | the thread to open first | |
--port | 0 | 0 picks a free port |
--no-browser | do not open the page in a browser | |
--reload | restart when a Python file under this directory changes |
soev-inspect list
The source's threads, newest first
soev-inspect list [-h] [--agent AGENT] [--limit LIMIT] [--before BEFORE] [--json] source| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agent | only the threads of this agent | |
--limit | 50 | threads per page |
--before | the last thread id of the previous page | |
--json | print the page as JSON |
soev-inspect export
Copy threads into a directory or a store
soev-inspect export [-h] [--agent AGENT] [--limit LIMIT] source target [thread_ids ...]| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agent | only the threads of this agent | |
--limit | 50 | threads per page |
target | required | a directory of trace files, a .db file or a postgresql:// URI |
thread_ids | the threads to copy; every listed thread when left out |
soev-inspect export-call
One call's request as built, as a JSON file that probe run --recorded replays
soev-inspect export-call [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL]
source [thread_id] call target| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
thread_id | may be left out when the source holds one thread | |
call | required | |
target | required | the JSON file to write |
soev-inspect outline
Every event, numbered, with the model calls marked
soev-inspect outline [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL] [--json]
source [thread_id]| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
thread_id | leave it out when the source holds one thread | |
--json | print the same content as JSON |
soev-inspect call
One call's messages and tools, each with its size
soev-inspect call [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL] [--json]
source [thread_id] call| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
thread_id | leave it out when the source holds one thread | |
--json | print the same content as JSON | |
call | required | the number of the call, as outline shows it |
soev-inspect message
One message of one call in full
soev-inspect message [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL] [--json]
[--sent] [--lines LINES]
source [thread_id] call message| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
thread_id | leave it out when the source holds one thread | |
--json | print the same content as JSON | |
call | required | the number of the call, as outline shows it |
message | required | the number of the message, as call shows it |
--sent | as the inference client would send it | |
--lines | A:B, a range of lines counted from 1 |
soev-inspect diff
What changed since the previous call
soev-inspect diff [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL] [--json]
source [thread_id] call| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
thread_id | leave it out when the source holds one thread | |
--json | print the same content as JSON | |
call | required | the number of the call, as outline shows it |
soev-inspect search
Where text occurs in the events and messages
soev-inspect search [-h] --agents AGENTS [--resources RESOURCES] [--model MODEL] [--json]
source [thread_id] text| Argument | Default | Description |
|---|---|---|
source | required | a trace file or directory, a .db file or a postgresql:// URI |
--agents | required | module:NAME of a mapping from each agent name to its Agent, for example myapp.agents:AGENTS. The module is imported from the current directory. |
--resources | module:NAME of a function that takes an agent and returns its resources for a replay (soev_inspect.OfflineResources) | |
--model | rebuild every turn as if its input had named this model | |
thread_id | leave it out when the source holds one thread | |
--json | print the same content as JSON | |
text | required | the text to find |