mirror of
https://github.com/openai/codex.git
synced 2026-04-28 00:25:56 +00:00
## Summary - Add an explicit stdin mode to process/start. - Keep normal non-interactive exec stdin closed while allowing pipe-backed processes. ## Stack ```text o #18027 [8/8] Fail exec client operations after disconnect │ o #18025 [7/8] Cover MCP stdio tests with executor placement │ o #18089 [6/8] Wire remote MCP stdio through executor │ o #18088 [5/8] Add executor process transport for MCP stdio │ o #18087 [4/8] Abstract MCP stdio server launching │ o #18020 [3/8] Add pushed exec process events │ @ #18086 [2/8] Support piped stdin in exec process API │ o #18085 [1/8] Add MCP server environment config │ o main ``` Co-authored-by: Codex <noreply@openai.com>
350 lines
7.1 KiB
Markdown
350 lines
7.1 KiB
Markdown
# codex-exec-server
|
|
|
|
`codex-exec-server` is the library backing `codex exec-server`, a small
|
|
JSON-RPC server for spawning and controlling subprocesses through
|
|
`codex-utils-pty`.
|
|
|
|
It provides:
|
|
|
|
- a CLI entrypoint: `codex exec-server`
|
|
- a Rust client: `ExecServerClient`
|
|
- a small protocol module with shared request/response types
|
|
|
|
This crate owns the transport, protocol, and filesystem/process handlers. The
|
|
top-level `codex` binary owns hidden helper dispatch for sandboxed
|
|
filesystem operations and `codex-linux-sandbox`.
|
|
|
|
## Transport
|
|
|
|
The server speaks the shared `codex-app-server-protocol` message envelope on
|
|
the wire.
|
|
|
|
The CLI entrypoint supports:
|
|
|
|
- `ws://IP:PORT` (default)
|
|
|
|
Wire framing:
|
|
|
|
- websocket: one JSON-RPC message per websocket text frame
|
|
|
|
## Lifecycle
|
|
|
|
Each connection follows this sequence:
|
|
|
|
1. Send `initialize`.
|
|
2. Wait for the `initialize` response.
|
|
3. Send `initialized`.
|
|
4. Call process or filesystem RPCs.
|
|
|
|
If the server receives any notification other than `initialized`, it replies
|
|
with an error using request id `-1`.
|
|
|
|
If the websocket connection closes, the server terminates any remaining managed
|
|
processes for that client connection.
|
|
|
|
## API
|
|
|
|
### `initialize`
|
|
|
|
Initial handshake request.
|
|
|
|
Request params:
|
|
|
|
```json
|
|
{
|
|
"clientName": "my-client"
|
|
}
|
|
```
|
|
|
|
Response:
|
|
|
|
```json
|
|
{}
|
|
```
|
|
|
|
### `initialized`
|
|
|
|
Handshake acknowledgement notification sent by the client after a successful
|
|
`initialize` response.
|
|
|
|
Params are currently ignored. Sending any other notification method is treated
|
|
as an invalid request.
|
|
|
|
### `process/start`
|
|
|
|
Starts a new managed process.
|
|
|
|
Request params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1",
|
|
"argv": ["bash", "-lc", "printf 'hello\\n'"],
|
|
"cwd": "/absolute/working/directory",
|
|
"env": {
|
|
"PATH": "/usr/bin:/bin"
|
|
},
|
|
"tty": true,
|
|
"pipeStdin": false,
|
|
"arg0": null
|
|
}
|
|
```
|
|
|
|
Field definitions:
|
|
|
|
- `processId`: caller-chosen stable id for this process within the connection.
|
|
- `argv`: command vector. It must be non-empty.
|
|
- `cwd`: absolute working directory used for the child process.
|
|
- `env`: environment variables passed to the child process.
|
|
- `tty`: when `true`, spawn a PTY-backed interactive process.
|
|
- `pipeStdin`: when `true`, keep non-PTY stdin writable via `process/write`.
|
|
- `arg0`: optional argv0 override forwarded to `codex-utils-pty`.
|
|
|
|
Response:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1"
|
|
}
|
|
```
|
|
|
|
Behavior notes:
|
|
|
|
- Reusing an existing `processId` is rejected.
|
|
- PTY-backed processes accept later writes through `process/write`.
|
|
- Non-PTY processes reject writes unless `pipeStdin` is `true`.
|
|
- Output is streamed asynchronously via `process/output`.
|
|
- Exit is reported asynchronously via `process/exited`.
|
|
|
|
### `process/read`
|
|
|
|
Reads buffered output and terminal state for a managed process.
|
|
|
|
Request params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1",
|
|
"afterSeq": null,
|
|
"maxBytes": 65536,
|
|
"waitMs": 1000
|
|
}
|
|
```
|
|
|
|
Field definitions:
|
|
|
|
- `processId`: managed process id returned by `process/start`.
|
|
- `afterSeq`: optional sequence number cursor; when present, only newer chunks
|
|
are returned.
|
|
- `maxBytes`: optional response byte budget.
|
|
- `waitMs`: optional long-poll timeout in milliseconds.
|
|
|
|
Response:
|
|
|
|
```json
|
|
{
|
|
"chunks": [],
|
|
"nextSeq": 1,
|
|
"exited": false,
|
|
"exitCode": null,
|
|
"closed": false,
|
|
"failure": null
|
|
}
|
|
```
|
|
|
|
### `process/write`
|
|
|
|
Writes raw bytes to a running process stdin.
|
|
|
|
Request params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1",
|
|
"chunk": "aGVsbG8K"
|
|
}
|
|
```
|
|
|
|
`chunk` is base64-encoded raw bytes. In the example above it is `hello\n`.
|
|
|
|
Response:
|
|
|
|
```json
|
|
{
|
|
"status": "accepted"
|
|
}
|
|
```
|
|
|
|
Behavior notes:
|
|
|
|
- Writes to an unknown `processId` are rejected.
|
|
- Writes to a non-PTY process are rejected unless it started with `pipeStdin`.
|
|
|
|
### `process/terminate`
|
|
|
|
Terminates a running managed process.
|
|
|
|
Request params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1"
|
|
}
|
|
```
|
|
|
|
Response:
|
|
|
|
```json
|
|
{
|
|
"running": true
|
|
}
|
|
```
|
|
|
|
If the process is already unknown or already removed, the server responds with:
|
|
|
|
```json
|
|
{
|
|
"running": false
|
|
}
|
|
```
|
|
|
|
## Notifications
|
|
|
|
### `process/output`
|
|
|
|
Streaming output chunk from a running process.
|
|
|
|
Params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1",
|
|
"seq": 1,
|
|
"stream": "stdout",
|
|
"chunk": "aGVsbG8K"
|
|
}
|
|
```
|
|
|
|
Fields:
|
|
|
|
- `processId`: process identifier
|
|
- `seq`: per-process output sequence number
|
|
- `stream`: `"stdout"`, `"stderr"`, or `"pty"`
|
|
- `chunk`: base64-encoded output bytes
|
|
|
|
### `process/exited`
|
|
|
|
Final process exit notification.
|
|
|
|
Params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1",
|
|
"seq": 2,
|
|
"exitCode": 0
|
|
}
|
|
```
|
|
|
|
### `process/closed`
|
|
|
|
Notification emitted after process output is closed and the process handle is
|
|
removed.
|
|
|
|
Params:
|
|
|
|
```json
|
|
{
|
|
"processId": "proc-1"
|
|
}
|
|
```
|
|
|
|
## Filesystem RPCs
|
|
|
|
Filesystem methods use absolute paths and return JSON-RPC errors for invalid
|
|
or unavailable paths:
|
|
|
|
- `fs/readFile`
|
|
- `fs/writeFile`
|
|
- `fs/createDirectory`
|
|
- `fs/getMetadata`
|
|
- `fs/readDirectory`
|
|
- `fs/remove`
|
|
- `fs/copy`
|
|
|
|
Each filesystem request accepts an optional `sandbox` object. When `sandbox`
|
|
contains a `ReadOnly` or `WorkspaceWrite` policy, the operation runs in a
|
|
hidden helper process launched from the top-level `codex` executable and
|
|
prepared through the shared sandbox transform path. Helper requests and
|
|
responses are passed over stdin/stdout.
|
|
|
|
## Errors
|
|
|
|
The server returns JSON-RPC errors with these codes:
|
|
|
|
- `-32600`: invalid request
|
|
- `-32602`: invalid params
|
|
- `-32603`: internal error
|
|
|
|
Typical error cases:
|
|
|
|
- unknown method
|
|
- malformed params
|
|
- empty `argv`
|
|
- duplicate `processId`
|
|
- writes to unknown processes
|
|
- writes to non-PTY processes
|
|
- sandbox-denied filesystem operations
|
|
|
|
## Rust surface
|
|
|
|
The crate exports:
|
|
|
|
- `ExecServerClient`
|
|
- `ExecServerError`
|
|
- `ExecServerClientConnectOptions`
|
|
- `RemoteExecServerConnectArgs`
|
|
- protocol request/response structs for process and filesystem RPCs
|
|
- `DEFAULT_LISTEN_URL` and `ExecServerListenUrlParseError`
|
|
- `ExecServerRuntimePaths`
|
|
- `run_main()` for embedding the websocket server
|
|
|
|
Callers must pass `ExecServerRuntimePaths` to `run_main()`. The top-level
|
|
`codex exec-server` command builds these paths from the `codex` arg0 dispatch
|
|
state.
|
|
|
|
## Example session
|
|
|
|
Initialize:
|
|
|
|
```json
|
|
{"id":1,"method":"initialize","params":{"clientName":"example-client"}}
|
|
{"id":1,"result":{}}
|
|
{"method":"initialized","params":{}}
|
|
```
|
|
|
|
Start a process:
|
|
|
|
```json
|
|
{"id":2,"method":"process/start","params":{"processId":"proc-1","argv":["bash","-lc","printf 'ready\\n'; while IFS= read -r line; do printf 'echo:%s\\n' \"$line\"; done"],"cwd":"/tmp","env":{"PATH":"/usr/bin:/bin"},"tty":true,"pipeStdin":false,"arg0":null}}
|
|
{"id":2,"result":{"processId":"proc-1"}}
|
|
{"method":"process/output","params":{"processId":"proc-1","seq":1,"stream":"stdout","chunk":"cmVhZHkK"}}
|
|
```
|
|
|
|
Write to the process:
|
|
|
|
```json
|
|
{"id":3,"method":"process/write","params":{"processId":"proc-1","chunk":"aGVsbG8K"}}
|
|
{"id":3,"result":{"status":"accepted"}}
|
|
{"method":"process/output","params":{"processId":"proc-1","seq":2,"stream":"stdout","chunk":"ZWNobzpoZWxsbwo="}}
|
|
```
|
|
|
|
Terminate it:
|
|
|
|
```json
|
|
{"id":4,"method":"process/terminate","params":{"processId":"proc-1"}}
|
|
{"id":4,"result":{"running":true}}
|
|
{"method":"process/exited","params":{"processId":"proc-1","seq":3,"exitCode":0}}
|
|
{"method":"process/closed","params":{"processId":"proc-1"}}
|
|
```
|