Skip to content

Repository files navigation

Tithon

Keep a Jupyter kernel alive on a remote host, independent of any client. Close your laptop in the middle of a long run, reopen hours later over SSH or a VSCode tunnel, and the output is still there — and still streaming.

The name is from Tithonus, who was granted immortality but not eternal youth and withered forever without dying. A remote kernel has the same curse: it keeps running, but its output dies the moment the client disconnects. Tithon lifts the curse — immortality, with the eternal youth this time. (And it rhymes with Python.)

Status: alpha. It works and it's in daily use, but you will hit rough edges. Bug reports are genuinely useful — please open an issue.

The problem

You SSH into a GPU box, start a long run in a notebook, and close your laptop. When you come back, depending on your setup:

  • JupyterLab reconnects, but everything printed while you were away is gone. iopub output is streamed over the WebSocket and never persisted server-side, so there is nothing to replay.
  • VSCode Jupyter ties the kernel to the extension-host process. Close the window or drop the network and the kernel dies, taking the session with it.
  • tmux + jupyter console survives the disconnect, but you lose rich output (plots, HTML, widgets) and you can't open the same session from a second client.

The root cause is the same in all three: the source of truth for your session lives on the client, or in a channel that doesn't outlive a disconnect. Tithon moves it to the host.

Tip

And in the age of coding agents, one more: a .ipynb is JSON bloat — the same notebook is ~250 lines of "cell_type"/"outputs" noise that Tithon keeps as ~50 lines of clean .py. Output images? Tithon keeps them as real files, so an agent hands them to the model as actual images it can see — not base64 the model burns thousands of tokens on and still can't read. Don't feed your LLM idiot JSON.

Requirements

  • Python 3.11+ for the daemon and CLI.
  • A Unix-like host — the daemon uses unix domain sockets and setsid (developed and tested on Linux).
  • For the notebook UI, VSCode with the Tithon extension. If the host is remote, connect over a Tunnel or Remote-SSH — the notebook then works exactly as it does locally.

Install

The CLI ships on PyPI:

pip install tithon      # or: uv add tithon

The VSCode extension is on the Marketplace:

code --install-extension rnoro.tithon

or search for "tithon" in the Extensions view. (Marketplace page)

Quickstart (CLI)

State — socket, log, journal, artifacts — lives under TITHON_HOME (default ~/.tithon).

Start the daemon. It runs in the foreground, so background it:

tithon daemon &
tail -f ~/.tithon/daemon.log     # optional

Run some code. Kernel state persists across calls:

tithon run -c 'x = 41'
tithon run -c 'x += 1; print(x)'     # -> 42
tithon status

Now prove the point — kill the daemon, and the kernel lives on:

tithon run -c 'for i in range(3): print("line", i)'

pkill -9 -f 'tithon daemon'          # the daemon dies; the kernel does not
tithon daemon &                      # restart -> re-attaches the same kernel

tithon attach --since 0 --once       # full snapshot: the earlier output is back
tithon run -c 'print(x)'             # -> 42, kernel state intact

VSCode extension

The extension opens a percent-format .py (a plain script with # %% cell markers) as a notebook backed by the daemon — same cells, same Run buttons, same rich output as a Jupyter .ipynb, except the kernel and its output live on the host and survive your disconnects.

  1. Open a .py (it opens as plain text by default) and switch it with Open as Notebook — the CodeLens at the top of the file, or the editor title menu.
  2. Pick the Tithon kernel and run cells as usual.

That's all. Selecting the kernel attaches the session automatically; output is journaled on the host, and when you reopen the notebook later — VSCode remembers the kernel — it is restored and resumes streaming with no command. Over a VSCode Tunnel or Remote-SSH this is identical: the extension host runs on the remote, so it talks to the daemon's host-local socket directly, with no port forwarding. Nothing special for the remote case.

Outputs are matched to cells by content hash, so they survive edits and reopens. An output whose cell was edited after it ran is flagged stale. The .py itself stays pure source — outputs never touch the file, so diffs stay clean.

Note

The daemon and the extension must run on the same host (they share TITHON_HOME, default ~/.tithon). A Tunnel/Remote-SSH satisfies this for free. If you instead run the extension on your laptop against a remote daemon, forward the unix socket yourself (SSH RemoteForward, socat, …).

How it works

A long-lived daemon on the host owns the kernel and serves clients:

Tithon architecture overview: a detached ipykernel connected to the tithon daemon over ZMQ. The daemon journals every message verbatim to SQLite/WAL, folds it into a current-display snapshot plus an ipywidgets state mirror, stores rich outputs as files referenced by hash, and serves VSCode and CLI clients over a 0600 unix socket — no TCP.

  • The kernel runs detached (setsid), so it is not a child of the daemon. The daemon can crash, restart, or be upgraded; the kernel keeps running and re-attaches through a persisted connection file.
  • Every iopub/shell message is journaled verbatim to append-only SQLite (WAL), alongside a per-execution folded snapshot — the current display state — so reconnects are fast.
  • Clients attach with the last sequence number they saw and get a snapshot plus an ordered, gapless delta stream; reconnecting is just resuming the stream.
  • Rich outputs (images) are stored as files and referenced by hash, never base64-embedded, and ipywidgets traffic is folded into a widget-state+json snapshot, so a tqdm bar or a slider comes back at its real value.
  • Backpressure is bounded: per-subscriber buffers are capped, and a client that falls too far behind is dropped and resyncs on reconnect — so one slow client can't grow daemon memory or block the others.
  • The daemon binds a 0600 unix domain socket. No TCP.

The kernel itself is plain ipykernel — Tithon replaces the session-management layer around it, not the execution engine. See docs/SPEC.md for the full design.

CLI reference

Command Description
tithon daemon Run the daemon (foreground). Owns the kernel and serves clients.
tithon run -c CODE Submit code and stream its output. --no-wait prints the exec id and exits; --timeout N bounds the wait.
tithon attach Stream events as NDJSON. --since N sets the resume point; --once exits after the backlog sync; --until-done exits after the next completion.
tithon status Print session, queue, kernel, and widget-model status.

attach --since is the reconnect knob:

  • --since 0 — full folded snapshot, then live delta.
  • --since N — replay only events after seq N, then a sync marker, then live.
  • --since -1 — live only, ignore history.

Configuration

Environment variables read by the daemon and CLI:

Variable Default Purpose
TITHON_HOME ~/.tithon Root for the socket, log, journal, and artifacts.
TITHON_SUB_QUEUE_MAX 10000 Max queued events per client before it is dropped (backpressure).
TITHON_SEND_TIMEOUT 10.0 Seconds a client may stall a send before being dropped.
TITHON_WRITE_BUFFER_HIGH 1048576 Per-connection send-buffer high-water mark (bounds daemon memory).
TITHON_SOCK_SNDBUF 1048576 Per-connection kernel socket send buffer.
TITHON_SUB_POLL 0.5 Interval at which a blocked sender re-checks for drop.

Outputs live in $TITHON_HOME/sessions/<session>/journal.db (raw messages plus folded snapshots), with rich outputs written as files under <workdir>/.tithon/outputs/ and referenced from the journal.

License

MIT.

About

Tithon - The immortal Python REPL notebook that will set you free

Topics

Resources

Stars

Watchers

Forks

Releases

Contributors

Languages