Preflight (cost estimate)
Before any LLM call, every translate / pipeline job estimates tokens and cost, shows what will not be translated (coverage) and, by default, waits for the user to confirm. Code: src/main/preflight/ and the preflight job step.
probe → extract → preflight ──► decision ├─ auto-confirmed ─────────► translate → … └─ needs-confirmation ─► awaiting-confirmation (slot released) jobs:confirm / batches:confirm ─► queued ─► translate → … jobs:cancel ─► cancelledHow the estimate is computed (estimate.ts)
It simulates the real requests with the same production code: Job Memory lookup in peek mode (does not touch last_used_at, so a cancelled preflight never keeps stale entries alive), planLanes over the misses (representatives only: lines.copies counts the lines filled from another one with the same context hash, which cost no request or token) with the same llm.concurrency.perJob (each lane simulated with only the cache and its own translations, as in the parallel run), buildContext, the real System Prompt (glossary included) and translate messages, and the strict JSON Schema when the model uses structured outputs. Translations not known yet are filled in the context with the source text (similar length). Deterministic.
- Input tokens: per chunk,
countMessageTokens([system, user])(+4 per message, +3 reply priming) + the JSON Schema. - Output tokens: target payload tokens × 1.2 + 8 per line (JSON keys/quotes).
- Range:
high = base × 1.15(repairs and retries). The provider’s prompt-cache discount is not subtracted (conservative). - Tokenizer (
token-counter.ts):js-tiktokeno200k_base(pure JS, lazily loaded). Exact only for models whosearchitecture.tokenizerisGPT; for every other family the result isapproximate: trueand the range widens tolow × 0.8 … base × 1.15 × 1.2. - Cost: tokens ×
pricingfrom the model catalog (USD per token, refreshed when older than 24 h).pricing: null(dynamic price) →cost: null; auto-confirm never applies then. The estimate records the price used and the catalog date.
Decision
| Condition | Decision |
|---|---|
confirmBeforeTranslate: false (job option, default true) |
auto-confirmed |
setting preflight.autoConfirmBelowUsd set and cost.high below it (per job) |
auto-confirmed |
| otherwise | needs-confirmation |
A job whose lines are all in the cache still stops for review (unless the threshold applies): the screen says nothing will be sent to the AI and shows the coverage.
jobs:confirm sets it to confirmed and re-queues the job; the runner resumes at translate from the stored artifacts (no re-extraction, no new estimate). awaiting-confirmation is not running: it frees the queue slot and survives an app restart unchanged.
Results
job.result.preflight:PreflightEstimate(model and price,approximate, lines total/cached/to translate/chunks, input/output token ranges, cost range, decision). Small enough forjobs:list.jobs:preflight(id): the estimate plus the fullCoverageReport(what will not be translated, where and why; capped at 500 entries) andprompt: PromptSummary.PromptSummary(src/main/jobs/steps/prompt-summary.ts): the exact system prompt thetranslatestep will send (samebuildSystemPromptand inputs, so it is deterministic), its o200k token count, and which blocks went in: glossary entries, preset style, TMDB details, episode synopsis, user notes, plusmedia.unavailablewhen the user chose TMDB context that could not be fetched. Stored inartifacts.preflight.prompt; absent on jobs created before it existed. The job detail shows it both in the review and after the job ends.- Batches:
Batch.preflightsums the jobs waiting for confirmation (awaiting,toTranslate,cost—nullif any job has a dynamic price — andapproximate);batches:confirmconfirms them all.