Commands cheat sheet

High-frequency entry points — full detail lives in Usage

Reference

High-frequency CLI entry points. Full flag semantics and recipes live in Usage.

NoteCanonical reference

This page is a quick map. Flag semantics, flags, and recipes: Usage.

Environment

pip install -e ".[dev]"
python scripts/setup_env.py
python scripts/setup_env.py --status

DICIE (src/docie)

# one-shot text demo
python -m src.docie \
  --application salvage_claims \
  --text "LETTER OF GUARANTEE ..." \
  --response-only

# batch JSONL
python -m src.docie \
  --application medical_bills \
  --in data/eval/docie_eval_set.jsonl \
  --out-dir data/pipeline/docie_run

# optional REST surface
python -m src.docie.serve

Guides: DICIE Pipeline · Notebook

Memo chain (src/pipeline)

python -m src.pipeline.orchestrator \
  --in data/synthetic/documents/documents.jsonl \
  --out data/pipeline/analysis.jsonl \
  --vision

python -m src.pipeline.orchestrator --pdf claim.pdf --vision
python -m src.pipeline.batch_runner \
  --in data/synthetic/documents/documents.jsonl \
  --out-dir data/pipeline/batch_run \
  --vision

Guides: Architecture · Notebook

Sample corpus (src/storage)

python -m src.storage seed --seed 42 --also-export
python -m src.storage stats
python -m src.storage export-docie --application salvage_claims \
  --out data/sample_corpus/exports/salvage.jsonl

Guides: Sample Document Corpus · Walkthrough · SQL · Train/test

RVL-CDIP SQL (src/rvl_cdip)

python -m src.rvl_cdip build          # labels → .venv SQLite (~17 MB download)
python -m src.rvl_cdip summary
python -m src.rvl_cdip list --split train --label invoice --limit 5
python -m src.rvl_cdip query "SELECT split, COUNT(*) AS n FROM documents GROUP BY split"
# python -m src.rvl_cdip download-images --preflight
# python -m src.rvl_cdip download-images \
#   --i-understand-large-download --confirm-writes-under-venv   # ~38 GB → .venv only

Guide: RVL-CDIP SQL Index · OpenRouter eval notebook

Classification & extraction (training)

python -m src.classification.prepare_dataset \
  --in data/synthetic/documents/documents_from_skeletons_n240_seed42.jsonl
python -m src.classification.train_classifier \
  --prepared data/synthetic/documents/classification_prepared --smoke
python -m src.classification.eval \
  --model-dir models/classifier_smoke \
  --prepared data/synthetic/documents/classification_prepared

Classical baseline notebook: Random Forest

Discord bot

pip install -e ".[discord]"
python -m src.discord_bot

Documentation site

./scripts/preview_docs_site.sh          # local Quarto preview
./scripts/publish_docs_site.sh          # Posit Connect Cloud

See also

Quick Start · Usage · Pipeline hub · How-to: Quarto site

Back to top