Skip to Content

Process Jobs

Processing is always a server job. The browser posts config_id to POST /process and polls /jobs.

Start a job

From Configurations:

  1. Run on the card (or table row).
  2. Confirm Run Analytic Job (or Interactions / Personality / Financial).
  3. You land on Jobs. A toast appears if the job fails.

From Jobs: pick a configuration and create a job (optional LLM interpretation override).

Only one active job per configuration: queued or running locks that config’s editor.

Pipeline steps

LangGraph (EcosystemDataWorkflow) walks:

StepLabel in UI
queuedQueued
initializationInitializing
data_extractionMongo or Trino extract
data_preparationClean, types, quality
data_analysisMain analysis (Analytic)
categorical_analysisCategorical
actuarial_analysisActuarial
time_series_analysisTime series
feature_engineeringFeature engineering
ml_analysisMachine learning
recommender_analysisInteractions
personality_analysisPersonality
financial_analysisFinancial
results_persistenceSaving results
completed / failed / cancelledTerminal

A failed family should not always abort the rest; remaining enabled modules can still write reports. Watch Jobs and the sidebar Running Jobs list.

Optional --sample-size / config sample limits cap documents for trials. Unlimited Mongo/Trino scans use disk partitions; Trino still does not write analysis collections.

Monitor

  • Sidebar: running jobs (elapsed) and last four completed
  • Jobs table: status, duration, sample size, report badges
  • /jobs/:jobId/logs — step and log level
  • Force-stop a stuck run; delete can remove artifacts (confirm in the modal)

Analytics (/analytics) is ops: job counts and success rate over 1–90 days — not ARPU or personality mix.

After completion

ActionWhere
Interactive chartsAnalysis Insights /analysis/:jobId (consolidated JSON)
Full artifact listReports (one docs page per report type)
Domain UIInteractions / Personality / Financial / Time Series pages (latest completed job for that config)
Eye on a config cardOpens the domain page if a completed job exists

Artifacts land under backend/reports/<YYYY-MM-DD_HHMMSS>/ including config_parameters.json (secrets masked) for reproducibility.

Last updated on