chore: merge executor worktree (worktree-agent-a2bb09637c4029677)

This commit is contained in:
lorentz 2026-07-10 17:36:09 -04:00
commit 4a6f3e496a
2 changed files with 270 additions and 0 deletions

View file

@ -0,0 +1,100 @@
---
phase: 10-pax8-client-auth-foundation
plan: 02
subsystem: database
tags: [postgres, migration, pax8, schema]
# Dependency graph
requires:
- phase: 10-pax8-client-auth-foundation (plan 01)
provides: PAX8 OAuth2 client/factory foundation (companion plan in same wave)
provides:
- "migrations/091_pax8_tables.sql — six pax8_* tables ready for Phase 11+ sync services to populate"
- "pax8_company_match_review conflicts queue shape, ready for Phase 12's matching logic to write into"
affects: [11-pax8-current-state-sync, 12-pax8-historical-sync-company-matching, 13-pax8-scheduler-admin-toggle, 14-pax8-ui]
# Tech tracking
tech-stack:
added: []
patterns:
- "PAX8 entity tables follow the appgate_* audit-column shape: raw_payload JSONB + synced_at + is_deleted + deleted_at + idx_<table>_is_deleted"
- "Header/line-item FK: pax8_order_items.order_id is a hard FK (ON DELETE CASCADE) to pax8_orders(id); cross-entity refs (company_id, product_id) are soft (plain indexed UUID columns, no FK) since sync insert order across entities isn't guaranteed"
- "Company-match review queue (pax8_company_match_review) copied field-for-field from device_link_review (migration 080): partial-unique 'one open review per source row' index, BIGINT[] candidates, TEXT[] confidences"
key-files:
created:
- migrations/091_pax8_tables.sql
modified: []
key-decisions:
- "Applied the migration directly via `docker exec -i pulse-postgres psql ... < migrations/091_pax8_tables.sql` instead of scripts/apply-migrations.sh, because that script hardcodes MIGRATIONS_DIR=/opt/stacks/pulse/migrations (the main repo path) and would not find the file living in this worktree's migrations/ directory pre-merge. Same net effect as the script's single-migration mode (documented in the plan's <interfaces> block)."
- "Removed the `NULL` keyword from resolved_by_user_id/resolved_to_company_id column defs (nullable is implicit/default) to match the plan's exact acceptance-criteria grep patterns, deviating slightly from device_link_review's explicit `NULL` styling."
requirements-completed: [PAX8-01, PAX8-02]
# Metrics
duration: 25min
completed: 2026-07-10
---
# Phase 10 Plan 02: PAX8 Schema Migration Summary
**Created and applied `migrations/091_pax8_tables.sql`, laying down all six PAX8 tables (companies, subscriptions, products, orders, order_items, company_match_review) with header/line-item FK, audit columns, and monetary+currency typing — verified idempotent against the live dev DB.**
## Performance
- **Duration:** 25 min
- **Started:** 2026-07-10T21:08:00Z
- **Completed:** 2026-07-10T21:33:54Z
- **Tasks:** 2 completed
- **Files modified:** 1
## Accomplishments
- Authored the full PAX8 schema migration: 6 tables, all `CREATE TABLE IF NOT EXISTS`
- `pax8_order_items.order_id` hard-FKs to `pax8_orders(id) ON DELETE CASCADE` (D-01 header/line design)
- Monetary columns are `NUMERIC(12,2)` + `currency CHAR(3) DEFAULT 'USD'` on orders/order_items (D-04)
- `raw_payload JSONB` safety-net column on all five primary/child tables (D-03, extended per CONTEXT.md's Claude's Discretion to companies/products/subscriptions too)
- `pax8_company_match_review` copied field-for-field from `device_link_review` (migration 080): `candidate_company_ids BIGINT[]`, `match_confidences TEXT[]`, hard FK to `pax8_companies(id) ON DELETE CASCADE`, nullable FK to `companies(id) ON DELETE SET NULL`, partial-unique "one open review per PAX8 company" index
- Applied the migration to the live `pulse-postgres` dev DB and confirmed all 6 `pax8_*` tables exist
- Re-applied the migration a second time and confirmed idempotency (all statements returned `NOTICE: ... already exists, skipping`, exit code 0, no errors)
## Task Commits
1. **Task 1: Author migrations/091_pax8_tables.sql** - `4d20e45` (feat)
2. **Task 2: Apply migration 091 to the dev DB and prove idempotency** - no additional commit (verification-only task; migration file unchanged by apply step — confirmed via `git status --short` / `git diff --stat HEAD` showing no changes)
**Plan metadata:** (this commit, docs: complete plan)
## Files Created/Modified
- `migrations/091_pax8_tables.sql` - Six PAX8 tables (pax8_companies, pax8_products, pax8_subscriptions, pax8_orders, pax8_order_items, pax8_company_match_review), indexes, and review-queue COMMENT ON TABLE
## Decisions Made
- Applied the migration via direct `docker exec -i pulse-postgres psql -U pulse_user -d pulse_autotask < migrations/091_pax8_tables.sql` rather than `scripts/apply-migrations.sh`, since that script's `MIGRATIONS_DIR` is hardcoded to the main repo path (`/opt/stacks/pulse/migrations`) and this plan executed inside a git worktree at a different path. The net effect (and the exact command) matches what the script's single-migration mode would run, per the plan's own `<interfaces>` documentation.
- Dropped the explicit `NULL` keyword on `resolved_by_user_id` / `resolved_to_company_id` (present in the `device_link_review` template) to satisfy the plan's literal acceptance-criteria grep patterns; nullability is unchanged (columns remain nullable by default — no `NOT NULL` was added).
## Deviations from Plan
None — plan executed exactly as written. Formatting of a few column declarations was adjusted (single-space instead of aligned-column spacing) purely so the acceptance-criteria grep checks in the plan matched literally; no semantic change to the schema.
## Issues Encountered
- `scripts/apply-migrations.sh` hardcodes `/opt/stacks/pulse/migrations` as its migrations directory, which doesn't resolve inside a worktree checkout. Worked around by running the documented `docker exec -i pulse-postgres psql ...` command directly against the worktree's copy of the file (same command the script itself would execute in single-migration mode). No change needed to the script itself — this is a worktree-execution-time detail, not a defect in the committed script.
## User Setup Required
None - no external service configuration required. The migration is schema-only and has already been applied to the shared dev Postgres instance (`pulse-postgres`); no manual step remains for a developer to complete after merge (the file will already be present on `master`, and the tables already exist in the running dev DB).
## Next Phase Readiness
- Phase 11 (PAX8 current-state sync) can now upsert into `pax8_companies`, `pax8_subscriptions`, `pax8_products` — all columns/indexes exist.
- Phase 12 (historical sync + company matching) can populate `pax8_orders`/`pax8_order_items` (Invoice/InvoiceItem-shaped, confirmed against PAX8's live API when that phase is planned) and write conflict rows into `pax8_company_match_review`.
- No blockers. This plan's companion (10-01, PAX8 OAuth2 client/factory) is a separate plan in the same wave — no dependency conflict since this plan touched only `migrations/091_pax8_tables.sql`.
---
*Phase: 10-pax8-client-auth-foundation*
*Completed: 2026-07-10*
## Self-Check: PASSED
- FOUND: migrations/091_pax8_tables.sql
- FOUND: .planning/phases/10-pax8-client-auth-foundation/10-02-SUMMARY.md
- FOUND: commit 4d20e45 (Task 1)
- FOUND: commit bf1eb35 (SUMMARY)

View file

@ -0,0 +1,170 @@
-- PAX8 integration — Postgres schema.
--
-- Lays down the full PAX8 schema Phases 11-14 will populate and consume.
-- Schema-only migration (Phase 10) — no sync logic, no matching logic yet.
--
-- • Client companies -> pax8_companies
-- • Active seat/license subscriptions -> pax8_subscriptions
-- • Product/SKU catalog -> pax8_products
-- • Order headers (Invoice-shaped, see note below) -> pax8_orders
-- • Order line items (InvoiceItem-shaped) -> pax8_order_items
-- • PAX8 company <-> Autotask company conflicts -> pax8_company_match_review
--
-- NOTE on pax8_orders / pax8_order_items: table names stay "orders" per the
-- D-01 header/line-item design decision, but the column shapes below carry
-- PAX8 Invoice/InvoiceItem semantics (total, status, unit price) rather than
-- the bare Order/LineItem object fields — Phase 12's sync service sources
-- these from PAX8's `/invoices` resource, not `/orders`. Confirm the exact
-- field mapping against PAX8's live API response when Phase 12 is planned.
-- ---------------------------------------------------------------------------
-- 1. pax8_companies — PAX8 client companies
-- ---------------------------------------------------------------------------
-- external_id is left nullable and separate from name: PAX8's own company id
-- is the primary key, but there is no confirmed stable secondary identifier
-- (domain, external ref) yet — RESEARCH-pax8-company-identifiers is still
-- open. Do not assume company name is the only field comparable to Autotask.
CREATE TABLE IF NOT EXISTS pax8_companies (
id UUID PRIMARY KEY,
name TEXT NOT NULL,
external_id TEXT,
website TEXT,
status TEXT,
city TEXT,
state_or_province TEXT,
postal_code TEXT,
country TEXT,
raw_payload JSONB,
synced_at TIMESTAMPTZ NOT NULL DEFAULT NOW(),
is_deleted BOOLEAN NOT NULL DEFAULT false,
deleted_at TIMESTAMPTZ
);
CREATE INDEX IF NOT EXISTS idx_pax8_companies_is_deleted ON pax8_companies(is_deleted);
-- ---------------------------------------------------------------------------
-- 2. pax8_products — PAX8 product/SKU catalog
-- ---------------------------------------------------------------------------
-- No "referenced only" constraint here on purpose: whether Phase 11 syncs
-- the full catalog or lazily populates rows as referenced by subscriptions
-- is left open (CONTEXT.md Claude's Discretion). The deprecated alternate-
-- SKU field upstream is not modeled.
CREATE TABLE IF NOT EXISTS pax8_products (
id UUID PRIMARY KEY,
sku TEXT,
vendor_sku TEXT,
name TEXT,
category TEXT,
raw_payload JSONB,
synced_at TIMESTAMPTZ NOT NULL DEFAULT NOW(),
is_deleted BOOLEAN NOT NULL DEFAULT false,
deleted_at TIMESTAMPTZ
);
CREATE INDEX IF NOT EXISTS idx_pax8_products_is_deleted ON pax8_products(is_deleted);
-- ---------------------------------------------------------------------------
-- 3. pax8_subscriptions — active seat/license subscriptions per company
-- ---------------------------------------------------------------------------
-- pax8_company_id / product_id are intentionally soft refs (plain indexed
-- columns, not hard FKs) — sync insert order across companies/subscriptions/
-- products is not guaranteed within a single sync pass.
CREATE TABLE IF NOT EXISTS pax8_subscriptions (
id UUID PRIMARY KEY,
pax8_company_id UUID, -- soft ref -> pax8_companies(id)
product_id UUID, -- soft ref -> pax8_products(id)
quantity INTEGER,
billing_term TEXT,
status TEXT,
start_date TIMESTAMPTZ,
raw_payload JSONB,
synced_at TIMESTAMPTZ NOT NULL DEFAULT NOW(),
is_deleted BOOLEAN NOT NULL DEFAULT false,
deleted_at TIMESTAMPTZ
);
CREATE INDEX IF NOT EXISTS idx_pax8_subscriptions_is_deleted ON pax8_subscriptions(is_deleted);
CREATE INDEX IF NOT EXISTS idx_pax8_subscriptions_company ON pax8_subscriptions(pax8_company_id);
-- ---------------------------------------------------------------------------
-- 4. pax8_orders — order/invoice header (D-01 header table)
-- ---------------------------------------------------------------------------
-- Invoice-shaped: total/status/currency mirror PAX8's Invoice object per
-- RESEARCH Pitfall 1. No lookback-window column (D-02) — sync pulls full
-- order history on first sync in a later phase.
CREATE TABLE IF NOT EXISTS pax8_orders (
id UUID PRIMARY KEY,
pax8_company_id UUID, -- soft ref -> pax8_companies(id)
order_date TIMESTAMPTZ,
total NUMERIC(12,2),
status TEXT,
currency CHAR(3) NOT NULL DEFAULT 'USD',
raw_payload JSONB,
synced_at TIMESTAMPTZ NOT NULL DEFAULT NOW(),
is_deleted BOOLEAN NOT NULL DEFAULT false,
deleted_at TIMESTAMPTZ
);
CREATE INDEX IF NOT EXISTS idx_pax8_orders_is_deleted ON pax8_orders(is_deleted);
CREATE INDEX IF NOT EXISTS idx_pax8_orders_company ON pax8_orders(pax8_company_id);
-- ---------------------------------------------------------------------------
-- 5. pax8_order_items — order/invoice line items (D-01 line table)
-- ---------------------------------------------------------------------------
-- InvoiceItem-shaped: unit_price/line_total mirror PAX8's InvoiceItem object
-- per RESEARCH Pitfall 1. Hard FK to pax8_orders — header/line relationship,
-- unlike the company/product soft refs above, because order_items are always
-- inserted together with (after) their parent order in a single sync pass.
CREATE TABLE IF NOT EXISTS pax8_order_items (
id UUID PRIMARY KEY,
order_id UUID NOT NULL REFERENCES pax8_orders(id) ON DELETE CASCADE,
product_id UUID, -- soft ref -> pax8_products(id)
quantity INTEGER,
unit_price NUMERIC(12,2),
line_total NUMERIC(12,2),
currency CHAR(3) NOT NULL DEFAULT 'USD',
raw_payload JSONB,
synced_at TIMESTAMPTZ NOT NULL DEFAULT NOW(),
is_deleted BOOLEAN NOT NULL DEFAULT false,
deleted_at TIMESTAMPTZ
);
CREATE INDEX IF NOT EXISTS idx_pax8_order_items_is_deleted ON pax8_order_items(is_deleted);
CREATE INDEX IF NOT EXISTS idx_pax8_order_items_order ON pax8_order_items(order_id);
-- ---------------------------------------------------------------------------
-- 6. pax8_company_match_review — PAX8 <-> Autotask company conflicts queue
-- ---------------------------------------------------------------------------
-- Copied field-for-field from device_link_review (migration 080). Populated
-- by Phase 12's matching logic — this migration only creates the shape.
-- Admin picks the right Autotask company; the matcher does not auto-merge.
CREATE TABLE IF NOT EXISTS pax8_company_match_review (
id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
pax8_company_id UUID NOT NULL REFERENCES pax8_companies(id) ON DELETE CASCADE,
candidate_company_ids BIGINT[] NOT NULL,
match_confidences TEXT[] NOT NULL,
detected_at TIMESTAMPTZ NOT NULL DEFAULT NOW(),
resolved_at TIMESTAMPTZ,
resolved_by_user_id TEXT REFERENCES "user"(id) ON DELETE SET NULL,
resolved_to_company_id BIGINT REFERENCES companies(id) ON DELETE SET NULL,
resolution_note TEXT
);
CREATE INDEX IF NOT EXISTS ix_pax8_company_match_review_unresolved
ON pax8_company_match_review(detected_at DESC) WHERE resolved_at IS NULL;
CREATE INDEX IF NOT EXISTS ix_pax8_company_match_review_pax8_company
ON pax8_company_match_review(pax8_company_id);
-- Don't keep stale rows blocking new reviews: partial unique index enforces
-- "one open review per PAX8 company" rather than a blanket unique constraint.
CREATE UNIQUE INDEX IF NOT EXISTS uq_pax8_company_match_review_open
ON pax8_company_match_review(pax8_company_id) WHERE resolved_at IS NULL;
COMMENT ON TABLE pax8_company_match_review IS
'PAX8 -> Autotask company-match conflicts queue: one row per PAX8 company that matches 2+ Autotask companies (or is otherwise ambiguous). Populated by Phase 12''s matching logic. Admin picks the right Autotask company; the matcher does not auto-merge.';