new-site/scripts
justin 4f455475c0 hc: weekly data-refresh pipeline + multi-segment warmup cron
Two gaps closed:

1. hc_data_refresh.py (NEW): weekly source-data refresh. Re-checks every
   emailable NPI against the LIVE government sources so sends never go stale:
   - CMS Revalidation Due Date List (data.cms.gov per-NPI API; handles both ISO
     and US date formats, normalizes to MM/DD/YYYY).
   - OIG LEIE full CSV download (the NPI-bearing exclusion source).
   - SAM.gov v4 exclusions (key in .secrets/sam-api-key) -- OFF by default since
     SAM exclusions rarely carry an NPI and the full set is ~167k records; it's
     opt-in via --sam-pages. SAM's real value is the live per-name screening
     service, not a bulk NPI join.
   Writes the master CSV atomically (temp+rename). A provider who has since
   revalidated flips overdue->upcoming/not_on_list, so we stop nagging them.

2. build_healthcare_campaigns_cron.py: was revalidation-only (one hardcoded
   list/campaign/CSV/template). Now multi-segment: imports SEGMENTS from the
   single-source-of-truth registry, warms ALL five programs in parallel, each
   with its own list, dated campaign, and per-segment import-state file (so
   dedup is per-segment). A  per segment maps master-CSV rows to the
   right program (reval_overdue / reval_upcoming / leie_or_deactivated /
   optout_ending / any). Daily ramp slice is split across segments (revalidation
   leads at 50%, rest share the remainder) so every program collects engagement
   data while the IPs warm. Back-compat: seeds revalidation import-state from the
   legacy hc_imported_emails.txt once.
2026-06-08 03:06:29 -05:00
..
document_gen ink-signature: pen-plotter pipeline for original wet-ink CMS signatures 2026-06-07 02:34:17 -05:00
email email trust signals: add data-safety + guarantee + social-proof strip to HC, telecom (campaign_template), and trucking (6 source + active campaigns via injector). Vertical accents: teal/blue/orange 2026-06-06 04:13:16 -05:00
formation fix Iowa: remove wrong Socrata dataset (was liquor stores), mark SOS as WAF-blocked 2026-05-30 19:28:41 -05:00
templates Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
tests Add portable Line-us pen-arm support to ink-signature pipeline 2026-06-07 03:45:46 -05:00
workers esign: make signing copy fully generic - remove all ink references from website/API 2026-06-07 05:06:26 -05:00
_email_exclusions.py campaigns: exclude full Yahoo/Verizon-Media domain family from cold email 2026-06-02 12:14:43 -05:00
alert.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
backup-db.sh Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
bounce-watcher.sh Guard bounce watcher against empty queue IDs 2026-06-04 12:33:53 -05:00
build_healthcare_campaigns.py hc campaigns: make the HTML templates the single source of truth 2026-06-08 02:57:49 -05:00
build_healthcare_campaigns_cron.py hc: weekly data-refresh pipeline + multi-segment warmup cron 2026-06-08 03:06:29 -05:00
build_npi_outreach_lists.py feat(healthcare): split outreach list into 3 outbound streams 2026-06-05 18:59:44 -05:00
build_trucking_campaigns.py Add DOT check CTA to trucking deficiency emails 2026-06-04 18:29:01 -05:00
campaign_template.html email trust signals: add data-safety + guarantee + social-proof strip to HC, telecom (campaign_template), and trucking (6 source + active campaigns via injector). Vertical accents: teal/blue/orange 2026-06-06 04:13:16 -05:00
check-service-catalog-drift.py fix(deploy): port catalog generator + drift-check to Python (prod has no node) 2026-06-07 19:26:01 -05:00
check_npi_slug_consistency.sh test(npi): add slug consistency check across all wiring places 2026-06-05 01:35:04 -05:00
clean_hc_warmup_list.py hc-warmup: add list-hygiene script (drop undeliverable addrs, smtp_valid first) 2026-06-07 18:08:36 -05:00
create_agent_jaykordic.cjs Add referral/discount code to FCC carrier page + REF-JAYK05 agent 2026-06-02 14:31:22 -05:00
create_deficiency_report_campaign.py Pivot CRTC offering on FCC carrier page for A-Z wholesale carriers 2026-06-02 13:26:39 -05:00
create_deficiency_source_campaigns.py Add DOT check CTA to trucking deficiency emails 2026-06-04 18:29:01 -05:00
create_state_campaigns.py Lower trucking compliance pricing across product + marketing surfaces 2026-06-02 10:45:07 -05:00
deploy-dev.sh feat(email): wire listmonk-hc into deploy + dev override + hc ramp-cap 2026-06-05 19:19:45 -05:00
deploy-go-live.sh Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
deploy.sh Use --no-cache in deploy to prevent stale Docker builds 2026-04-27 07:57:14 -05:00
Dockerfile Add CMS-855 PDF filler + e-sign fulfillment for Medicare revalidation/enrollment 2026-06-05 02:27:11 -05:00
gap_tracker.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
gen-service-catalog.py fix(deploy): port catalog generator + drift-check to Python (prod has no node) 2026-06-07 19:26:01 -05:00
generate_all_permutations.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
generate_all_templates.py Fix flagged items: CRTC email submission, BITS todo, selector docs, stale plans 2026-05-04 11:33:45 -05:00
hc-bounce-watcher.sh hc email: reframe value-add to 'No 2FA. No government portals.' (we have a portal; the pain is CMS 2FA/identity-proofing); cron creates fresh dated campaign when prior is finished; add hc bounce watcher (Postfix->listmonk-hc webhook, hard/complaint->blocklist) 2026-06-06 16:47:12 -05:00
hc_data_refresh.py hc: weekly data-refresh pipeline + multi-segment warmup cron 2026-06-08 03:06:29 -05:00
healthcare_email_streams.py fix(npi): two-tier Direct/HISP classifier so real Direct-Primary-Care/counseling practices stay institutional (was wrongly parked); add classifier unit tests 2026-06-06 00:09:42 -05:00
inject_healthcare_nav.py fix: maintain Services dropdown header from one canonical source 2026-06-05 14:27:24 -05:00
inject_order_headers.py feat(site): vertical-specific order-page headers (trucking/telecom/healthcare/corporate) via unified VerticalOrderHeader; apply to all 49 order pages; retire TruckingOrderHeader 2026-06-06 01:52:22 -05:00
listmonk-bounce-sync.py UPL-proof document templates + reliable bounce sync 2026-05-21 15:06:29 -05:00
load_npi_companion_data.py fix(npi): lenient CSV decoding in companion loader (CMS exports have stray latin-1 bytes) 2026-06-05 01:38:02 -05:00
methodology_campaign.py Wire createCommission() into compliance batch checkout 2026-05-11 11:00:38 -05:00
ollama_client.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
populate_deficiency_list.py Add shared DOCX style module + campaign tools 2026-05-04 08:52:07 -05:00
populate_new_carrier_startup_campaign.py campaigns: exclude full Yahoo/Verizon-Media domain family from cold email 2026-06-02 12:14:43 -05:00
probe_npi_undetected.py feat(healthcare): route NPPES/PECOS Playwright flows through residential SOCKS proxy 2026-06-05 14:36:01 -05:00
product_facts.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
recon_gckey.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
reddit-monitor.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
requirements.txt add fax filing pipeline: VitalPBX sender, attestation cover page with digital signature, compliance checker pending filing override 2026-05-30 18:32:01 -05:00
send_test_campaigns.py Add shared DOCX style module + campaign tools 2026-05-04 08:52:07 -05:00
setup_erpnext_payments.py Initial commit — Performance West telecom compliance platform 2026-04-27 06:54:22 -05:00
setup_trucking_campaigns.py Lower trucking compliance pricing across product + marketing surfaces 2026-06-02 10:45:07 -05:00
sync_nav.py fix: maintain Services dropdown header from one canonical source 2026-06-05 14:27:24 -05:00
test_healthcare_e2e.py Reframe healthcare filing as standard vs expedited; e2e test + bug fixes 2026-06-05 03:58:46 -05:00
test_healthcare_email_streams.py fix(npi): two-tier Direct/HISP classifier so real Direct-Primary-Care/counseling practices stay institutional (was wrongly parked); add classifier unit tests 2026-06-06 00:09:42 -05:00
verify_csv_emails.py healthcare email: teal gradient header (matches site hero) + standalone CSV MX/SMTP verifier (binds .72 non-sending IP); gitignore PII warmup lists 2026-06-06 03:39:19 -05:00