Scrape status
Refreshes every 20s · source of truth:
scrape_runs · registered sources: 77| Source | Status | When | Last run | Landed | Cadence | Warnings | |
|---|---|---|---|---|---|---|---|
| ab-inbev AB InBev retailer locator — Bud Light, Michelob Ultra, Stella Artois over an ~8,700-ZIP plan (a flagship search covers ~one ZIP in a city), at most 3,000 searches a run, never-asked first: a rolling ~9-day cycle. $0, no auth, direct. |
success | 5h ago (2026-11-16 04:47 EST) | 153380 rows · 11158 new · 0 dropped | 431342 | daily | — | |
| abc ABC Fine Wine & Spirits (Florida) via its public SearchSpring search: ~10.3k products x 126 stores, price + units on hand per store, plus the store list from the site's locator; ~105 requests, direct, no proxy |
success | 12h ago (2026-11-15 21:03 EST) | 579499 rows · 37 new · 1929 dropped | 544256 | daily | ⚠ 2 | |
| adaptive-review MASTER — a DERIVED build: a small model learns from the person's outlet answers and scores every candidate pair of the latest outlet-pairs build; the most informative ones, plus a uniform random sample, feed the Match page's Next best queue. It only orders the queue — never merges. See adaptive_review.py and docs/ADAPTIVE-REVIEW.md. |
success | 19h ago (2026-11-15 14:03 EST) | 4000 rows · 0 new · 0 dropped | 3999 | daily | — | |
| al-products Alabama ABC statewide retail price list (control state, Retail sheet) — quarterly XLSX, ~2,140 real products across 22 categories, $0, no key, no proxy, verified live. |
success | 3d ago (2026-11-12 19:01 EST) | 2140 rows · 0 new · 0 dropped | 2140 | weekly | — | |
| bc-liquor BC Liquor Distribution Branch provincial product + price list — CKAN CSV (link resolved at pull time), $0, no key, no proxy, ~8,211 real products, verified live. |
success | 2d ago (2026-11-13 17:00 EST) | 8224 rows · 0 new · 0 dropped | 8273 | weekly | — | |
| bea BEA regional income (state disposable income + county personal income) — needs BEA_API_KEY (free), keyed + verified live. |
success | 6d ago (2026-11-09 16:04 EST) | 96450 rows · 0 new · 0 dropped | 96450 | weekly | — | |
| binnys Binny's via the public Algolia search key: 31.5k products x ~49 stores, numeric units per store, full pull in under a minute; stores current price/units plus a movement row per CHANGE (the velocity signal), not a daily snapshot |
success | 15h ago (2026-11-15 18:03 EST) | 1387055 rows · 819 new · 1653 dropped | 1599581 | daily | ⚠ 1 | |
| ca-abc California ABC statewide alcohol license export — the CA outlet spine (~129.6k licenses), $0, no key, no proxy needed, verified live. |
success | 3d ago (2026-11-12 16:03 EST) | 129310 rows · 407 new · 0 dropped | 132756 | weekly | — | |
| census US Census supply+demand reference (CBP/Nonemployer/PEP/ACS-demand/Economic Census, long/tall) — needs CENSUS_API_KEY (free), ~876k rows, verified live. |
success | 22d ago (2026-10-24 12:05 EDT) | 876322 rows · 0 new · 0 dropped | 876322 | monthly | — | |
| census-acs US Census ACS5 county reference (demographic/economic/housing, 3 tables) — needs CENSUS_API_KEY (free), every US county by default, verified live. |
success | 22d ago (2026-10-24 11:00 EDT) | 9666 rows · 0 new · 0 dropped | 3222 | monthly | — | |
| census-acs5 EVERY ACS5 detailed table (~1,200) at state grain + headline estimates and the 21+ population by county, newest vintage discovered each run (2024 on 2026-11-03); needs CENSUS_API_KEY (free), ~1,200 calls |
success | 12d ago (2026-11-03 11:53 EST) | 1507722 rows · 1507722 new · 0 dropped | 1507722 | monthly | — | |
| census-migration US Census county-to-county migration flows — needs CENSUS_API_KEY (free), 2020 vintage (last with true county detail, verified live), ~4M rows national scope. |
degraded | 22d ago (2026-10-24 11:06 EDT) | 1155275 rows · 0 new · 0 dropped | 1404318 | monthly | ⚠ 9 | |
| census-tracts Every US census tract (85,396 with DC and PR): Gazetteer internal point and land area + ACS 5-year population, adults 21+, households, income, age, ethnicity, education — the consumer side of the trade area. Vintages discovered each run. Needs CENSUS_API_KEY (free). |
success | 6d ago (2026-11-09 17:49 EST) | 85396 rows · 0 new · 0 dropped | 85396 | monthly | — | |
| cex BLS Consumer Expenditure Survey — alcohol spend by income bracket, keyless OK (BLS_API_KEY optional). |
success | 4d ago (2026-11-11 14:03 EST) | 450 rows · 0 new · 0 dropped | 450 | weekly | — | |
| chain-locator Every chain in chain_config.CHAINS (restaurants and grocers: Chipotle, Wingstop, Applebee's, Chili's, IHOP, Pizza Hut, Outback, Circle K, Safeway), from its own store pages: the store sitemap -> store-root pages -> the page's own schema.org address (JSON-LD, else microdata). Direct, no proxy, one request a second per chain, at most CHAIN_LOCATOR_MAX_PAGES pages per chain per run (never-seen first). Only place facts are read — never a person or an email. See sources/chain_locator.py. |
success | 3h ago (2026-11-16 06:01 EST) | 9 rows · 9 new · 0 dropped | 168070 | daily | — | |
| chain-thin-retry Re-reads every hour a locator-list chain whose last read was THIN (under its chain_config `min_stores`) until a complete read lands. CVS's full store list (store-covid-19-details.xml) was in its sitemap at 11:00 ET on 2026-11-11 and gone by 13:00 ET, so a once-a-day read can miss it for days. A chain read completely this week costs one count query. See chain_locator.pull_thin. |
success | 54m ago (2026-11-16 09:00 EST) | 0 rows · 0 new · 0 dropped | 168070 | hourly due | — | |
| city-centroid-build Free US Census Gazetteer place/township centroid reference — the fast-geo layer a future outlet enrichment can join against, $0. |
success | 18d ago (2026-10-28 14:01 EDT) | 51419 rows · 0 new · 0 dropped | 51419 | monthly | — | |
| co-led Colorado LED liquor licences (data.colorado.gov ier5-5ms2) — current, with coordinates, open Socrata data, $0; verified live 2026-11-02 (12,855 outlets). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-10 09:02 EST) | 20427 rows · 0 new · 0 dropped | 154229 | weekly | ⚠ 1 | |
| cpi BLS CPI-U alcoholic beverages (15 series) — keyless OK (BLS_API_KEY optional, widens the window). |
success | 5d ago (2026-11-10 18:03 EST) | 1890 rows · 15 new · 0 dropped | 1890 | weekly | — | |
| ct-dcp Connecticut DCP liquor permits (data.ct.gov gwv2-eswx) — active permits; brand registrations and auction permits landed, not outlets, open Socrata data, $0; verified live 2026-11-02 (7,299 outlets). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-10 09:02 EST) | 80852 rows · 279 new · 0 dropped | 154229 | weekly | ⚠ 1 | |
| doordash-addr street/city/state/lat-lng (NO ZIP — the page publishes none) for doordash_stores, one 3.5 MB page per store through the ISP pool (Safari-17 TLS); alcohol-named stores first, DDADDR_BATCH per run; blocked fetches are never stored |
success | 2h ago (2026-11-16 07:16 EST) | 39932 rows · 39929 new · 0 dropped | 677264 | hourly due | ⚠ 2 | |
| doordash-full per-store alcohol item catalogs by walking each retail store's category tree (~100 items/page, ~3 MB/page) through the ISP pool; bounded (DDFULL_BATCH stores x DDFULL_MAX_PAGES pages), paced per IP, US convenience stores with a known address; item_msid is a UPC only when 12-14 digits |
success | 1d ago (2026-11-15 08:18 EST) | 136096 rows · 144 new · 0 dropped | 4229589 | daily due | ⚠ 3 | |
| doordash-sitemap DoorDash national store universe — DoorDash's own sitemaps, $0, no proxy needed. |
success | 2d ago (2026-11-13 17:02 EST) | 794824 rows · 3881 new · 19214 dropped | 814038 | weekly | — | |
| doordash-zip derives a ZIP for DoorDash stores (their pages publish none) from the street address (Census batch geocoder) then the coordinates' ZCTA; stored in zip_derived with its method; measured 96.2% equal to published ZIPs on 400 Uber Eats stores |
degraded | 15h ago (2026-11-15 18:09 EST) | 49998 rows · 49998 new · 0 dropped | 677264 | daily | ⚠ 1 | |
| fl-abt Florida DBPR ABT retail alcohol licences (bd4006lic.csv, statewide extract) — current licences, direct download, $0; verified live 2026-11-02 (53,189). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-10 09:02 EST) | 53278 rows · 101 new · 0 dropped | 53304 | weekly | ⚠ 1 | |
| fred FRED macro pulse (4 monthly series) — open API, needs FRED_API_KEY (free); no-creds honest skip without it. |
success | 6d ago (2026-11-09 16:03 EST) | 562 rows · 0 new · 0 dropped | 562 | weekly | — | |
| geocode Free Census batch geocoder — lat/lng + county FIPS for CA premises and, by address, every licence list that publishes no coordinates (TX, FL, MI, CT, MO, OR, TTB); loops batches until nothing is due. $0, no key, no proxy. |
success | 12h ago (2026-11-15 21:05 EST) | 14106 rows · 14106 new · 0 dropped | 336799 | daily | — | |
| haskells Haskell's (Minneapolis) full catalog — BigCommerce sitemap + GraphQL, real on-hand qty. |
success | 4d ago (2026-11-11 18:53 EST) | 10173 rows · 24 new · 221 dropped | 10394 | weekly | — | |
| hemp-finder Hemp/THC beverage retailers nationwide — VTInfo brand finder, all 5 hemp brands x 51 states, $0. |
success | 2d ago (2026-11-13 15:13 EST) | 6624 rows · 295 new · 2936 dropped | 9560 | weekly | — | |
| hemp-scan Hemp/THC beverages mined from catalogs already landed here — no fetch, Postgres read + regex classify, $0. Carries a real on-hand qty through where the source has one (haskells_products only, today) — NULL, not 0, everywhere else. |
success | 13h ago (2026-11-15 20:05 EST) | 952 rows · 0 new · 13 dropped | 965 | daily | — | |
| id-products Idaho State Liquor Division statewide product + price catalog (control state) — ~3,244 real products, $0, no key, no proxy, verified live. |
success | 3d ago (2026-11-12 19:01 EST) | 3293 rows · 5 new · 0 dropped | 3404 | weekly | — | |
| item-footprint MASTER — a DERIVED build: refreshes the points-of-distribution summaries over the master_distribution view (DoorDash items, Meijer and Binny's store stock joined to the current master outlet and master item): outlets per product, products per outlet. See item_footprint.py. |
success | 13h ago (2026-11-15 20:05 EST) | 126275 rows · 0 new · 0 dropped | 126275 | daily | ⚠ 3 | |
| master-brand MASTER Phase 3 — a DERIVED build, not a scrape: one brand per spelling-family (spelling variants merged by a compact key), the ownership facts sources state, each master item's brand, and the brand pairs that share barcodes (listed for a person, never merged). See docs/MASTER-ON-POSTGRES.md. |
success | 1h ago (2026-11-16 08:03 EST) | 28883 rows · 2 new · 0 dropped | 28883 | daily | ⚠ 1 | |
| master-item MASTER Phase 1 — a DERIVED build, not a scrape: folds every landed catalog's barcodes into one item per GS1 GTIN-14 (master_item / master_item_member). Incremental, no network. See docs/MASTER-ON-POSTGRES.md. |
success | 13h ago (2026-11-15 20:05 EST) | 236252 rows · 7745 new · 0 dropped | 259883 | daily | ⚠ 3 | |
| master-outlet MASTER Phase 2 — a DERIVED build, not a scrape: folds every outlet source into one outlet per physical point of distribution. Merges ONLY the Match page's addr-agree rule (same street+ZIP, name >= 0.8), cross-source, guarded; precision is unmeasured until the review queue is labelled. See docs/MASTER-ON-POSTGRES.md. |
success | 20h ago (2026-11-15 13:03 EST) | 1497034 rows · 87917 new · 0 dropped | 2394430 | daily | ⚠ 2 | |
| mdm-briefing DOCS — Claude writes the MDM docs page's 'Next steps and suggestions' (dashboard /docs) once a week, after the master build: where the master stands, what changed since the last briefing, and grounded next steps with who should do them. Read-only tools (run history, the package's code, the docs, one SELECT at a time); changes nothing. Weekly and on Sonnet since 2026-11-13, to cut spend. Budget MDM_BRIEFING_MAX_USD (default $1). See mdm_briefing.py. |
degraded | 1d ago (2026-11-14 16:05 EST) | 0 rows · 0 new · 0 dropped | 4 | weekly | ⚠ 1 | |
| me-products Maine Spirits (BABLO) statewide master price list (control state) — monthly XLSX, ~6,180 real products, $0, no key, no proxy, verified live. |
success | 3d ago (2026-11-12 19:01 EST) | 6278 rows · 0 new · 0 dropped | 6335 | weekly | — | |
| meijer Meijer bev-alc catalog — open storefront GraphQL, real UPCs, national store discovery (286 real stores, confirmed live 2026-09-29); stock STATUS only, no inventory quantity field exists in the API. |
success | 2d ago (2026-11-14 08:50 EST) | 845693 rows · 5751 new · 35284 dropped | 880977 | weekly | ⚠ 1 | |
| mi-lcc Michigan LCC Master License List (XLSX) — every licence, one address string split on landing, direct download, $0; verified live 2026-11-02 (35,845). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-10 09:02 EST) | 35845 rows · 0 new · 0 dropped | 35845 | weekly | ⚠ 1 | |
| mo-atc Missouri ATC active licences (data.mo.gov yyhn-562y) — one row per licence (the list repeats per associated person), open Socrata data, $0; verified live 2026-11-02 (13,198 outlets). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-10 09:02 EST) | 15888 rows · 30 new · 0 dropped | 154229 | weekly | ⚠ 1 | |
| mont-catalog Montgomery County MD product + price + inventory catalog — control-state Socrata dataset, $0, current snapshot (not price history), verified live. |
success | 2d ago (2026-11-13 13:06 EST) | 7014 rows · 56 new · 183 dropped | 7197 | weekly | — | |
| mont-purch Montgomery County MD product purchases by DLC — control-state Socrata dataset, $0, rolling current-month snapshot (accumulates into a real archive via merge-only landing), verified live. |
success | 2d ago (2026-11-13 13:06 EST) | 8649 rows · 0 new · 0 dropped | 24788 | weekly | — | |
| mont-sales Montgomery County MD monthly warehouse + retail sales — control-state Socrata dataset, $0, real multi-year demand history (~341k rows, 2017-2020 + 2026), verified live. |
success | 2d ago (2026-11-13 13:08 EST) | 352419 rows · 0 new · 0 dropped | 352419 | weekly | — | |
| nc-pricing North Carolina ABC statewide spirits price list (control state) — ~3,273 real rows, $0, no key, no proxy, verified live. |
success | 3d ago (2026-11-12 19:01 EST) | 3372 rows · 25 new · 0 dropped | 3472 | weekly | — | |
| ny-sla New York SLA active alcohol licences (data.ny.gov 9s3h-dpkz) — active only, with coordinates, open Socrata data updated daily, $0; verified live 2026-11-02 (58,492). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-09 17:03 EST) | 58617 rows · 272 new · 0 dropped | 58763 | weekly | ⚠ 1 | |
| or-olcc Oregon OLCC licences (data.oregon.gov srxe-qkm2) — unexpired, open Socrata data, $0; verified live 2026-11-02 (13,561 outlets). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-10 09:02 EST) | 17812 rows · 26 new · 0 dropped | 154229 | weekly | ⚠ 1 | |
| or-pricing Oregon OLCC statewide product price book — control-state Socrata dataset, $0, monthly price history. |
success | 6d ago (2026-11-09 16:03 EST) | 7494 rows · 0 new · 259494 dropped | 266988 | weekly | — | |
| outlet-attributes MASTER golden record — a DERIVED build: each outlet's CHANNEL (off/on premise, producer, virtual; liquor store, grocery, restaurant, bar ...) and CHAIN, from its members' own evidence (CA licence > chain locator > Uber Eats type > DoorDash URL > name), each value with its basis and any disagreeing signal. See outlet_attributes.py. |
success | 20h ago (2026-11-15 13:19 EST) | 1497034 rows · 0 new · 0 dropped | 1497034 | daily | — | |
| outlet-pairs MASTER — a DERIVED build: EVERY candidate outlet pair in the strata the Claude-confirmed merge tier judges (near, same-address, control), from the same generator and scorer as the Match page but without its review-sized cap, so the judge (Haiku screens, Opus confirms, via the Message Batches API) and the tier cover the whole master, not a sample. See outlet_pairs.py. |
success | 20h ago (2026-11-15 13:36 EST) | 2839605 rows · 0 new · 0 dropped | 3709525 | daily | — | |
| outlet-record MASTER golden record — a DERIVED build: each outlet's ONE street address, map pin and phone, chosen by a stated source precedence (chain locator > licence > Uber Eats > DoorDash > TTB > finders for the address; never a vote or an average), each with its source, plus every licence the outlet holds. See outlet_record.py. |
success | 20h ago (2026-11-15 13:05 EST) | 1497034 rows · 0 new · 0 dropped | 1497034 | daily | — | |
| outlet-zip MASTER — a DERIVED build: a ZIP for outlet records that publish none (hemp finder, VIP finder, some CA licences) from the free Census geocoder (address, then coordinates), and each ZIP's city/state learned from our own records (zip_place) to fill a blank city/state. Read by the matcher for blocking only. See outlet_zip.py. |
success | 22h ago (2026-11-15 11:25 EST) | 10632 rows · 10632 new · 0 dropped | 1275302 | daily | — | |
| overture Overture Maps Places (open data, anonymous Parquet on S3) as a CORROBORATING source: a place is kept only when it passes the master's own address+name rule against a record we already hold. Measured on Texas before building: 36% of single-source records (19,465 of 57,186 licences) had one. One DuckDB scan of US places joined to the members' (ZIP, house number) keys. See sources/overture.py. |
success | 21h ago (2026-11-15 12:41 EST) | 680341 rows · 75818 new · 0 dropped | 680341 | weekly | — | |
| quality-misses QUALITY — the weekly mistakes report: every person answer the pinned judge, the screen or the master contradicts, given a cause by Claude (within QUALITY_MISSES_MAX_USD) and ranked — the input to the next challenger judge and rule. Changes no answer. See quality_misses.py. |
success | 4d ago (2026-11-11 16:02 EST) | 125 rows · 0 new · 0 dropped | 125 | weekly | ⚠ 1 | |
| quality-scorecard QUALITY — every way two outlet records merge, scored against the person's blind answers: precision per tier (a growing uniform sample in the Gaps set), the Claude gates (and the judge's on the sealed test split), recall, staleness. Tops up the tier buckets; never merges or labels. See quality.py. |
success | 20h ago (2026-11-15 13:03 EST) | 15 rows · 0 new · 0 dropped | 143 | daily | — | |
| salsify Salsify Sites platform recipe — public CPG/distributor catalogs (seed: bbg, 55k+ products), $0, no auth. |
success | 18h ago (2026-11-15 15:01 EST) | 23 rows · 23 new · 0 dropped | 65207 | daily | — | |
| sevenfifty SevenFifty/Provi distributor storefronts — open JSON search API, no auth. |
success | 5d ago (2026-11-10 23:21 EST) | 28752 rows · 248 new · 159 dropped | 29571 | weekly | — | |
| shopify Shopify platform recipe, national seed — 5 known bev-alc/hemp-bev brand domains, open /products.json, $0. |
success | 6d ago (2026-11-09 16:04 EST) | 999 rows · 8 new · 284 dropped | 1283 | weekly | — | |
| slug-cities DERIVED, not a scrape: learns cities from the DoorDash slugs via chain stores (>= 2 distinct chains, guarded), then re-derives every slug-only outlet title with them. Weekly because new cities appear slowly; the daily master-outlet build re-cleans only the outlets it touches. See docs/SLUG-TITLE-CLEANUP.md and CLAUDE.md. |
success | 5d ago (2026-11-10 11:44 EST) | 464383 rows · 118 new · 0 dropped | 64 | weekly | ⚠ 1 | |
| source-health MONITOR — a DERIVED build over scrape_runs: rules find every failed, degraded, resting, stale, never-run or shrunken source; Claude (read-only tools: run history, the package's code, one SELECT at a time) diagnoses each new or changed finding — cause, evidence, next action. Changes nothing. Budget SOURCE_HEALTH_MAX_USD (default $0.50) per run, on Sonnet. See source_health.py. |
degraded | 9h ago (2026-11-16 00:05 EST) | 6 rows · 2 new · 5 dropped | 31 | daily | ⚠ 2 | |
| specs Spec's (Texas) product pages, direct: ~27.9k beverage pages x the stores that carry each (price + in/out per store, a UPC per product) plus 188 store pages; ~40 min at 12 workers (measured 12.4 pages/s from Railway, nothing refused) |
success | 5d ago (2026-11-10 22:52 EST) | 1906922 rows · 6083 new · 0 dropped | 1908631 | weekly | ⚠ 4 | |
| tax-rates Bev-alc tax rate reference — encoded federal schedule + a curated state seed CSV, not a live crawl. |
degraded | 6d ago (2026-11-09 16:03 EST) | 171 rows · 0 new · 0 dropped | 171 | weekly | ⚠ 5 | |
| tax-revenue Bev-alc tax revenue (collections) — Census STC, needs CENSUS_API_KEY (free); no-creds honest skip without it. |
success | 5d ago (2026-11-10 21:02 EST) | 612 rows · 0 new · 0 dropped | 612 | weekly | — | |
| trade-area MASTER trade area — a DERIVED build: per pinned outlet, EXACT counts of the outlets within 1 and 3 miles (all / off / on premise / alcohol-selling) and the nearest same-channel and licensed outlet; and the consumer within 3 miles from census tracts (population, adults 21+, income, age, ethnicity, education, urban / suburban / rural, adults per alcohol outlet). See trade_area.py. |
success | 6d ago (2026-11-09 18:09 EST) | 815401 rows · 0 new · 0 dropped | 815401 | weekly | — | |
| trader-joes Trader Joe's bev-alc catalog — open storefront GraphQL, no auth, national locator sweep (662 real stores, confirmed live 2026-09-28). |
success | 6d ago (2026-11-10 05:23 EST) | 48368 rows · 812 new · 7763 dropped | 56131 | weekly | — | |
| ttb-cola TTB COLA public registry (label approvals) — search/list layer, $0, off-Mac, no key (unverified TLS context). |
success | 6d ago (2026-11-09 17:03 EST) | 432 rows · 231 new · 0 dropped | 1758 | weekly | — | |
| ttb-cola-detail One public TTB form per COLA approval in ttb_cola: plant registry numbers, varietals, appellation, dates, label filenames (no ABV: the current form has no such field; no UPC: needs label-image decoding; no personal details) |
success | 14h ago (2026-11-15 19:01 EST) | 0 rows · 0 new · 0 dropped | 1758 | daily | — | |
| ttb-permits TTB federal permittee lists (FOIA CSVs, weekly): wineries, distilleries, alcohol wholesalers and importers with premises address, $0; verified live 2026-11-02 (83,917 permits). An outlet source for the master (not importers). See sources/ttb_permits.py. |
success | 6d ago (2026-11-10 09:02 EST) | 83917 rows · 0 new · 0 dropped | 83917 | weekly | ⚠ 4 | |
| tx-tabc Texas TABC alcohol licences (data.texas.gov 7hf9-qc9f) — every status, one row per licence, open Socrata data updated daily by the agency, $0; verified live 2026-11-02 (79,184 active). An outlet source for the master. See sources/state_licences.py. |
success | 6d ago (2026-11-09 17:03 EST) | 128650 rows · 206 new · 0 dropped | 128650 | weekly | — | |
| ubereats US store universe (26 public sitemaps, direct) + each store's address/ZIP/lat-lng/chain via getStoreV1 THROUGH THE ISP POOL (a bare Railway IP is reCAPTCHA-challenged after a modest volume — measured); alcohol-named stores first, UE_BATCH per run. Items not landed yet (no alcohol marker) |
degraded | 1d ago (2026-11-15 05:45 EST) | 9893 rows · 0 new · 0 dropped | 1048889 | daily due | ⚠ 3 | |
| ut-products Utah DABS statewide product + price list (control state) — monthly XLSX, ~10,239 real products, $0, no key, no proxy, verified live. |
success | 3d ago (2026-11-12 19:01 EST) | 10239 rows · 0 new · 0 dropped | 10239 | weekly | — | |
| vip-brandbuilder VIP Brand Builder distributor catalogs — open JSON API, pulls every confirmed distributor in vip-brandbuilder-census's own directory (363 as of 2026-09-28), falls back to a 1-distributor seed only if that directory hasn't been built yet. |
success | 20h ago (2026-11-15 13:10 EST) | 807450 rows · 61 new · 138 dropped | 842589 | daily | ⚠ 2 | |
| vip-brandbuilder-census VIP Brand Builder distributor keyspace census — enumerates sourceCode 00000-99999 (100k), $0, resumable. |
success | 6d ago (2026-11-10 00:03 EST) | 0 rows · 0 new · 0 dropped | 383 | weekly | — | |
| vt-pricing Vermont 802 Spirits statewide price guide (control state) — 8 categories, ~1,231 real rows, $0, no key, no proxy, verified live. |
success | 3d ago (2026-11-12 19:01 EST) | 1328 rows · 0 new · 0 dropped | 1361 | weekly | — | |
| vtinfo VTInfo/VIP "where to buy" finder — 17 supplier finders (Tito's, Sazerac, Boston Beer, Sierra Nevada, Bell's, Founders, Deschutes, Harpoon, Bacardi, Heineken, Proximo, Diageo Beer, Pabst, Heaven Hill, The Wine Group, Ste. Michelle, Labatt) x a ~2,100-ZIP plan covering 90% of the master's alcohol outlets (a search reaches ~10 miles). At most 2,000 searches a run, never-asked first: a rolling ~18-day cycle. One flat-pool IP per search, 4 at once, $0. Accounts fold per store. |
success | 9h ago (2026-11-15 23:59 EST) | 361235 rows · 181027 new · 0 dropped | 1411073 | daily | — | |
| wa-lcb Washington LCB Off / On Premise licensee lists (lcb.wa.gov, two spreadsheets under dated names, discovered from the lists page each run), $0; measured 2026-11-13: 17,263 active rows, 6,495 pass the merge rule against a record already held. An outlet source for the master. See sources/state_licences.py. |
success | 22h ago (2026-11-15 11:07 EST) | 18883 rows · 18883 new · 0 dropped | 154229 | weekly | ⚠ 1 | |
| walmart search + detail pages through the flat ISP pool (curl_cffi Chrome TLS); ~30%/try past PerimeterX, retried on fresh IPs. Detail pages are store-localised to the proxy's exit IP |
success | 1d ago (2026-11-15 06:26 EST) | 3310 rows · 128 new · 0 dropped | 9439 | daily due | ⚠ 1 | |
| winebow Winebow importer brand portfolio — server-rendered HTML, regex parse, no auth. |
failed | 6d ago (2026-11-10 05:02 EST) | 0 rows · 0 new · 0 dropped | 1399 | weekly | ⚠ 2 |