Address Resolution · ARS vs Smarty
ARS standardization QA
Five fields scored — delivery line · city · state · ZIP · FIPS. A row passes only if all five match Smarty.
Fix packets — downloads
Owner: ARS service / DE. Raw Markdown of this audit's findings, for the owning engineer's work list.
Audit verdict · a row passes only if all five fields match
91 of 104 addresses pass on the five scored fields — 13 diverge.
91/104
87.5% pass
avg field score 97.5% across addresses
9 flagged · 1 over-match · 8 weak DPV
Per-field agreement
| Field | Match | % | |
|---|---|---|---|
| Delivery line | 91/104 | 87.5% | |
| City | 104/104 | 100.0% | |
| State | 104/104 | 100.0% | |
| ZIP | 104/104 | 100.0% | |
| FIPS | 104/104 | 100.0% |
Pass rate by ARS resolution source
ARS resolves each address via Athena → its own cache → Smarty. The first two are 8020 data; the Smarty path is passthrough. All should equal Smarty.
| Source | n | Pass | What it means |
|---|---|---|---|
| ARS own data — the real test | |||
| athena | 33 | 33/33 | ARS Athena resolution vs Smarty |
| cache | 5 | 5/5 | ARS delta-cache vs live Smarty |
| Smarty passthrough / no-match | |||
| smarty | 63 | 50/63 | ARS called Smarty (passthrough) |
| null | 3 | 3/3 | ARS no-match |
Caveats — passes that don't confirm deliverability
These rows score PASS on the five standardized fields, but Smarty (the ground truth) did not return a confirmed delivery point — so the green means ARS and Smarty agree on the standardized string, not that the address is confirmed deliverable. They are surfaced here instead of being absorbed silently into the pass count.
over-match 1 — ARS resolved a should-not-resolve address as match-mailable while Smarty did not confirm it: nonexistent. A real ARS over-reach (tracked, not a standardization fail).
weak DPV 8 — edge address forms (rural route, fractional, grid, territory, no-ZIP landmark) where Smarty's DPV is unconfirmed: zip_missing_empire, rural_route, dl_half, fips_sanjuan_pr, dl_grid_utah, dl_dir_suffix, dl_us_highway, dl_county_road. Standardization agrees; deliverability is not vouched for.
Refresh this audit
Re-run the full ARS↔Smarty battery against live Smarty and rebuild this page:
uv run python run.py sync
- POST the synthetic battery to ARS
/v1/resolve/sync - resolve the same addresses through Smarty (us-street, cached so repeats are free)
- score the 5 fields per address & rebuild this page
Add cases in ars_audit/cases/synthetic.py. Every number here is generated from sync_compare.json — nothing is hand-typed.
| # | Case | Input address | Src | Delivery line | City | State | ZIP | FIPS | Score | Verdict | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | ▸zip_wrong_whitehouse | 1600 Pennsylvania Ave NW, Washington, DC, 10001 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
White House w/ a WRONG ZIP (10001 is NYC) → must correct to 20500 ARS source smarty · summary match-mailable · ZIP fixed 10001 → 20500 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 1 | ▸zip_missing_whitehouse | 1600 Pennsylvania Ave NW, Washington, DC | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
White House, no ZIP → must fill 20500 from street+city+state ARS source smarty · summary match-mailable · ZIP filled → 20500 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 2 | ▸zip_missing_empire | 350 5th Ave, New York, NY | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Empire State Bldg, no ZIP → must fill 10118 ARS source smarty · summary match-mailable · ZIP filled → 10001 Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 3 | ▸zip_missing_miami | 3500 Pan American Dr, Miami, FL | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Miami City Hall, no ZIP → fill + county_fips 12086 ARS source athena · summary match-mailable · ZIP filled → 33133 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 4 | ▸zip_missing_phoenix | 200 W Washington St, Phoenix, AZ | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Phoenix City Hall, no ZIP → fill + county_fips 04013 ARS source athena · summary match-mailable · ZIP filled → 85003 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 5 | ▸zip_wrong_houston | 901 Bagby St, Houston, TX, 99999 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Houston City Hall w/ impossible ZIP 99999 → must correct to 77002 ARS source smarty · summary match-mailable · ZIP fixed 99999 → 77002 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 6 | ▸zip_short_philly | 1400 John F Kennedy Blvd, Philadelphia, PA, 191 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Truncated ZIP (191) → must expand/correct to a valid 5-digit ARS source smarty · summary match-mailable · ZIP fixed 191 → 19107 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 7 | ▸clean_civic | 1600 Pennsylvania Ave NW, Washington, DC, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
White House — canonical clean DPV-Y baseline (correct ZIP) ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 8 | ▸clean_landmark | 350 5th Ave, New York, NY, 10118 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Empire State Bldg — high-rise, plus4 + precision check ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 9 | ▸fips_miami | 3500 Pan American Dr, Miami, FL, 33133 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Miami City Hall — county_fips 12086 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 10 | ▸fips_maricopa | 200 W Washington St, Phoenix, AZ, 85003 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Phoenix City Hall — county_fips 04013 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 11 | ▸fips_philly | 1400 John F Kennedy Blvd, Philadelphia, PA, 19107 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Philadelphia City Hall — county_fips 42101 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 12 | ▸fips_harris | 901 Bagby St, Houston, TX, 77002 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Houston City Hall — county_fips 48201 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 13 | ▸fips_jackson | 415 E 12th St, Kansas City, MO, 64106 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Jackson County courthouse — county_fips 29095 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 14 | ▸zip_plus4 | 1 Infinite Loop, Cupertino, CA, 95014-2083 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
ZIP+4 input → ARS must normalize to ZIP5 for matching, still mailable ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 15 | ▸dup_tokens | 350 5th Ave Ave, New York, NY, 10118 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Duplicated street token → preprocessing should dedupe and still match ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 16 | ▸messy_case | 1600 pennsylvania ave nw, washington, dc, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
All-lowercase → casing must not change standardization ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 17 | ▸abbrev_expand | 1 N State St, Chicago, IL, 60602 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Directional + abbrev St → both should expand consistently ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 18 | ▸extra_space | 350 5th Ave, New York, NY, 10118 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Collapsed whitespace — tokenization robustness ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 19 | ▸no_city_state | 1600 Pennsylvania Ave NW, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Missing city/state but ZIP present → should still resolve ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 20 | ▸street_only | 1600 Pennsylvania Ave NW | null | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS · NM | |||||||||||||||||||||||
Street only, no ZIP/city/state → expect no-match or low-confidence ARS source null · summary no-match Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 21 | ▸mf_with_unit | 20 W 34th St Apt 1000, New York, NY, 10001 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Multifamily WITH unit → unit must be preserved in delivery_line_2 ARS source smarty · summary match-mailable · ZIP fixed 10001 → 10118 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 22 | ▸mf_no_unit | 100 Beacon St, Boston, MA, 02116 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Multifamily NO unit → DPV may flag, both should agree on flag ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 23 | ▸suite_variant | 30 Rockefeller Plaza Ste 100, New York, NY, 10112 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Suite designator variant — secondary-unit handling ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 24 | ▸po_box | PO Box 1142, Washington, DC, 20013 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
PO Box — RDI/precision differs, both must agree ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 25 | ▸rural_route | RR 2 Box 152, Jackson, KY, 40387 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Rural route — non-city-style ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 26 | ▸directional_heavy | 1 N 1st St, Phoenix, AZ, 85004 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Directional-heavy — leading directional ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 27 | ▸nonexistent | 99999 Nowhere Fake St, Springfield, IL, 62701 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS⚠ over-match | |||||||||||||||||||||||
Fabricated street → both no-match (DPV X) ARS source smarty · summary match-mailable ⚠ Over-match. ARS returned match-mailable for an address that should not resolve, while Smarty did not confirm a delivery point (DPV unconfirmed). The five standardized fields still echo-match, so it scores PASS — but this is an ARS over-reach, surfaced here rather than hidden in the pass count. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 28 | ▸garbage | asdf qwer zxcv, 00000 | null | ✓both no-match | ✓ | ✓ | ✓both no-match | ✓ | 100% | PASS · NM | |||||||||||||||||||||||
Garbage tokens + invalid ZIP → both no-match ARS source null · summary no-match Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 29 | ▸foreign | 10 Downing Street, London | null | ✓both no-match | ✓both no-match | ✓ | ✓ | ✓ | 100% | PASS · NM | |||||||||||||||||||||||
Foreign (UK) → US-only APIs no-match; foreign-handling parity ARS source null · summary no-match Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 30 | ▸bad_zip_for_state | 1600 Pennsylvania Ave NW, Washington, CA, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
State/ZIP mismatch (DC ZIP, CA state) → corrected or flagged ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 31 | ▸fips_la | 200 N Spring St, Los Angeles, CA, 90012 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
LA City Hall — FIPS 06037 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 32 | ▸fips_seattle | 600 4th Ave, Seattle, WA, 98104 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Seattle City Hall — FIPS 53033 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 33 | ▸fips_denver | 1437 Bannock St, Denver, CO, 80202 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Denver City/County Bldg — FIPS 08031 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 34 | ▸fips_atlanta | 55 Trinity Ave SW, Atlanta, GA, 30303 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Atlanta City Hall — FIPS 13121 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 35 | ▸fips_boston | 1 City Hall Sq, Boston, MA, 02201 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Boston City Hall — FIPS 25025 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 36 | ▸fips_detroit | 2 Woodward Ave, Detroit, MI, 48226 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Detroit City Hall — FIPS 26163 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 37 | ▸fips_nashville | 1 Public Sq, Nashville, TN, 37201 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Nashville Metro — FIPS 47037 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 38 | ▸fips_nola | 1300 Perdido St, New Orleans, LA, 70112 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
New Orleans City Hall — FIPS 22071 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 39 | ▸fips_portland | 1221 SW 4th Ave, Portland, OR, 97204 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Portland City Hall — FIPS 41051 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 40 | ▸fips_vegas | 495 S Main St, Las Vegas, NV, 89101 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Las Vegas City Hall — FIPS 32003 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 41 | ▸fips_saltlake | 451 S State St, Salt Lake City, UT, 84111 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
SLC City Hall — FIPS 49035 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 42 | ▸fips_columbus | 90 W Broad St, Columbus, OH, 43215 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Columbus City Hall — FIPS 39049 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 43 | ▸dl_highrise_suite | 233 S Wacker Dr Ste 8400, Chicago, IL, 60606 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Willis Tower high suite ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 44 | ▸dl_apt | 1 Astor Pl Apt 5B, New York, NY, 10003 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Apartment unit — delivery_line_2 preservation ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 45 | ▸dl_hyphen_queens | 30-30 47th Ave, Long Island City, NY, 11101 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Queens hyphenated house number '30-30' ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 46 | ▸dl_half | 123 1/2 Elm St, Dallas, TX, 75201 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Fractional house number '123 1/2' ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 47 | ▸dl_ordinal | 1 W 72nd St, New York, NY, 10023 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Ordinal street — Dakota Bldg ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 48 | ▸zip_missing_la | 200 N Spring St, Los Angeles, CA | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 06037 ARS source athena · summary match-mailable · ZIP filled → 90012 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 49 | ▸zip_missing_seattle | 600 4th Ave, Seattle, WA | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 53033 ARS source athena · summary match-mailable · ZIP filled → 98104 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 50 | ▸zip_wrong_atlanta | 55 Trinity Ave SW, Atlanta, GA, 10001 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Wrong ZIP (NYC) → correct to 30303 ARS source smarty · summary match-mailable · ZIP fixed 10001 → 30303 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 51 | ▸zip_missing_boston | 1 City Hall Sq, Boston, MA | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 25025 ARS source smarty · summary match-mailable · ZIP filled → 02201 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 52 | ▸zip_missing_denver | 1437 Bannock St, Denver, CO | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 08031 ARS source athena · summary match-mailable · ZIP filled → 80202 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 53 | ▸fips_ind_richmond | 900 E Broad St, Richmond, VA, 23219 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Richmond City Hall — independent city FIPS 51760, NOT Henrico/Chesterfield ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 54 | ▸fips_ind_baltimore | 100 Holliday St, Baltimore, MD, 21202 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Baltimore City Hall — independent city FIPS 24510, NOT Baltimore County 24005 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 55 | ▸fips_ind_stlouis | 1200 Market St, Saint Louis, MO, 63103 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
St. Louis City Hall — independent city FIPS 29510, NOT St. Louis County 29189 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 56 | ▸fips_ind_norfolk | 810 Union St, Norfolk, VA, 23510 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Norfolk City Hall — independent city FIPS 51710 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 57 | ▸fips_ind_alexandria | 301 King St, Alexandria, VA, 22314 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Alexandria City Hall — independent city FIPS 51510 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 58 | ▸zip_lead0_providence | 25 Dorrance St, Providence, RI, 02903 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Providence City Hall — leading-zero ZIP, FIPS 44007 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 59 | ▸zip_lead0_hartford | 550 Main St, Hartford, CT, 06103 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Hartford City Hall — leading-zero ZIP, FIPS 09003 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 60 | ▸zip_lead0_newark | 920 Broad St, Newark, NJ, 07102 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Newark City Hall — leading-zero ZIP, FIPS 34013 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 61 | ▸zip_lead0_portland_me | 389 Congress St, Portland, ME, 04101 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Portland ME City Hall — leading-zero ZIP, FIPS 23005 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 62 | ▸zip_lead0_manchester | 1 City Hall Plaza, Manchester, NH, 03101 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Manchester NH City Hall — leading-zero ZIP, FIPS 33011 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 63 | ▸fips_honolulu | 530 S King St, Honolulu, HI, 96813 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Honolulu Hale — FIPS 15003 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 64 | ▸fips_anchorage | 632 W 6th Ave, Anchorage, AK, 99501 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Anchorage City Hall — FIPS 02020 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 65 | ▸fips_sanjuan_pr | 171 Av Fernández Juncos, San Juan, PR, 00901 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
San Juan PR — territory, urbanization-style addr, FIPS 72127 ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 66 | ▸city_saint_paul | 15 Kellogg Blvd W, Saint Paul, MN, 55102 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Saint Paul — 'Saint' vs 'St', FIPS 27123 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 67 | ▸city_hyphen | 101 N Main St, Winston-Salem, NC, 27101 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Winston-Salem — hyphenated city, FIPS 37067 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 68 | ▸city_apostrophe | 710 E Mullan Ave, Coeur d'Alene, ID, 83814 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Coeur d'Alene — apostrophe+space, FIPS 16055 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 69 | ▸city_abbrev_input | 1600 Pennsylvania Ave NW, Washinton, DC, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Misspelled city 'Washinton' → resolve to Washington ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 70 | ▸city_la_abbrev | 200 N Spring St, L A, CA, 90012 | athena | ✓unit-only | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Malformed city 'L A' → Smarty mis-parses the 'L' as a secondary unit (# L) in delivery_line_1; ARS keeps the clean street line. The only divergence is that unit, and secondary units aren't scored, so this PASSES (delivery line badged unit-only). Same address with a clean 'Los Angeles' matches outright (see fips_la). ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 71 | ▸dl_grid_utah | 1300 E 1700 S, Salt Lake City, UT, 84105 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Utah grid address '1300 E 1700 S' ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 72 | ▸dl_two_word_dir | 1120 NW Couch St, Portland, OR, 97209 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Two-word directional 'NW' prefix ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 73 | ▸dl_dir_suffix | 100 Peachtree St NE, Atlanta, GA, 30303 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Directional SUFFIX 'NE' after street type ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 74 | ▸dl_us_highway | 10001 US Highway 441, Leesburg, FL, 34788 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
US Highway street form ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 75 | ▸dl_numbered_st | 30 W 21st St, New York, NY, 10010 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Numbered street '21st' ordinal parsing ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 76 | ▸dl_county_road | 5500 County Road 42, Savage, MN, 55378 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
County-road street form ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 77 | ▸zip_wrong_richmond | 900 E Broad St, Richmond, VA, 90001 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Wrong ZIP (LA) on Richmond → correct to 23219 + FIPS 51760 ARS source smarty · summary match-mailable · ZIP fixed 90001 → 23219 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 78 | ▸zip_missing_honolulu | 530 S King St, Honolulu, HI | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 15003 ARS source athena · summary match-mailable · ZIP filled → 96813 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 79 | ▸zip_missing_stlouis | 1200 Market St, Saint Louis, MO | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, independent-city FIPS 29510 ARS source smarty · summary match-mailable · ZIP filled → 63103 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 80 | ▸zip_wrong_state_tx | 901 Bagby St, Houston, FL, 77002 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Wrong STATE (FL not TX) w/ correct Houston ZIP → state correction ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 81 | ▸unit_apt_nyc | 8 Spruce St Apt 30A, New York, NY, 10038 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Condo tower 'Apt 30A' — unit preservation ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 82 | ▸unit_hash | 330 W 38th St # 1105, New York, NY, 10018 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'#' unit designator ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 83 | ▸unit_unit_chi | 201 W Grand Ave Unit 2103, Chicago, IL, 60654 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'Unit' designator high-rise ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 84 | ▸unit_ste_office | 233 S Wacker Dr Ste 4200, Chicago, IL, 60606 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'Ste' office suite (Willis Tower) ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 85 | ▸unit_fl_floor | 30 Rockefeller Plz Fl 65, New York, NY, 10112 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'Fl' floor designator ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 86 | ▸unit_apt_miami | 100 Biscayne Blvd Apt 1408, Miami, FL, 33132 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Miami condo Apt — county_fips 12086 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 87 | ▸unit_apt_dtla | 1100 S Hope St Apt 2407, Los Angeles, CA, 90015 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
DTLA condo high unit ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 88 | ▸unit_mobile_lot | 8500 E Southern Ave Lot 120, Mesa, AZ, 85209 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Mobile-home 'Lot' designator ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 89 | ▸unit_no_word | 20 Pine St 2210, New York, NY, 10005 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Unit number with NO designator word ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 90 | ▸unit_denver | 1133 14th St Unit 3850, Denver, CO, 80202 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
High-rise residence 'Unit' designator ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 91 | ▸defect_a_ct_18 | 660 Mulberry Ct, 60901 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[A] Ct/state confusion r18 — ARS returns street '660'; expect '660 Mulberry Ct', Kankakee IL 60901 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 92 | ▸defect_a_ct_78 | 2640 Sapphire Ct, 10451 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[A] Ct/state confusion r78 — ARS returns street '2640'; expect '2640 Sapphire Ct', Bronx NY 10451 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 93 | ▸defect_a_ct_102 | 640 Beige Ct, 80901 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[A] Ct/state confusion r102 — ARS returns street '640'; expect '640 Beige Ct', Colorado Springs CO 80901 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 94 | ▸defect_b_ord_390 | 123 1ST ST, 90001 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[B] ordinal suffix stolen r390 — ARS '123 1st' (drops St); expect '123 1st St', Los Angeles CA 90001 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 95 | ▸defect_b_ord_397 | 258 7TH ST, 19101 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[B] ordinal suffix stolen r397 — ARS '258 7th' (drops St); expect '258 7th St', Philadelphia PA 19101 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 96 | ▸defect_b_ord_399 | 741 9TH ST, 30301 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[B] ordinal suffix stolen r399 — ARS '741 9th' (drops St); expect '741 9th St', Atlanta GA 30301 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 97 | ▸defect_b_ord_401 | 963 4TH ST, 48201 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[B] ordinal suffix stolen r401 — ARS '963 4th' (drops St); expect '963 4th St', Detroit MI 48201 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 98 | ▸defect_b_ord_403 | 357 8TH ST, 80201 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[B] ordinal suffix stolen r403 — ARS '357 8th' (drops St); expect '357 8th St', Denver CO 80201 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 99 | ▸defect_c_unit_249 | 900 Chestnut Cir Apt 7, 33101 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[C] token boundary drop r249 — ARS 'Cir Apt 7 33101'; expect '900 Chestnut Cir Apt 7', Miami FL 33101 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 100 | ▸defect_c_unit_270 | 800 Sequoia Ct Unit E, 27601 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[C] token boundary drop r270 — ARS drops 'Unit E' → '800 Sequoia Ct'; expect '800 Sequoia Ct Unit E', Raleigh NC 27601 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 101 | ▸defect_d_long_439 | 12345 Intercontinental Airport Expressway Frontage Rd, 77032 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[D] long-street truncation r439 — ARS '12345 Intercontinental Airport Expi'; expect full 'Expressway Frontage Rd', Houston TX 77032 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 102 | ▸defect_d_long_448 | 9173 Southwest Desert Mountain Foothills Pkwy, 85745 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[D] long-street truncation r448 — ARS '9173 SW Desert Mt'; expect '9173 SW Desert Mountain Foothills Pkwy', Tucson AZ 85745 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 103 | ▸defect_d_multicity_453 | 800 El Camino Real, 94025 | smarty | ✗ | ✓ | ✓ | ✓ | ✓ | 80% | PARTIAL | |||||||||||||||||||||||
[D] long-street truncation r453 — ARS '800 El'; expect '800 El Camino Real', Menlo Park CA 94025 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
Click any row to expand the field-by-field ARS-vs-Smarty detail. A green cell = the two agree; ✗ = they differ on that field.
What counts
Each address is scored on exactly five fields. A row PASSES only if all five match Smarty. Score = matched / 5.
| Scored field | Meaning |
|---|---|
| Delivery line | Standardized street line (delivery_line_1). Primary deliverability field. |
| City | USPS city name (city_name). |
| State | 2-letter state (state_abbreviation). |
| ZIP | 5-digit ZIP (zipcode, +4 normalized away). Corrected/filled where input was wrong/missing. |
| FIPS | 5-digit county FIPS (county_fips). Drives every geo join. |
Excluded by design
plus4, rdi, precision, and dpv_match_code are NOT scored — out of scope for this Q&A.
Secondary units (apartment / suite / #)
The delivery line is scored on its primary street portion, but a secondary unit (#, Apt, Ste, Fl, Unit, Lot …) is excused only when the input never carried one. Two cases:
Phantom unit → PASS. When a malformed input makes Smarty fabricate a unit the input did not have — e.g. a city like L A makes Smarty mis-parse the L as # L while ARS keeps the clean street — the row PASSES, badged ✓unit-only. ARS holding the clean street is correct.
Dropped unit → FAIL. When the input carried a unit (e.g. 800 Sequoia Ct Unit E) and ARS dropped or changed it relative to Smarty, that is lost data and counts as a real delivery-line mismatch — even though the primary street agrees. ARS must preserve the unit in delivery line 1 or 2 to pass.
No-match agreed
For garbage / foreign inputs, when ARS returns no-match AND Smarty has no confirmed delivery point (DPV unconfirmed), both agree the address is undeliverable. Such rows count as PASS and are badged PASS · NM — Smarty echoing the parsed input back is not held against ARS.
Each card: the raw input, ARS's standardization, and Smarty's. Red = the two disagree on a scored field.
0 · zip_wrong_whitehouseWhite House w/ a WRONG ZIP (10001 is NYC) → must correct to 20500PASS 100%
Input
1600 Pennsylvania Ave NW, Washington, DC, 10001
ARS smarty
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
1 · zip_missing_whitehouseWhite House, no ZIP → must fill 20500 from street+city+statePASS 100%
Input
1600 Pennsylvania Ave NW, Washington, DC
ARS smarty
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
2 · zip_missing_empireEmpire State Bldg, no ZIP → must fill 10118PASS 100%
Input
350 5th Ave, New York, NY
ARS smarty
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10001
FIPS36061
Smarty ground truth
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10001
FIPS36061
3 · zip_missing_miamiMiami City Hall, no ZIP → fill + county_fips 12086PASS 100%
Input
3500 Pan American Dr, Miami, FL
ARS athena
Delivery line3500 PAN AMERICAN DR
CityMIAMI
StateFL
ZIP33133
FIPS12086
Smarty ground truth
Delivery line3500 PAN AMERICAN DR
CityMIAMI
StateFL
ZIP33133
FIPS12086
4 · zip_missing_phoenixPhoenix City Hall, no ZIP → fill + county_fips 04013PASS 100%
Input
200 W Washington St, Phoenix, AZ
ARS athena
Delivery line200 W WASHINGTON ST
CityPHOENIX
StateAZ
ZIP85003
FIPS04013
Smarty ground truth
Delivery line200 W WASHINGTON ST
CityPHOENIX
StateAZ
ZIP85003
FIPS04013
5 · zip_wrong_houstonHouston City Hall w/ impossible ZIP 99999 → must correct to 77002PASS 100%
Input
901 Bagby St, Houston, TX, 99999
ARS smarty
Delivery line901 BAGBY ST
CityHOUSTON
StateTX
ZIP77002
FIPS48201
Smarty ground truth
Delivery line901 BAGBY ST
CityHOUSTON
StateTX
ZIP77002
FIPS48201
6 · zip_short_phillyTruncated ZIP (191) → must expand/correct to a valid 5-digitPASS 100%
Input
1400 John F Kennedy Blvd, Philadelphia, PA, 191
ARS smarty
Delivery line1400 JOHN F KENNEDY BLVD
CityPHILADELPHIA
StatePA
ZIP19107
FIPS42101
Smarty ground truth
Delivery line1400 JOHN F KENNEDY BLVD
CityPHILADELPHIA
StatePA
ZIP19107
FIPS42101
7 · clean_civicWhite House — canonical clean DPV-Y baseline (correct ZIP)PASS 100%
Input
1600 Pennsylvania Ave NW, Washington, DC, 20500
ARS cache
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
8 · clean_landmarkEmpire State Bldg — high-rise, plus4 + precision checkPASS 100%
Input
350 5th Ave, New York, NY, 10118
ARS smarty
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10118
FIPS36061
Smarty ground truth
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10118
FIPS36061
9 · fips_miamiMiami City Hall — county_fips 12086PASS 100%
Input
3500 Pan American Dr, Miami, FL, 33133
ARS athena
Delivery line3500 PAN AMERICAN DR
CityMIAMI
StateFL
ZIP33133
FIPS12086
Smarty ground truth
Delivery line3500 PAN AMERICAN DR
CityMIAMI
StateFL
ZIP33133
FIPS12086
10 · fips_maricopaPhoenix City Hall — county_fips 04013PASS 100%
Input
200 W Washington St, Phoenix, AZ, 85003
ARS athena
Delivery line200 W WASHINGTON ST
CityPHOENIX
StateAZ
ZIP85003
FIPS04013
Smarty ground truth
Delivery line200 W WASHINGTON ST
CityPHOENIX
StateAZ
ZIP85003
FIPS04013
11 · fips_phillyPhiladelphia City Hall — county_fips 42101PASS 100%
Input
1400 John F Kennedy Blvd, Philadelphia, PA, 19107
ARS athena
Delivery line1400 JOHN F KENNEDY BLVD
CityPHILADELPHIA
StatePA
ZIP19107
FIPS42101
Smarty ground truth
Delivery line1400 JOHN F KENNEDY BLVD
CityPHILADELPHIA
StatePA
ZIP19107
FIPS42101
12 · fips_harrisHouston City Hall — county_fips 48201PASS 100%
Input
901 Bagby St, Houston, TX, 77002
ARS athena
Delivery line901 BAGBY ST
CityHOUSTON
StateTX
ZIP77002
FIPS48201
Smarty ground truth
Delivery line901 BAGBY ST
CityHOUSTON
StateTX
ZIP77002
FIPS48201
13 · fips_jacksonJackson County courthouse — county_fips 29095PASS 100%
Input
415 E 12th St, Kansas City, MO, 64106
ARS athena
Delivery line415 E 12TH ST
CityKANSAS CITY
StateMO
ZIP64106
FIPS29095
Smarty ground truth
Delivery line415 E 12TH ST
CityKANSAS CITY
StateMO
ZIP64106
FIPS29095
14 · zip_plus4ZIP+4 input → ARS must normalize to ZIP5 for matching, still mailablePASS 100%
Input
1 Infinite Loop, Cupertino, CA, 95014-2083
ARS smarty
Delivery line1 INFINITE LOOP
CityCUPERTINO
StateCA
ZIP95014
FIPS06085
Smarty ground truth
Delivery line1 INFINITE LOOP
CityCUPERTINO
StateCA
ZIP95014
FIPS06085
15 · dup_tokensDuplicated street token → preprocessing should dedupe and still matchPASS 100%
Input
350 5th Ave Ave, New York, NY, 10118
ARS smarty
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10118
FIPS36061
Smarty ground truth
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10118
FIPS36061
16 · messy_caseAll-lowercase → casing must not change standardizationPASS 100%
Input
1600 pennsylvania ave nw, washington, dc, 20500
ARS cache
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
17 · abbrev_expandDirectional + abbrev St → both should expand consistentlyPASS 100%
Input
1 N State St, Chicago, IL, 60602
ARS smarty
Delivery line1 N STATE ST
CityCHICAGO
StateIL
ZIP60602
FIPS17031
Smarty ground truth
Delivery line1 N STATE ST
CityCHICAGO
StateIL
ZIP60602
FIPS17031
18 · extra_spaceCollapsed whitespace — tokenization robustnessPASS 100%
Input
350 5th Ave, New York, NY, 10118
ARS smarty
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10118
FIPS36061
Smarty ground truth
Delivery line350 5TH AVE
CityNEW YORK
StateNY
ZIP10118
FIPS36061
19 · no_city_stateMissing city/state but ZIP present → should still resolvePASS 100%
Input
1600 Pennsylvania Ave NW, 20500
ARS cache
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
20 · street_onlyStreet only, no ZIP/city/state → expect no-match or low-confidencePASS · NM 100%
Input
1600 Pennsylvania Ave NW
ARS null
Delivery line—
City—
State—
ZIP—
FIPS—
Smarty ground truth
Delivery line—
City—
State—
ZIP—
FIPS—
21 · mf_with_unitMultifamily WITH unit → unit must be preserved in delivery_line_2PASS 100%
Input
20 W 34th St Apt 1000, New York, NY, 10001
ARS smarty
Delivery line20 W 34TH ST APT 1000
CityNEW YORK
StateNY
ZIP10118
FIPS36061
Smarty ground truth
Delivery line20 W 34TH ST APT 1000
CityNEW YORK
StateNY
ZIP10118
FIPS36061
22 · mf_no_unitMultifamily NO unit → DPV may flag, both should agree on flagPASS 100%
Input
100 Beacon St, Boston, MA, 02116
ARS athena
Delivery line100 BEACON ST
CityBOSTON
StateMA
ZIP02116
FIPS25025
Smarty ground truth
Delivery line100 BEACON ST
CityBOSTON
StateMA
ZIP02116
FIPS25025
23 · suite_variantSuite designator variant — secondary-unit handlingPASS 100%
Input
30 Rockefeller Plaza Ste 100, New York, NY, 10112
ARS smarty
Delivery line30 ROCKEFELLER PLZ STE 100
CityNEW YORK
StateNY
ZIP10112
FIPS36061
Smarty ground truth
Delivery line30 ROCKEFELLER PLZ STE 100
CityNEW YORK
StateNY
ZIP10112
FIPS36061
24 · po_boxPO Box — RDI/precision differs, both must agreePASS 100%
Input
PO Box 1142, Washington, DC, 20013
ARS smarty
Delivery linePO BOX 1142
CityWASHINGTON
StateDC
ZIP20013
FIPS11001
Smarty ground truth
Delivery linePO BOX 1142
CityWASHINGTON
StateDC
ZIP20013
FIPS11001
25 · rural_routeRural route — non-city-stylePASS 100%
Input
RR 2 Box 152, Jackson, KY, 40387
ARS smarty
Delivery line2 BOX 152
CityJACKSON
StateKY
ZIP40387
FIPS21165
Smarty ground truth
Delivery line2 BOX 152
CityJACKSON
StateKY
ZIP40387
FIPS21165
26 · directional_heavyDirectional-heavy — leading directionalPASS 100%
Input
1 N 1st St, Phoenix, AZ, 85004
ARS athena
Delivery line1 N 1ST ST
CityPHOENIX
StateAZ
ZIP85004
FIPS04013
Smarty ground truth
Delivery line1 N 1ST ST
CityPHOENIX
StateAZ
ZIP85004
FIPS04013
27 · nonexistentFabricated street → both no-match (DPV X)PASS 100%
Input
99999 Nowhere Fake St, Springfield, IL, 62701
ARS smarty
Delivery line99999 NOWHERE FAKE ST
CitySPRINGFIELD
StateIL
ZIP62701
FIPS17167
Smarty ground truth
Delivery line99999 NOWHERE FAKE ST
CitySPRINGFIELD
StateIL
ZIP62701
FIPS17167
28 · garbageGarbage tokens + invalid ZIP → both no-matchPASS · NM 100%
Input
asdf qwer zxcv, 00000
ARS null
Delivery line—
City—
State—
ZIP—
FIPS—
Smarty ground truth
Delivery lineASDF QWER CV
City—
State—
ZIP00000
FIPS—
29 · foreignForeign (UK) → US-only APIs no-match; foreign-handling parityPASS · NM 100%
Input
10 Downing Street, London
ARS null
Delivery line—
City—
State—
ZIP—
FIPS—
Smarty ground truth
Delivery line10 DOWNING ST
CityLONDON
State—
ZIP—
FIPS—
30 · bad_zip_for_stateState/ZIP mismatch (DC ZIP, CA state) → corrected or flaggedPASS 100%
Input
1600 Pennsylvania Ave NW, Washington, CA, 20500
ARS cache
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
31 · fips_laLA City Hall — FIPS 06037PASS 100%
Input
200 N Spring St, Los Angeles, CA, 90012
ARS athena
Delivery line200 N SPRING ST
CityLOS ANGELES
StateCA
ZIP90012
FIPS06037
Smarty ground truth
Delivery line200 N SPRING ST
CityLOS ANGELES
StateCA
ZIP90012
FIPS06037
32 · fips_seattleSeattle City Hall — FIPS 53033PASS 100%
Input
600 4th Ave, Seattle, WA, 98104
ARS athena
Delivery line600 4TH AVE
CitySEATTLE
StateWA
ZIP98104
FIPS53033
Smarty ground truth
Delivery line600 4TH AVE
CitySEATTLE
StateWA
ZIP98104
FIPS53033
33 · fips_denverDenver City/County Bldg — FIPS 08031PASS 100%
Input
1437 Bannock St, Denver, CO, 80202
ARS athena
Delivery line1437 BANNOCK ST
CityDENVER
StateCO
ZIP80202
FIPS08031
Smarty ground truth
Delivery line1437 BANNOCK ST
CityDENVER
StateCO
ZIP80202
FIPS08031
34 · fips_atlantaAtlanta City Hall — FIPS 13121PASS 100%
Input
55 Trinity Ave SW, Atlanta, GA, 30303
ARS smarty
Delivery line55 TRINITY AVE SW
CityATLANTA
StateGA
ZIP30303
FIPS13121
Smarty ground truth
Delivery line55 TRINITY AVE SW
CityATLANTA
StateGA
ZIP30303
FIPS13121
35 · fips_bostonBoston City Hall — FIPS 25025PASS 100%
Input
1 City Hall Sq, Boston, MA, 02201
ARS athena
Delivery line1 CITY HALL SQ
CityBOSTON
StateMA
ZIP02201
FIPS25025
Smarty ground truth
Delivery line1 CITY HALL SQ
CityBOSTON
StateMA
ZIP02201
FIPS25025
36 · fips_detroitDetroit City Hall — FIPS 26163PASS 100%
Input
2 Woodward Ave, Detroit, MI, 48226
ARS smarty
Delivery line2 WOODWARD AVE
CityDETROIT
StateMI
ZIP48226
FIPS26163
Smarty ground truth
Delivery line2 WOODWARD AVE
CityDETROIT
StateMI
ZIP48226
FIPS26163
37 · fips_nashvilleNashville Metro — FIPS 47037PASS 100%
Input
1 Public Sq, Nashville, TN, 37201
ARS athena
Delivery line1 PUBLIC SQ
CityNASHVILLE
StateTN
ZIP37201
FIPS47037
Smarty ground truth
Delivery line1 PUBLIC SQ
CityNASHVILLE
StateTN
ZIP37201
FIPS47037
38 · fips_nolaNew Orleans City Hall — FIPS 22071PASS 100%
Input
1300 Perdido St, New Orleans, LA, 70112
ARS smarty
Delivery line1300 PERDIDO ST
CityNEW ORLEANS
StateLA
ZIP70112
FIPS22071
Smarty ground truth
Delivery line1300 PERDIDO ST
CityNEW ORLEANS
StateLA
ZIP70112
FIPS22071
39 · fips_portlandPortland City Hall — FIPS 41051PASS 100%
Input
1221 SW 4th Ave, Portland, OR, 97204
ARS smarty
Delivery line1221 SW 4TH AVE
CityPORTLAND
StateOR
ZIP97204
FIPS41051
Smarty ground truth
Delivery line1221 SW 4TH AVE
CityPORTLAND
StateOR
ZIP97204
FIPS41051
40 · fips_vegasLas Vegas City Hall — FIPS 32003PASS 100%
Input
495 S Main St, Las Vegas, NV, 89101
ARS smarty
Delivery line495 S MAIN ST
CityLAS VEGAS
StateNV
ZIP89101
FIPS32003
Smarty ground truth
Delivery line495 S MAIN ST
CityLAS VEGAS
StateNV
ZIP89101
FIPS32003
41 · fips_saltlakeSLC City Hall — FIPS 49035PASS 100%
Input
451 S State St, Salt Lake City, UT, 84111
ARS athena
Delivery line451 S STATE ST
CitySALT LAKE CITY
StateUT
ZIP84111
FIPS49035
Smarty ground truth
Delivery line451 S STATE ST
CitySALT LAKE CITY
StateUT
ZIP84111
FIPS49035
42 · fips_columbusColumbus City Hall — FIPS 39049PASS 100%
Input
90 W Broad St, Columbus, OH, 43215
ARS athena
Delivery line90 W BROAD ST
CityCOLUMBUS
StateOH
ZIP43215
FIPS39049
Smarty ground truth
Delivery line90 W BROAD ST
CityCOLUMBUS
StateOH
ZIP43215
FIPS39049
43 · dl_highrise_suiteWillis Tower high suitePASS 100%
Input
233 S Wacker Dr Ste 8400, Chicago, IL, 60606
ARS smarty
Delivery line233 S WACKER DR STE 8400
CityCHICAGO
StateIL
ZIP60606
FIPS17031
Smarty ground truth
Delivery line233 S WACKER DR STE 8400
CityCHICAGO
StateIL
ZIP60606
FIPS17031
44 · dl_aptApartment unit — delivery_line_2 preservationPASS 100%
Input
1 Astor Pl Apt 5B, New York, NY, 10003
ARS smarty
Delivery line1 ASTOR PL APT 5B
CityNEW YORK
StateNY
ZIP10003
FIPS36061
Smarty ground truth
Delivery line1 ASTOR PL APT 5B
CityNEW YORK
StateNY
ZIP10003
FIPS36061
45 · dl_hyphen_queensQueens hyphenated house number '30-30'PASS 100%
Input
30-30 47th Ave, Long Island City, NY, 11101
ARS smarty
Delivery line3030 47TH AVE
CityLONG ISLAND CITY
StateNY
ZIP11101
FIPS36081
Smarty ground truth
Delivery line3030 47TH AVE
CityLONG ISLAND CITY
StateNY
ZIP11101
FIPS36081
46 · dl_halfFractional house number '123 1/2'PASS 100%
Input
123 1/2 Elm St, Dallas, TX, 75201
ARS smarty
Delivery line123 ELM ST
CityDALLAS
StateTX
ZIP75201
FIPS48113
Smarty ground truth
Delivery line123 ELM ST
CityDALLAS
StateTX
ZIP75201
FIPS48113
47 · dl_ordinalOrdinal street — Dakota BldgPASS 100%
Input
1 W 72nd St, New York, NY, 10023
ARS smarty
Delivery line1 W 72ND ST
CityNEW YORK
StateNY
ZIP10023
FIPS36061
Smarty ground truth
Delivery line1 W 72ND ST
CityNEW YORK
StateNY
ZIP10023
FIPS36061
48 · zip_missing_laNo ZIP → fill, FIPS 06037PASS 100%
Input
200 N Spring St, Los Angeles, CA
ARS athena
Delivery line200 N SPRING ST
CityLOS ANGELES
StateCA
ZIP90012
FIPS06037
Smarty ground truth
Delivery line200 N SPRING ST
CityLOS ANGELES
StateCA
ZIP90012
FIPS06037
49 · zip_missing_seattleNo ZIP → fill, FIPS 53033PASS 100%
Input
600 4th Ave, Seattle, WA
ARS athena
Delivery line600 4TH AVE
CitySEATTLE
StateWA
ZIP98104
FIPS53033
Smarty ground truth
Delivery line600 4TH AVE
CitySEATTLE
StateWA
ZIP98104
FIPS53033
50 · zip_wrong_atlantaWrong ZIP (NYC) → correct to 30303PASS 100%
Input
55 Trinity Ave SW, Atlanta, GA, 10001
ARS smarty
Delivery line55 TRINITY AVE SW
CityATLANTA
StateGA
ZIP30303
FIPS13121
Smarty ground truth
Delivery line55 TRINITY AVE SW
CityATLANTA
StateGA
ZIP30303
FIPS13121
51 · zip_missing_bostonNo ZIP → fill, FIPS 25025PASS 100%
Input
1 City Hall Sq, Boston, MA
ARS smarty
Delivery line1 CITY HALL SQ
CityBOSTON
StateMA
ZIP02201
FIPS25025
Smarty ground truth
Delivery line1 CITY HALL SQ
CityBOSTON
StateMA
ZIP02201
FIPS25025
52 · zip_missing_denverNo ZIP → fill, FIPS 08031PASS 100%
Input
1437 Bannock St, Denver, CO
ARS athena
Delivery line1437 BANNOCK ST
CityDENVER
StateCO
ZIP80202
FIPS08031
Smarty ground truth
Delivery line1437 BANNOCK ST
CityDENVER
StateCO
ZIP80202
FIPS08031
53 · fips_ind_richmondRichmond City Hall — independent city FIPS 51760, NOT Henrico/ChesterfieldPASS 100%
Input
900 E Broad St, Richmond, VA, 23219
ARS athena
Delivery line900 E BROAD ST
CityRICHMOND
StateVA
ZIP23219
FIPS51760
Smarty ground truth
Delivery line900 E BROAD ST
CityRICHMOND
StateVA
ZIP23219
FIPS51760
54 · fips_ind_baltimoreBaltimore City Hall — independent city FIPS 24510, NOT Baltimore County 24005PASS 100%
Input
100 Holliday St, Baltimore, MD, 21202
ARS athena
Delivery line100 HOLLIDAY ST
CityBALTIMORE
StateMD
ZIP21202
FIPS24510
Smarty ground truth
Delivery line100 HOLLIDAY ST
CityBALTIMORE
StateMD
ZIP21202
FIPS24510
55 · fips_ind_stlouisSt. Louis City Hall — independent city FIPS 29510, NOT St. Louis County 29189PASS 100%
Input
1200 Market St, Saint Louis, MO, 63103
ARS smarty
Delivery line1200 MARKET ST
CitySAINT LOUIS
StateMO
ZIP63103
FIPS29510
Smarty ground truth
Delivery line1200 MARKET ST
CitySAINT LOUIS
StateMO
ZIP63103
FIPS29510
56 · fips_ind_norfolkNorfolk City Hall — independent city FIPS 51710PASS 100%
Input
810 Union St, Norfolk, VA, 23510
ARS athena
Delivery line810 UNION ST
CityNORFOLK
StateVA
ZIP23510
FIPS51710
Smarty ground truth
Delivery line810 UNION ST
CityNORFOLK
StateVA
ZIP23510
FIPS51710
57 · fips_ind_alexandriaAlexandria City Hall — independent city FIPS 51510PASS 100%
Input
301 King St, Alexandria, VA, 22314
ARS athena
Delivery line301 KING ST
CityALEXANDRIA
StateVA
ZIP22314
FIPS51510
Smarty ground truth
Delivery line301 KING ST
CityALEXANDRIA
StateVA
ZIP22314
FIPS51510
58 · zip_lead0_providenceProvidence City Hall — leading-zero ZIP, FIPS 44007PASS 100%
Input
25 Dorrance St, Providence, RI, 02903
ARS athena
Delivery line25 DORRANCE ST
CityPROVIDENCE
StateRI
ZIP02903
FIPS44007
Smarty ground truth
Delivery line25 DORRANCE ST
CityPROVIDENCE
StateRI
ZIP02903
FIPS44007
59 · zip_lead0_hartfordHartford City Hall — leading-zero ZIP, FIPS 09003PASS 100%
Input
550 Main St, Hartford, CT, 06103
ARS smarty
Delivery line550 MAIN ST
CityHARTFORD
StateCT
ZIP06103
FIPS09110
Smarty ground truth
Delivery line550 MAIN ST
CityHARTFORD
StateCT
ZIP06103
FIPS09110
60 · zip_lead0_newarkNewark City Hall — leading-zero ZIP, FIPS 34013PASS 100%
Input
920 Broad St, Newark, NJ, 07102
ARS smarty
Delivery line920 BROAD ST
CityNEWARK
StateNJ
ZIP07102
FIPS34013
Smarty ground truth
Delivery line920 BROAD ST
CityNEWARK
StateNJ
ZIP07102
FIPS34013
61 · zip_lead0_portland_mePortland ME City Hall — leading-zero ZIP, FIPS 23005PASS 100%
Input
389 Congress St, Portland, ME, 04101
ARS smarty
Delivery line389 CONGRESS ST
CityPORTLAND
StateME
ZIP04101
FIPS23005
Smarty ground truth
Delivery line389 CONGRESS ST
CityPORTLAND
StateME
ZIP04101
FIPS23005
62 · zip_lead0_manchesterManchester NH City Hall — leading-zero ZIP, FIPS 33011PASS 100%
Input
1 City Hall Plaza, Manchester, NH, 03101
ARS smarty
Delivery line1 CITY HALL PLZ
CityMANCHESTER
StateNH
ZIP03101
FIPS33011
Smarty ground truth
Delivery line1 CITY HALL PLZ
CityMANCHESTER
StateNH
ZIP03101
FIPS33011
63 · fips_honoluluHonolulu Hale — FIPS 15003PASS 100%
Input
530 S King St, Honolulu, HI, 96813
ARS athena
Delivery line530 S KING ST
CityHONOLULU
StateHI
ZIP96813
FIPS15003
Smarty ground truth
Delivery line530 S KING ST
CityHONOLULU
StateHI
ZIP96813
FIPS15003
64 · fips_anchorageAnchorage City Hall — FIPS 02020PASS 100%
Input
632 W 6th Ave, Anchorage, AK, 99501
ARS smarty
Delivery line632 W 6TH AVE
CityANCHORAGE
StateAK
ZIP99501
FIPS02020
Smarty ground truth
Delivery line632 W 6TH AVE
CityANCHORAGE
StateAK
ZIP99501
FIPS02020
65 · fips_sanjuan_prSan Juan PR — territory, urbanization-style addr, FIPS 72127PASS 100%
Input
171 Av Fernández Juncos, San Juan, PR, 00901
ARS smarty
Delivery line171 AVE FERNANDEZ JUNCOS
CitySAN JUAN
StatePR
ZIP00901
FIPS72127
Smarty ground truth
Delivery line171 AVE FERNANDEZ JUNCOS
CitySAN JUAN
StatePR
ZIP00901
FIPS72127
66 · city_saint_paulSaint Paul — 'Saint' vs 'St', FIPS 27123PASS 100%
Input
15 Kellogg Blvd W, Saint Paul, MN, 55102
ARS athena
Delivery line15 KELLOGG BLVD W
CitySAINT PAUL
StateMN
ZIP55102
FIPS27123
Smarty ground truth
Delivery line15 KELLOGG BLVD W
CitySAINT PAUL
StateMN
ZIP55102
FIPS27123
67 · city_hyphenWinston-Salem — hyphenated city, FIPS 37067PASS 100%
Input
101 N Main St, Winston-Salem, NC, 27101
ARS athena
Delivery line101 N MAIN ST
CityWINSTON SALEM
StateNC
ZIP27101
FIPS37067
Smarty ground truth
Delivery line101 N MAIN ST
CityWINSTON SALEM
StateNC
ZIP27101
FIPS37067
68 · city_apostropheCoeur d'Alene — apostrophe+space, FIPS 16055PASS 100%
Input
710 E Mullan Ave, Coeur d'Alene, ID, 83814
ARS athena
Delivery line710 E MULLAN AVE
CityCOEUR D ALENE
StateID
ZIP83814
FIPS16055
Smarty ground truth
Delivery line710 E MULLAN AVE
CityCOEUR D ALENE
StateID
ZIP83814
FIPS16055
69 · city_abbrev_inputMisspelled city 'Washinton' → resolve to WashingtonPASS 100%
Input
1600 Pennsylvania Ave NW, Washinton, DC, 20500
ARS cache
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
Smarty ground truth
Delivery line1600 PENNSYLVANIA AVE NW
CityWASHINGTON
StateDC
ZIP20500
FIPS11001
70 · city_la_abbrevMalformed city 'L A' → Smarty mis-parses the 'L' as a secondary unit (# L) in delivery_line_1; ARS keeps the clean street line. The only divergence is that unit, and secondary units aren't scored, so this PASSES (delivery line badged unit-only). Same address with a clean 'Los Angeles' matches outright (see fips_la).PASS 100%
Input
200 N Spring St, L A, CA, 90012
ARS athena
Delivery line200 N SPRING ST
CityLOS ANGELES
StateCA
ZIP90012
FIPS06037
Smarty ground truth
Delivery line200 N SPRING ST # L
CityLOS ANGELES
StateCA
ZIP90012
FIPS06037
71 · dl_grid_utahUtah grid address '1300 E 1700 S'PASS 100%
Input
1300 E 1700 S, Salt Lake City, UT, 84105
ARS smarty
Delivery line1300 E 1700 S
CitySALT LAKE CITY
StateUT
ZIP84105
FIPS49035
Smarty ground truth
Delivery line1300 E 1700 S
CitySALT LAKE CITY
StateUT
ZIP84105
FIPS49035
72 · dl_two_word_dirTwo-word directional 'NW' prefixPASS 100%
Input
1120 NW Couch St, Portland, OR, 97209
ARS smarty
Delivery line1120 NW COUCH ST
CityPORTLAND
StateOR
ZIP97209
FIPS41051
Smarty ground truth
Delivery line1120 NW COUCH ST
CityPORTLAND
StateOR
ZIP97209
FIPS41051
73 · dl_dir_suffixDirectional SUFFIX 'NE' after street typePASS 100%
Input
100 Peachtree St NE, Atlanta, GA, 30303
ARS smarty
Delivery line100 PEACHTREE ST NE
CityATLANTA
StateGA
ZIP30303
FIPS13121
Smarty ground truth
Delivery line100 PEACHTREE ST NE
CityATLANTA
StateGA
ZIP30303
FIPS13121
74 · dl_us_highwayUS Highway street formPASS 100%
Input
10001 US Highway 441, Leesburg, FL, 34788
ARS smarty
Delivery line10001 US HIGHWAY 441
CityLEESBURG
StateFL
ZIP34788
FIPS12069
Smarty ground truth
Delivery line10001 US HIGHWAY 441
CityLEESBURG
StateFL
ZIP34788
FIPS12069
75 · dl_numbered_stNumbered street '21st' ordinal parsingPASS 100%
Input
30 W 21st St, New York, NY, 10010
ARS athena
Delivery line30 W 21ST ST
CityNEW YORK
StateNY
ZIP10010
FIPS36061
Smarty ground truth
Delivery line30 W 21ST ST
CityNEW YORK
StateNY
ZIP10010
FIPS36061
76 · dl_county_roadCounty-road street formPASS 100%
Input
5500 County Road 42, Savage, MN, 55378
ARS smarty
Delivery line5500 W COUNTY ROAD 42
CitySAVAGE
StateMN
ZIP55378
FIPS27139
Smarty ground truth
Delivery line5500 W COUNTY ROAD 42
CitySAVAGE
StateMN
ZIP55378
FIPS27139
77 · zip_wrong_richmondWrong ZIP (LA) on Richmond → correct to 23219 + FIPS 51760PASS 100%
Input
900 E Broad St, Richmond, VA, 90001
ARS smarty
Delivery line900 E BROAD ST
CityRICHMOND
StateVA
ZIP23219
FIPS51760
Smarty ground truth
Delivery line900 E BROAD ST
CityRICHMOND
StateVA
ZIP23219
FIPS51760
78 · zip_missing_honoluluNo ZIP → fill, FIPS 15003PASS 100%
Input
530 S King St, Honolulu, HI
ARS athena
Delivery line530 S KING ST
CityHONOLULU
StateHI
ZIP96813
FIPS15003
Smarty ground truth
Delivery line530 S KING ST
CityHONOLULU
StateHI
ZIP96813
FIPS15003
79 · zip_missing_stlouisNo ZIP → fill, independent-city FIPS 29510PASS 100%
Input
1200 Market St, Saint Louis, MO
ARS smarty
Delivery line1200 MARKET ST
CitySAINT LOUIS
StateMO
ZIP63103
FIPS29510
Smarty ground truth
Delivery line1200 MARKET ST
CitySAINT LOUIS
StateMO
ZIP63103
FIPS29510
80 · zip_wrong_state_txWrong STATE (FL not TX) w/ correct Houston ZIP → state correctionPASS 100%
Input
901 Bagby St, Houston, FL, 77002
ARS athena
Delivery line901 BAGBY ST
CityHOUSTON
StateTX
ZIP77002
FIPS48201
Smarty ground truth
Delivery line901 BAGBY ST
CityHOUSTON
StateTX
ZIP77002
FIPS48201
81 · unit_apt_nycCondo tower 'Apt 30A' — unit preservationPASS 100%
Input
8 Spruce St Apt 30A, New York, NY, 10038
ARS smarty
Delivery line8 SPRUCE ST APT 30A
CityNEW YORK
StateNY
ZIP10038
FIPS36061
Smarty ground truth
Delivery line8 SPRUCE ST APT 30A
CityNEW YORK
StateNY
ZIP10038
FIPS36061
82 · unit_hash'#' unit designatorPASS 100%
Input
330 W 38th St # 1105, New York, NY, 10018
ARS smarty
Delivery line330 W 38TH ST RM 1105
CityNEW YORK
StateNY
ZIP10018
FIPS36061
Smarty ground truth
Delivery line330 W 38TH ST RM 1105
CityNEW YORK
StateNY
ZIP10018
FIPS36061
83 · unit_unit_chi'Unit' designator high-risePASS 100%
Input
201 W Grand Ave Unit 2103, Chicago, IL, 60654
ARS smarty
Delivery line201 W GRAND AVE UNIT 2103
CityCHICAGO
StateIL
ZIP60654
FIPS17031
Smarty ground truth
Delivery line201 W GRAND AVE UNIT 2103
CityCHICAGO
StateIL
ZIP60654
FIPS17031
84 · unit_ste_office'Ste' office suite (Willis Tower)PASS 100%
Input
233 S Wacker Dr Ste 4200, Chicago, IL, 60606
ARS smarty
Delivery line233 S WACKER DR STE 4200
CityCHICAGO
StateIL
ZIP60606
FIPS17031
Smarty ground truth
Delivery line233 S WACKER DR STE 4200
CityCHICAGO
StateIL
ZIP60606
FIPS17031
85 · unit_fl_floor'Fl' floor designatorPASS 100%
Input
30 Rockefeller Plz Fl 65, New York, NY, 10112
ARS smarty
Delivery line30 ROCKEFELLER PLZ FL 65
CityNEW YORK
StateNY
ZIP10112
FIPS36061
Smarty ground truth
Delivery line30 ROCKEFELLER PLZ FL 65
CityNEW YORK
StateNY
ZIP10112
FIPS36061
86 · unit_apt_miamiMiami condo Apt — county_fips 12086PASS 100%
Input
100 Biscayne Blvd Apt 1408, Miami, FL, 33132
ARS smarty
Delivery line100 BISCAYNE BLVD STE 1408
CityMIAMI
StateFL
ZIP33132
FIPS12086
Smarty ground truth
Delivery line100 BISCAYNE BLVD STE 1408
CityMIAMI
StateFL
ZIP33132
FIPS12086
87 · unit_apt_dtlaDTLA condo high unitPASS 100%
Input
1100 S Hope St Apt 2407, Los Angeles, CA, 90015
ARS smarty
Delivery line1100 S HOPE ST APT 2407
CityLOS ANGELES
StateCA
ZIP90015
FIPS06037
Smarty ground truth
Delivery line1100 S HOPE ST APT 2407
CityLOS ANGELES
StateCA
ZIP90015
FIPS06037
88 · unit_mobile_lotMobile-home 'Lot' designatorPASS 100%
Input
8500 E Southern Ave Lot 120, Mesa, AZ, 85209
ARS smarty
Delivery line8500 E SOUTHERN AVE LOT 120
CityMESA
StateAZ
ZIP85209
FIPS04013
Smarty ground truth
Delivery line8500 E SOUTHERN AVE LOT 120
CityMESA
StateAZ
ZIP85209
FIPS04013
89 · unit_no_wordUnit number with NO designator wordPASS 100%
Input
20 Pine St 2210, New York, NY, 10005
ARS smarty
Delivery line20 PINE ST APT 2210
CityNEW YORK
StateNY
ZIP10005
FIPS36061
Smarty ground truth
Delivery line20 PINE ST APT 2210
CityNEW YORK
StateNY
ZIP10005
FIPS36061
90 · unit_denverHigh-rise residence 'Unit' designatorPASS 100%
Input
1133 14th St Unit 3850, Denver, CO, 80202
ARS athena
Delivery line1133 14TH ST UNIT 3850
CityDENVER
StateCO
ZIP80202
FIPS08031
Smarty ground truth
Delivery line1133 14TH ST UNIT 3850
CityDENVER
StateCO
ZIP80202
FIPS08031
91 · defect_a_ct_18[A] Ct/state confusion r18 — ARS returns street '660'; expect '660 Mulberry Ct', Kankakee IL 60901PARTIAL 80%
Input
660 Mulberry Ct, 60901
ARS smarty
Delivery line660
CityKANKAKEE
StateIL
ZIP60901
FIPS17091
Smarty ground truth
Delivery line660 MULBERRY CT
CityKANKAKEE
StateIL
ZIP60901
FIPS17091
92 · defect_a_ct_78[A] Ct/state confusion r78 — ARS returns street '2640'; expect '2640 Sapphire Ct', Bronx NY 10451PARTIAL 80%
Input
2640 Sapphire Ct, 10451
ARS smarty
Delivery line2640
CityBRONX
StateNY
ZIP10451
FIPS36005
Smarty ground truth
Delivery line2640 SAPPHIRE CT
CityBRONX
StateNY
ZIP10451
FIPS36005
93 · defect_a_ct_102[A] Ct/state confusion r102 — ARS returns street '640'; expect '640 Beige Ct', Colorado Springs CO 80901PARTIAL 80%
Input
640 Beige Ct, 80901
ARS smarty
Delivery line640
CityCOLORADO SPRINGS
StateCO
ZIP80901
FIPS08041
Smarty ground truth
Delivery line640 BEIGE CT
CityCOLORADO SPRINGS
StateCO
ZIP80901
FIPS08041
94 · defect_b_ord_390[B] ordinal suffix stolen r390 — ARS '123 1st' (drops St); expect '123 1st St', Los Angeles CA 90001PARTIAL 80%
Input
123 1ST ST, 90001
ARS smarty
Delivery line123 1ST
CityLOS ANGELES
StateCA
ZIP90001
FIPS06037
Smarty ground truth
Delivery line123 1ST ST
CityLOS ANGELES
StateCA
ZIP90001
FIPS06037
95 · defect_b_ord_397[B] ordinal suffix stolen r397 — ARS '258 7th' (drops St); expect '258 7th St', Philadelphia PA 19101PARTIAL 80%
Input
258 7TH ST, 19101
ARS smarty
Delivery line258 7TH
CityPHILADELPHIA
StatePA
ZIP19101
FIPS42101
Smarty ground truth
Delivery line258 7TH ST
CityPHILADELPHIA
StatePA
ZIP19101
FIPS42101
96 · defect_b_ord_399[B] ordinal suffix stolen r399 — ARS '741 9th' (drops St); expect '741 9th St', Atlanta GA 30301PARTIAL 80%
Input
741 9TH ST, 30301
ARS smarty
Delivery line741 9TH
CityATLANTA
StateGA
ZIP30301
FIPS13121
Smarty ground truth
Delivery line741 9TH ST
CityATLANTA
StateGA
ZIP30301
FIPS13121
97 · defect_b_ord_401[B] ordinal suffix stolen r401 — ARS '963 4th' (drops St); expect '963 4th St', Detroit MI 48201PARTIAL 80%
Input
963 4TH ST, 48201
ARS smarty
Delivery line963 4TH
CityDETROIT
StateMI
ZIP48201
FIPS26163
Smarty ground truth
Delivery line963 4TH ST
CityDETROIT
StateMI
ZIP48201
FIPS26163
98 · defect_b_ord_403[B] ordinal suffix stolen r403 — ARS '357 8th' (drops St); expect '357 8th St', Denver CO 80201PARTIAL 80%
Input
357 8TH ST, 80201
ARS smarty
Delivery line357 8TH
CityDENVER
StateCO
ZIP80201
FIPS08031
Smarty ground truth
Delivery line357 8TH ST
CityDENVER
StateCO
ZIP80201
FIPS08031
99 · defect_c_unit_249[C] token boundary drop r249 — ARS 'Cir Apt 7 33101'; expect '900 Chestnut Cir Apt 7', Miami FL 33101PARTIAL 80%
Input
900 Chestnut Cir Apt 7, 33101
ARS smarty
Delivery lineCIR APT 7 33101
CityMIAMI
StateFL
ZIP33101
FIPS12086
Smarty ground truth
Delivery line900 CHESTNUT CIR APT 7
CityMIAMI
StateFL
ZIP33101
FIPS12086
100 · defect_c_unit_270[C] token boundary drop r270 — ARS drops 'Unit E' → '800 Sequoia Ct'; expect '800 Sequoia Ct Unit E', Raleigh NC 27601PARTIAL 80%
Input
800 Sequoia Ct Unit E, 27601
ARS smarty
Delivery line800 SEQUOIA CT
CityRALEIGH
StateNC
ZIP27601
FIPS37183
Smarty ground truth
Delivery line800 SEQUOIA CT UNIT E
CityRALEIGH
StateNC
ZIP27601
FIPS37183
101 · defect_d_long_439[D] long-street truncation r439 — ARS '12345 Intercontinental Airport Expi'; expect full 'Expressway Frontage Rd', Houston TX 77032PARTIAL 80%
Input
12345 Intercontinental Airport Expressway Frontage Rd, 77032
ARS smarty
Delivery line12345 INTERCONTINENTAL AIRPORT EXPY
CityHOUSTON
StateTX
ZIP77032
FIPS48201
Smarty ground truth
Delivery line12345 INTERCONTINENTAL AIRPORT EXPRESSWAY FRONTAGE RD
CityHOUSTON
StateTX
ZIP77032
FIPS48201
102 · defect_d_long_448[D] long-street truncation r448 — ARS '9173 SW Desert Mt'; expect '9173 SW Desert Mountain Foothills Pkwy', Tucson AZ 85745PARTIAL 80%
Input
9173 Southwest Desert Mountain Foothills Pkwy, 85745
ARS smarty
Delivery line9173 SW DESERT MT
CityTUCSON
StateAZ
ZIP85745
FIPS04019
Smarty ground truth
Delivery line9173 SW DESERT MOUNTAIN FOOTHILLS PKWY
CityTUCSON
StateAZ
ZIP85745
FIPS04019
103 · defect_d_multicity_453[D] long-street truncation r453 — ARS '800 El'; expect '800 El Camino Real', Menlo Park CA 94025PARTIAL 80%
Input
800 El Camino Real, 94025
ARS smarty
Delivery line800 EL
CityMENLO PARK
StateCA
ZIP94025
FIPS06081
Smarty ground truth
Delivery line800 EL CAMINO REAL
CityMENLO PARK
StateCA
ZIP94025
FIPS06081
What this is. Every synthetic address is resolved by ARS (as-is) and by Smarty directly. Smarty is treated as ground truth.
How to read a row. Five cells = the five scored fields. Green ✓ means ARS equals Smarty on that field; red ✗ means they differ. Score is matched-of-five; a row passes only at 5/5.
Src. How ARS resolved it — cache / athena are 8020's own data (the real test), smarty is passthrough.
Click a row to see the exact ARS and Smarty values side by side.
ARS audit · ars-api-poc · Smarty us-street ground truth · 104 addresses · generated 2026-06-15 from sync_compare.json. Internal.