feat(orders): rebuild the receipt parser against real captured email

The previous parser was written against synthetic fixtures shaped to match the code. It invented a table layout DoorDash does not send, generated order_reference from Math.random(), read the order date from a 'Date:' string present in no real message, and detected [Family] by searching the body for the substring 'family'. Its tests passed because the fixtures were built to satisfy it. Against 36 real DoorDash and 29 real Uber Eats receipts it does not work. Rebuilt from the real corpus. 63 of 65 now parse and validate; the 2 rejected are correctly rejected — one is an order-adjustment notice and one a refund, neither of which is a receipt. Corrects an inherited diagnosis: the Mad Mex 'Discounts -$24.09' was recorded as an HTML-flattening artefact masking a 'true discount of $9.45'. Parsing the table cells structurally returns the same figures and no $9.45 exists anywhere in the message — DoorDash genuinely prints a Discounts line that equals subtotal plus service fee, and the components fail to reconcile on 32 of 36 receipts. So the breakdown is stored as provenance and never gated on; validation instead cross-checks the two independently stated totals and the payment line, which is the number that becomes money. Real-world cases the corpus forced, none of which were in the spec: [Family] orders are LKR purchases for family in Sri Lanka (reading them as dollars inflates ~200x), Swiss orders arrive in CHF, grocery 'Final receipt' mails carry no Total Charged row, and a declined payment is printed alongside the successful retry and must be skipped or it records money that never moved. order_reference now comes from the Uber order UUID embedded in the body, or the provider message id where DoorDash supplies no order id at all — never random, so re-ingestion is genuinely idempotent.
2026-07-26 22:25:26 +10:00
parent 6d3b6e1a9d
commit 33db7d05ef
12 changed files with 4714 additions and 0 deletions
@@ -0,0 +1,254 @@
+[
+ {
+  "id": "19f89664ea7b3aeb",
+  "date": "Date: Wed, 22 Jul 2026 10:36:50 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Homey Meals",
+  "len": 38394
+ },
+ {
+  "id": "19f68fd09cd2c3f1",
+  "date": "Date: Thu, 16 Jul 2026 03:34:00 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Mad Mex",
+  "len": 37448
+ },
+ {
+  "id": "19f656a298f42858",
+  "date": "Date: Wed, 15 Jul 2026 10:54:42 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Carl's Jr.",
+  "len": 37970
+ },
+ {
+  "id": "19f605de9ab82216",
+  "date": "Date: Tue, 14 Jul 2026 11:23:14 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Delhi Nights - Sweets & Indian\r\n Cuisine",
+  "len": 38707
+ },
+ {
+  "id": "19f2b6390a95b665",
+  "date": "Date: Sat, 04 Jul 2026 04:29:32 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from TEG KEBABS & BIRYANI",
+  "len": 38005
+ },
+ {
+  "id": "19f2256c51714b9c",
+  "date": "Date: Thu, 02 Jul 2026 10:18:58 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Sri Dwaraka",
+  "len": 37817
+ },
+ {
+  "id": "19f1d0b003834626",
+  "date": "Date: Wed, 01 Jul 2026 09:38:07 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Taco Bell",
+  "len": 38019
+ },
+ {
+  "id": "19f1c301dda7332c",
+  "date": "Date: Wed, 01 Jul 2026 05:39:01 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Woolworths",
+  "len": 38753
+ },
+ {
+  "id": "19f0c5624707ae34",
+  "date": "Date: Sun, 28 Jun 2026 03:46:39 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from ALDI",
+  "len": 68206
+ },
+ {
+  "id": "19f0c0d0c33bf5c9",
+  "date": "Date: Sun, 28 Jun 2026 02:26:49 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from ALDI",
+  "len": 47419
+ },
+ {
+  "id": "19eed89eee79b624",
+  "date": "Date: Mon, 22 Jun 2026 04:14:59 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Woolworths",
+  "len": 48653
+ },
+ {
+  "id": "19eed498e3fb7fce",
+  "date": "Date: Mon, 22 Jun 2026 03:04:39 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Woolworths",
+  "len": 44104
+ },
+ {
+  "id": "19eed38ca77047a1",
+  "date": "Date: Mon, 22 Jun 2026 02:46:21 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Oporto",
+  "len": 38675
+ },
+ {
+  "id": "19ee9b9b1b7073c9",
+  "date": "Date: Sun, 21 Jun 2026 10:28:39 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37871
+ },
+ {
+  "id": "19e95be74e216594",
+  "date": "Date: Fri, 05 Jun 2026 03:05:46 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37817
+ },
+ {
+  "id": "19e854cdbf552dcf",
+  "date": "Date: Mon, 01 Jun 2026 22:27:45 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from TOMKINS BAKERY",
+  "len": 37741
+ },
+ {
+  "id": "19e8020eb0027109",
+  "date": "Date: Sun, 31 May 2026 22:21:39 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Tonmax Bakery",
+  "len": 37439
+ },
+ {
+  "id": "19e16b64b3f6dbad",
+  "date": "Date: Mon, 11 May 2026 11:05:04 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Woolworths",
+  "len": 39750
+ },
+ {
+  "id": "19e16b1a2d9526f8",
+  "date": "Date: Mon, 11 May 2026 11:00:00 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Burger Road",
+  "len": 38230
+ },
+ {
+  "id": "19e11390ea456222",
+  "date": "Date: Sun, 10 May 2026 09:30:11 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37847
+ },
+ {
+  "id": "19cdfa1d25f194a8",
+  "date": "Date: Thu, 12 Mar 2026 01:20:48 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Kesari Indian Kitchen",
+  "len": 37922
+ },
+ {
+  "id": "19cc62db0460b8a0",
+  "date": "Date: Sat, 07 Mar 2026 02:43:28 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37884
+ },
+ {
+  "id": "19ca1f0fa493f0ca",
+  "date": "Date: Sat, 28 Feb 2026 01:50:49 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37862
+ },
+ {
+  "id": "19c9c18ad4bf22e1",
+  "date": "Date: Thu, 26 Feb 2026 22:36:27 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Hungry Jacks",
+  "len": 37596
+ },
+ {
+  "id": "19c8ef02c0a0f590",
+  "date": "Date: Tue, 24 Feb 2026 09:17:09 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Schnitz",
+  "len": 38107
+ },
+ {
+  "id": "19c6e7cb5565afd5",
+  "date": "Date: Wed, 18 Feb 2026 02:03:12 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37418
+ },
+ {
+  "id": "19c4c4b1a0efa1e0",
+  "date": "Date: Wed, 11 Feb 2026 10:41:56 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from lahori fish n tikka",
+  "len": 37166
+ },
+ {
+  "id": "19c4013c5a7fac93",
+  "date": "Date: Mon, 09 Feb 2026 01:46:02 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Subway",
+  "len": 39212
+ },
+ {
+  "id": "19c30b95bf183a2b",
+  "date": "Date: Fri, 06 Feb 2026 02:12:59 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Souvlaki GR",
+  "len": 37776
+ },
+ {
+  "id": "19c30b773199c2fb",
+  "date": "Date: Fri, 06 Feb 2026 02:10:54 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Souvlaki GR",
+  "len": 37309
+ },
+ {
+  "id": "19c27f770fae04f2",
+  "date": "Date: Wed, 04 Feb 2026 09:24:13 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37440
+ },
+ {
+  "id": "19c21316b26e066f",
+  "date": "Date: Tue, 03 Feb 2026 01:50:11 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Punjabi bai sweets & Indian\r\n cuisine",
+  "len": 39289
+ },
+ {
+  "id": "19bf2e0fd25facda",
+  "date": "Date: Sun, 25 Jan 2026 01:59:48 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 38432
+ },
+ {
+  "id": "19bb18096ebd9bf5",
+  "date": "Date: Mon, 12 Jan 2026 09:19:12 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Woolworths",
+  "len": 42464
+ },
+ {
+  "id": "19bac527ef5fb1d4",
+  "date": "Date: Sun, 11 Jan 2026 09:10:45 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37833
+ },
+ {
+  "id": "19baad6dd7f80a9f",
+  "date": "Date: Sun, 11 Jan 2026 02:16:04 +0000 (UTC)",
+  "from": "From: DoorDash Order <no-reply@doordash.com>",
+  "subject": "Subject: Order Confirmation for Siddharth from Chilli India",
+  "len": 37334
+ }
+]