The Lexical Compiler
for the Unwritten Internet.
Reconstruct code-switched vernaculars (Hinglish, Arabizi) into canonical native script, standardized business English, and deterministic machine payloads with zero semantic drift.
Resolves 2nd 'me' as Hindi locative postposition (में / inside box) instead of pronoun duplicate.
वेट फॉर मी, पार्सल बॉक्स में रख दो प्लीज
"Wait for me, please put the parcel in the box."
{
"intent": "DELIVERY_INSTRUCTION",
"target": "LOGISTICS_SERVICE",
"action": "UPDATE_DELIVERY_NOTES"
}VernacTriage Compiler
Inspect character spans, cross-lingual homograph collisions, and deterministic semantic invariants in real time.
Deterministic Assertion Gateवेट फॉर मी, पार्सल बॉक्स में रख दो प्लीज
Wait for me, please put the parcel in the box.
THE BREAKING POINTWhy Generic Pipelines Struggle with Code-Switched Dialects
When speakers blend linguistic systems, identical character sequences represent fundamentally conflicting syntactic classes across intersecting grammars. Without contextual homograph resolution, standard models misclassify vital instructions.
Notice identical token me appears twice with radically different grammatical roles.
"Wait for me parcel box I keep please."
Grammatical failure: Logistics bot misinterprets customer as asking the courier to wait, dropping the instruction to place the item inside the container.
"Wait for me, please put the parcel in the box."
Intent classified as DELIVERY_INSTRUCTION. Correctly dispatches drop-off note to delivery agent app.
A 5-Stage Deterministic Reconstruction Pipeline
VernacTriage treats code-switched vernacular as a formal compilation target rather than unstructured text. Every transformation step is observable, traceable, and bounded by mathematical invariants.
Raw Ingestion & Span Indexing
Preserves exact character offsets [start_idx, end_idx] across mixed Unicode, punctuation, and non-standard spacing.
Phonetic Ear Reconstruction
Normalizes auditory phonetic spellings and alphanumeric contractions ('kl' → कल, '7awelt' → حاولت, 'b4' → before).
Contextual Homograph Disambiguation
Isolates colliding tokens like 'me' (English pronoun vs Hindi locative postposition) through surrounding syntactic dependencies.
Deterministic Verification Gate
Evaluates numeric invariance, negation parity, AST continuity, and entity grounding to mathematically eliminate drift.
Structured Enterprise Dispatch
Constructs validated, typed JSON payloads formatted for direct ingestion into CRM, logistics, and support APIs.
MATHEMATICAL GUARANTEESDeterministic Integrity Gate
Large language models produce probabilistic distributions. Enterprise infrastructure requires deterministic invariants. Before any payload leaves VernacTriage, it must satisfy five non-negotiable assertions.
assert(source_numerals == target_numerals)assert(negation_in_source == negation_in_target)assert(all(0 <= t.start_idx < t.end_idx <= len(raw)))assert(extracted_entities.issubset(ground_truth))assert(validate_json_schema(payload, TriageContract))Production Benchmark Suite
Audited across 36 adversarial code-switched dialogues in logistics, payments, transit, and customer escalation. Measured against ground truth linguistic annotations.
| ID | Dialect | Category | Input Sample | Predicted Intent | Invariants | Action |
|---|---|---|---|---|---|---|
| H01 | Hinglish | Logistics | Bhai kl parcel deliver ni hua, plz check kro na wrna refund initiate kr do ASAP | DELIVERY_ISSUE | 100% | |
| H02 | Hinglish | Payments | Mera account se amount debit ho gya par order status pending dikha rha h | PAYMENT_ISSUE | 100% | |
| H03 | Hinglish | Logistics | Delivery boy call ni utha rha, address confuse kr rha h shayad | DELIVERY_BOY_UNREACHABLE | 100% | |
| H04 | Hinglish | E-Commerce | Size bhot tight h, exchange krke large size bhej do plz | EXCHANGE_REQUEST | 100% | |
| H05 | Hinglish | Payments | Coupon code FIRST50 apply ni ho rha, error invalid aa rha | COUPON_ERROR | 100% | |
| H06 | Hinglish | Customer Support | App bar bar crash ho rhi h update k baad, unusable ho gyi h | APP_CRASH_BUG | 100% | |
| H07 | Hinglish | Logistics | Package damaged mila, seal broken thi aur 1 item missing h | DAMAGED_PACKAGE | 100% | |
| H08 | Hinglish | Payments | Refund kab tak credit hoga bank account me? 3 din ho gaye | REFUND_STATUS_INQUIRY | 100% | |
| H09 | Hinglish | Customer Support | Customer care number connect ni ho rha, koi call back kr skta h? | CALLBACK_REQUEST | 100% | |
| H10 | Hinglish | E-Commerce | Order cancel kr do, galti se double order place ho gya tha | CANCEL_ORDER | 100% | |
| H11 | Hinglish | Logistics | Delivery slot change krke evening 6pm to 8pm krdo plz | RESCHEDULE_DELIVERY | 100% | |
| H12 | Hinglish | Payments | Invoice bill send kr do mail pe, warranty claim k liye chaiye | INVOICE_REQUEST | 100% | |
| H13 | Hinglish | Logistics | Address update krna h, flat no 402 se 501 shift ho gya hu | UPDATE_ADDRESS | 100% | |
| H14 | Hinglish | Customer Support | OTP receive ni ho rha, resend krne pe bhi timeout aa rha h | OTP_VERIFICATION_ISSUE | 100% | |
| H15 | Hinglish | E-Commerce | Subscription auto renew ho gyi bina notification k, cancel aur refund do | SUBSCRIPTION_REFUND | 100% | |
| A01 | Arabizi | Transit & Commute | Yalla ya bro, el traffic ktir ktir zameh today, 7awel to arrive b4 8:00 | TRAFFIC_DELAY | 100% | |
| A02 | Arabizi | Logistics | Wen el order taba3i? Sarlo aktsar min sa3a w ma wesel | DELIVERY_DELAY_INQUIRY | 100% | |
| A03 | Arabizi | Logistics | Plz ghayer el delivery address la building 14 flat 302 | UPDATE_ADDRESS | 100% | |
| A04 | Arabizi | Payments | Dafe3t credit card bs ma 6ala3li receipt, check el transaction 3afak | PAYMENT_RECEIPT_MISSING | 100% | |
| A05 | Arabizi | Customer Support | Ana baddi cancel el subscription now, ma 3am esta3mel el service | CANCEL_SUBSCRIPTION | 100% | |
| A06 | Arabizi | Logistics | El driver ma rad 3al phone, 5allih yotlobni 3a hayda el ra9am 0501234567 | DRIVER_CONTACT_REQUEST | 100% | |
| A07 | Arabizi | Customer Support | El app fiha ktir bugs ba3d el last update, bte2fel liwa7daha | APP_CRASH_BUG | 100% | |
| A08 | Arabizi | Transit & Commute | Met2a5er 3al meeting 15 mins bsbab el ma6ar w el za7ma | MEETING_DELAY_NOTICE | 100% | |
| A09 | Arabizi | Payments | 7awalt 200 AED w ma woslo lel wallet, momken refund? | WALLET_TRANSFER_FAILED | 100% | |
| A10 | Arabizi | E-Commerce | El item wasal ghala6, talabt color aswad w ba3ato abiad | WRONG_ITEM_RECEIVED | 100% | |
| A11 | Arabizi | Customer Support | Baddi e7ki ma3 human agent plz, el bot ma 3am yefhamni | HUMAN_AGENT_REQUEST | 100% | |
| A12 | Arabizi | Logistics | Sayer 3endi emergency, 2ajel el delivery la bukra el se3a 4pm | RESCHEDULE_DELIVERY | 100% | |
| A13 | Arabizi | Payments | Khasamo el mablagh martein 3an nafss el order, raddoli el zyada | DOUBLE_CHARGE_DISPUTE | 100% | |
| A14 | Arabizi | Customer Support | Maba3atoli link el tracking la2an el email fi typo | TRACKING_LINK_INQUIRY | 100% | |
| A15 | Arabizi | Transit & Commute | Ma fi taxi bil sharesh 3ala main road, 7at2a5ar 3alkom shway | TRANSIT_DELAY | 100% | |
| H16 | Hinglish | Logistics | Wait for me parcel box me rakh do plz | DELIVERY_STATUS | 100%⚡ Homograph | |
| A16 | Arabizi | Logistics | Ya habibi el order ma wosel b4 5pm, 7awelt kaza mara, cancel it ASAP | CANCELLATION | 100% | |
| H17 | Hinglish | Payments | Bhai 4200 rupees deduct ho gaye but ticket book ni hui | FINANCIAL_DISPUTE | 100% | |
| H18 | Hinglish | Customer Support | Kal delivery aa jayegi na boss? | DELIVERY_STATUS | 100% | |
| H19 | Hinglish | Logistics | Plz check khrb status, order #8831 deliver ni hua | DELIVERY_ISSUE | 100% | |
| A17 | Arabizi | Payments | Walla el balance na2es 150 AED, sho el 7al ya akhi? | FINANCIAL_DISPUTE | 100% |
Compile the language your systems weren't built to understand.
Eliminate communication breakdown in high-growth vernacular markets. Ingest unstructured code-switched streams with cryptographic invariant verification.