Preprint / scholarly article

Inference in Normal Form: Unifying LLM Tricks via TRoT

K. Takahashi

Published
DOI
10.5281/zenodo.17389109

Abstract

Our formulation uses enriched category theory over the Lawvere cost quantale (tropical (min,+) semiring): left/right Kan extensions / / / , residuation (elementwise residuals), masking and nuclei (1-Lipschitz projectors).

Keywords

  • large language models
  • AI
  • llm inference
  • machine learning
  • decoding
  • mbr
  • conformal prediction
  • verifier
  • rag
  • chain-of-thought
  • tree-of-thought

Identifiers and source records