Skip to content

laya-serve

Jev-compatible HTTP server for Laya System One decision models. Point any Jev client at this server and get typed choice / score / noul answers from local Laya weights instead of the TypeSafe API.

Quickstart

pip install "laya-serve[inference]"
LAYA_SERVE_BACKEND=laya LAYA_SERVE_PRELOAD=true laya-serve
curl -X POST localhost:8000/v1/systemone \
  -H "Content-Type: application/json" -d '{
    "state": "Help! My payouts have been failing for 3 days.",
    "model": "jev-latest",
    "questions": {
      "department": {
        "type": "choice",
        "instructions": "Which team should handle this?",
        "criteria": {
          "billing": "Payments, invoicing, refunds",
          "technical": "Bugs, outages, integrations",
          "sales": "Pricing, upgrades, new accounts"
        }
      },
      "is_urgent": {"type": "noul", "instructions": "The message conveys urgency?"}
    }
  }'

Weight-free mode for API development and CI:

pip install -e ".[test]"
LAYA_SERVE_BACKEND=fake laya-serve  # deterministic uniform answers

Endpoints

Method Path Notes
POST /v1/systemone Jev-compatible evaluation endpoint
GET /v1/models Serving model + accepted aliases
GET /healthz Liveness probe (not part of the Jev API)

Interactive OpenAPI docs are served by the app itself at /docs (Swagger UI) and /redoc once the server is running.

Next steps