{"ref":"content:what-an-ai-infra-engineer-sees-when-opening-sap-s-ai-stack-1-3-the-model-gateway","page":"/content/what-an-ai-infra-engineer-sees-when-opening-sap-s-ai-stack-1-3-the-model-gateway","json":"/content/what-an-ai-infra-engineer-sees-when-opening-sap-s-ai-stack-1-3-the-model-gateway.json","generated":"2026-10-26","drafted_with_ai":true,"entity":{"id":"what-an-ai-infra-engineer-sees-when-opening-sap-s-ai-stack-1-3-the-model-gateway","title":"What an AI infra engineer sees when opening SAP's AI stack (1/3): the model gateway","url":"https://community.sap.com/t5/data-and-ai-professionals-blog-posts/what-an-ai-infra-engineer-sees-when-opening-sap-s-ai-stack-1-3-the-model/ba-p/14494320","content_type":"blog","published_on":"source:sap-community","explains":["capability:llm-integration","artifact:btp-ai-core","artifact:sap-ai-sdk-orchestration"],"summary":"A first look at [SAP AI Core](artifact:btp-ai-core)'s Generative AI Hub from someone who builds gateways outside SAP for a living: the orchestration service harmonizes provider calls onto one API (a model name string switches providers, and SAP Note 3437766 carries the current model list, token rates and deprecation dates), runs a fixed, non-reorderable module pipeline — templating, masking through SAP Data Privacy Integration, grounding, content filtering, then the model call — and retries down an ordered fallback list whose entries can each carry their own model and rules. It places [@sap-ai-sdk/orchestration](artifact:sap-ai-sdk-orchestration) among the official JavaScript, Java and Python SDKs, and notes SAP's own LiteLLM provider as a way to put a different gateway in front of it.","author":"amishkush","published":"2026-09-30","provenance":{"discovered_via":[{"source":"source:sap-community","channel":"btp-tag"}],"first_seen":"2026-10-20"},"drafted_with_ai":true},"readings":{"liveness":[{"label":"Checked against the source","tier":"unknown","evidence":"nobody has checked it"},{"label":"Source reachable","tier":"unknown","evidence":"not crawled"},{"label":"Age","tier":"good","evidence":"published 1 month ago"}],"compatibility":[{"label":"Version","tier":"unknown","evidence":"no version declared"},{"label":"Moved since?","tier":"good","evidence":"no recorded change after 2026-09-30"},{"label":"Findings","tier":"good","evidence":"none flagged"}],"reach":[{"value":534,"unit":"views"},{"value":0,"unit":"comments"},{"value":4,"unit":"likes"}]},"signals":{"views":534,"likes":4,"comments":0,"metrics_at":"2026-10-25"},"series":null,"edges":{"authors":[]}}