LLM integration

On this door the concern is the service itself: which models the Generative AI Hub offers, the orchestration deployment a call goes through, and the modules that run around the call, templating, masking, filtering and grounding. SAP AI Core is the entry; the SDKs on the CAP door are its clients.

Overview

SAP SHIPS

SAP AI Core is the service the calls go to: the Generative AI Hub inside it gives access to the models, and its orchestration service puts one harmonised API in front of them, so a change of model is configuration rather than a client change.

Not covered: At the service boundary. Binding it, choosing a resource group and a deployment, and paying for tokens are the platform's; what the application does with an answer is the application's. SAP AI Launchpad is the UI over the same deployments, not a second route to the models.

THE COMMUNITY ADDS

No community artifact is documented here.

Artifacts1

1 of 1 artifacts
ArtifactSignals
Services1
SAP AI CoreAI runtime on BTP with the Generative AI Hub
Signals
none

Content27

Group by27 of 27 pieces
Piece, what it offers
🟣 Enable Your AI application to Run on Multiple Models to Ensure Resilience and Compliance
YouTube — SAP Developers playlists, SAP Developers, Talk
What an AI infra engineer sees when opening SAP's AI stack (1/3): the model gateway
SAP Community, amishkush, Blog
Connecting SAP Integration Suite with SAP Document AI and SAP Business AI
SAP Community, subhojitSaha, Blog
Show 23 more
CAP in the age of AI #3 - from MCP to A2A
YouTube — SAP Developers playlists, DJ Adams, Johannes Vogt, Stefan Rudi, part 3 of 7, Video
Autonomous Diagnostics on Kyma Unplugged: Goose + LiteLLM + KRO + SAP AI Core in Production
SAP Community, quovadis, Blog
Banking Sentinel: A Multi-Agent Credit-Risk Copilot on SAP BTP, Built on a Mixed AI Stack
SAP Community, Shahid, BlogThe reasoningA recipeRunnable code
Core changed
Beyond Basic AI Error Handling in SAP CPI - A Rules-First Architecture with HANA Cloud Learning
SAP Community, Krishna_Karthik, Blog
Building an LLM Agent in CAP Java with Spring AI
SAP Community, Johannes Vogt, BlogThe reasoningRunnable code
Core changed
Calling Claude from ABAP: How I Wired SAP AI Core into a Real Business Scenario
SAP Community, PranayGaroo, Blog
Building an LLM Agent using CAP
SAP Community, Johannes Vogt, BlogThe reasoningRunnable code
Core changed
Agentic AI on BTP: a Multi‑Agent App with Pydantic AI
SAP Community, Wouter Lemaire, Blog
Agentic AI on BTP: a Single Agent with LangGraph
SAP Community, Wouter Lemaire, Blog
What Happens to Your Data When You Enable SAP's AI Features?
SAP Community, jaripie, Blog
Integrating a Custom AI Model into SAP CAP Using AI Launchpad
SAP Community, egeAksoyek, BlogThe reasoningRunnable code
Core changed
SAP Integration Suite: Intelligent Integration with AI Adapter
SAP Community, meena_choudhary, Blog
Enhancing Business Processes with SAP BTP AI in SAP Integration Suite
SAP Community, arunmaarirajha_kv, Blog
Generative AI on SAP BTP
SAP Architecture Center, SAP Architecture Center, Reference architectureThe reasoningA reference
Core changed
Improving Exception Handling using Generative AI in SAP Cloud Integration (SAP CI/CPI)
SAP Community, AdarshRao, Blog
An Innovative Language Exchange App developed with SAP Build Apps, CAP, Kyma, and OpenAI
SAP Community, javieryw, BlogThe reasoningRunnable code
Core changed
GenAI Mail Insights - Leveraging the generative AI hub in SAP AI Core to improve customer support
SAP Community, martinfrick, BlogThe reasoning
Automate your Job Postings Using Generative AI (ChatGPT) & SAP Build Process Automation Apps
SAP Community, shivamshukla12, BlogThe reasoning
Creating a meal generator application with SAP Build, Cloud Application Programming and openAI
SAP Community, former_member793421, BlogThe reasoning
Access to Generative AI Models
SAP BTP AI Best Practices, SAP, DocThe reasoning
Agentic CAP: Build MCP servers and enterprise AI agents
SAP TechEd — session catalogue, Daniel Hutzel, Daniel Schlachter, TalkA recipe
AI-enabled administration: Automating log analysis with generative AI hub
SAP TechEd — session catalogue, TalkThe reasoning
Stop guessing, start counting: How generative AI fixed an inventory mess
SAP TechEd — session catalogue, TalkThe reasoning
🟣 Enable Your AI application to Run on Multiple Models to Ensure Resilience and Compliance
YouTube — SAP Developers playlists, SAP Developers, Talk
What an AI infra engineer sees when opening SAP's AI stack (1/3): the model gateway
SAP Community, amishkush, Blog
CAP in the age of AI #3 - from MCP to A2A
YouTube — SAP Developers playlists, DJ Adams, Johannes Vogt, Stefan Rudi, part 3 of 7, Video
Show 4 more
Enhancing Business Processes with SAP BTP AI in SAP Integration Suite
SAP Community, arunmaarirajha_kv, Blog
Agentic CAP: Build MCP servers and enterprise AI agents
SAP TechEd — session catalogue, Daniel Hutzel, Daniel Schlachter, TalkA recipe
AI-enabled administration: Automating log analysis with generative AI hub
SAP TechEd — session catalogue, TalkThe reasoning
🟣 Bring AI into Your ABAP Applications with ISLM: Build, Integrate, and Consume AI Natively
YouTube — SAP Developers playlists, SAP Developers, Talk

Seen working9

ArtifactSignals
Samples9
ai-enabled-integrations-codejamCodeJam on LLM-backed integration flows and MCP via API Management
none
aicore-genai-samplesSample apps for SAP AI Core's Generative AI Hub capabilities
none
btp-gen-ai-hub-sdk-samplesSetup guide and Python notebooks for SAP AI Core's Generative AI Hub
none
Sample CAP Application with SAP Cloud SDK for AICAP samples calling SAP AI Core through the SAP Cloud SDK for AI
Functional boundary
sap-btp-ai-best-practicesSample implementations for AI-powered applications on SAP BTP
none
SAP-samples/codejam-code-based-agentsCodeJam on code-based AI agents in Python or TypeScript on SAP BTP
none
SAP-samples/generative-ai-codejamCodeJam deploying an LLM on Generative AI Hub and building RAG
none
SAP-samples/teched2025-AI160Hands-on building an AI agent with the SAP Cloud SDK for AI
none
teched2025-DA266TechEd 2025 material on two SAP Databricks scenarios in BDC
none

Details

Coverage
statecore only, BTP/BAIP
assessed
also inCAP, UI5, ABAP
For your agent
Ref
capability:llm-integration
JSON
/capabilities/llm-integration.json
MCP
Connecting an agent