AI in SAP: LLM Integration & SAP AI Core

Large language models can take real workload off customer service and back-office teams – if they are connected to SAP securely, with clear governance and reliable processes. We lead and implement AI projects in SAP landscapes from the first idea to go-live and hypercare.

What we deliver

  • Use case assessment and architecture for AI in SAP: where does an LLM add value, where are the risks?
  • Technical project lead for AI-supported customer communication (e-mail, chat, voice bot)
  • Automation of standard business cases in S/4HANA Utilities: payment plans, payment extensions, invoice copies, moves
  • AI e-mail triage: classification, data extraction and routing into SAP Customer Engagement
  • Connection of Cognigy hotlines and voice bots to SAP
  • Integration of Azure OpenAI, Databricks and conversational platforms with SAP BTP Integration Suite, SAP Customer Engagement and S/4HANA Utilities
  • SAP AI Core, SAP Joule and the SAP Model Context Protocol (MCP): features, licensing and roadmap assessment
  • Data protection, authorizations and compliance for AI scenarios
  • Operations: monitoring, incident handling, releases and continuous improvement

Case: AI-supported customer communication

For an energy supplier we took on the technical project lead for introducing AI-supported customer communication: concept, workshops, technical implementation, go-live, hypercare and reporting to management. Payment plans, payment extensions, invoice copies and moves are processed automatically from e-mails (AI triage) and via a Cognigy hotline. The solution combines SAP BTP Integration Suite, an Azure-hosted LLM, Databricks and deep integration into SAP Customer Engagement and S/4HANA Utilities. Read the lessons learned.

Thinking about AI in your SAP landscape?

We help you separate hype from real value – and build what works.