Data Scientist - Agentic AI
Company Description
You'll help shape SAP's global analytics community, contribute to internal thought leadership, and foster a culture where diverse voices and international collaboration elevate the work.
Job Description
What you'll do
- Develop and deploy machine learning models, AI Agent and AI algorithms to build prototypes, enhance products,
and improve business processes.
- Build LLM-powered applications using prompt engineering, RAG, tool calling, and reasoning pipelines.
- Build AI capabilities including RAG pipelines, embeddings, and vector databases that support SAP's agents
in production.
- Work with cloud and data platforms including Databricks, SAP Datasphere, SAP HANA Cloud, AWS,
Azure, and GCP to support reliable AI workflows.
- Prepare, clean, annotate, and engineer large, high-quality training and evaluation datasets to ensure
high-quality inputs for AI models.
- Continuously evaluate and optimize AImodels* to improve performance and accuracy.
- Apply machine learning, deep learning, Tabular AI and statistical modeling to develop and evaluate AI solutions
using real-world enterprise datasets.
- Develop and maintain high-quality data pipelines for training, validation, and continuous improvement.
- Apply ethical considerations in AI model development, deployment, and monitoring to ensure compliance
and data privacy.
- Work closely with data engineers and software developers to integrate AI solutions into platforms and
- applications.
- Stay updated with the latest advancements in AI research and propose solutions to drive continuous improvement.
- Share knowledge and best practices through mentorship, workshops, and technical presentations.
- Productize Agentic SaaS based solutions on SAP BTP with proper multi-tenancy and lifecycle management.
- Implement CI/CD pipelines for agents (automated build, test, evaluation gates, deployment, rollback).
- Embed security and compliance by design - secure secrets/credential handling, and AI guardrails.
What you bring
Required:
- Bachelor's degree in Computer Science, Data Science, AI, Statistics, Mathematics, or a related field — or
equivalent practical experience.
- 3+ years of experience delivering ML solutions, with exposure to generative AI techniques.
- Strong Python skills with experience in ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face).
- Solid understanding of machine learning fundamentals — supervised and unsupervised learning, model
evaluation, feature engineering.
- Working knowledge of SQL and data manipulation at scale.
- Experience with data preparation, cleaning, and pipeline development.
- Familiarity with cloud platforms (AWS, Azure, or GCP).
- Experience with LLM techniques including prompt engineering, fine-tuning, and RAG.
- Familiarity with LLM frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel).
- Strong analytical thinking, problem-solving, and clear communication skills.
Preferred:
- Master's degree in a relevant field.
- Exposure to SAP data models, metadata structures, or core business processes.
- Familiarity with MLOps practices — model versioning, experiment tracking, CI/CD for ML.
- Experience with Databricks, Spark, or PySpark for large-scale data processing.
- Knowledge of vector databases (e.g., FAISS, Pinecone, Weaviate) and embedding techniques.
Meet your team:
SAP Private Cloud Cross Technology and Architecture unit that is driving technology empowering innovations in business and people. It is part of the global organization Private Cloud dedicated to delivering innovative solutions to meet our customers’ unique business process needs in Private Cloud.
- You will be joining a dynamic and passionate team dedicated to leveraging Agentic AI , Enterprise Ontologies, to facilitate seamless interactions between individuals and information.
- We foster a culture of collaboration, learning, and growth, encouraging all team members to contribute ideas and perspectives.
- Enjoy the benefits of working within a diverse and international environment, with opportunities to collaborate with colleagues from around the globe.
Our vision is to become the premier strategic RISE with SAP enabler, driving accelerated innovation and technology adoption leveraging the SAP Business Technology Platform, focusing on a clean core approach.
Additional Information
About SAP With a global network of customers, partners, employees, and thought leaders, SAP helps the world run better and improves people’s lives. As a leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations spanning finance, procurement, HR, supply chain, and customer experience.
We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone, regardless of background, feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or complete your application, please send an email with your request to the Recruiting Operations Team: Careers@sap.com.
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.
Qualified applicants will receive consideration for employment without regard to age, race, religion, national origin, ethnicity, gender (including pregnancy and childbirth), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.
Successful candidates might be required to undergo a background verification with an external vendor.
AI Usage in the Recruitment Process
For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.
Please note that any violation of these guidelines may result in disqualification from the hiring process.