Senior Data & AI Engineer
Senior Data & AI Engineer - London (Hybrid) - Azure Databricks - AI & LLMs - Life Sciences - Up to £90,000 We're supporting a fast-growing technology business that is investing heavily in its data platform, AI capability and international growth plans. Their products help organisations across the Life Sciences sector unlock greater value from complex scientific data, and they're now looking for a Senior Data & AI Engineer to play a key role in that journey. This is an opportunity to join at a pivotal stage of growth, where you'll have real influence over technical direction, architecture decisions and AI innovation. Rather than simply maintaining pipelines, you'll play a key role in shaping products used by industry-leading organisations, helping turn complex data into actionable insights. With major investment being made into Databricks, cloud infrastructure and generative AI initiatives, including the development of proprietary LLM-powered products, you'll be working on projects that are high-profile, business-critical and highly visible to senior leadership.
You Will Work With Designing and scaling Azure Databricks-based data platforms Building robust data pipelines using Databricks, PySpark, Delta Lake and Airbyte Developing AI and LLM-powered capabilities within customer-facing products Delivering data products that support commercial decision-making Optimising Azure and Databricks environments for performance, scalability and cost Implementing governance, security and best practice across the data estate Collaborating closely with Product, Engineering and Business stakeholders Supporting the development of innovative data visualisation capabilities Influencing technical strategy and future AI initiatives Mentoring colleagues and helping shape a growing data function
Benefits Exposure to cutting-edge AI and LLM technologies Significant ownership and autonomy Clear influence on technical direction and product strategy Modern Azure & Databricks technology stack High-growth, investment-backed environment Excellent career progression opportunities as the business scales internationally Opportunity to make tangible business impact from day one
Key Experience We're looking for a senior-level engineer who can operate independently and make an immediate impact. Essential experience: Strong Azure Databricks expertise Advanced Python, SQL and PySpark skills Experience designing and building modern data platforms and pipelines Databricks optimisation, performance tuning and cost management Experience with Delta Lake and Lakehouse architectures Strong Azure cloud experience Experience with modern data ingestion tools such as Airbyte Exposure to Generative AI, LLMs, RAG or AI-enabled products Excellent stakeholder management and communication skills Experience delivering business-facing or customer-facing data products Highly desirable: Life Sciences, Healthcare, Pharmaceutical or Scientific Data experience Unity Catalog implementation and governance experience Experience with data visualisation platforms such as Sigma Experience scaling platforms within SaaS environments Candidates available within a short notice period
Ready for Your Next Challenge? If you're looking for a role where you can combine Data Engineering, AI innovation and commercial impact, this is a real opportunity to help shape the future of a rapidly expanding technology business with significant investment and ambitious growth plans. Apply now!