Databricks Engineer (Contract)

Responsibility

• Collaborating with business users to understand their key priorities and use cases; proposing and developing solutions using data science and/or Generative AI techniques to drive business value
• Researching emerging AI/data science techniques and identifying relevant ones for EDB to explore and adopt (e.g., agentic, LLM, predictive, fraud/anomaly detection, text analytics, customer segmentation), Integrate Databricks with cloud platforms such as AWS, Azure or GCP and Implement CI/CD pipelines for Databricks projects.
• Data wrangling & analysis - preprocessing, cleaning and feature engineering
• Supporting daily operations and maintenance of deployed data science models and products, including assistants on PAIR/AIBots
• Developing backend APIs and services to support AI model deployment and integration
• Building frontend interfaces and user experiences for AI-powered applications
• Documenting changes to existing products
• Reviewing and implementing fixes for reported security vulnerabilities.

Requirements

• Minimum of a bachelor's degree in computer science, computer engineering, machine learning/data science/AI or related disciplines;
• Able to to understand and apply a range of AI/ML techniques for regression and classification
• Familiar with popular Python packages (e.g., pandas, matplotlib, scikit-learn, XGBoost, NLTK, spaCy)
• Understanding of LLM concepts (e.g. context windows, embeddings, chunking, token management) and architectures (e.g. RAG)
• Experience with context engineering techniques and prompt optimization strategies
• Proficient in git, SQL
• Proficiency in business intelligence tools (e.g., Tableau, Qlik, MS Power BI, Microstrategy)