Senior Big Data Engineer (R-19335)
Shape the Future with Dun & Bradstreet At Dun & Bradstreet, we believe data has the power to create a better tomorrow. As a global leader in business decisioning data and analytics, we help companies worldwide grow, manage risk, and innovate. For over 180 years, businesses have trusted us to turn uncertainty into opportunity. We’re a diverse, global team that values creativity, collaboration, and bold ideas. Are you ready to make an impact and help shape what’s next? Join us! Explore opportunities at dnb.com/careers.
Key Responsibilities : Design, build, deploy, and document scalable data pipelines within big data ecosystems
Develop ETL/ELT pipelines using modern data processing frameworks and tools
Work with data lake architectures and modern data warehousing concepts such as virtual data warehouses and push-down analytics
Build and optimize data solutions using file formats such as Parquet, Iceberg, and Delta
Develop high-performance solutions using Python, Databricks, and Apache Spark
Work with cloud infrastructure, primarily on GCP Design and manage relational databases including DB2, Oracle, and SQL Server with strong SQL expertise
Implement workflow scheduling and orchestration using Apache AirflowManage big data clusters including installation, configuration, monitoring, security, resource allocation, and performance tuning
Create detailed design documents and proof of concepts for new capabilities
Collaborate with platform and infrastructure teams to deploy solutions into production
Optimize workloads, manage multi-tenant environments, and ensure SLA adherence
Participate in planning, data science initiatives, and continuous platform improvement
Key Requirements: Minimum 8 years of experience in ETL/ELT technologies
4+ years of hands-on experience with big data technologies such as Databricks and Apache Spark
Minimum 6 years of experience working with cloud platforms, preferably GCP
Strong programming expertise in Python
Experience with relational databases and complex SQL development
Exposure to NoSQL and graph databases is a plus
Experience with access control mechanisms such as role-based and attribute-based access
Familiarity with BI tools such as Tableau, Power BI, or Looker
Hands-on experience managing and deploying cloud-based solutions
Experience working in a global environment and DevOps model is an advantage
All Dun & Bradstreet job postings can be found at https://jobs.lever.co/dnb. Official communication from Dun & Bradstreet will come from an email address ending in @dnb.com.
Notice to Applicants: Please be advised that this job posting page is hosted and powered by Lever, a subsidiary of Employ Inc. Your use of this page is subject to Employ's Privacy Notice and Cookie Policy, which governs the processing of visitor data on this platform.