Data Management Senior Engineer I
Skilyrði:PythonJavaCloudDataAgile
Kostur:AWSAzure
- Excellent analytical, organizational, and problem-solving and skills.
- Has excellent written and verbal communication skills, as well as presentation skills.
- Able to communicate to multiple levels of the organization, including stakeholders and third-party vendors, via phone, email, and chat.
- Ability to work independently and collaborate with others at all levels of technical understanding.
- Able to handle multiple concurrent projects, with an ability to prioritize and manage projects effectively.
- Self-motivated and dedicated with the ability to triage and prioritize technical issues, work with service providers and team members to problem resolution.
- Ability to plan and carry out responsibilities with minimal direction.
- Ability to mentor others, including peers and application developers, clearly explain complex technical issues to business analysts and end users.
- Ability to quickly learn new systems and business processes and adapt to changing technology and priorities.
- Experience in coordinating with data stewards and analysts to understand business requirements, functional requirements, and conversion of business rules into technical specifications.
- Experience in Analysis, Design, Development, Implementation, Testing and Support of Data Warehousing and Data Integration Solutions and ETL data pipelines.
- Experience in various programming languages like Java and Python, orchestration tools and processes or other directly related experience.
- Hands on experience in database and table design, proficient in writing complex SQLs, expertise in performance tuning of SQLs.
- Excellent knowledge of the Informatica platform as a whole and the integration among different Informatica components and services.
- Good experience in end-to-end implementation of DW & BI projects, especially in data warehouse and mart developments.
- Experience in Relational Modeling, Dimensional Modeling, Modeling of Unstructured Data and business process relationships.
- Good understanding of Data integration, Data quality paradigms and data governance/ data architecture concepts.
- Working knowledge in handling various web services and APIs (Soap, REST).
- Good understanding of Data integration, Data quality paradigms and data governance/ data architecture concepts.
- Working knowledge in handling various web services and APIs (Soap, REST)
- Working experience on Informatica Cloud Services (IDMC) development; Cloud Data Integration (CDI), Cloud Application Integration (CAI), Cloud Data Quality CDQ and CDGC
- Experience in ETL design and development using Informatica PowerCenter, Data Quality, and Data Engineering using various transformations, and ETL design/development methodologies.
- Experience developing profiles and scripts for the execution and testing of mappings and workflows to implement data stewardship and exception processing
- Full lifecycle project experience as a developer in designing and developing ETL jobs.
- Knowledge of UNIX/Linux shell scripting, scheduling and orchestration tools and processes.
- Good understanding of XML/Json structures.
- Experience working in Agile framework and project management methodologies.
- Knowledge of data analysis in AWS environment (Athena, Redshift, S3, Sagemaker, EMR) is a plus.
- Knowledge of Python libraries (Pandas, Numpy, Plotly, Pyspark, Sklearn) is a plus.
- Knowledge of using Change Data Capture methodologies is a plus.
- Knowledge of data analysis in Azure platform (Data Factory/Synapse/etc.) is a plus.
- Experience working with Power BI in data analytics space is a plus.
Special Requirements:
- Strong hands-on expertise in Hadoop ecosystem (HDFS, YARN, Hive, HBase, Oozie, Sqoop).
- Proficiency in Spark (PySpark/Scala), Kafka, and distributed data processing frameworks.
- Skilled in SQL, Python, Scala, and Java for data engineering use cases.