Job Description

Job Title: Azure Data Factory Engineer

Work Location: Weehawken, NJ
 

Job Description:

We are seeking a highly skilled Azure Data Factory Engineer to join our team in Weehawken, NJ. As an ADF Engineer, you will play a crucial role in designing, developing, and implementing data pipelines using Azure technologies. You will be responsible for integrating data from various sources, transforming data into actionable insights, and ensuring seamless data flow through automation and cloud-based solutions. The ideal candidate will have a strong background in Azure Data Factory, Informatica PowerCenter (PC), SQL, Azure Databricks, PLSQL, Git, and CI/CD processes.

Key Responsibilities:

1. Azure Data Factory (ADF) Development:

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory.
• Build scalable and robust data integration workflows to manage large volumes of data.
• Monitor and troubleshoot data pipeline performance issues to ensure data accuracy and reliability.

2. Data Integration:

• Integrate data from multiple sources, including on-premise and cloud-based systems, using ADF and Informatica PowerCenter.
• Optimize data transformation and migration processes to improve performance and efficiency.
   

3. Collaboration & Communication:

• Work closely with data architects, data engineers, and business stakeholders to understand data requirements and provide innovative solutions.
• Participate in Agile project management practices, including sprint planning, daily standups, and retrospectives.
   

4. Azure Databricks & SQL:

• Utilize Azure Databricks for data processing and advanced analytics.
• Write complex SQL queries and stored procedures to retrieve, manipulate, and transform data.
• Implement PLSQL scripts to automate data-related tasks and ensure data quality.
   

5. Version Control & CI/CD:

• Use Git for version control to manage changes in the codebase and collaborate with other developers.
• Implement CI/CD pipelines to automate the build, test, and deployment processes using Azure DevOps or similar tools.
   

6. Performance Monitoring & Troubleshooting:

• Regularly monitor data pipelines, performance metrics, and system logs to proactively identify and resolve issues.
• Conduct root cause analysis on data issues and implement solutions to ensure data integrity and smooth operations.
   

Qualifications:

• Azure Data Factory (ADF): Extensive experience in designing and building data pipelines using Azure Data Factory.
• Informatica PowerCenter: Strong knowledge of data integration and transformation using Informatica PC.
• Azure Databricks: Experience working with Databricks for big data processing and advanced analytics.
• SQL/PLSQL: Advanced proficiency in SQL and PLSQL for database management, data extraction, and manipulation.
• Git: Hands-on experience with Git for version control and collaboration.
• CI/CD: Familiarity with continuous integration and deployment pipelines, particularly in Azure DevOps or similar tools.
   

Educational Qualifications:

• Bachelor’s Degree in Computer Science, Information Technology, Engineering, or a related field.
• A Master’s Degree in a relevant field can be an added advantage but is not always required.
• Relevant certifications in Azure, such as Microsoft Certified: Azure Data Engineer Associate, can also be beneficial.
   

How to Apply:

Prepare Your Resume: Ensure your resume highlights your relevant experience with Azure Data Factory, Informatica PowerCenter, Azure Data bricks, SQL, PLSQL, Git, and CI/CD pipelines. Also, include any additional qualifications or certifications you may have.

Write a Cover Letter (optional but recommended): Briefly explain why you are a good fit for the role, emphasizing your experience with data engineering and Azure technologies.

Submit Your Application: Reach out to KAAS technology recruitment agencies in Singapore and search for the Azure Data Factory Engineer job on the search. There is a direct application link provided to upload your CV and personal details.

Ready to take your career to the next level? If you have the skills and experience we’re looking for, we want to hear from you! Apply now to join our dynamic team in Weehawken, NJ, and make a significant impact with your expertise in Azure Data Factory and big data frameworks. Don’t miss this opportunity to grow your career in a supportive and innovative environment.