Position:Senior PySpark-SSIS Data Engineer

Experience:2-4 Years

Location:Pune/Hybrid

Mandatory Skills: Pyspark, SQL, ETL, ssis(knowledge), AWS/Azure

Key Job Summary:

We are seeking a PySpark -SSIS Data Engineer with extensive experience in developing, optimizing, and maintaining data processing jobs using PySpark. The ideal candidate will possess a robust background in SQL and ETL processes, along with proficiency in cloud platforms such as AWS or Azure. This role will require excellent analytical skills and the ability to communicate effectively with both technical and non-technical stakeholders.

Key Responsibilities:

• Design, develop, and optimize PySpark jobs for enhanced performance and scalability. • Collaborate with data architects and business analysts to understand data requirements and translate them into technical specifications. • Redesign and maintain complex SQL queries and stored procedures to support data extraction and transformation processes. • Utilize ETL tools, specifically Informatica PowerCenter, to build effective data pipelines. • Troubleshoot and resolve data quality issues and performance bottlenecks. • Mentor and provide technical guidance to a team of developers to enhance productivity and code quality. • Stay updated with new technologies and practices to continually improve data processing capabilities.

Qualifications:

• Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. • Experience: 5-8 years of experience in data engineering, with a strong focus on PySpark and ETL processes.

Technical Skills:

Must-Have:

1. Extensive experience with PySpark, focusing on job optimization techniques. 2. Proficiency in SQL, with experience in SQL Server, MySQL, or other relational databases. 3. Strong knowledge of ETL concepts and tools, particularly Informatica PowerCenter and IDMC. 4. Excellent analytical and troubleshooting skills. 5. Strong communication skills for effective collaboration.

Good to Have:

1. Basic knowledge of Unix commands and Shell scripting. 2. Experience in leading and mentoring development teams. 3. Familiarity with Azure/Fabric.

Interested candidates, please share your updated resume at info@d-techworks.com with the following details: - Updated Resume - Experience - Current Organization - Current CTC - Expected CTC - Notice Period - Offer In Hand - Current Location