About this role
We are seeking an experienced Senior Python ETL Developer/Lead to join our client’s team. The ideal candidate will have a strong background in developing ETL processes using Python and open-source tools/libraries, including PySpark and Apache Airflow. This position requires a hands-on developer who can design, implement, and maintain robust ETL solutions and lead a team of developers.
Key Responsibilities:
- Design and develop ETL processes to extract, transform, and load data from various sources.
- Lead a team of developers, providing guidance and support in ETL best practices.
- Collaborate with data engineers and data analysts to understand data requirements and ensure data quality.
- Optimize ETL processes for performance and scalability.
- Troubleshoot and resolve any issues in the ETL pipeline.
Required Skills & Qualifications:
- Proficiency in Python and experience with ETL frameworks.
- Strong knowledge of PySpark and Apache Airflow.
- Experience with data warehousing concepts and technologies.
- Familiarity with SQL and database management systems.
- Excellent problem-solving skills and attention to detail.
Experience:
- 5-7 years of relevant experience in ETL development and team leadership.
What we offer:
- Opportunity to work on challenging projects in a collaborative environment.
- Potential for contract extension based on performance.
- Support for professional development and career growth.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.