About this role
We are seeking an experienced Senior Python ETL Developer/Lead to join our team. The ideal candidate will have a strong background in developing ETL processes using Python and open-source tools/libraries, including PySpark and Apache Airflow. This position requires a hands-on developer who can design, implement, and maintain robust ETL solutions while also leading a team of developers.
Key Responsibilities:
- Design and develop ETL processes using Python, PySpark, and Apache Airflow.
- Lead a team of developers, providing guidance and support in ETL best practices.
- Collaborate with data engineers and stakeholders to understand data requirements and translate them into technical specifications.
- Ensure the performance, scalability, and reliability of ETL processes.
- Troubleshoot and resolve issues in ETL workflows and data pipelines.
- Document ETL processes and maintain up-to-date technical documentation.
Required Skills & Qualifications:
- Strong experience in Python programming and ETL development.
- Proficiency with PySpark and Apache Airflow.
- Knowledge of data warehousing concepts and best practices.
- Experience with databases such as SQL Server, PostgreSQL, or similar.
- Strong analytical and problem-solving skills.
- Excellent communication and leadership abilities.
Experience: 5-7 years in ETL development and team leadership.
What we offer:
- Opportunity to work on challenging projects with a talented team.
- Professional development and growth opportunities.
- A collaborative and innovative work environment.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.