About this role
Our client is seeking a skilled Data Engineer to join their team on a contract basis in Bangalore. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark and distributed computing frameworks.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines.
- Implement ETL processes and integrate data from structured and unstructured sources into cloud data warehouses.
- Work across Azure or AWS cloud ecosystems to deploy and manage big data workflows.
- Optimize performance of SQL queries and develop stored procedures for data transformation and analytics.
- Collaborate with Data Scientists and Analysts to understand data requirements and deliver solutions.
Required Skills & Qualifications:
- Strong experience with PySpark and distributed computing frameworks.
- Proficient in ETL processes and data integration techniques.
- Experience with cloud platforms, specifically Azure or AWS.
- Solid understanding of SQL and experience in performance optimization.
- Excellent problem-solving skills and ability to work in a collaborative environment.
Experience:
- Minimum of 5-8 years of relevant experience in data engineering or related fields.
What we offer:
- Opportunity to work on cutting-edge technologies in a dynamic environment.
- Collaborative team culture with a focus on professional growth.
- Flexible working arrangements.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.