About this role
Our client is seeking an experienced AWS Data Engineer to join their team for a 12-month contract. This role can be performed from anywhere in India where our client's offices are located. The ideal candidate will have a strong background in data engineering and a proven track record of working with AWS services.
Key Responsibilities:
- Design and implement data pipelines using AWS services such as S3, Athena, Redshift, and Glue.
- Develop ETL processes to extract, transform, and load data efficiently.
- Utilize Python and Spark to process large datasets and perform data modeling.
- Manage and optimize data storage solutions in AWS RDS and EC2.
- Implement data streaming solutions using Kafka or Kinesis.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
- Ensure data quality and integrity throughout the data lifecycle.
Required Skills & Qualifications:
- 5+ years of relevant experience in data engineering.
- Proficiency in AWS services including S3, Athena, Redshift, Lambda, and Glue.
- Strong programming skills in Python and experience with Spark.
- Familiarity with container orchestration using Kubernetes and Argo.
- Experience with SQL and data modeling techniques.
- Knowledge of messaging services such as SNS and SQS.
- Understanding of data governance and compliance best practices.
What we offer:
- Opportunity to work with cutting-edge technologies in a dynamic environment.
- Collaborative team culture with a focus on innovation.
- Exposure to large-scale data engineering projects.
- Flexible working arrangements.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.