About this role
Our client is seeking a highly skilled Databricks Developer for a 6-month contract role based in Bangalore or Mangalore, with a hybrid working model. The ideal candidate will have strong expertise in PySpark, Spark SQL, and Databricks, and will be responsible for building scalable cloud-based data engineering solutions.
Key Responsibilities:
- Design, develop, and optimize scalable data pipelines using Databricks and PySpark.
- Build and maintain ETL/ELT workflows for enterprise data processing.
- Perform data migration, validation, reconciliation, and quality checks.
- Develop efficient Spark SQL solutions for large-scale datasets.
- Work with Delta Lake, Delta Tables, and Databricks Workflows.
- Implement data governance using Unity Catalog, RBAC, and ABAC.
- Monitor, troubleshoot, and optimize pipeline performance.
- Collaborate with business stakeholders and technical teams to deliver data solutions.
- Ensure high-quality, secure, and scalable data architecture.
Required Skills:
- 3-6 years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Excellent expertise in PySpark and Spark SQL.
- Experience developing ETL/ELT pipelines.
- Hands-on experience with Delta Lake, Delta Tables, and Databricks Workflows.
- Strong knowledge of Unity Catalog.
- Experience implementing RBAC and ABAC.
- Good understanding of Data Warehousing and Dimensional Modeling.
- Experience in data migration, validation, and reconciliation.
- Strong debugging and performance tuning skills.
- Excellent communication and problem-solving abilities.
Preferred Skills:
- Experience in Databricks performance tuning and cost optimization.
- Databricks Certification is a strong advantage.
- Experience with cloud platforms (Azure/AWS) is preferred.
What we offer:
- Opportunity to work on enterprise-scale data engineering projects.
- A collaborative and innovative work environment.
- Flexibility of a hybrid work model.
- Immediate start for the right candidate.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.