About this role
Our client is seeking an experienced Senior Databricks Engineer to design, build, and optimize scalable data solutions on the Databricks platform. The ideal candidate will possess strong expertise in data engineering, Spark, SQL, Python/Scala, and cloud-based data platforms. This role involves collaborating closely with data architects, analysts, and business teams to deliver reliable, high-performance data pipelines and analytics solutions.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks.
- Optimize data processing workflows for performance and efficiency.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Implement data quality checks and ensure data integrity.
- Utilize Spark for large-scale data processing and transformation.
- Write efficient SQL queries for data retrieval and manipulation.
- Mentor junior engineers and share best practices in data engineering.
Required Skills & Qualifications:
- Strong experience with Databricks and Apache Spark.
- Proficiency in SQL and programming languages such as Python or Scala.
- Experience with cloud-based data platforms (AWS, Azure, GCP).
- Solid understanding of data modeling and ETL processes.
- Ability to work collaboratively in a fast-paced environment.
- Excellent problem-solving skills and attention to detail.
Experience:
- 5-8 years of relevant experience in data engineering or related fields.
What we offer:
- Opportunity to work on cutting-edge data technologies.
- Collaborative and innovative work environment.
- Professional development and growth opportunities.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.