Databricks Engineer/ Architect

Our client is seeking a skilled Databricks Engineer/Architect to join their team in India. This role presents a unique opportunity to contribute to a high-impact data transformation initiative aimed at stabilizing and scaling an existing production-live Databricks environment. The successful candidate will play a crucial role in enhancing data pipelines that support essential business reporting and analytics.

Key Responsibilities:

• Design, implement, and optimize data pipelines using Databricks to ensure robust and efficient data processing.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Develop and maintain documentation for data processes and architecture.
• Implement best practices for data governance, security, and compliance within the Databricks environment.
• Provide technical leadership and mentorship to junior team members.

Required Skills & Qualifications:

• Strong experience with Databricks and its ecosystem, including Spark.
• Proficiency in programming languages such as Python or Scala.
• Familiarity with cloud platforms, particularly AWS or Azure.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Knowledge of SQL and database systems (e.g., PostgreSQL, MySQL).
• Excellent problem-solving skills and attention to detail.
• Strong communication skills and ability to work collaboratively in a team environment.

Experience Level:

• Minimum of 5 years of experience in data engineering or architecture roles.
• Proven track record of working with large-scale data processing and analytics projects.

What We Offer:

• Opportunity to work on cutting-edge data transformation projects.
• Collaborative and innovative work environment.
• Professional development and growth opportunities.
• Flexible work arrangements to support work-life balance.