Location: Remote within Canada
Client: Consulting Client Contract Duration: 6 months contract
MUST HAVE atleast 3+ years of hands-on Databricks development experience.
Overview
Our consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its enterprise data landscape and building a next-generation data platform leveraging Databricks and modern cloud-based architecture. This role will play a key part in designing, developing, and implementing scalable data solutions that support enterprise reporting, analytics, AI initiatives, and future data-driven capabilities.
The ideal candidate will possess strong data engineering expertise, hands-on Databricks development experience, and a solid understanding of ETL/ELT processes, data integration, and modern data architecture. This individual will work closely with data architects, project managers, analysts, and business stakeholders to deliver high-quality data solutions within a rapidly evolving environment.
Key Responsibilities
- Design, develop, and maintain data pipelines within the Enterprise Data Platform (EDP).
- Build and optimize ETL/ELT processes to support data ingestion, transformation, and integration requirements.
- Make use of an Agentic approach to development and ensure that output matches development standards.
- Develop scalable and reusable data solutions using Databricks and cloud-based data technologies.
- Support migration and modernization activities from HANA environments to a modern data platform.
- Collaborate with Data Architects to implement scalable data models and platform solutions.
- Develop data transformation logic and workflows to support business and analytics requirements.
- Ensure data quality, integrity, consistency, and performance across platform solutions.
- Troubleshoot and resolve data-related issues, bottlenecks, and performance concerns.
- Participate in code reviews, testing, deployment, and release activities.
- Work closely with business and analytics teams to understand data requirements and deliver fit-for-purpose solutions.
- Contribute to platform best practices, documentation, and continuous improvement initiatives.
Requirements
MUST HAVE atleast 3+ years of hands-on Databricks development experience.
Required Qualifications
- 3+ years of hands-on Databricks development experience.
- 4+ years of overall Data Engineering, ETL, or Data Integration experience.
- Strong experience building ETL/ELT data pipelines and transformation processes.
- Proven experience working with large and complex datasets.
- Experience with Agentic frameworks and AI-assisted coding is a value add.
- Experience developing data solutions within cloud-based platforms.
- Solid understanding of data warehousing, data lake, and lakehouse concepts.
- Experience working in Agile delivery environments.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
Preferred Qualifications
- Experience supporting large data platform initiatives.
- Experience in significant data migration efforts.
- Experience with Azure Data Services and Databricks Lakehouse architecture.
- Experience with modern data engineering frameworks and best practices.
- Exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives.
- Experience working in large enterprise or consulting environments.
- Knowledge of data governance, metadata management, and data quality frameworks.
Technical Knowledge
Required
•
Databricks
•
ETL / ELT Development
•
Data Engineering
•
Data Integration
•
SQL
•
Python
•
Data Pipeline Development
•
Data Transformation
•
Data Warehousing Concepts
•
Agile Delivery
Preferred
•
Azure Data Factory
•
Delta Lake
•
Spark / PySpark
•
Azure Synapse
•
Data Lake Architecture
•
Cloud Data Platforms
•
Data Governance & Data Quality
•
CI/CD for Data Solutions
Key Skills & Experience
•
Databricks Development
•
Data Engineering
•
ETL/ELT Design & Development
•
Enterprise Data Platforms
•
Data Modernization
•
Data Migration
•
Data Warehousing
•
Cloud Data Platforms
•
SQL & Python Development
•
Data Quality & Validation
•
Agile Delivery
•
Stakeholder Collaboration
Ideal Candidate Profile
We are seeking a developer who
✅ Has hands-on Databricks experience and can contribute immediately
✅ Understands enterprise data concepts and platform modernization initiatives
✅ Has strong ETL/ELT and data engineering experience
✅ Can partner effectively with architects, project managers, and business teams
✅ Is comfortable working in a fast-paced, highly visible enterprise transformation program
✅ Can help build a scalable lakehouse architecture supporting reporting, analytics, and future AI capabilities
Originally posted on Himalayas
Time-zone restrictions (UTC offsets): 1