We are looking for an experienced Data Architect to design modern, scalable, and secure data platforms on Databricks. They will lead the technical direction of data teams, advise clients on modernizing data solutions, and participate in projects from initial analysis to implementation.
Job description
- Design of scalable, secure and powerful data platforms on Databricks and Lakehouse architecture
- Leading the end-to-end architecture design of data lakes, lakehouses and data warehouses
- Defining architectural standards, data governance principles and best practices
- Design of batch and streaming data processing
- Translation of business requirements into technical architecture and implementation roadmaps
- Technical leadership and architectural consulting for data engineering teams
- Architectural reviews, technical assessments and workshops with clients
- Advising clients on data platform modernization, performance, security and cost optimization
Requirements
- 5+ years of experience designing and implementing cloud data platforms, ideally as a Data Architect or Senior Data Engineer
- Strong hands-on experience with Databricks, Apache Spark, Delta Lake, and Lakehouse architectures
- Advanced knowledge of SQL and PySpark including performance optimization
- Experience with Unity Catalog, Databricks Workflows and Delta Live Tables / Lakeflow Spark Declarative Pipelines
- Good knowledge of data modeling (Kimball, Inmon, Medallion architecture) and ETL/ELT principles
- Experience with designing batch and streaming data pipelines
- Experience with at least one cloud platform (Azure, AWS, or GCP)
- Knowledge of data governance, security, CI/CD, Infrastructure as Code and DevOps practices
- Excellent communication skills and ability to lead technical discussions with clients and delivery teams
Advantage
- Databricks certifications
- Experience with Azure Databricks and Azure Data Services
- Experience with Apache Kafka and Spark Structured Streaming
- Experience with cloud migration and data platform modernization
- Knowledge of MLflow and AI/ML workloads
- Previous experience in consulting roles in direct client contact