Senior Solution Architect - Databricks

End-to-End Data Architecture

. Collaborate with Databricks PS and customer

. on comprehensive end-to-end data architecture on Databricks platform

. Design and implement data ingestion strategies from various source systems

. Architect scalable storage solutions leveraging Delta Lake and lakehouse architecture

. Develop efficient data processing frameworks using Apache Spark and Databricks workflows

. Create data consumption layers for analytics, reporting, and machine learning use cases

. Ensure seamless data flow across the entire data lifecycle

Governance, Security & Compliance

. Collaborate with Databricks PS on implementing robust governance frameworks

. Design and enforce security policies and access controls within Databricks environments

. Ensure compliance with regulatory requirements and industry standards

. Implement data lineage, audit trails, and monitoring capabilities

. Optimize performance through best practices in cluster configuration and query optimization

. Establish data quality standards and validation processes

Data Modelling & Design

. Define business-aligned data models that support organizational objectives

. Design Delta table structures optimized for performance and scalability

. Create dimensional and normalized data models based on business requirements

. Implement medallion architecture (Bronze, Silver, Gold layers) for data refinement

. Develop data schemas that support both analytical and operational workloads

. Document data models and maintain data dictionaries

Technical Leadership & Collaboration

. Lead technical discussions with clients and stakeholders to understand business requirements

. Provide technical guidance to development teams on Databricks best practices

. Work closely with Infrastructure (Infra), Applications (Apps), and Cyber teams for integrated delivery

. Mentor junior architects and engineers on Databricks technologies

. Present solution architectures and technical recommendations to client leadership

Solution Implementation

. Oversee implementation of Databricks solutions from design through deployment

. Ensure solutions meet performance, scalability, and reliability requirements

. Support proof-of-concepts and pilot implementations

. Conduct architecture reviews and ensure alignment with enterprise standards