Data Architect / Senior Data Engineer (Azure Databricks)

Що робити

• Assess existing data lakes, warehouses, pipelines, models, jobs, notebooks and tooling; work with client architects and the wider delivery team to confirm or refine the target architecture and document decisions, options, trade-offs and rationale.
• Design the layered data architecture (landing, bronze, silver and gold) and guide its implementation across the engineering team, covering ingestion, standardisation, transformation, integration, conformance, data products and reporting marts.
• Develop and review production-grade data transformations using SQL and Python/PySpark, including reusable and metadata-driven pipelines that are idempotent, re-runnable, testable and observable.
• Define data-modelling standards and contribute to the development of integrated and consumption-layer models, including Data Vault 2.0, Kimball dimensional models, slowly changing dimensions, historical and as-at reporting, and model-generation approaches.
• Define the data-quality and data-cleansing approach together with the engineering team: establish profiling and baseline measures; define rule catalogues, quality gates and scorecards; design quarantine, remediation, reconciliation, audit, balance and control processes; and ensure these are implemented consistently.