Data Quality Automation Engineer
- Джерело:
- djinni.co
Що робити
- Define and implement data quality rules across ingestion, transformation, and reporting layers
- Validate data in Databricks-based pipelines
- Monitor and test Databricks transformations (PySpark/SQL) for correctness and completeness
- Ensure Databricks / Power BI reports reflect accurate and reconciled data
- Set up data validation checks (schema, nulls, duplicates, ranges, referential integrity)
Що очікуємо
- 4-5+ years of Relevant work experience in data analysis, quality assurance, data governance, or a similar field is highly desirable.
- Strong knowledge of Databricks / Spark (SQL, PySpark)
- Understanding of ETL/ELT pipelines and data transformations (dbt)
- Experience validating BI/reporting outputs (Power BI preferred)
- SQL proficiency for data validation and reconciliation
Що пропонуємо
- Experience with AWS data stack
- Experience with data governance or data catalog tools
- Exposure to CI/CD for data pipelines
- Knowledge of data lineage and observability tools
- Success Criteria
Схожі вакансії
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot