Senior Data Engineer
- Рівень:
- senior
- Джерело:
- djinni.co
Що робити
- Design, build, and maintain Python-based ETL pipelines across Bronze, Silver, and Gold layers following the Medallion architecture pattern.
- Develop and operationalise data quality (DQ) rules in Python, covering validity, completeness, consistency, uniqueness, accuracy, and timeliness dimensions.
- Build and maintain DQ rules using Informatica IDQ 10.5 on-premises, including mapplet design, profile configuration, and scorecard setup.
- Support data cataloguing and lineage activities using Informatica EDC, including schema scanning, data classification, and lineage mapping.
- Configure and maintain Informatica Axon for governance workflows, business glossary management, policy enforcement, and surfacing DQ scores to stakeholders.
Що очікуємо
- Strong Python development skills, including experience with data processing libraries (pandas, PySpark) and testing frameworks (pytest).
- Hands-on experience with Informatica IDQ 10.5 on-premises: Developer Tool, mapplet design, profiles, scorecards, and expression-based DQ rules.
- Working knowledge of Informatica EDC for schema scanning, data lineage, and data classification.
- Experience with Informatica Axon for governance, business glossary management, HITL steward workflows, and DQ score surfacing.
- Solid understanding of the Medallion architecture (Bronze / Silver / Gold) and data lake design patterns.
Що пропонуємо
- Familiarity with Talend for data ingestion workflows.
- Exposure to AI/ML techniques for data quality: anomaly detection, entity resolution, DQ score aggregation.
- Experience generating or consuming Informatica IMX-format XML programmatically.
- Knowledge of Power BI for building or maintaining DQ score dashboards.
- Understanding of data governance frameworks, stewardship models, and regulatory reporting requirements.
Схожі вакансії
З блогу Trackr
Усі статті →Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot


