Middle Data Engineer IRC295734

Що робити

Develops, documents, and configures systems specifications that conform to defined architecture standards, address business requirements, and processes in the cloud development & engineering.
Involved in planning of system and development deployment as well as responsible for meeting compliance and security standards.
API development using AWS services in a scalable, microservices based architecture
Actively identifies system functionality or performance deficiencies, executes changes to existing systems, and tests functionality of the system to correct deficiencies and maintain more effective data handling, data integrity, conversion, input/output requirements, and storage.
May document testing and maintenance of system updates, modifications, and configurations.

Strong programming skills in Python
Data Formats: Experience with JSON, XML and other relevant data formats
CI/CD Tools: experience setting up and managing CI/CD pipelines using GitLab CI, Jenkins, or similar tools
Scripting and automation: experience in scripting language such as Python, PowerShell, etc…
Monitoring and Logging: Familiarity with monitoring & logging tools like CloudWatch, ELK, Dynatrace, Prometheus, etc…

Apache Iceberg: best practices for wide tables, Apache Iceberg metadata, Apache Iceberg Optimization, Apache Iceberg CoW vs MoR, Apache Iceberg Metadata Tree, the small file problem (compaction jobs), handling snapshots, handling orphaned data, etc.
Previous Healthcare or Medical Device experience
Experience working in Digital Health software
Experience developing global applications
Strong understanding of SDLC – Waterfall & Agile methodologies