Senior Python Developer_ Bucharest

Що робити

• Data Pipeline Development & Optimization: Design, develop, and optimize complex data pipelines using Python and PySpark/Apache Spark for large-scale data processing, transformation, and ingestion.
• Workflow Orchestration: Implement and manage data workflows and dependencies using Apache Airflow to ensure efficient and reliable data delivery.
• Containerization & Orchestration: Deploy and manage data engineering workloads and applications within containerized environments using Kubernetes, ensuring scalability, resilience, and efficient resource utilization.
• CI/CD Implementation: Design and implement robust CI/CD pipelines for automated testing, deployment, and monitoring of data engineering solutions, promoting a culture of continuous delivery and quality.
• Data Lake & Storage Management: Work with modern data lake technologies, including Apache Iceberg, for efficient data storage, versioning, and schema evolution.