LanceSoft Europe
The Netherlands / Global
GET
The Big Jobsite
The Netherlands / Global
- At least 8 years of relevant experience in data engineering, cloud engineering, data analytics or a closely related technical field.
- Proven hands-on experience designing and building complex production-grade data pipelines using ETL and ETL patterns.
- Strong programming skills in Python and SQL, with practical experience using PySpark for distributed data processing.
- Hands-on experience with Apache Spark and workflow orchestration tools such as Apache Airflow.
- Experience with cloud data platforms, preferably Google Cloud Platform and BigQuery, and working knowledge of Azure or AWS.
- Strong understanding of data modelling, normalization and denormalization, data integration, data lakes and data warehouses.
- Experience with relational and non-relational data stores, including technologies such as MS SQL, Hive and dbt, plus object storage such as Amazon S3.
- Experience with containerization, orchestration and automated delivery tooling, including Docker, Kubernetes and CI/CD pipelines.
- Experience managing and optimizing distributed systems and clusters for large-scale batch processing.
- Good command of software engineering practices, including modular design, testing, code review, documentation, security and production support.
#J-18808-Ljbffr
The Netherlands / Global
The Netherlands / Global
The Netherlands / Global
The Netherlands / Global
The Netherlands / Global
The Netherlands / Global