data engineer in data platforms

Описание: Sytac provides data platforms for some of the Netherlands' largest companies, including KLM, ABN AMRO, ING, Rabobank, Bol, and Ahold. The company operates in software development, data infrastructure and analytics, and IT consulting.

Задачи: Build maintainable, modular, tested, and versioned ETL/ELT pipelines in Python, PySpark, and SQL

Design Lakehouse environments using Medallion architecture and dimensional/Star Schema modelling on Azure and GCP

Own infrastructure as code with Terraform or Bicep and containerized deployments on Docker and Kubernetes

Orchestrate data workflows with Apache Airflow

Run CI/CD for data pipelines using Azure DevOps and GitHub Actions

Use AI tools in the development workflow and integrate LLMs into pipelines where appropriate

Translate business logic into clear technical specifications

Set the quality bar through code quality

Maintain accurate data lineage and governance.

Требования: 6+ Years of experience building production software

HBO/WO level of thinking

Expert Python and SQL across PostgreSQL, MSSQL, and Oracle

Deep Apache Spark/PySpark experience for distributed processing

Experience with pandas or polars

Experience with Azure Databricks, Data Factory, and Synapse, and/or GCP BigQuery and Dataflow

Experience with Lakehouse/Data Lake environments and Star/dimensional modelling

Experience with Apache Airflow orchestration

Experience with Git, Azure DevOps Pipelines, and CI/CD for data pipelines

Daily experience with Docker and Kubernetes

Experience with Kafka and Elasticsearch

Experience with data quality, lineage, and governance

Experience with AI-assisted development

Strong stakeholder management and ability to translate business needs into technical solutions

Strong English

NL residency required; expats must already be living and working in the Netherlands; Nice to have: Scala, Java, Kotlin, Dutch, dbt, FastAPI, Terraform/Bicep, Medallion, Delta, Iceberg, Hudi, GitHub Actions, Helm, ArgoCD, Kafka, Debezium, Azure Event Hub/Service Bus, GCP Pub/Sub, Snowflake, AWS Glue/Athena, OpenAI/Azure OpenAI, LLM integration in pipelines, MDM, reference data.

Условия: Unlimited Growth Days for professional development and Sytac activities

Private laptop under €4,000 with 50% paid by the company

Technology budget

€2,400 Annual growth budget for training and conferences

Company contribution of 3.75% to the pension

Annual ski trips, beach BBQs, and parties

No relocation support is offered.

#J-18808-Ljbffr