data engineer in data platforms

Описание:Sytac provides data platforms for some of the Netherlands' largest companies, including KLM, ABN AMRO, ING, Rabobank, Bol, and Ahold. The company operates in software development, data infrastructure and analytics, and IT consulting.Задачи:Build maintainable, modular, tested, and versioned ETL/ELT pipelines in Python, PySpark, and SQLDesign Lakehouse environments using Medallion architecture and dimensional/Star Schema modelling on Azure and GCPOwn infrastructure as code with Terraform or Bicep and containerized deployments on Docker and KubernetesOrchestrate data workflows with Apache AirflowRun CI/CD for data pipelines using Azure DevOps and GitHub ActionsUse AI tools in the development workflow and integrate LLMs into pipelines where appropriateTranslate business logic into clear technical specificationsSet the quality bar through code qualityMaintain accurate data lineage and governance.Требования:6+ Years of experience building production softwareHBO/WO level of thinkingExpert Python and SQL across PostgreSQL, MSSQL, and OracleDeep Apache Spark/PySpark experience for distributed processingExperience with pandas or polarsExperience with Azure Databricks, Data Factory, and Synapse, and/or GCP BigQuery and DataflowExperience with Lakehouse/Data Lake environments and Star/dimensional modellingExperience with Apache Airflow orchestrationExperience with Git, Azure DevOps Pipelines, and CI/CD for data pipelinesDaily experience with Docker and KubernetesExperience with Kafka and ElasticsearchExperience with data quality, lineage, and governanceExperience with AI-assisted developmentStrong stakeholder management and ability to translate business needs into technical solutionsStrong EnglishNL residency required; expats must already be living and working in the Netherlands; Nice to have: Scala, Java, Kotlin, Dutch, dbt, FastAPI, Terraform/Bicep, Medallion, Delta, Iceberg, Hudi, GitHub Actions, Helm, ArgoCD, Kafka, Debezium, Azure Event Hub/Service Bus, GCP Pub/Sub, Snowflake, AWS Glue/Athena, OpenAI/Azure OpenAI, LLM integration in pipelines, MDM, reference data.Условия:Unlimited Growth Days for professional development and Sytac activitiesPrivate laptop under €4,000 with 50% paid by the companyTechnology budget€2,400 Annual growth budget for training and conferencesCompany contribution of 3.75% to the pensionAnnual ski trips, beach BBQs, and partiesNo relocation support is offered.

#J-18808-Ljbffr