**Company Description**

Berlin Information Technology AB, established in 2013 and headquartered in Helsingborg, specializes in providing IT consulting services to both public and private operations. With nearly a decade of experience, the company collaborates with industry-leading technology partners like IBM Cognos, Qlik, Microsoft and Google to deliver innovative solutions. Berlin IT emphasizes building strong relationships with clients to help them maximize returns on their IT investments. The company values collaboration, professionalism, and a solution-oriented approach to every project.

**Role Description**

This is a full-time on-site role for a Senior Data Engineer (Apache Beam) based in Malmö.

You will act as a Senior Dataflow & Integration Engineer, serving as the technical architect and builder of the data bridge between GCP and AEP.

Pipeline Architecture: Designing and developing production-grade Apache Beam pipelines on GCP Dataflow using Scala and Python.

Performance Engineering: Deep-diving into execution metrics to optimize Shuffle Service, Streaming Engines, and autoscaling thresholds.

Advanced Logic Implementation: Handling complex windowing, watermarking, and late-data sequencing for real-time event signals.

Transformation & Integrity: Building type-safe transformation layers to map raw data into Adobe XDM structures.

Orchestration: Designing Cloud Composer (Airflow) DAGs and custom operators for lifecycle management and automated error handling.

**Qualifications**

- Dataflow Mastery: 5+ years of hands-on experience with Apache Beam (GCP Dataflow), covering both Batch and Streaming models
- Programming: Expert-level proficiency in Scala (Functional Programming) and Python
- Orchestration: Advanced Apache Airflow (Cloud Composer) skills, specifically in DAG design and Custom Operators
- GCP Ecosystem: Deep knowledge of BigQuery (Storage Write API), Pub/Sub, and Cloud IAM
- Data Modeling: Experience with XDM Schema Registry and AEP Ingestion APIs
- Experience with Dead Letter Queue (DLQ) management and back-pressure tuning
- Familiarity with Agile methodologies and collaborative DevOps environments
- Previous experience in large-scale retail or e-commerce marketing environments