eucalyptus
Senior Data Engineer
Опубликовано
- Опыт
- От 5 лет
- Уровень
- Senior
Актуальность нужно проверить
Откройте публикацию в источнике и уточните, продолжается ли набор.
Источник проверяли 15 ноября
Доступ проверим при нажатии.
О вакансии
Вакансия «Senior Data Engineer» в компании eucalyptus.
Чем предстоит заниматься
- Build Scalable Pipelines: Design and build data pipelines that are dependable, high quality and ready to grow with the business.
- Care for Containerised Deployments: Take responsibility for production deployments of containerised data applications and ETL infrastructure on Kubernetes (EKS) across our AWS and GCP environments.
- Support Data Processing & Integration: Build and look after batch and streaming workflows using Python, SQL, dbt, Kafka (AWS MSK), Flink and Airflow, bringing data into the BigQuery warehouse via CDC and user event tracking (UET) streams and REST APIs.
- Improve Quality & Reliability: Implement testing frameworks, monitoring as code (Datadog or equivalent), anomaly detection, SLOs and runbooks so our data stays trustworthy and dependable.
- Enable Self-Service Onboarding: Build platform capabilities such as config-driven table onboarding that help analytics engineers, analysts and business colleagues bring new data onto the platform without bespoke engineering.
- Partner Across Data Teams: Work with analytics engineers to keep core data sources performant and dependable, and support ML engineers with reliable platform foundations for deploying models. Transformation logic and data marts remain with Analytics Engineering.
- Share Engineering Practices: Work with the wider Data Platform team to agree on and uphold good engineering practices.
- Embed Governance & Security: Partner with legal and security colleagues on governance, data compliance and security policies, including HIPAA/PHI handling, UK GDPR and cross-border access to patient data.
- Deliver Infrastructure as Code: Help shape how we approach DevOps on Terraform (IaC) and CI/CD within the data platform, taking responsibility for versioning and deployment of data pipelines.
Что нужно для работы
- Data Engineering Depth: You are an experienced data engineer (typically 5+ years) who can design and look after pipelines end to end, from ingestion through to consumption. You are comfortable working with Python, SQL, dbt, Kafka, Flink, Airflow and REST APIs.
- Infrastructure & Operational Skills: You have experience running containerised infrastructure on Kubernetes and are comfortable with Terraform, CI/CD and code versioning practices for data workloads, ideally across both AWS and GCP.
- Quality & Reliability Mindset: You care about data quality as a core part of the job, with hands-on experience implementing testing frameworks, observability tooling, SLOs and runbooks.
- Enablement Focus: You care about the people using your data. You have a track record of building platform tooling that helps analysts, analytics engineers and colleagues feel confident working with data themselves.
- Cross-Functional Collaboration: You work well with analytics engineers, machine learning engineers, DevOps, legal and security, and can explain technical trade-offs clearly to non-technical colleagues.
- Responsibility & Judgement: You take responsibility for the systems you build, help the team grow through code review and mentoring, and make thoughtful calls in ambiguous, fast-moving environments.
- Nice to have
- Будет плюсом: Experience in regulated sectors (such as healthtech, fintech or gaming), finding creative paths forward inside compliance constraints rather than being stopped by them. Familiarity with reverse-ETL / data activation tools such as Hightouch or Segment is also a plus.
Что предлагает компания
- ДМС / медицинское страхование
Источник: Arbeitnow. Условия и актуальность вакансии подтверждает работодатель.
Подходит вакансия?
Перейдите к исходному объявлению или контакту работодателя.
Доступ проверим при нажатии.