eucalyptus
Staff Data Engineer
Опубликовано
- Опыт
- От 8 лет
Актуальность нужно проверить
Откройте публикацию в источнике и уточните, продолжается ли набор.
Источник проверяли 15 ноября
Доступ проверим при нажатии.
О вакансии
Вакансия «Staff Data Engineer» в компании eucalyptus.
Чем предстоит заниматься
- Guide Platform Initiatives: Take ownership of high-complexity, multi-sprint initiatives, including CDC connector buildouts, BigQuery warehouse workstreams, event-streaming infrastructure, lower environments and adoption of shared standards.
- Build Dependable Ingestion: Design and maintain ingestion pipelines and platform infrastructure, from source connectivity through the raw and cleansed warehouse layers, that Analytics Engineering, Data Science and business teams rely on daily. Take responsibility for production deployments of containerised services on Kubernetes (EKS) across our AWS and GCP environments.
- Run Streaming Pipelines: Design and look after event-driven and streaming pipelines using Kafka (AWS MSK) and Flink on EKS, delivering CDC and user event tracking (UET) streams into BigQuery, with scaling approaches, cost guardrails, consumer lag alerting and runbooks in place before production rollout.
- Own CDC Ingestion: Take responsibility for change-data-capture pipelines from source systems into BigQuery end to end, from Terraform provisioning through schema change governance and production monitoring.
- Own Data Contracts: Take responsibility for raw-to-cleansed data contracts, schema governance and SLAs, agreeing expectations with the teams who depend on them.
- Champion Data Quality: Ship pipelines with built-in quality checks, including dbt tests, anomaly detection, schema validation and data-drift alerting, so our data stays trustworthy.
- Strengthen System Reliability: Agree KPIs and SLOs, build monitoring and alerting as code with Datadog (or equivalent), join the on-call rotation, and look after Tier 1 tickets and runbooks across your area, working through the root causes rather than the symptoms.
- Empower Data Teams: Build platform capabilities that unblock Analytics Engineering, Data Science and ML roadmaps. Partner with legal, security and DevOps on compliance controls, including HIPAA/PHI handling, UK GDPR and cross-border access to patient data, and on IaC hardening.
- Mentor & Share Standards: Mentor Senior Data Engineers through design reviews, code reviews and pairing, helping them grow their impact to cross-squad scope. Help the team adopt good practice in testing, CI/CD, observability as code, Airflow, dbt and Schema Registry governance, and join ARC reviews for changes with cross-team or financial impact.
Что нужно для работы
- Platform Engineering Depth: You are a highly experienced data engineer (typically 8+ years) who has designed, built and run production ingestion and streaming platforms at scale. You are confident in Python and SQL, comfortable with Kafka, Flink, dbt, Airflow and BigQuery, and ideally have built Kafka-ecosystem services in Kotlin, Go or similar.
- Initiative Ownership: You have taken ownership of complex, multi-sprint technical initiatives as the directly responsible owner, from scoping and design docs through to production rollout, and can keep several teams aligned along the way.
- Reliability Mindset: You treat reliability as part of the design. You have set SLOs, built monitoring and alerting as code, worked on-call rotations and written the runbooks that make operations repeatable.
- Data Quality & Governance: You build quality checks into pipelines from the start, and you have experience with data contracts, schema governance and tooling such as a Schema Registry.
- Infrastructure as Code: You are comfortable with Terraform and CI/CD patterns across AWS and GCP, and enjoy working alongside DevOps and security colleagues to harden them.
- Mentoring & Influence: You help other engineers grow through design reviews, code reviews and pairing. You work across squads, take part in architecture reviews and share standards that other teams choose to adopt.
- Cross-Functional Collaboration: You work well with Analytics Engineers, Data Scientists, Machine Learning Engineers, legal and security, and can explain technical trade-offs clearly to non-technical colleagues.
- Nice to have
- Будет плюсом: Experience in regulated sectors (such as healthtech, fintech or gaming), finding creative paths forward inside compliance constraints rather than being stopped by them. Familiarity with reverse-ETL / data activation tools such as Hightouch or Segment is also a plus.
Что предлагает компания
- ДМС / медицинское страхование
Источник: Arbeitnow. Условия и актуальность вакансии подтверждает работодатель.
Подходит вакансия?
Перейдите к исходному объявлению или контакту работодателя.
Доступ проверим при нажатии.