DevJobs

Data Engineer (POEN)

Overview
Skills
  • Python Python ꞏ 3y
  • SQL SQL
  • Pandas Pandas
  • Numpy Numpy
  • CI/CD CI/CD
  • GitHub Actions GitHub Actions
  • GCP GCP
  • Kubernetes Kubernetes
  • Podman
  • Docker Docker
  • Airflow Airflow
  • Jinja
  • ETL
  • OLAP
  • OLTP
  • ELT
  • pyarrow
  • dbt
  • Dagster
  • Functional Programming
  • GitlabCI
  • Luigi
  • Prefect
  • Test-driven development
We're looking for a Data Engineer to help us grow our data engineering capabilities. The ideal candidate is a python engineer with a solid background in building data-intensive applications, familiar with industrial best practices who is self-driven, motivated, independent, and sharp.

You as a member of the data engineering team will take an active part in all development phases, including research, design, development, testing and deployment using technologies like Python, Dagster, Kubernetes, BigQuery, Clickhouse, Ray.

Requirements:

You’ll be a great fit if you have:

  • Strong Python programming skills, including:
  • 3+ years of production experience
  • Working with highly parallel computations
  • Optimizing memory consumption
  • Optimizing IO operations at scale
  • Fluency in SQL and data modeling within both OLAP and OLTP databases
  • Vast experience in building ETL(ELT) pipelines with diverse architectures (streaming, batching) using any orchestration tools (i.e. Dagster, Airflow, Prefect, Luigi, etc.)
  • Fluent with commonly used data engineering libraries like pandas, pyarrow, numpy, Jinja, dbt
  • Hands-on experience in containerized environments (Docker, Kubernetes, Podman, etc.)
  • B.Sc or Master’s degree in Computer Science or equivalent STEM degree
  • You’re a team player, ready to help others
  • Have a readiness and willingness to continuously learn while working
  • Readiness to work in stressful environment with strict deadlines and SLA’s

Would be an extra-plus if you have:

  • Strong experience with Dagster
  • Practical experience with functional programming. Any language, conceptual knowledge is more important
  • Familiarity with cloud computing (ideally GCP)
  • Test-driven development mindset
  • Experience with CI/CD tooling i.e. GitlabCI, Github Actions, etc.
Fetcherr