DevJobs

Senior Data Engineer

Overview
Skills
  • Python Python ꞏ 2y
  • SQL SQL
  • Spark Spark
  • Git Git
  • Azure DevOps Azure DevOps
  • GitHub Actions GitHub Actions
  • Azure Azure
  • Databricks ꞏ 2y
  • Data Architecture
  • Data Lake
  • Data Modeling
  • Delta Lake
  • DWH
  • Repos
  • FinOps

we're looking for an experienced Data Engineer to join our team and help design, develop, and optimize cutting-edge cloud solutions that make a real impact.


What you’ll be doing:

* Designing, developing, and maintaining complex pipelines in Databricks

* Implementing Data Lakehouse solutions in Azure with Delta Lake

* Integrating with diverse cloud systems

* Managing code versions and asset bundles via Repos and Git

* Driving CI/CD processes with Azure DevOps or GitHub Actions

* Improving performance, optimizing code, and solving issues in Spark

* Collaborating with Data Science and BI teams to bring models and visualizations into production


What we’re looking for:

* Bachelor’s degree in Computer Science, Engineering, Data Science, Information Systems, or related field – must

* 5+ years of experience as a Data Engineer, including data integration and ETL/ELT processes in cloud environments – must

* 2+ years of experience in Databricks – must

* 2+ years of proven development in Python – must

* Strong command of SQL – must

* Solid knowledge of DWH/Data Lake methodologies, Data Architecture, and Data Modeling

* Experience in Cloud resource optimization (FinOps) – advantage

G-STAT