DevJobs

Senior Data Engineer

Overview
Skills
  • Python Python ꞏ 5y
  • SQL SQL ꞏ 5y
  • Spark Spark ꞏ 4y
  • Numpy Numpy
  • Pandas Pandas
  • GCP GCP
  • Airflow Airflow ꞏ 4y
  • BigQuery ꞏ 4y
  • Arrow
We’re seeking a Senior Data Engineer to Take full ownership of designing, building, and deployment of data infrastructures, work with researchers, data scientists and product managers, Create a new industry-altering product from its inception to production level.

Requirements:

  • At least 5 years of demonstrated experience in software development.
  • At least 4 years of experience in building data stream pipelines and ETL using Big Data frameworks such as Spark, Apache Airflow, and BigQuery.
  • Advanced proficiency in Python and SQL.
  • Extensive experience with various types of databases.
  • Skilled in using Python data analysis libraries (e.g., Pandas, Numpy, Arrow).
  • Proven experience in deploying pipelines on the cloud (GCP preferred), including testing, staging, and monitoring.
  • Proficient in applying software engineering best practices, including coding standards, code reviews, - CI/CD, and testing
  • B.Sc in Computer Science or a related scientific field.
Razor Labs