DevJobs

Data Engineer

Overview
Skills
  • Python Python ꞏ 3y
  • Spark Spark
  • RDBMS RDBMS
  • NoSQL NoSQL
  • AWS Lambda AWS Lambda
  • AWS S3
  • BI Solutions
  • Columnar Databases
  • Sub Architecture
  • AWS Athena
  • Pub
  • Presto
  • Hive
  • Hadoop
  • Data Modeling
  • AWS State Machine
  • AWS SQS
  • AWS SNS
  • AWS Sage Maker
  • AWS Redshift
  • AWS Glue
  • AWS EMR

About us:

With more than 15 years of activity, and over 3 million customers (and growing), Pango’s app has become synonymous with driver, vehicle, and commuters solutions. It is a known brand and one of the most widespread applications in Israel.


About the job:

We are looking to add a skilled, talented and motivated Data Engineer to our dynamic data team. We are offering an opportunity to play a key role in a data-driven, open-minded and dynamic organization that applies cutting-edge technology and constantly thrives to discover more, know more, and do better.


Responsibilities:

-Collaborate with our talented data engineers to re/design, develop, maintain and implement scalable solutions associated with Data/Big Data/ML.

·Address complex problems associated with integration and digestion of data flow, calculation of BI models, as well as other issues like execution times, velocity, and volume of data, RT/NRT latencies, process orchestration etc.

·Build and maintain CI/CD infrastructure.


Requirements

You must have:

·3+ years hands-on (backend or data) programming experience with Python - a must.

· hands-on experience with relational, columnar and NoSQL databases – a must.

· Fundamental understanding of design and implementation of BI solutions - a must.


Advantages:

· Deep understanding of scalable data modeling/structure concepts.

· Experience using Big Data technologies such as Hadoop, Hive, Spark, Presto or equivalent.

· Experience working with any cloud technology, particularly AWS stack such as Redshift, S3, EMR, Athena, Sage maker, AWS Glue, Lambda, SQS, SNS, and State Machine.

· Experience or decent understanding of pub/sub architecture in general.

· B.A\BSc in CS/IE/Math/Statistics or equivalent from a known university/college.


Pango