DevJobs

Big Data Tech Lead

Overview
Skills
  • Java Java ꞏ 5y
  • Scala Scala ꞏ 5y
  • SQL SQL ꞏ 5y
  • Python Python
  • Spring Boot Spring Boot ꞏ 5y
  • Flink Flink
  • Spark Spark
  • Linux Linux ꞏ 5y
  • GCP GCP
  • No SQL ꞏ 5y
  • BigQuery
  • BigTable
  • Cloud Dataflow
  • Cloud Dataproc
  • Cloud Pub
  • Sub
We’re looking for a hands-on Big Data Tech Lead to play a key role in our Data-infrastructure Team. If you have a passion for big-data and you enjoy tackling complex data challenges, this one's for you!

In your day-to-day, you’ll define, shape, and evolve the architecture of large-scale data products. You'll be responsible for processing terabytes of data as well as building and maintaining production systems with sub-millisecond latency response time while targeting to reduce storage consumption as much as possible.

You will mentor and guide Data Engineers, empowering them to reach their full potential. Additionally, You will be involved in researching, designing, and implementing robust systems that handle vast amounts of data, serving as the backbone of our search index. You'll also take the lead in conducting POCs for new requirements and emerging technologies.

Requirements:

  • 5+ years of experience in developing large-scale complex systems - Java/Scala
  • Experience with software frameworks as Spring boot
  • Experience with different DBs (SQL/No SQL)
  • A proven track record of developing in Linux-based environments
  • Excellent organizational, communication, and interpersonal skills; enjoy working in both individual and team settings
  • Very high Proficiency in both speaking and writing English

Advantage:

  • Strong understanding of data warehousing, data lakes, and big data technologies
  • Experience with python
  • Experience with Spark/Flink/Similar
  • Experience with Google Cloud Platform (GCP) services such as BigTable, BigQuery, Cloud Dataflow, Cloud Pub/Sub, and Cloud Dataproc
Pipl