DevJobs

Big - Data Engineer

Overview
Skills
  • Java Java ꞏ 4y
  • Scala Scala ꞏ 4y
  • SQL SQL
  • Python Python
  • Flink Flink
  • Kafka Kafka
  • Spark Spark
  • Microservices Microservices
  • AWS AWS
  • Azure Azure
  • GCP GCP
  • Airflow Airflow
  • SQL DB's
  • MapReduce
ControlUp is the market leader in IT platform for Monitoring, Self-healing and Analyzing customers’ virtual environments, creating solutions that save IT organizations time, money, and stress.


If you’re looking to be part of a fast-growing, cutting-edge technology company, join us for the ride and play a significant role in developing the next generation of ControlUp innovation.


We are looking for a Big - Data Engineer to join our team. If you are interested in real-scale data challenges, working on a life-changing product, your place is with us!


Responsibilities:


Build infrastructure and products Working in a high-volume production environment that gets bigger and bigger


Mastering scalability and enterprise-grade production services implementation


Sense of ownership - leading design for new products and initiatives as well as integrating with currently implemented best-practices


Working with a number of modern technologies including Flink, Spark, Kafka, K8s, and more


Collaborating and working as part of a highly skilled team that enjoys doing the impossible together every day


Requirements:


4+ years of coding experience with data streaming application, performance optimization and scaling out data worldwide


Coding experience in high throughput real time data processing with Scala or Java - Must!


Knowledge with Python


Experience with the following technologies: Kafka, SQL DB's, Spark and Flink - Must!


End-to-end experience - owning features from an idea stage, through design, architecture, coding, integration, and deployment stages


Dealing with data on high volume, high availability production systems


Fluent with SQL


Strong data modeling skills


Design, develop, and deliver microservices knowledge


Advantages:


Experience working with a cloud provider (AWS / Azure / GCP)


Bachelor's degree or higher in Computer Science or equivalent professional Software Engineering experience


Experience working with CI/CD systems


MapReduce, Airflow
ControlUp