DevJobs

Big Data Developer

Overview
Skills
  • Go Go ꞏ 2y
  • SQL SQL
  • Kafka Kafka
  • Flink Flink
  • Spark Spark
  • Elasticsearch Elasticsearch
  • NoSQL NoSQL
  • Redis Redis
  • Kubernetes Kubernetes
  • Pulsar
  • GTP tools

We are seeking an experienced Big Data Engineer to join our team, contributing to the development and maintenance of high-performance, scalable systems in a dynamic, Agile environment. The ideal candidate possesses a strong background in software development, a deep understanding of distributed systems, and a passion for exploring and implementing cutting-edge technologies.


What Will You Do:

Design, develop, and maintain high-quality distributed systems with complex requirements in an Agile environment.

Collaborate with cross-functional teams to ensure seamless integration of software components and systems.

Lead and mentor team members in best practices, software design, and architecture expertise.

Implement and optimize high-performance, scalable server systems, leveraging parallel and distributed processing, microservices, and security development principles.

Utilize SQL, NoSQL, Kafka/Pulsar, ELK, Redis, and column store databases effectively in system design and development.

Leverage big data tools such as Spark or Flink to enhance system performance and scalability (experience is an advantage).


Requirements:

Master's or Bachelor’s degree in Computer Science or related field.

5+ years of software development experience, with at least 2 years as a Senior Software Engineer using GoLang.

Proven track record of delivering high-quality distributed systems in an Agile environment.

Expertise in software development lifecycle, Agile methodologies, DevOps CI/CD, team leadership, and test automation.

Strong technical background with a focus on software design, architecture, and large-scale systems.

Experience with performance optimization, design patterns, and security development principles.

Proficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis, and column store databases.

Familiarity with big data tools like Spark or Flink is advantageous.

Proven experience with K8S; familiarity with GTP tools is a plus.

Exceptional interpersonal skills and a collaborative, team-oriented mindset.

Ability to explore and implement new technologies independently.

Comfortable working in a startup-like environment.

Fluency in Hebrew and English.

Note: This is a challenging and rewarding opportunity for a driven individual passionate about leveraging their expertise in building and optimizing distributed systems using the latest technologies in a fast-paced, collaborative environment.

Cynet