DevJobs

Lead Big Data Engineer

Overview
Skills
  • Python Python
  • SQL SQL
  • Flink Flink
  • Kafka Kafka
  • CI/CD CI/CD
  • GCP GCP ꞏ 5y
  • Kubernetes Kubernetes
  • Apache Spark
  • BigQuery
  • Cloud Functions
  • Cloud Pub
  • Sub
  • Apache Iceberg
  • Containers
CYREBRO is the first interactive SOC Platform, transforming how today’s businesses respond to and mitigate cyber threats with a centralized security operations infrastructure. The platform provides complete clarity, insight, and real-time cyber recommendations for businesses of all sizes by integrating all of their security events into one central command.

We are seeking a Lead Big Data Engineer to architect and drive our data platform initiatives and lead our existing project with growth potential. The ideal candidate will have extensive experience with large-scale, real-time data processing on Google Cloud Platform (GCP) and modern big data technologies.

Responsibilities:

  • Lead the development of scalable big data pipelines using GCP services.
  • Design and implement large-scale data lake solutions and streaming architectures.
  • Drive technical decisions and establish best practices for big data architecture.
  • Manage project deliverables while ensuring scalability, performance and reliability.
  • Collaborate with cross-functional teams to align technical solutions with business objectives.

Requirements:

  • 10+ years of software engineering experience, with 5+ years focused on big data engineering.
  • Strong expertise with GCP, particularly Cloud Pub/Sub, Cloud Functions, and BigQuery.
  • Advanced experience with Apache Spark and distributed computing systems.
  • Deep knowledge of stream processing and non-relational databases.
  • Strong programming skills in Python and SQL.
  • Proven track record in big data modeling and pipeline optimization.

Preferred Qualifications

  • Previous experience as a team leader.
  • System design experience in high-throughput, low-latency environments.
  • Experience with Apache Iceberg or similar tools.
  • Advanced stream processing experience (e.g., Flink, Kafka Streams).
  • DevOps experience (CI/CD pipelines, Containers, Kubernetes).
  • Experience working in startup environments or fast-paced organizations.
  • Background in the cybersecurity industry is a plus.

What We Offer

  • Opportunity to build and lead a growing engineering team.
  • Work with cutting-edge cloud technologies in cybersecurity.
  • Competitive compensation package including equity.
  • Collaborative startup environment with high impact potential.
  • Professional development and learning opportunities.
CYREBRO