DevJobs

Data Platform Engineer

Overview
Skills
  • Go Go
  • Python Python
  • Kafka Kafka
  • PostgreSQL PostgreSQL
  • ClickHouse

Miggo is a young cybersecurity startup founded in 2023 to revolutionize the application security space. Miggo is bringing the first Application Detection and Response (ADR) platform to stop application breaches. Today, 80% of all cyber incidents happen in the application layer, however too many are being slipped by existing tools due to a blindspot to the actual application behavior. By using in-application runtime context, Miggo maps how applications actually operate in runtime, identifies high-risk application flows, pinpoints the weak spots, and provides real-time detection and response capabilities in the application layer.


We are looking for a talented and driven Data Platform Engineer to design and develop scalable data pipelines capable of efficiently ingesting and processing large volumes of data. In this role, you will be at the heart of building and enhancing our data architecture, optimizing system performance, and ensuring data integrity across our platform. You will have the opportunity to develop our data infrastructure, setting a foundation for high-performance data operations and analytics.


Key Responsibilities

  • Design and implement a robust data architecture supporting both streaming and batch processing
  • Develop, maintain, and enhance our data platform, including databases, warehouses, and querying capabilities
  • Build and deploy complex microservices and distributed systems in Go and Python
  • Optimize and scale data operations using a range of technologies, including Postgres, ClickHouse, and Kafka
  • Mentor a team of talented engineers, fostering a collaborative and innovative environment
  • Drive internal team vision, contributing to strategic planning and architecture decisions


Requirements

  • Proven experience in distributed systems, data pipeline development, and data architecture
  • Expertise in performance tuning, data modeling, and system optimization for data-intensive applications
  • Strong knowledge of microservice architecture, with a track record of building and scaling services in Go and Python
  • Advanced proficiency in Postgres, ClickHouse, and, Kafka
  • Effective communicator, able to present and discuss complex technical concepts with a diverse team

Miggo Security