DevJobs

Software Engineer - DataLake

Overview
Skills
  • Go Go ꞏ 3y
  • Python Python
  • Kafka Kafka
  • Redis Redis
  • AWS AWS
  • Azure Azure
  • GCP GCP
  • Kubernetes Kubernetes ꞏ 2y
  • OpenSearch

We are seeking an exceptional Software Engineer to join our innovative datalake development team.

As part of our dynamic group, you'll tackle complex engineering challenges daily, overseeing the entire data pipeline from collection to transformation, enrichment, and visualization. We operate across all major cloud providers and leverage various technologies, including Kubernetes, Kafka, OpenSearch, and Redis.

Our programming stack primarily consists of Go and Python.

 

About the Role

In this position, you'll play a crucial role in developing our data collection and data lake capabilities, shaping the future of our technology stack. You must be comfortable diving into unfamiliar territory.

 

Key Responsibilities

  • End-to-End Project Ownership: Drive all project phases from conception to production, including design, development, deployment, monitoring, and maintenance.
  • Cross-Functional Collaboration: Work closely with backend and platform teams to deliver exceptional features and maintain a cohesive tech ecosystem.

Requirements

  • 3+ years of experience in Software Engineering with proficiency in high-level programming languages
  • 2+ years of hands-on experience working with Kubernetes
  • 3+ years of experience developing in Go
  • Extensive experience with cloud platforms and products (e.g., AWS, GCP, and Azure)
Lightlytics