DevJobs

Senior Data Platform Engineer

Overview
Skills
  • Java Java ꞏ 5y
  • Python Python ꞏ 5y
  • Scala Scala ꞏ 5y
  • SQL SQL
  • Flink Flink
  • Kafka Kafka
  • Spark Spark
  • AWS AWS ꞏ 2y
  • Azure Azure ꞏ 2y
  • GCP GCP ꞏ 2y
  • Airflow Airflow
  • Hive
Who we are

Lightricks, an AI-first company, is revolutionizing how visual content is created. With a mission to bridge the gap between imagination and creation, Lightricks is dedicated to bringing cutting-edge technology to the creative and business spaces.

Our advanced AI photo and video generation models, including our open-source LTXV model, power our apps and platforms including Facetune, Photoleap, Videoleap, and LTX Studio, allowing creators and brands to leverage the latest research breakthroughs, offering endless control over their creative potential. Our influencer marketing platform, Popular Pays, provides creators the ability to monetize their work and offers brands opportunities to scale their content through tailored creator partnerships.

We are seeking an experienced Data Engineer to join our Data Platform Engineering group at Lightricks. This group is responsible for providing the technological solutions that best fit the business needs of various stakeholders, including product teams, BI analysts, marketing analysts, finance, data scientists, backend teams, and more.

What you will be doing

  • Build and own the infrastructure and services required for processing and storing data from a wide variety of sources, including mobile apps and internal/external data producers.
  • Design and build processes to integrate a wide range of edge systems across multiple cloud providers and handheld platforms reliably.
  • Assist data consumers across Lightricks in defining requirements and refining existing processes using a wide variety of tools.
  • Define and own the systems and processes that deliver data to the data warehouse, while maintaining these systems and the warehouse itself.
  • Identify bottlenecks in internal data processes and resolve them by automating workflows, optimizing data delivery and storage, and redesigning infrastructure for greater scalability.
  • Integrate new tools and solutions to empower the company’s data consumers and help assimilate them effectively.

Your Skills And Experience

  • 5+ years of experience with Python, Scala, Java, or other modern programming languages.
  • 2+ years of hands-on experience designing, building, and optimizing data-intensive distributed systems.
  • 2+ years of experience managing workloads on a major cloud provider.
  • Proven experience working with cross-functional teams in rapidly evolving stacks and environments.
  • Hands-on experience with one or more major cloud platforms (AWS, GCP, Azure).
  • Expertise in Big Data technologies, including Flink, Spark, Kafka, Hive, and Airflow.
  • Functional programming and streaming systems experience, including designing, building, and optimizing stream processing systems (e.g., Flink, Storm, Spark Streaming).
  • Strong knowledge of SQL, data modeling, and relational databases, as well as a deep understanding of ETL and ELT processes.
Lightricks