DevJobs

Data Pipelines Team Lead

Overview
Skills
  • Python Python ꞏ 7y
  • MongoDB MongoDB
  • PostgreSQL PostgreSQL
  • Redis Redis
  • AWS AWS
  • DO
  • Langchain
  • OCI
  • OpenAI
  • Opentelemetry

We are looking for an experienced Software Engineering Team Lead to join us in our TLV offices.

We’re on a search for a Team Lead who has a lot of passion for scaling software up. In this role, you will be forming from scratch Nimble’s Data Pipelines team, who is responsible for integrating data from different sources, Improving data quality, and efficiently processing it.

You will be developing highly scalable solutions, leading an innovative team designing and implementing the backbone that connects all of Nimble’s Data products.


Responsibilities:

  • A unique opportunity to lead a new, small, innovative team designing and experimenting with the future of Nimble’s Data products
  • The next suite of products, named our “Data Pipeline” products, is a web-data orchestration platform that delivers and structures web data at scale, using,among others things, AI and LLMs including GPT-based models.
  • We work with Python, MongoDB, Postgres, OpenAI, Langchain, Redis, and Opentelemetry, to name a few, Deployed in a multi-cloud environment (AWS, OCI, DO).
  • You will be expected to lead the design, implementation, and growth of Nimble’s Data Pipelines , bringing them from an incubation period to being used in production at scale.
  • You will lead a small team of senior backend engineers and data scientists all focused on the same goal.
  • Grow a healthy, collaborative engineering culture in line with the Nimble values
  • You will shape product and architecture decisions together with the Product Manager, UX Designer, and other engineering teams.
  • You will lead processes to analyze and improve the efficiency, scalability, and stability of various system components.


Job Requirements:

  • Proficiency with Python is expected (we believe strong candidates will have 7+ years of experience as Back-End engineers and 3+ years of experience as Team Leaders).
  • Experience designing and implementing large-scale apps in production is a must.
  • Excellent emotional intelligence and a desire to understand, develop and motivate people.
  • Excellent understanding of modern web apps’ lifecycle and architecture.
  • A demonstrated ability to design and architect back-end solutions independently from scratch.
  • An understanding of how consumers of data (scientists, analysts, engineers) use data pipelines in production at scale, and their requirements and challenges, is a plus.
  • Some experience developing apps on top of LLMs is a plus.
  • A demonstrated ability to collaborate with other teams effectively
  • Significant experience with API design and implementation.
  • Fluent in written and conversational English.

Nimble Way