The role:
We're seeking a driven Data Team Lead to join our dynamic team at Kaltura, spearheading our pioneering video platform as a service. In this leadership role, you will oversee the data engineering team, playing a pivotal role in advancing our data operations. Your expertise will be crucial in steering the team's collaboration with various R&D teams to meet our product roadmap objectives.
The day-to-day:
- Lead the development and refinement of ETL infrastructure using Python/Scala/Java, SQL, and advanced AWS technologies like EMR and Redshift.
- Drive innovation in our big data platform to efficiently process millions of events daily.
- Architect and manage robust, scalable data pipelines that support rapid data growth.
- Design and maintain ETL pipelines with enhanced monitoring and alert systems.
- Mentor team members on optimizing data models for clarity and accessibility.
- Oversee the management of metadata, data catalogs, and documentation to aid business decisions.
- Ensure team proficiency in SQL for effective data querying and manipulation.
- Direct the use of Databricks for complex data engineering and analytical tasks.
Ideally, we’re looking for:
- Demonstrated leadership in managing data engineering teams and overseeing large-scale distributed systems.
- Minimum of 5 years in a technical leadership role, with expertise in Python, Scala, or Java.
- In-depth knowledge of Big Data technologies like Spark, Kafka, Redshift, Athena, S3, and Kinesis.
- Extensive experience with Amazon Web Services, including hands-on experience with Apache Airflow.
- Proven ability to excel in ambiguous situations and create innovative solutions.
These would also be nice:
- Exceptional problem-solving, analytical, and communication skills, fostering strong team collaboration.
- Committed to continuous learning and staying current with industry trends, data engineering best practices, security, and compliance.
- Highly adaptable to evolving project requirements and priorities, ensuring flexibility in dynamic environments.
The perks:
- Hybrid, flexible work environment
- Extended private health (including mental) insurance
- Personal and professional development programs
- Occasional Cross company long weekends