We seek a passionate Data Engineer Manager to join the Data team, in our TLV Site.
Responsibilities - what you’ll be doing:
- Create and maintain optimal data pipeline architecture
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using NoSQL and ‘big data’ technologies
- Analyze and organize raw data
- Prepare data for prescriptive and predictive modeling
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
- Collaborate with data scientists and architects on several projects
- Own the BI within the company
- Be the point of contact for internal and external stakeholders regarding data and data integrations
- Work closely with a talented agile team of engineers, product managers, and designers to build browser-based/mobile user experiences that are robust and friendly
- Be an important part of the company’s development team
Requirements - does this describe you?
- Degree in Computer Science; a master’s is a plus
- Experienced in data monetization
- Proficient in SQL and Python
- Backend software development in languages such as Java, Scala, Go, C# or similar – 5 years
- Proficient knowledge of Data lake, Data Warehouse, and LakeHouse architectures
- Hands-on experience with NoSQL database design – 5 years
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience with message brokers (like Kafka RabbitMQ or similar) – 3 years
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
Advantages - these will bring you to our front row:
- Great numerical and analytical skills
- Proven team lead ability and experience with a focus of leading experienced software engineers and or data engineers
- Degree/Experience in ML, DL, or/and algorithms
- Experience with cross-platform client app development (Linux, Windows, Mac, Mobile)