Mertens-Malam Team is looking for a Big Data Engineer for a Leading Organization.
Job Description:
- Perform and oversee the integration, linking, and organization of diverse data sources.
- Develop, design, and manage data transportation and streaming solutions of various types, including the operation and management of the data pipeline in both Batch and real-time.
- Expertise in various information technologies with a strong emphasis on deep familiarity with different cloud environments and leading tools for handling and processing large volumes of data.
- Understand incoming data into the organizational data lake, extract valid data, package it into various physical and logical layers, catalog, and package it for use by data scientists.
Job Requirements:
- 4 years of experience as a Big Data Engineer
- Experience in system analysis, understanding client needs, and writing specifications
- Experience working with Python, SQL, SPARK, Azure DataBricks, Azure Data Factory
- Experience working with Azure Platform
- Experience with Azure Data Explorer, Azure EventHub - an advantage
- Familiarity with reporting tools, with an emphasis on Power BI - an advantage