DevJobs

Data Engineer

Overview
Skills
  • Python Python ꞏ 4y
  • SQL SQL
  • Flink Flink ꞏ 4y
  • Elasticsearch Elasticsearch
  • Apache NiFi ꞏ 4y
  • Apache Spark ꞏ 4y

Data Engineer / DataOps Engineer/ Big Data

As a Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data solutions in a Big Data environment. You will work closely with Data Science, BI, and Information Systems teams to build robust, scalable, and high-performance data pipelines that drive business insights.


Key Responsibilities:

* Design, develop, and maintain complex ETL processes using Apache NiFi and Apache Spark

* Develop real-time data processing pipelines using Apache Flink

* Manage, process, and optimize data using Elasticsearch

* Write complex queries and optimize performance across relational and non-relational databases

* Develop data solutions and implement scalable data flows using Python

* Collaborate closely with Data Science, BI, and system development teams


Mandatory Requirements:

* 4+ years of experience as a Data Engineer with hands-on work in one or more of the following: Apache Spark, Apache NiFi, Apache Flink - Must

* Strong experience developing in Python for data processing and building data flows - Must

* Solid understanding of data architecture and Big Data infrastructure, including challenges and best practices - Must

* Full proficiency in SQL - Must

If you are passionate about building scalable data platforms and working with advanced - Must

Unilink Ltd.