DevJobs

Data Engineer

Overview
Skills
  • Python Python
  • Bash Bash
  • Kafka Kafka
  • Spark Spark
  • ML ML
  • NoSQL NoSQL
  • Big Data Lakehouse Architectures
  • Compliance Analytics
  • Data Observability
  • Data Workflows
  • Graph DB
  • Algorithms
  • Metadata Schemas
  • Programs
  • Apache NiFi
  • Analytics Tools
  • Public Cloud AI Services
  • Public Cloud Big Data Services

abra professional services is seeking for an senior data engineer.

We are seeking a Senior Data Engineer to lead the technical development of our Data Fabric within a military program.

This role involves technical leadership in building contextual data pipelines, working with big data lake house architectures, and driving data pipeline automation.


Requirements:


MUST HAVE Requirements:

  • 5+ years of hands-on experience as a Big Data Engineer
  • Proven ability to design and deploy Big Data & AI solutions using frameworks and tools such as:
  • Apache NiFi
  • Kafka
  • Spark
  • Graph DB
  • NoSQL databases
  • Strong coding proficiency in Python and Bash
  • Experience building large-scale data pipelines for data processing, transformation, and analytics
  • Ability to define and manage metadata schemas
  • Experience developing data workflows (e.g., metadata generation, auto-extraction, validation, format conversion)
  • Experience developing tools for data observability and compliance analytics
  • Ability to analyze and report on complex datasets and results
  • Experience working with big data lakehouse architectures
  • Ability to explore, enhance, and manage data fusion from multiple data sources
  • Experience developing analytics tools, algorithms, and programs
  • Technical leadership of data structure design for contextual pipelines
  • Collaboration experience with Data Scientists and Architects
  • Strong ability to work independently, learn new technologies, and apply innovative solutions
  • Excellent interpersonal skills and ability to work as part of a team
  • MSc in Computer Science or Data Science

Advantages:

  • Experience with managing metadata and taxonomy concepts alongside big data objects
  • Experience working with public cloud Big Data & AI services
  • Familiarity with machine learning concepts
  • Strong technical skills
  • Independent, hands-on developer
  • Curious, open-minded, fast learner, and a strong team player

abra