abra professional services is seeking for an senior data engineer.
We are seeking a Senior Data Engineer to lead the technical development of our Data Fabric within a military program.
This role involves technical leadership in building contextual data pipelines, working with big data lakehouse architectures, and driving data pipeline automation.
Requirements:
MUST HAVE Requirements:
- 5+ years of hands-on experience as a Big Data Engineer
- Proven ability to design and deploy Big Data & AI solutions using frameworks and tools such as:
- Apache NiFi
- Kafka
- Spark
- Graph DB
- NoSQL databases
- Strong coding proficiency in Python and Bash
- Experience building large-scale data pipelines for data processing, transformation, and analytics
- Ability to define and manage metadata schemas
- Experience developing data workflows (e.g., metadata generation, auto-extraction, validation, format conversion)
- Experience developing tools for data observability and compliance analytics
- Ability to analyze and report on complex datasets and results
- Experience working with big data lakehouse architectures
- Ability to explore, enhance, and manage data fusion from multiple data sources
- Experience developing analytics tools, algorithms, and programs
- Technical leadership of data structure design for contextual pipelines
- Collaboration experience with Data Scientists and Architects
- Strong ability to work independently, learn new technologies, and apply innovative solutions
- Excellent interpersonal skills and ability to work as part of a team
- MSc in Computer Science or Data Science
Advantages:
- Experience with managing metadata and taxonomy concepts alongside big data objects
- Experience working with public cloud Big Data & AI services
- Familiarity with machine learning concepts
- Strong technical skills
- Independent, hands-on developer
- Curious, open-minded, fast learner, and a strong team player