abra R&D is looking for a Data Engineer!We are looking for a Data Engineer to join our R&D team and contribute to exciting AI-related projects.
The role involves ingesting and processing large volumes of data, performing deep analysis, and collaborating closely with Data Scientists.
You will design and develop critical, large-scale, and diverse data pipelines in both cloud and on-premise environments.
Requirements- Minimum 3 years of experience as a Data Engineer – mandatory
- 3 years of hands-on experience with Python, including work with JSON files and databases – mandatory
- At least 2 years of practical experience with AWS, using services such as Athena, Glue, Step Functions, EMR, Redshift, and RDS – mandatory
- Experience working with text files for AI or LLM-related projects – strong advantage
- Practical experience with Spark for large-scale data processing – advantage
- Hands-on experience integrating and processing data via REST APIs – advantage
- Solid understanding of optimization techniques and data partitioning using formats like Parquet, Avro, HDFS, and Delta Lake
- Experience working with Docker, Linux, CI/CD tools, and Kubernetes
- Familiarity with GenAI solutions or prompt engineering – strong advantage