Key Responsibilities:
- Design, construct, install, test, and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices for security and integrity.
- Develop data set processes for data modeling, mining, and production.
- Integrate new data management technologies and software engineering tools into existing structures.
- Create custom software components and analytics applications.
- Employ a variety of languages and tools to marry systems together.
- Recommend ways to improve data reliability, efficiency, and quality.
- Collaborate with data architects, modelers, and IT team members on project goals.
Must-Have Qualifications:
- Minimum 2 Years Experience as a Data Engineer: You have at least two years of hands-on experience in a Data Engineer role, with a proven track record of developing and maintaining scalable data architecture.
- Strong Python Knowledge: You possess advanced skills in Python, with the ability to write efficient, reusable, and reliable code.
- Strong SQL Knowledge: You have extensive experience with SQL, understanding complex queries and the ability to optimize database operations for performance and efficiency.
Nice-to-Have Qualifications:
- Familiarity with AWS Environment: Experience with Amazon Web Services (AWS) and its data services (e.g., S3, Redshift, DynamoDB) is highly desirable.
- Familiarity with MySQL: Knowledge of MySQL, including database design, optimization, and maintenance, is a plus.
Skills and Abilities:
- Excellent problem-solving skills and the ability to think algorithmically.
- Strong analytical skills, with the ability to work with large data sets and derive insights.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Detail-oriented with an aptitude for precision and the ability to manage multiple projects simultaneously.