Atlas Invest is transforming the bridge loan landscape, seamlessly connecting investors with real estate developers using advanced big data analytics for a personalized investment experience. We're seeking a skilled Data Engineer with a passion for unlocking the potential of data through web scraping, research, and evaluation. You'll play a crucial role in expanding our data capabilities and driving insights for strategic decision-making.

What you'll do:

Web Scraping: Design and implement robust web scraping solutions and workflows using Python or Node.js to extract data from diverse sources. 

Data Source Research and Evaluation: Conduct extensive research to identify new and relevant data sources. Assess data quality, reliability, and legality, ensuring compliance with ethical and privacy guidelines.

Data Collection and Preprocessing: Gather and preprocess data from various sources, including databases, APIs, and scraped websites. Clean, format, and transform data to ensure its accuracy and consistency.

Who you are:

• At least 3 years of experience as a Data Engineer with a proven track record in researching, designing and implementing ETL pipeline through web scraping and APIs.
• Strong understanding of data cleaning, transformation, and validation techniques.
• Proficiency in Python, as well as experience with web scraping libraries (e.g., Beautiful Soup, Scrapy, Puppeteer).
• Familiarity with data storage technologies (e.g., SQL/NoSQL databases, data lakes).
• Ability to assess data quality, identify patterns and trends, and draw meaningful insights.
• Excellent problem-solving and troubleshooting abilities.

What we offer:

• The opportunity to work on challenging and impactful projects.
• A collaborative and supportive work environment.
• Competitive salary and benefits package.
• Continuous learning and development opportunities.