DevJobs

Web Scraping Expert and Backend Developer

Overview
Skills
  • Python Python ꞏ 5y
  • Postman Postman
  • JIRA JIRA
  • Bitbucket Bitbucket
  • Git Git
  • Fiddler
  • Networking Networking
  • Command line
  • Scraping techniques
  • OOP principles
  • Linux OS
  • HTTP Methods
  • Headless browsers
  • Debugging tools in Browsers
  • Lua script
  • Crawlers
  • Scanners
  • Coralogix
  • Splash
  • Wireshark

Fornova is looking for a bright, motivated, self-learner & enthusiastic blockages resolver and backend developer. We are a big data company specializing in the travel industry.

Our expertise is to extract the data from travel websites across the web with many different patterns, using our unique technology. The collected data assists thousands of hotels and multiple major car rental companies in taking optimal business decisions and securing competitive advantage.


Tasks:

● Performing website analysis to overcome bot detection mechanisms, and implementing these

solutions as a highly efficient and maintainable automated data collector in Python;

● Develop and improve internal backend services that will help to handle website blockages;

● Adding enhancements to existing infrastructure;

● Understanding internal data pipelines, troubleshooting, spotting and overcoming issues on the

different stages of data flows;

● Integrating external partner’s solutions to our infrastructure;

● Taking a logical, data-backed approach to prioritizing projects, while cooperating with

colleagues from different departments at the same time;

● Taking ownership of challenging projects and enjoying being the “go-to” person;

● Enhancing our knowledge base with new high-end solutions


Skills:

● 5+ years of experience in the data collection (scrapping);

● 5+ years of experience in blockages resolving and preventing bot detection

● High level understanding of user’s fingerprints and how to randomize them;

● Reverse engineering of API/web-applications

● Excellent communication in both spoken and written English;

● Familiarity with: scraping techniques, headless browsers;

● Understanding of OOP principles;

● Strong knowledge of HTTP Methods and Networking, Debugging tools in Browsers, Experience

with Postman;

● Proficient understanding of code versioning tools (Git, Bitbucket ect.)

● Good familiarity with the Linux OS and command line (pip, basic commands)

● BA in Computer Science /Information Systems or Industrial Engineering and Management

Graduate – Advantage

● Ability to work well independently and productively in highly pressured environment

● Creative thinking and team collaborator

● Self-learner


It would be very useful if you have experience working with the following:

Scanners & Crawlers, Splash, Lua script, Fiddler, Wireshark, Linux, JIRA, Coralogix.

Fornova