Crawler for data collection

Employer

Wojciech Kopycki

Description

I need to write a crawler that collects data from these sites:

Inhire.io

IT Leaders

JustJoinIT

Jobviously

JobsForGeek

NoFluffJobs

RocketJobs

It is mainly about the elements of the offers such as: "position", "technology", "price range" and "location". The crawler will probably be fired x1/day and should be detectable and blockable. The resulting file should contain a "link to the offer", preferably the whole HTML dump so that you can preview the offer and the individual extracted information.

Published

on 2022-04-26