Crawler for data collection

Closed job
Wojciech Kopycki
Wojciech Kopycki
Employer
5 deals
Job category:
Desktop/web applications
Expected budget:

Negotiable

Published:
Finished

Job description

I need to write a crawler that collects data from these sites:

Inhire.io

IT Leaders

JustJoinIT

Jobviously

JobsForGeek

NoFluffJobs

RocketJobs

It is mainly about the elements of the offers such as: "position", "technology", "price range" and "location". The crawler will probably be fired x1/day and should be detectable and blockable. The resulting file should contain a "link to the offer", preferably the whole HTML dump so that you can preview the offer and the individual extracted information.

Required functions: