Job description
Project description:
I am looking for a programmer to create a script from scratch that will retrieve and analyze data from the Allegro.pl auction site. The script should be able to search through various product categories to a depth of 5 pages to gather detailed market information.
Detailed requirements:
Data extraction: The script must extract the following information:
Product category path
The position of the product in the list in the category
Product title
Name of the seller
Product price
Product price with delivery
Product condition (new/used)
Whether the offer is promoted
Scope of search: The script should search all product categories to a depth of 5 listing pages.
Proxy support: The script must include a proxy function to bypass potential IP blockers.
Output format: Data should be exported to a CSV file, organized and easy to analyze.
Verification of security mechanisms:
Candidates must verify their ability to extract data from Allegro.co.uk, taking into account website security mechanisms such as captcha, IP blockers, etc. Please confirm this ability in your proposal.
Expectations for the candidate: