Job description
We are looking for an experienced programmer to join our research team and develop an automated labor market monitoring tool for a dedicated project. Your task will be to develop and implement a webscraper that will regularly collect and process job listing data from various online sources, such as recruitment portals and social media.
Responsibilities:
Creating a web scraping tool to automatically collect data from selected websites (e.g. pracuj.pl, offers.praca.gov.pl).
Implementation of scripts and algorithms for web scraping and data extraction (e.g., occupation name, location, requirements).
Data preprocessing (merging, cleaning, removing duplicates).
Implementation of algorithms to process and classify data from advertisements using AI tools (e.g., classification of occupations, expected competencies).