Stworzenie crowlera monitorującego ceny

Closed job

Recent jobs from category Coding and IT

  • no avatar
    beletere
    I need a daily download of Prisma Access Gateway IP Address list in python. Then do a diff against the list from the day before and be notified of any changes that have happened. For now don't send any reminders but store the diff file on GCP bucket. For now only gp_gateway would be needed. More details to be found under the URL https://docs.paloaltonetworks.com/prisma/prisma-access/3-1/prisma-access-panorama-admin/prisma-access-overview/retrieve-ip-addresses-for-prisma-access
  • no avatar
    enova
    Programmer in a Voiceflow or Chatbase
    Proposed by freelancer
    5
    7d
    I am looking for a programmer in the Voiceflow or Chatbase co environment, with an overlay on Voiceflow, maybe and for permanent cooperation. I would like on my accounts in the above, as well as Make and Google sheets to create an Agent on my website which, will in a loop answer the customer's questions, as well as introduce some functionality: 1. retrieving user data, from the API prepared in Google sheets excel (order number, order date, products, their names, complaint status if any, authorization by order number, email, login, for confirmation the customer should provide phone number). 2. complaint form after completion exported to Google sheets with fields: Order No., Product, Reason: (Product damaged, Product not as described, Wrong size/color, Other reason (please describe), Bank account number (for refund), and statement: I declare that I have read the store's return policy and accept its terms. 3. If you attempt to contact me, Form To Collect Leads. Provide your name, Company Name, email and phone, Do you prefer to be contacted by email or phone. 4. Finally, in case of problems, Connect with a consultant (via Whatsap, masenger, or google Chat). 5. product knowledge base, downloaded from xml Google Shopping Feed Extensions via a link on the site. Scenario details: Customer seeks product information: Agent: “Good morning! How can I help you? Are you looking for a specific product?” Customer: “Yes, I am interested in [product name].” Agent: “I'm happy to help. The [product name] is [brief description]. Would you like to know more about its specifications, availability or usage?” A customer has a problem with a purchase: Agent: “Good morning. I see that you have encountered a problem with your purchase. How can I help you?” Customer: “I can't add the product to my shopping cart.” Agent: “I understand. Please try [suggestions for solutions, e.g. clear cache, use a different browser]. If the problem persists, please give me more details.” Customer wants to make a complaint, Questions about return policy.
  • no avatar
    Ferhatcan
    System engineer
    70.00 EUR
    9
    17d
    Role 1: Systems Architect As a Systems Architect, the candidate is expected to have a basic understanding of hardware. It is not necessary to be an expert, but having insight into how hardware and software communicate with each other is crucial. The role requires a strategic mindset, where the candidate can create structures and solutions that support both the system’s software and hardware. Desired competencies: Experience in software architecture. Understanding of the function of hardware components. Experience working in cross-functional teams. Ability to communicate and anchor architectural decisions with various stakeholders. Request for a quote for the month of work for the declared number of hours.
  • no avatar
    extension 2 deals
    We're looking for a freelancer with good TS & React skills to help with emergency project with a potential for a long-term collab. Must have: - Availability to start immediately - Strong TypeScript skills - Knowledge of React and it's ecosystem (TanStack-Query, react-hook-form, Storybook) - Knowledge of Tailwind - Knowledge of client-server protocols (HTTP, GraphQL) - Experience in building maintainable and scalable systems, design systems, and writing tests Nice to have: - Web3 skills - Basic experience in building browser extensions - Knowledge of WebSockets
no avatar
Tomek Kwiecinski
Employer
Job category:
Software
Expected budget:

Negotiable

Published:
Finished

Job description

1. Opis projektu

Zleceniobiorca ma stworzyć crawler internetowy, który będzie monitorował ceny produktów w sklepach internetowych, bazując na nazwie produktu lub numerze GTIN (EAN/UPC). Crawler ma automatycznie wyszukiwać oferty w Google oraz generować tabelę z wynikami.

2. Wymagania funkcjonalne

Wejście danych

Użytkownik wprowadza nazwę produktu lub numer GTIN.

Skrypt wysyła zapytanie do Google, przeszukując pierwsze 100 organicznych wyników wyszukiwania.

Proces zbierania danych

Crawler odwiedza strony z wyników wyszukiwania, sprawdza dostępność produktu oraz wydobywa następujące informacje:

Nazwa sklepu

Link do strony produktu

Cena produktu (bez i z VAT, jeśli dostępne)

Skrypt pomija strony niebędące sklepami internetowymi (fora, blogi, recenzje itp.).

Wyjście danych

Wyniki są prezentowane w formie tabeli CSV, JSON lub XLSX.

Kolumny tabeli:

Nazwa sklepu

Link do produktu

Cena produktu

3. Wymagania techniczne

Język programowania: Python (preferowany), Node.js lub PHP.

Biblioteki/web scraping:

Selenium / Playwright (do dynamicznych stron)

BeautifulSoup4 / Scrapy (do statycznych stron)

SerpAPI / Google Search API (jeśli używane)

Przechowywanie wyników:

CSV / JSON / XLSX (eksport)

Możliwość zapisu do bazy danych SQL lub NoSQL (opcjonalnie).

Obsługa proxy i rotating user-agents:

Używanie User-Agent Rotation i proxy, aby unikać blokad ze strony Google.

Obsługa Captcha (opcjonalne):

Możliwość automatycznego rozwiązywania Captcha (np. przez 2Captcha API lub Anticaptcha).

4. Sposób działania

Użytkownik uruchamia skrypt → podaje nazwę produktu lub numer GTIN.

Crawler wyszukuje wyniki w Google i odwiedza pierwsze 100 organicznych wyników.

Zbiera dane o produkcie (nazwa sklepu, link do produktu, cena).

Eksportuje dane do pliku XLSX.

Zapisuje historię wyszukiwania (opcjonalnie).

5. Dodatkowe wymagania

Łatwość w instalacji i konfiguracji – dokumentacja instalacji oraz krótkie instrukcje użytkowania.

Kod dobrze udokumentowany – komentarze i czytelna struktura kodu.

Required functions: