Scraping content with CHAT GPT processing and publishing to WordPress

Employer
Czarna_Wrona
Czarna_Wrona
Description

I am looking for a programmer to help me create a system to scrape content from selected websites, process this content using AI (ChatGPT) and publish it automatically on a portal built on WordPress. I would like the entire process to be as automated as possible and minimize manual involvement.

The scope of the project includes:

Creating a scraper to pull content from other websites

I need a dedicated scraper that will automatically pull content from selected websites (e.g. articles, news, tutorials, journalism). The scraper should:

Use popular scraping tools such as BeautifulSoup, Requests or Scrapy (depending on the size of the project).

Handle dynamic changes to pages (e.g., changes in HTML structure, CSS, JavaScript) and deal with potential blockers (e.g., CAPTCHA, User-Agent blockers).

Save downloaded data in JSON format or in a lightweight database (e.g. SQLite).

AI processing of downloaded data (ChatGPT).

Published
on 2024-09-09
Category
Place or location:
Scraper - detailed process of operation.
Required functions:
Technical requirements: Advanced knowledge of Python and scraping libraries (BeautifulSoup, Requests, Scrapy). Experience working with ChatGPT API and WordPress API (REST API). Knowledge of databases and data storage formats (JSON, SQLite). Ability to create scalable and resilient scraping scripts. Familiarity with process automation tools (Task Scheduler, Cron, Heroku). Please provide me with a quote and an indication of approximate completion time. I realize that there are off-the-shelf solutions on the market, but I am interested in creating a dedicated tool that best meets my needs. Attached is a detailed description of the scraper process - please read it before submitting a quote.

Offers sent (15)

Budget
Negotiable
Copyright
-
Expires in
90 days

Recent jobs from category

  • no avatar
    Navia 🔥 Automate 🤖 & Apps 📱 0 deals
    Automation Developer
    Szukamy osoby, która chce tworzyć automatyzacje i aplikacje low-code z wykorzystaniem narzędzi...
    Negotiable
    87 offers
    Expires in 19 days
  • no avatar
    kamil 0 deals
    SKRYPT ALLEGRO
    Zlecę stworzenie skryptu, który przez oficjalne API Allegro będzie codziennie wyszukiwał...
    Negotiable
    79 offers
    Expires in 16 days
  • no avatar
    Gustavo Toscani 0 deals
    Building EyeLabX – Join as a Founding Blockchain & Full-Stack Developer
    At EyeLabX, we’re building the first eye wellness ecosystem that combines digital health, token...
    Negotiable
    26 offers
    Expires in 9 days