European Union flag Log in
European Union flag

Scraping content with CHAT GPT processing and publishing to WordPress

Employer
Czarna_Wrona
Czarna_Wrona
Description

I am looking for a programmer to help me create a system to scrape content from selected websites, process this content using AI (ChatGPT) and publish it automatically on a portal built on WordPress. I would like the entire process to be as automated as possible and minimize manual involvement.

The scope of the project includes:

Creating a scraper to pull content from other websites

I need a dedicated scraper that will automatically pull content from selected websites (e.g. articles, news, tutorials, journalism). The scraper should:

Use popular scraping tools such as BeautifulSoup, Requests or Scrapy (depending on the size of the project).

Handle dynamic changes to pages (e.g., changes in HTML structure, CSS, JavaScript) and deal with potential blockers (e.g., CAPTCHA, User-Agent blockers).

Save downloaded data in JSON format or in a lightweight database (e.g. SQLite).

AI processing of downloaded data (ChatGPT).

Published
on 2024-09-09
Category
IT projects
Place or location:
Scraper - detailed process of operation.
Required functions:
Technical requirements: Advanced knowledge of Python and scraping libraries (BeautifulSoup, Requests, Scrapy). Experience working with ChatGPT API and WordPress API (REST API). Knowledge of databases and data storage formats (JSON, SQLite). Ability to create scalable and resilient scraping scripts. Familiarity with process automation tools (Task Scheduler, Cron, Heroku). Please provide me with a quote and an indication of approximate completion time. I realize that there are off-the-shelf solutions on the market, but I am interested in creating a dedicated tool that best meets my needs. Attached is a detailed description of the scraper process - please read it before submitting a quote.
Skills
AI wordpress

Offers sent (15)

Budget
Negotiable
Copyright
-
Expires in
90 days

Recent jobs from category