Scraping content with CHAT GPT processing and publishing to WordPress

Open

walerys

Employer

Job category:

IT projects

Expected budget:

Negotiable

Preferable skills:

AI wordpress

Published: on 2024-09-09

15 days left

Job description

I am looking for a programmer to help me create a system to scrape content from selected websites, process this content using AI (ChatGPT) and publish it automatically on a portal built on WordPress. I would like the entire process to be as automated as possible and minimize manual involvement.

The scope of the project includes:

Creating a scraper to pull content from other websites

I need a dedicated scraper that will automatically pull content from selected websites (e.g. articles, news, tutorials, journalism). The scraper should:

Use popular scraping tools such as BeautifulSoup, Requests or Scrapy (depending on the size of the project).

Handle dynamic changes to pages (e.g., changes in HTML structure, CSS, JavaScript) and deal with potential blockers (e.g., CAPTCHA, User-Agent blockers).

Save downloaded data in JSON format or in a lightweight database (e.g. SQLite).

AI processing of downloaded data (ChatGPT).

Place or location:

Scraper - detailed process of operation.

Required functions:

Technical requirements: Advanced knowledge of Python and scraping libraries (BeautifulSoup, Requests, Scrapy). Experience working with ChatGPT API and WordPress API (REST API). Knowledge of databases and data storage formats (JSON, SQLite). Ability to create scalable and resilient scraping scripts. Familiarity with process automation tools (Task Scheduler, Cron, Heroku). Please provide me with a quote and an indication of approximate completion time. I realize that there are off-the-shelf solutions on the market, but I am interested in creating a dedicated tool that best meets my needs. Attached is a detailed description of the scraper process - please read it before submitting a quote.

Submitted offers 15

Add your offer or ask the client for more details

Add an offer Ask for details

Andrzej Tkaczyk

3 deals

copywriting
data analysis
databases
... (+8)

Added: on 2024-09-23

Matboom

2 deals

databases
java
mysql
... (+2)

Added: on 2024-09-13

Kaliduda

60 deals

adwords
article
blog
... (+28)

Added: on 2024-09-12

HypeDev Group - Sp. z o.o.

1 deal

api
backend
cms
... (+18)

Added: on 2024-09-11

Vulcanoo - CodeOlympus.studio

88 deals

api
backend
cms
... (+14)

Added: on 2024-09-11

Hermsoft

angular2
bootstrap
C Sharp
... (+2)

Added: on 2024-09-10

Kacper Włodarczyk

35 deals

api
aws
django
... (+9)

Added: on 2024-09-09

MTZN

1 deal

Added: on 2024-09-09

✅ M.Donsewicz Expert

10 deals

android
aws
cms
... (+14)

Added: on 2024-09-09

Natasza Inigra.eu

1 deal

AI
design
iOS
... (+4)

Added: on 2024-09-09

Konrad 1 deal

Deployment of Windows remote station for office workers

Proposed by freelancer

12

13d

I am looking for a specialist to create a Windows workstation that can be accessed remotely by employees who use Macs on a daily basis. The project includes selection of appropriate hardware, installation and configuration of remote software, integration with the office network. The goal is to allow employees to access applications available only on Windows and to perform demanding tasks (such as 3D rendering) on the created unit. We would like it to be possible for 2-3 people to connect to the unit simultaneously.
jarekhi

Repairing a partially broken WordPress plugin

Proposed by freelancer

12

12d

Hi. I need a quote for a relatively simple wordpress plugin. The problems I'm encountering pertain to saving records in the database and editing that creates new records instead of overwriting existing ones. In addition, the main photo in the record does not assign. Also to be dealt with is the Settings section, which exists, but has no real effect on the rest of the plugin's settings. The plugin is based on JS, PHP, CSS. I generated it through ClaudeAI.
KacperAI

Business Automation Specialist with AI Experience

Proposed by freelancer

12

12d

We are looking for a freelancer with solid experience in business automation using AI technologies to help us streamline and optimize our work processes. The goal is to increase efficiency in various areas of our business through AI-based solutions. Before preparing a formal quote, we would like to hold an initial meeting - live or online - to discuss our expectations, present our vision and determine whether the project is feasible. We are characterized by openness to cooperation and are keen to understand the scope of the project together. Requirements: Proven experience in business automation using AI Communication skills that will facilitate collaboration Availability for an initial consultation meeting
Adikam Chocolate

Automation in Copilot Studio and configuration of AI Agents

Proposed by freelancer

6

11d

Job Description: Adikam company is looking for a specialist to help us with advanced automation configuration in Copilot Studio service. We are looking for someone with experience in creating and setting up automation processes and the ability to configure AI Agents to improve our internal operations and business processes. Scope of assignment: 1. setting up automation - configuring processes in Copilot Studio, adapting them to the specifics of our business. 2. AI Agents - configuration of AI Agents to automate communications, administrative tasks and other operations to streamline the team. 3. Process Optimization - identifying areas that can be automated and implementing solutions to reduce time consumption and increase efficiency. 4. Support and training - provide introduction and training to the team on the use of new automations and support when processes are modified or updated.
nmart.pl

Freelancer for permanent cooperation - WordPress, PHP, Linux integration with AI

Proposed by freelancer

18

7d

If you are a programmer with skills in the following technologies and tools, I invite you to contact me! Requirements: WordPress - plugin programming, customization of existing solutions, knowledge of optimization for performance and SEO PHP (legacy systems) - experience working with legacy systems that may need to be updated and upgraded, but are critical to operations. Linux - knowledge of server management at a basic/intermediate level (configuring servers, taking care of security) Integration with AI tools - ability to integrate with AI tools for text and graphics processing, which will be essential for some of my projects. Scope of cooperation: Customizing and creating new plugins for WordPress. Work on PHP-based systems, including support and development of legacy systems, including upgrades and integration with newer technologies. Administration of Linux servers ( security, performance monitoring). Implementation and integration of AI tools that support text and graphics processes.
TomTom 1 deal

Making a website

Proposed by freelancer

56

5d

I am looking for a person who specializes in creating modern websites to design a website for my company. The site should professionally present our offerings, past projects, team and technologies we focus on. The website is intended to build trust among customers, increase our recognition in the market and attract new orders. Functional requirements: 1. graphic design - Modern, minimalist design in line with current trends. 2. Responsiveness - The website must be fully responsive. 3. CMS - Implementation on Wordpress is preferred. 4. Site sections: - Home page with a brief description of the company and the most important services. - “About us” section with information about the team and company values. - Services section with a description of the solutions offered. - Portfolio with sample implementations. - Blog. - Contact with form and Google map integration. - SEO - Optimization of the site for search engines. 5. loading speed - The site should be optimized for loading speed to provide the best user experience
QuickSort Software House

Integration with Subiekt GT

Proposed by freelancer

7

5d

I am looking for a person to support my team in integrating SUBIEKT system using Subiekt Sphere via COM API.
Bartosz Bukowski 8 deals

Wordpress Programmer

50.00 PLN

24

4d

I am looking for a wordpress programmer for web development activities. The work is rather casual. Currently I need changes regarding the price configurator on the client's site. Budget 1000-1300 zł for the whole work.
Hermer 35 deals

Changes to the website - Joomla

Proposed by freelancer

10

4d

Changes to the website - Joomla We are looking for a programmer to make changes to a website made on the Joomla system. Possibility of permanent cooperation. - Please quote a rate per hour of work. - Please describe your experience on the Joomla system preferably showing several implementations.
jeffi777

Paymant Gateway Crypto

Proposed by freelancer

14

4d

Hello, I am looking for an experienced individual to create a cryptocurrency payment gateway for me. It is essential that the gateway be 100% independent, developed entirely from scratch without integration with external providers like Coinsgate or similar platforms. I am seeking someone with experience in designing such solutions who can complete the project without relying on third-party services.