Scraping content with CHAT GPT processing and publishing to WordPress

Open

walerys

Employer

Job category:

IT projects

Expected budget:

Negotiable

Preferable skills:

AI wordpress

Published: on 2024-09-09

53 days left

Job description

I am looking for a programmer to help me create a system to scrape content from selected websites, process this content using AI (ChatGPT) and publish it automatically on a portal built on WordPress. I would like the entire process to be as automated as possible and minimize manual involvement.

The scope of the project includes:

Creating a scraper to pull content from other websites

I need a dedicated scraper that will automatically pull content from selected websites (e.g. articles, news, tutorials, journalism). The scraper should:

Use popular scraping tools such as BeautifulSoup, Requests or Scrapy (depending on the size of the project).

Handle dynamic changes to pages (e.g., changes in HTML structure, CSS, JavaScript) and deal with potential blockers (e.g., CAPTCHA, User-Agent blockers).

Save downloaded data in JSON format or in a lightweight database (e.g. SQLite).

AI processing of downloaded data (ChatGPT).

Place or location:

Scraper - detailed process of operation.

Required functions:

Technical requirements: Advanced knowledge of Python and scraping libraries (BeautifulSoup, Requests, Scrapy). Experience working with ChatGPT API and WordPress API (REST API). Knowledge of databases and data storage formats (JSON, SQLite). Ability to create scalable and resilient scraping scripts. Familiarity with process automation tools (Task Scheduler, Cron, Heroku). Please provide me with a quote and an indication of approximate completion time. I realize that there are off-the-shelf solutions on the market, but I am interested in creating a dedicated tool that best meets my needs. Attached is a detailed description of the scraper process - please read it before submitting a quote.

Submitted offers 15

Add your offer or ask the client for more details

Add an offer Ask for details

Andrzej Tkaczyk

3 deals

copywriting
data analysis
databases
... (+8)

Added: on 2024-09-23

Matboom

2 deals

databases
java
mysql
... (+2)

Added: on 2024-09-13

Kaliduda

54 deals

article
blog
buzzmarketing
... (+24)

Added: on 2024-09-12

HypeDev Group - Sp. z o.o.

1 deal

api
backend
cms
... (+18)

Added: on 2024-09-11

Vulcanoo - CodeOlympus.studio

88 deals

api
backend
cms
... (+14)

Added: on 2024-09-11

Hermsoft

angular2
bootstrap
C Sharp
... (+2)

Added: on 2024-09-10

Kacper Włodarczyk

33 deals

api
aws
django
... (+9)

Added: on 2024-09-09

MTZN

Added: on 2024-09-09

✅ M.Donsewicz Expert

10 deals

android
aws
cms
... (+14)

Added: on 2024-09-09

Natasza Inigra.eu

AI
design
iOS
... (+4)

Added: on 2024-09-09

CORVUS IT SP. Z O.O. 8 deals

Developer Python

Proposed by freelancer

7

30d

We are looking for a person with very good knowledge of Python. Additionally: REST API WebSockets FastAPI (optional) SQL/noSQL
BFI

Freelancer to create and support the implementation of an internal knowledge base based on the LLM model in the company.

Proposed by freelancer

9

28d

We are looking for a freelancer to create and support the implementation of an internal knowledge base based on the Large Language Model (LLM). The scope of cooperation includes: - Designing and building a knowledge base using LLM - Integration of the system with the company's IT infrastructure - Training the model on the company's internal data and documents (unstructured) - Support in implementation and optimization of the database in daily use Required: experience in working with LLM, NLP, programming skills, knowledge of knowledge management tools and system integration. If you have experience in such projects, performed them for your clients, feel free to contact me!
BFI

Freelancer to re-implement CRM program: Pipedrive in the company.

Proposed by freelancer

4

28d

We are looking for an experienced freelancer to support us in re-implementing and optimizing our company's Pipedrive system. We expect a comprehensive approach to CRM analysis, configuration and integration to maximize our sales processes. The scope of cooperation includes: Responsibilities: - Analysis of the current state and needs of the company - Personalization of Pipedrive: Customization of sales funnel stages, creation of custom fields and implementation of workflow automation. - Integration with other tools: Integration of Pipedrive with the systems we use (e.g. TMS, BI). - Data import and migration: Migrating and cleaning existing data from previous systems and properly importing it into the new system. - Training and team support: Conducting user training, creating documentation and ongoing support after system implementation. - Sales process optimization: Identifying bottlenecks and implementing improvements and automation that will increase team efficiency. - Reporting and Analytics: Configure custom reports, dashboards and tools to analyze sales performance.
Danstat

Websrcaper

Proposed by freelancer

12

28d

Setup Scraper to Update Prices and Inventory Daily. Description: We are looking for a freelancer to create or set up an application that will automatically scrape prices and stock levels of selected products from various stores. We are currently using Octoparse, but we are looking for a more advanced solution. Scraper should run daily and provide accurate updates on product availability and prices. Knowledge of data scraping tools and process automation is required. Requirements: - Creation or configuration of a custom scraper for daily updates - Integration with current tools (e.g. Octoparse or others) - Scalability to different stores - Handling frequent product changes Scope of work: - A working scraper with daily updates - Documentation of system operation and maintenance - Support in integration with other tools
Proton Polska 5 deals

Expansion of product cards + implementation of calculator

Proposed by freelancer

10

25d

Good day, We are looking for a person to make modifications to the product card: https://proton-polska.pl/product-pol-734-Magazyn-Energii-Proton-EnergyCore-II-10-2-kWh.html We would like to add to the site: - calculator - product carousel - possibility to expand headers - possibility to add text on the background of the photo or a different background color - animation of texts All the effects we want to get can be found at: https://e-zpue.com/magazyny-energii/ Our store is put on the IdoSell platform. I will ask for a specific quote for the order and the deadline for implementation. After successful implementation of modifications, we will be happy to establish further cooperation. Feel free to contact me!
Marek Banaszak

Notion corporate WIKI template

Proposed by freelancer

5

25d

I am looking for a person who will develop for me : 1. a template of the company's WIKI in NOTION to put a description of processes, mapped processes, procedures, instructions and tag them with various variables (project department, owner, contractor, etc.) - (description in “required functions”) 2. instruction on how to use WIKI on this template in Notion (settings, adding data, configuring) from the point of view of the person managing WIKI, entering data and reviewing data (instruction in video or pdf form)
Agape 4 deals

Database specialist

Proposed by freelancer

6

24d

I am looking for a database specialist who has experience in the preparation and architecture of large databases used for research/analytical work (big data), confirmed by having participated in two projects in the last 3 years prior to the deadline for submission of bids in which he/she performed tasks related to the preparation of large databases used for research/analytical work (big data).
Agape 4 deals

Programming Specialist

Proposed by freelancer

7

24d

We will establish cooperation with a programming specialist who has experience related to the use of coding and machine learning techniques and demonstrates a working knowledge of programming languages, as well as experience in working with machine learning tools and libraries, confirmed by the fact that in the last 3 years before the deadline for submission of tenders, he participated in two projects in which he carried out tasks related to coding, machine learning, the use of programming languages, as well as working with machine learning tools and libraries.
Karol Kordus

Create a CRM Firmao Report using Jaspersoft Studio or iReport

Proposed by freelancer

5

23d

Execution of the report according to the template prepared in the appendix.
Ryzyk Fizyk

Connecting wholesale / products to baselinker

Proposed by freelancer

16

22d

I am looking for a person to connect wholesalers and products to baselinker. We have an online store and accounts on portals like allegro. We received xml files from our wholesalers and suppliers, which contain data like - EAN, name, price, links to pictures.... In a word, everything you need to display auckji. We need someone to connect these files with baselinker, they will synchronize and we will be able to easily display them on allegro, store or other such places. Note - we care about time :) The files at this point are about 5-10. We are waiting for offers.