Cloudflare WAF challenge - WebDriver - Web Scraper - C# Selenium

Closed job

extension 1 deal

Emergency project: freelancer with good TS & React skills

Proposed by freelancer

13

78d

We're looking for a freelancer with good TS & React skills to help with emergency project with a potential for a long-term collab. Must have: - Availability to start immediately - Strong TypeScript skills - Knowledge of React and it's ecosystem (TanStack-Query, react-hook-form, Storybook) - Knowledge of Tailwind - Knowledge of client-server protocols (HTTP, GraphQL) - Experience in building maintainable and scalable systems, design systems, and writing tests Nice to have: - Web3 skills - Basic experience in building browser extensions - Knowledge of WebSockets
GIT

Application for Work Schedule Automation and Work Hour Forecasting

Proposed by freelancer

15

14d

Project Description: We are seeking a freelancer to develop a Python-based application to automate monthly work schedules and forecast work hours for our employees. Currently, we rely on an Excel file that we update manually each month. We would like an application to streamline this process. Functional Requirements: Application Views: Client View: Available view of the work schedule for employees. Manager View: A panel for entering data, adjusting workdays, and inputting work amounts to calculate daily work hours. Forecast View: A panel view with forecasted work times for all positions. Database: We require the application to use a database for saving and storing historical data, enabling access to previous schedules and forecasts. Excel File: We have an Excel file with views and formulas that we wish to replicate in the application. This file can serve as a template or reference point. Technical Requirements: Programming Language: Python (knowledge of data-related libraries like pandas, openpyxl, tkinter, or Django is a plus). Application Type: Web or desktop application. Database: We are open to suggestions, such as SQLite, PostgreSQL, or others. Contact: Please submit your application along with a portfolio, estimated completion time, and pricing.
TrioNet 4 deals

Programmer to execute query automation application for ChatGPT

Proposed by freelancer

25

13d

I am looking for a programmer to make in any technology an application to automate queries to ChatGPT. The application: 1. retrieves individual query lines from the indicated csv file 2. sends the query to ChatGPT 3. saves the response in the database 4. the application provides the ability to: 4.1. track query progress 4.2 Log errors for re-queries 4.3 Export the database to csv 4.4. integrate and connect through multiple accounts up to 20 4.5. configure and manage query frequency depending on ChatGPT parameters. E.g. 10 profiles send a query no more often than every 10 seconds
TrioNet 4 deals

Programmer to execute an application that builds a database of the most searched keywords in Google, Bing search engine

Proposed by freelancer

15

13d

I am looking for a programmer to develop in any technology an application that builds a database of the most searched keywords in Google, Bing search engine. The application: 1. retrieves from the indicated csv file individual lines containing words or phrases from the industry whose popularity should be studied 2. sends a query to the Google/Bing advertising system and retrieves the estimated number of searches and recommended to use other keywords and phrases. 3. the aforementioned recommended to use other keywords and phrases for which the advertising system did not provide results - the application adds to the list of queries and queues the query. 4. answers saves in the database 5 The application provides the ability to: 5.1 Track the progress of queries 5.2 Log errors for re-queries 5.3 Export the database to csv 5.4 Integrate and connect through multiple accounts up to 20 5.5. Configure and manage the frequency of queries over time, e.g., 10 profiles send a query no more often than every 10 seconds and a value to end the query loop, e.g., 2000 keywords with results.
TrioNet 4 deals

Programmer to execute query content automation application for translation (work on texts)

Proposed by freelancer

20

13d

I am looking for a programmer to develop in any technology an application to automate the content of queries for translation into one of the translators. The application: 1. loads from a csv file the content prepared in the formula: line number and content of 1 sentence and a maximum of 2-3 sentences. Consecutive sentences in consecutive lines. One file is about 1000 -4000 lines. 2.The application analyzes the whole text and creates a list of used words in the text. 3.The application ranks all the words/phrases in the file according to the most frequent ones and gives a unique code to the word. 4.The application generates a csv file for translation with the following layout: word code, word, random sentence from the text in which the word was used, while the sentence can be used once; sentence code. 5 The application sends the file prepared in this way to one of the services for translation, i.e. it sends the word and sentence to be translated into the indicated language and saves the translated words and sentences. Then, it generates the texts in the arrangement of word, translated word, sentence, translated sentence. It generates a CSV file in this layout. 6. the contents are saved in the database
User blocked by Useme

C# C Sharp Selenium ChromeDriver user profile indication

Proposed by freelancer

4

12d

C# C Sharp Selenium ChromeDriver, Windows ChromeDriver creates a temporary user profile each time. The purpose of the fix is to point to an existing profile so that the settings and plugins of that profile work in the controlled Chrome instance. Correctly implement: var options = new ChromeOptions(); options.AddArguments(“--user-data-dir=C:-user-directory=AppData”); options.AddArgument(“--profile-directory=Default”); The application includes an iteration counter that resets every n loops. Bug: if the link is wrong on the last iteration before the counter resets, the counter stands and reset does not occur regardless of the number of loops executed. If the link is wrong on any other iteration, the counter considers that iteration correctly.
UBEstrefa

Collaborate on MongoDB repairs and optimizations

Proposed by freelancer

5

11d

We are looking for a person who could provide us with assistance in maintaining a production mongodb database in replicaSet 3 (deployed on a k8s cluster). The database has about 40GB of data. Problems that we are currently aware of: - database crash and replicaset recovery from single database running with skipShardingConfigurationChecks=true - tips on optimizing query code EXPERIENCE REQUIRED !
Grażyna

Implementation of Bitrix System in Temporary Employment Agency

100.00 PLN

9

10d

The staffing agency is looking for a specialist to carry out the implementation of the Bitrix system. We want to integrate CRM, project management functions and improve communication and workflow in our company. We are looking for a person with experience to support us in full implementation, configuration and training of the team. Scope of work: 1. Analysis of our agency's needs and planning of Bitrix implementation, 2. Configuration of the system according to the specifics of the temporary work industry, 3. integration of Bitrix with currently used recruitment and HR tools, 4. Provide training to employees on the use and capabilities of the system, 5. post-implementation technical support and consultation. Requirements: - Proven experience in Bitrix implementation (preferable in HR industry), - Knowledge of recruitment processes and specifics of temporary employment agencies, - Ability to work with a team and conduct training.
Adikam Chocolate

Automation Specialist at MAKE.COM platform

Proposed by freelancer

10

10d

Adikam is looking for an experienced specialist to work with us on setting up automation on the MAKE platform. Scope of activities: 1. social media automation - configuration of processes for automated publication of posts on various social media channels. 2. automation of documents and invoices - setting up flows redirecting documents with invoices to the appropriate folders and people converting invoices in OCR and automatically extracting data such as Values types of goods payment terms, etc. further processing of data through data visualization in Power BI 3. work card billing - automation of billing processes for employee work cards automatic recording of hours of absence overtime, etc. 4. API integrations - connection of MAKE platform with Microsoft Office 365 database and external CRM and other tools used through API.
ofelinski

Programming plug-ins for Minecraft Java server

Proposed by freelancer

7

65d

We are looking for creative programmers who are ready to create plugins for our Minecraft server in Java. Experience and portfolio required, we are willing to consider a longer form of cooperation. :)

User blocked by Useme

Employer

Job category:

Software

Expected budget:

Negotiable

Published: on 2024-10-31

Finished

Job description

Długo po opracowaniu w pełni funkcjonalnego scrapera portal wprowadził firewall CloudFlare. Reguła wyrzuca 403 na stronie logowania, jeśli przeglądarka ma zmienionego user agenta / jest sterowana przez WebDriver. Dotyczy C# + Selenium, Python + PhantomJS. Konsola wskazuje błąd WAF challenge już po wejściu na stronę logowania. Próba logowania / interakcja z formularzem wywołuje 403. W zwykłej przeglądarce Chrome bez ua zmienionego wtyczkami / zmienionego przez Dev Tools konsola nie wyświetla nic nt. WAF challenge.

403 w zwykłej przeglądarce Chrome, gdy ua zostaje zmieniony:

- wtyczkami

- WebDriverem

403 nie występuje w zwykłej przeglądarce Chrome, gdy ua zostaje zmieniony w symulacji Dev Tools.

Firefox i Opera:

403 nie występuje w zwykłych przeglądarkach, gdy ua zostaje zmieniony wtyczkami

403 występuje w instancji WebDriver

Zmiany http header requests na adekwatne do sytuacji braku 403 nie przynoszą rezultatu.

Maksymalny uzyskany efekt:

1. Zalogowanie w zwykłej przeglądarce bez zmiany ua

2. Zmiana ua dowolną metodą po zalogowaniu

3. Możliwość nawigacji po portalu