EasySpider: No-Code Visual Web Crawler/Browser Automation Test Tool

Sponsors

123Proxy is an enterprise-level overseas proxy IP provider, with an exclusive pool of over 80 million proxy IPs, covering 190+ countries, offering real residential IPs suitable for various data collection tasks. It supports free testing for 2-4 hours; you can get it by registering and contacting customer service. It also supports a 15% cashback promotion, allowing companies to get cashback on proxy purchases which can be credited back to individuals via WeChat/Alipay—a little perk for employees.

Proxy302

Proxy302 is a global proxy IP self-service supermarket. Pay as you go, no need to purchase bundles; no tiered pricing, recharge and use all types of proxy IPs; free testing with a $1 trial credit upon registration. Covers over 240+ countries and regions globally, offering 65 million residential IPs.

BrightData

BrightData is the leader in the proxy market, covering 72 million IPs worldwide. It provides real residential IPs and can instantly collect public data from the internet in bulk with a guaranteed success rate tested in practice. If you need cost-effective proxy IPs, you can click the image above to register and contact the Chinese customer service representative. There is currently a promotion where the initial deposit amount will be matched.

Koala-IP

Koala-IP provides a vast selection of low-cost, high-quality proxy IP services, dedicated to offering customers the best prices and the most stable proxy IP solutions. Whether you need web scraping, data extraction, privacy protection, or cross-region access, Koala-IP (Chinese) can meet all your needs. Register with Koala-IP now to enjoy highly cost-effective proxy IP services and boost your business efficiency!

Capsolver.com

Capsolver.com is an AI-based service provider that offers automatic captcha-solving functionalities. Supported captcha types include reCAPTCHA, hCaptcha, FunCaptcha, AWS captcha, Geetest, Akamai Web, BMP, Imperva/Incapsula, captcha image recognition, and more.

Software Features

Open Source, Free and Ad-Free

The code is open source, all software features are free (excluding commercial use), with no pop-ups or external ads.

Cross-Platform

The software can run on Windows, MacOS, and Linux.

Quick and Easy

Graphical setup and execution of crawler tasks, typically a crawler task can be completed in design within 2-5 minutes.

Safe

No registration required, all tasks and data are saved locally, no third-party servers involved.

Flexible

Can freely add browser extensions, execute JavaScript instructions, and directly manipulate the browser using Selenium statements.

Running Parallel Tasks

Can launch any number of execution programs, achieve large-scale data parallel acquisition.

Dynamic Debugging

Click/double-click the completed operation to automatically mark/trial run, convenient for locating and debugging issues, saving time on modifying tasks.

Custom Plugins

Supports external custom plugins to achieve any custom functionality.

Captcha Recognition

Supports multiple captcha recognition schemes, such as graphic captcha, Google reCAPTCHA, etc.

Element Screenshot and OCR Recognition

Supports element screenshots and OCR recognition, as well as image downloads.

Proxy IP

Supports tunnel IP switching, private IP, etc.

LAN Access

Can be used within a LAN without internet.

External Program Invocation

Can call any external systems to meet any complex requirements.

API Invocation

Tasks can be executed via API invocation, achieving advanced automation collection.

Scheduled Execution

Supports scheduled task execution, becomes a handy life assistant.

Pause Anytime

Can pause task execution at any time for manual debugging and captcha input.

Custom Environment

Can modify the Python environment at any time, such as defining custom letiables, and write the letiable values into any Code/XPath statement.

Mobile Device Simulation

Supports mobile device simulation, enabling mobile web page collection.

Flexible Import

Supports reading Excel files to import a large number of input parameters.

Free Export

Can export to Excel/CSV/TXT files, and supports writing into MySQL databases.

Task Migration

Tasks can be copied and moved to other machines, regardless of the operating system environment.

Page Scroll

Can set page scrolling to access content that needs scroll loading.

IFRAME Support

Supports the collection of data within iframe tags, including multi-layer nested iframes.

Cookies Modification

Can access and modify page cookies.

Command Line Execution

Tasks can be executed directly via command line, seamlessly integrated into other programs.

Headless Mode

Supports headless mode, allowing it to run in the background without opening a browser window.

Regular Expressions

Supports regular expressions, allowing the usage of regex anywhere.

Modify Web Content

Capable of modifying web content, enabling customized scraping for more precise requirements.

Code Debugging

The software comes with an embedded code execution feature, allowing direct running and debugging of Python code.

JSON Support

Supports JSON data collection.

File Download

Supports downloading files, such as images, PDFs, and compressed files.

Popup Handling

Supports handling browser Alert and Confirm popups.

Copyright and Support Author

This software is intended for educational and communication purposes only. It is strictly prohibited to use the software for any illegal activities or operations, such as crawling government/military websites that are not allowed to be crawled. The user bears all consequences resulting from the use of this software and the author shall not be held responsible or liable in any way. Furthermore, the software is protected by patent rights. If you intend to use it for commercial purposes or profit-making activities, such as using the software for client orders, selling the collected data, please contact author: naibowang@foxmail.com for patent authorization and payment operations: https://www.patentguru.com/cn/search?q=一种自定义提取流程的服务封装系统

For individual users, EasySpider is a completely free and ad-free open-source software. The development and maintenance of the software rely entirely on the author's voluntary contributions. Therefore, you can choose to support the author and enable them to have more passion and energy to maintain this software. If you have benefited from this software and made a profit, you are also welcome to support the author through the following methods:

1. Alipay account: naibowang@foxmail.com. You can also scan the QR code below.

2. WeChat Pay: Scan the QR code below.

3. PayPal account: naibowang. You can also scan the QR code below.