Download ScrapeStorm Software
AI-Powered Web Crawler Tool & Web Scraping Software | ScrapeStorm
Version 3. 6. 1 is now available! Read about the new features and fixes!
Dismiss this update
One-click to install, extract any data from any website.
Version Updates
3. 1
Update time: 2021-06-16
Fix
Fix some bug of downloading file
Fix some bug of using proxy
3. 0
Update time: 2021-04-26
New
Support download file with HTTP POST
Optimize
Optimize compatibility issues of sku
Fix the problem of click in flowchart mode
Fix the bug of branch
Fix some bug of proxy
3. 5. 3
Update time: 2020-07-22
Array
Adjust the prompt window display
Fix the problem that some webpages won’t open
Fix scrolling bug
3. 1
Update time: 2020-05-26
Fix the problem that some website files cannot be downloaded
Fix the next page issue on some websites
3. 0
Update time: 2020-02-25
Optimize the task running
Fixed a login bug when password contains a special character
Fixed an issue that Sql Server could not be connected
3. 4. 13
Update time: 2020-01-15
Optimize the file downloading
Fixed a bug when scraping from an iframe
Fixed an issue that the data scraping hangs up in some cases
Fixed an issue that some website pictures cannot be downloaded
Fixed an issue that the option with & cannot be selected
3. 9
Update time: 2019-12-11
Configuration of export is supported to import and export
Fixed an issue where flowchart mode might crash when loading old tasks
Fixed the issue about the click of element
3. 7
Update time: 2019-11-27
Flowchart mode supprot multi-tab
Optimize the flowchart mode promot of the combine text list
Optimize the flowchart mode paging recognition and prompting process
3. 6
Update time: 2019-10-24
Optimize the flow chart mode interface and the operation procedure
Support for setting promot text to detect captcha during the scraping
3. 5
Update time: 2019-10-08
Interval loop support set custom interval time
Download file support named by value
关闭
Flowchart Mode – How to Download Files – ScrapeStorm
Abstract:This tutorial will show you how to download files with ScrapeStorm ScrapeStormFree Download
ScrapeStorm supports downloading files from webpages while scraping data. The supported file formats include image, audio, video, document and other formats.
This function can be set up in the run settings, as shown below:
The setting here is only for enabling the file download function. All file downloads need to set the corresponding download link in the scraping field. Files that cannot get the download link do not support downloading.
When downloading files, the software supports to modify the file download path, you can set it according to the following figure:
When downloading files, the software supports the creation of independent folders to store files in accordance with certain rules. The rules include naming folders according to File type, Date, Task name or Field value, as shown in the following figure:
When downloading files, the software supports renaming the downloaded files according to certain rules. The rules include naming the downloaded files according to the File name, File md5, Task name_Index, Date_Index, Index, Customize and Field value, as follows As shown in the figure:
When choosing a custom rule, you can combine different fixed rules to create the required naming rule, as shown in the following figure:
When encountering a file with the same name, you can choose from the following three ways:
File downloads can be divided into three types, the first is to directly click the download link, the second is to click the download button, and the third is to modify the data to generate the download link.
Type 1: Download link
1. Image
The supported image formats include jpg, png, gif, jpeg, bmp, eps, psd and other mainstream image formats. When you need to download an image, please check the image option, as shown in the figure below:
The tutorials for downloading images:
【Smart Mode】How to download images
【Flowchart Mode】How to download images
P. S. There is no essential difference between smart mode and flowchart mode in downloading images. Just because the interface is different, the two are described separately.
2. Audio
Supported audio formats include mp3, amr, wav, m4a and other mainstream audio formats. When you need to download audio, please check the audio option, as shown in the figure below.
If you can click to get the audio download link, please follow the steps below:
Step 1: Add a field, and then click the audio download link
Step 2: Right-click to set the field, and set the extract type to “Image/Video/Audio URL”
If the above methods cannot solve your needs, please follow the steps below:
Step 1: Add a field, then right-click the field, select “Edit Xpath”, and select the audio download link by manually editing Xpath
3. Video
Supported video formats include mp4, avi, mov, 3gp, flv and other mainstream video formats. When you need to download a video, please check the video option, as shown in the figure below.
Step 1: Add a field, and then click the video download link
Step 1: Add a field, then right-click the field, select “Edit Xpath”, and select the video download link by manually editing Xpath
4. Document
Supported document formats include doc(x), ppt(x), xls(x), pdf, snb, txt and other mainstream document formats. When you need to download a document, please check the document option, as shown in the figure below.
5. Other format
Other file formats supported include apk, exe, rar, zip, gzip, dmg, torrent, epub and other mainstream file formats. When you need to download these files, please check other file options, as shown in the figure below.
Type2: download button
For the second type, all file types are set in the same way. The specific steps are as follows:
Step 1: Add a field, and then click the download button
Step 2: Right-click the field and set the value attribute to “Download button”
In the setting section of the download file, check the corresponding file option. For the specific method, please refer to the first type of download setting above.
Type 3: modify data to generate download link
For the third type, after modifying the data of the download link, one more step needs to be added, as shown in the following figure:
How to download, install, register, set up and upgrade …
Abstract:This article explains a series of basic operations from downloading to upgrading. No Programming Needed. Visual Operation. ScrapeStormFree Download
1. ScrapeStorm download and installation
(1)Download
ScrapeStorm is the first Web Scraping Tool to support Windows, Mac and Linux operating systems. You can click here to go directly to the official homepage to download the software, the website will push the corresponding version according to your operating system.
Or click here to open the official website download page, here is a download link for all versions, you can download the corresponding installation package according to your own operating system requirements.
(2)Installation
How to install on Windows?
After the download is complete, find the installation package file in the file save path and double-click to install it.
How to install on Mac?
Please refer to this tutorial:How to Install ScrapeStorm on Mac
How to install on Linux?
When using the Linux version, your Linux system must have a desktop environment.
Run the following command in your terminal:
$ chmod a+x ScrapeStorm*. AppImage
$. /ScrapeStorm*. AppImage
2. ScrapeStorm registration and settings
(1)Open ScrapeStorm and click on the upper left corner to register for new users.
(2)Please enter your email address to sign up.
If you have not received the account activation email, please follow the steps below to troubleshoot:
Step 1: Please confirm that the email address you filled in is correct.
Step 2: If the email address is correct, please check your spam folder. The activation email may be there.
Step 3: If the email is not in the spam folder, please check if the email address blacklist is set. The activation email may be blocked by the email. Please add ScrapeStorm to the whitelist, and then click “resend email” in the login interface.
Step 4: If the above steps do not solve your problem, please contact the official customer service directly, we will solve your problem in the first time.
(3)Modify personal account information.
Click on the top left corner to open the basic data window where you can modify your account information.
(4)Open the settings center by opening the upper left gear icon, where you can make basic software settings.
3. How to upgrade the software version
Under normal circumstances, ScrapeStorm will automatically recognize the new version of the prompt update, if not, you can check the update in the settings, and then log in to the official website to download the latest version of the installation package, after the download is complete, double-click to open the software update.