Top 15 Heritrix Alternative and Similar Softwares | Nov 2024

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

Heritrix (sometimes spelled heretrix, or misspelled or mis-said as heratrix/heritix/ heretix/heratix) is an archaic word for heiress (woman who inherits). Since our crawler seeks to collect and preserve the digital artifacts of our culture for the benefit of future researchers and generations, this name seemed apt.

1. Semantic Juice

Semantic Juice Focused Crawler & Topical Link Analysis @ Semantic Juice - focusing on relevant info only, as detected by topical crawler Semantic Juice......

2. Mozenda

Mozenda Sorry, we have added any description on Mozenda......

3. Datahut

Datahut Datahut is a web scraping service that helps companies gather data from web pages. Datahut provides low latency crawls (Thousands of pages per seconds) and large-scale crawls to enterprises (Millions of webpages). Datahut allows you to access web data at an affordable cost and eliminates vendor lock-in by using open......

4. Mixnode

Mixnode Mixnode is a fast, flexible and massively scalable web crawler in the cloud. Using Mixnode eliminates the need for upfront investment in infrastructure, hardware, software and labour that would be required if you built or ran your own web crawler.If you need to crawl the web, chances are you need......

5. Apache Nutch

Apache Nutch Sorry, we have added any description on Apache Nutch......

6. Common Crawl

Common Crawl Common Crawl builds and maintains an open repository of web crawl data that can be accessed and analyzed by anyone......

7. Portia

Portia Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.......

8. PromptCloud

PromptCloud What’s in it for you?Big data has become essential to closely monitor user sentiments and to respond to the dynamic market. But acquiring it places high technology barriers.With an aim to make Big data look really small so that you just get your relevant data served on the table, we......

9. Datoin

Datoin An enterprise grade, large scale web crawler and extraction engine built using Datoin Platform for all your Data Needs. The Crawling or Data Acquisition is just an another component in the complete extraction pipeline. Datoin platform gives us the benefit of a quick configuration of extractions, and easier implementation of......

10. Data Scraping Studio

Data Scraping Studio Data Scraping Studio allows you to extract data from web pages, html, xml, pdfs in seconds. It lets you do web mining, screen scraping and web page extraction with point and click feature.......

11. Cyotek WebCopy

Cyotek WebCopy Cyotek WebCopy is a free tool for copying full or partial websites locally onto your harddisk for offline viewing.WebCopy will scan the specified website and download it's content onto your hardisk. Links to resources such as stylesheets, images, and other pages in the website will automatically be remapped to match......

12. Seobility

Seobility Seobility allows you to quickly audit and review a website from an onsite SEO perspective. You will get valuable insights to improve your search engine optimization. It is free for small websites with up to 1.000 pages......

13. Email Extractor Online

Email Extractor Online Email Extractor Online was created to help marketers, internet entrepreneurs and sales professionals around the globe gather the most important piece of information in modern day communication; the email address. In most cases this information can be found by visiting a URL, searching for the email address, and then copying......

14. Product API by Fetchee

Product API by Fetchee Simple API to extract product data for any URL.- Product API extracts product related data from any online store in any country.- Get product title, image, price, currency and more.- Multiple currencies and languages are supported as well as GEO locations.- Power fatures include region specific pricing retival and price......

15. ScrapeHero

ScrapeHero ScrapeHero is a website scraping service and a web crawling platform. The service builds web scrapers for websites and collects the data by running it in ScrapeHero's massive distributed infrastructure. This data can then be downloaded in JSON, CSV, XML or accessed as a REST API. Simple Websites are scraped......