crawlfeeds.com valuation and analysis
Robots.txt Information
| Robot | Path | Permission |
| GoogleBot | / | ✔ |
| BingBot | / | ✔ |
| BaiduSpider | / | ✔ |
| YandexBot | / | ✔ |
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Allow: / Disallow: /tmp/ Disallow: /users/ Sitemap: | ||
Meta Tags
| Title | Crawl Feeds | Web scraping service | Web crawling | Data |
| Description | Customized web scraping service and download clean ready use pre crawled Crawl Feeds is customized web crawling |
| Keywords | web crawling service, data mining |
Server Information
| WebSite | |
| Host IP | 139.59.32.94 |
| Location | Australia |
Related Websites
| Site | Rank |
More to Explore
crawlfeeds.com Valuation
|
US$864,039
Last updated: 2023-05-11 03:34:24
crawlfeeds.com has Semrush global rank of 12,249,809. crawlfeeds.com has an estimated worth of US$ 864,039, based on its estimated Ads revenue. crawlfeeds.com receives approximately 99,697 unique visitors each day. Its web server is located in Australia, with IP address 139.59.32.94. According to SiteAdvisor, crawlfeeds.com is safe to visit. |
Traffic & Worth Estimates
| Purchase/Sale Value | US$864,039 |
| Daily Ads Revenue | US$798 |
| Monthly Ads Revenue | US$23,928 |
| Yearly Ads Revenue | US$287,127 |
| Daily Unique Visitors | 6,647 |
| Note: All traffic and earnings values are estimates. | |
DNS Records
| Host | Type | TTL | Data |
| crawlfeeds.com. | A | 3599 | IP: 139.59.32.94 |
| crawlfeeds.com. | AAAA | 3599 | IPV6: 2400:6180:100:d0::8:f001 |
| crawlfeeds.com. | NS | 1800 | NS Record: ns3.digitalocean.com. |
| crawlfeeds.com. | NS | 1800 | NS Record: ns2.digitalocean.com. |
| crawlfeeds.com. | NS | 1800 | NS Record: ns1.digitalocean.com. |
| crawlfeeds.com. | MX | 14400 | MX Record: 0 smtp.secureserver.net. |
| crawlfeeds.com. | MX | 14400 | MX Record: 10 mailstore1.secureserver.net. |
| crawlfeeds.com. | TXT | 3600 | TXT Record: D6929724 |
| crawlfeeds.com. | TXT | 3600 | TXT Record: google-site-verification=U3owsojYrKUeL1ILxpEbvNPND8pkg12gJ3zufoKKeUY |
| crawlfeeds.com. | TXT | 3600 | TXT Record: v=spf1 include:secureserver.net -all |
HtmlToTextCheckTime:2023-05-11 03:34:24
| Crawl Feeds Datasets About Pricing Contact us Login In Contact Sales × Name Email Company Phone Number Description Crawl Feeds Customized web scraping service and download clean ready use pre crawled datasets. Create Custome Feed --> Purchase pre crawled datasets Get data of entire sites, including millions of records and data points, in key industry verticals. Optional to refresh datasets upon your request. Customize existing datasets Customize an existing dataset based on format, location, category, or any other parameter to create the subset you want. Request new dataset Can’t find the dataset you need? We will create a dataset from any publicly available website as per your requirements. Custom Web scraping service Submit Requirements List of URLs, Data Fields, Format (CSV, XLSX, JSON), Frequency and additional requirements. Quality Analysis Site setup fee and we will send sample records for quality analysis. Get Data Download your data anytime within 15 days from our portal. |
HTTP Headers
HTTP/1.1 301 Moved Permanently Server: nginx/1.14.0 (Ubuntu) Date: Wed, 03 Nov 2021 23:44:40 GMT Content-Type: text/html Content-Length: 194 Connection: keep-alive Location: https://crawlfeeds.com/ HTTP/1.1 200 OK Content-Type: text/html; charset=utf-8 Connection: keep-alive Status: 200 OK Cache-Control: max-age=0, private, must-revalidate Referrer-Policy: strict-origin-when-cross-origin X-Permitted-Cross-Domain-Policies: none X-XSS-Protection: 1; mode=block X-Request-Id: 5538052b-07b8-4518-b1e7-f0944e6b1495 X-Download-Options: noopen ETag: W/"db94ac6317577f212922a61cb687ceb3" X-Frame-Options: SAMEORIGIN X-Runtime: 0.012837 X-Content-Type-Options: nosniff Date: Wed, 03 Nov 2021 23:44:41 GMT Set-Cookie: _crawl_feeds_session=RVb9jaGtBRzQwZbRBzYFZ8DWXYIhy3xwkpn9DJI%2BkE5Vc7ZW88dA0rwIAStTfxX32uzTJlDJpzLUL9GQZXHpNW%2FW9f9bdIfcEphjW296AmHTspP9roUvlwi6I0AF%2BUElZPKwYwWyf2I%2Be7tNMx4%3D--7adRHThIaCHIpG47--QgQvhjuLbDE%2FklSfvdzvLA%3D%3D; path=/; HttpOnly X-Powered-By: Phusion Passenger 6.0.2 Server: nginx/1.14.0 + Phusion Passenger 6.0.2 |
crawlfeeds.com Whois Information
Domain Name: CRAWLFEEDS.COM Registry Domain ID: 2584815039_DOMAIN_COM-VRSN Registrar WHOIS Server: whois.godaddy.com Registrar URL: http://www.godaddy.com Updated Date: 2021-01-15T02:12:19Z Creation Date: 2021-01-14T19:53:18Z Registry Expiry Date: 2023-01-14T19:53:18Z Registrar: GoDaddy.com, LLC Registrar IANA ID: 146 Registrar Abuse Contact Email: abuse@godaddy.com Registrar Abuse Contact Phone: 480-624-2505 Domain Status: clientDeleteProhibited https://icann.org/epp#clientDeleteProhibited Domain Status: clientRenewProhibited https://icann.org/epp#clientRenewProhibited Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited Domain Status: clientUpdateProhibited https://icann.org/epp#clientUpdateProhibited Name Server: NS1.DIGITALOCEAN.COM Name Server: NS2.DIGITALOCEAN.COM Name Server: NS3.DIGITALOCEAN.COM DNSSEC: unsigned >>> Last update of whois database: 2021-10-15T06:50:27Z <<< |