apache CPU / crawling site

Welcome, Guest

TOPIC: apache CPU / crawling site

apache CPU / crawling site 10 years, 11 months ago #41924

kruemelg OFFLINE Posts: 65	Hi, is there a way to reduce the CPU usage when I try to crawl the sites from me with the crawling tool?? I have a CPU usage warning < 80% when I start crawling.... also crawling will stop after a wile without having all sites :-( Urgent help needed Greetings
	The topic has been locked.

Re: apache CPU / crawling site 10 years, 11 months ago #42066

kruemelg OFFLINE Posts: 65	Hi, sorry.. but over one week no response??? Any solution here? Greetings
	The topic has been locked.

Re: apache CPU / crawling site 10 years, 11 months ago #42075

dajo
OFFLINE
Posts: 5069

Hi,

I'm sorry, but it's not possible to reduce the CPU usage during crawling. Since the crawler accesses your own website's URLs one by one, the CPU is constantly working. The only possibility I can think of would be to add a small waiting time between each request, which would however slow down the crawling.

Is there any JavaScript error reported in your web browser's console, when the crawling stops?

ARTIO Support Team

The topic has been locked.

Re: apache CPU / crawling site 10 years, 11 months ago #42076

kruemelg OFFLINE Posts: 65	Hi, because I'm not a coder I not able to see a fault report or something like that. Is it possible for you to check this? I can send you access details. How can we make a small waiting time? Greetings Guido
	The topic has been locked.

Re: apache CPU / crawling site 10 years, 11 months ago #42113

kruemelg OFFLINE Posts: 65	Any news here? Greetings
	The topic has been locked.

Page:
1

ARTIO Forums

Support