The Cavern Links Checker

By yah Last update Jan 19, 2012 — Installed 2,001,300 times.

Slow Responce On Page Load With Many Links

in
Subscribe to Slow Responce On Page Load With Many Links 2 posts, 2 voices



Tanith User
FirefoxWindows

Hey,

I have noticed on pages with many links on it (say 50-100 links on one page, e.g. on a forum) the checker is a good deal slower to respond and while I was for it to respond Firefox itself is temporally frozen.

This is something that I haven't faced with other links checkers where I would get immediate results regardless of the number of links on a page. But the unique features of this one intrigue me.

 
yah Script's Author
FirefoxWindows

Tanith,
..
It all depends on the filehost sites and their load most of all. The script is only as fast as they can respond. The script is blazingly fast for Rapidshare links. Rapidshare provides a way to submit hundreds of links and check them all at once. Most other sites only accept a single link per request.
..
The script can submit many requests at once; these are done asynchronously. But each takes a little bandwidth/memory/cpu to complete so response will drop as the number of requests increase.
..
Other scripts may handle themselves faster. Some are just front ends to a server on the internet. TCLC is a stand-alone application. It does not depend on a server sending the filehost requests. It will suffer the penalty of doing all the work itself, but it does distribute Link Checking. It was designed originally to aid The Cavern's staff and not hammer the forum's server. It basically pushed out the job of Link Checking to all clients.
..
I'm continually evaluating new filehosts to add and each one you enable will slow your checking a bit. I don't recommend enabling every single one. Keep only the ones active that you need. The newest version of Firefox is a good deal faster than what was out prior to 3.5. But really, the filehosts themselves determine how quickly you get your results.
..
I would be interested to know more about the link checkers that do not slow down REGARDLESS OF THE NUMBER OF LINKS ON A PAGE. Scripts like that would indeed be impressive.
..
yah.

Cross
Presentational HTML allowed.
Use <code> for inline code and <pre> for code blocks. Use &lt; and &gt; for literal < and >.
We help break paragraphs and link your links.
or cancel