[MLB-WIRELESS] Node database

[Steven Haigh]

The server has been playing up lately due to a number of reasons...

1) Google, Yahoo, and MSN search bots have been trawling the site and
deciding to download *all* node db maps. This takes up a ton of CPU and
usually raises the load index on the server to ~4-5... I've added a
robots.txt in the MW site to hopefully stop them from trawling the node
db...

2) A runaway wiki script that runs hourly decided to cause major dramas
and respawn and use 100% CPU. This resulted in a load average of ~36. The
script in question has been disabled by myself, and I'm not sure what the
status is of fixing it.

This is one of the reasons I'm wanting to finish off building version 5 of
the server - which will handle this kind of stuff with more kindness -
instead of killing sendmail etc when the load gets up sky high.

There's a load of resources required by the node database, and it's *very*
CPU and memory hungry. Dynamic mapping is never a CPU easy task, and the
current server is feeling the brunt of it.

All I'm waiting for, is funds to purchase the new raid hardware to make
the new server even better. I've already had a donation of $25 since my
plea, which makes the total towards the hardware $100. The raid hardware
is $375.

So, there's $275 between the continuing issues, and the new server being
built.


Tim Hogard said:
>
> Hi.
>
> Is someone playing with the node database or web server?
> It seems to be locking up and resbmit just hangs... however
> I now have three new nodes and ELS also has 3 new nodes too.
>
> I think there might be a small issue :-)
>
> -tim
> http://web.abnormal.com
> Node HVC, HVA and now with IIF, IIJ, III
>
> To unsubscribe: send mail to majordomo at wireless.org.au
> with "unsubscribe melbwireless" in the body of the message
>


-- 
Signed,
Steven Haigh

I am root. If you see me laughing, you'd better have a backup.

To unsubscribe: send mail to majordomo at wireless.org.au
with "unsubscribe melbwireless" in the body of the message