kdanieli

great catch. thanks. it's working better now!

jdcopelin

Thank you. Glad to hear that it is working again.
Cheers,
Jonathan

__________________
Server: Pass32 and dedicated server

kdanieli

Please see my script below. It reflects what we've worked on in this thread. Surpass reports that my spamd processes are hanging SH107
and I'd like to stop that if it's related to the script.

#!/bin/sh

for SPAMFOLDER in `find /home/kdanieli/mail -name .SPAM -print`
do
echo " "
echo -e "\tProcessing verified spam in $SPAMFOLDER"
echo -n -e "\t\t"
find $SPAMFOLDER/cur -type f -name \*S | sa-learn --spam --no-sync -f -
echo -e "\t\tMoving messages marked as read..."
cd $SPAMFOLDER
cd ../.Trash
echo -n -e "\t\tCurrent Directory: " ; pwd
echo -n -e "\t\t"
for MSG in `find $SPAMFOLDER/cur -type f -name \*S`
do
#echo -e -n "\t\t\t" ; mv -v $MSG cur/
echo -n "." ; mv $MSG cur/

done
done

echo " "
echo "Learning from HAM"
for HAMFOLDER in `find /home/kdanieli/mail -name .HAM -print`
do
echo " "
echo -e "\tProcessing $HAMFOLDER/cur"
echo -n -e "\t\t"
find $HAMFOLDER/cur -type f -name \*, -or -name \*S | sa-learn --ham --no-sync -f -

echo -e "\t\tRemoving ham messages..."
echo -n -e "\t\t"
for MSG in `find $HAMFOLDER/cur -type f -name \*, -or -name \*S`
do
#rm -v $MSG
echo -n "." ; rm $MSG
done
done

echo " "
echo "Synchronising spam database"
sa-learn --sync --progress



Thanks.

jdcopelin

Hello kdanieli,

I'm sorry the learnspam script is causing your shared server a problem. I can only remember one time where it caused server load to go sky-high: one particular mailbox had about 1000 spam messages in it when some old spam messages never got deleted, it was taking the server about 6 minutes to run the script. I wonder if something similar is happening to you. How many email accounts is the script processing and how many messages are in each spam/ham/learnspam folder?

Regards
Jonathan

__________________
Server: Pass32 and dedicated server

Kayla

Jonathan, thank you very much for your help.

I think the problem here is just what you describe - too many messages..

__________________

kdanieli

Thanks for the help but I don't think that there were many messages. There are 3 or 4 accounts....and only a few messages in each except for the first time when I loaded maybe 50 or 100 messages into the SPAM folder (not sure) and the spam account. I believe that I currently have the 8+* spams sent to a spam account. That one currently has 108 messages in the SPAM folder - but I think the script should have emptied all the SPAM folders already - dunno why it hasn't.


My cron job i is set to 0 0 2 * * - to run every 2 days but I think that's not doing it as I haven't received the email report for some time. thanks

jdcopelin

Hello,

Hmm. I think "0 0 2 * *" tells cron to run on the 2nd day of each month. You need something like "0 0 * * 1,3,5" which will run on mondays, wednesdays and fridays.

Can you ask support to run it from the console/ssh to check that it finishes executing and doesn't hang? Might also be worth asking them to confirm the last cron runs of the script aren't still running. It sounds to me though like your script hasn't been running (looking at the cron config and the number of spam messages you say you have).

EDIT: Have you seen my post with the newer, completely re-written version of the learn spam script? It should give better performance as it doesn't execute sa-learn unless it has to. I have also tried to make it easier to configure and read what it is doing.

Cheers
Jonathan

__________________
Server: Pass32 and dedicated server

Bigjohn

WOW.
The old (original script) with MBOX runs on my server in a minute - and I have several mail box spam folders with THOUSANDS of spam (incase re-training is necessary...)...

I'm liking this new "maildir" thing less and less as time goes forth... but that's just me, complain complain complain....

__________________
Proud to be a Surmunity Mod!
XEON PASS60 PASS61
Make a fundamental difference!
My Sites:
Curious about Brewing Beer? Join the community!
>>>>> Some Change is GOOD! Keep your paycheck! Support the Fair Tax
Get into an Art museum
Victorian London
It's your brain -ON WEB - mybrainhost.com (under development)
What SHOULD Government do? Much Less than it Does!

kdanieli

That new script is at this thread: new spamassassin script

No, I haven't tried that yet. Thanks for the help.