Closed
Bug 1205525
Opened 9 years ago
Closed 7 years ago
Message Filters failed to run during messages moving between folders
Categories
(Thunderbird :: Filters, defect)
Tracking
(Not tracked)
RESOLVED
DUPLICATE
of bug 168648
People
(Reporter: tomofumi, Unassigned)
References
(Blocks 1 open bug, )
Details
(Whiteboard: [filterfail)
Attachments
(2 files)
User Agent: Mozilla/5.0 (X11; Linux i686; rv:25.6) Gecko/20150723 Firefox/31.9 PaleMoon/25.6.0
Build ID: 20150723175141
Steps to reproduce:
- Moving lots of message from A folder to B folder (~500MB)
- There is a filter for incoming email which will goes to B folder
- Auto checking new email every 5 mins.
Actual results:
After moving message completed, the new message stay at inbox rather than goes to B folder. Manual running the filter again using "Run Now" works fine.
Expected results:
The new message matching filter criteria should goes to B folder, but it is stay at inbox and need manual running.
I do not understand this report.
Do the new messages come in WHILE you copy messages? In that case the filter is not applied on the NEW messages? Or do you somehow expect a filter to be applied to messages that are moved manually?
Please explain better.
Comment 2•9 years ago
|
||
(In reply to Tomofumi from comment #0)
> Steps to reproduce:
> - Moving lots of message from A folder to B folder (~500MB)
> - There is a filter for incoming email which will goes to B folder
> - Auto checking new email every 5 mins.
> Actual results:
> After moving message completed, the new message stay at inbox rather than goes to B folder.
This is a known case of "silent filter move failure while downloading new mail, due to contention at MoveTargetFolder, or due to interfere by someone at MoveTargetFolder".
Many of similar reports is "Junk move while downloading new mails silently fails, then mail marked as Junk stays in Inbox", and is long-lived phenomenon. In this case, "contension at Junk folder(JunkMoveTargetFolder)" usually doesn't occur. So, "contension at Inbox among download, filter move, Junk move", "interfere by Compaact" etc. is suspected.
Some errors while filter move may be reported to Error Comsole or Activity Manager.
Is error reported to Error Console or Activity Manager?
Did "Move lots of message from A folder to B folder" normally end without interfere by "atempt of filter move to B folder while downloading"?
POP3 and local mail folder case? Or IMAP and IMAP folder case?
Is the "filter move" (i) "Filter before Junk Classificaation"? Or (ii) "Filter after Junk Classification"?
If problem when (i), can you see your problem with (ii)?
Hi aceman,
I am moving lots of messages while the new mail checking automatically in background (as far as I can tell/feel it). The filter does not work and that mail only stay at inbox. If I run the filter manually again it goes back to B folder.
Hi WADA,
> Is error reported to Error Console or Activity Manager?
I didn't check the error console at that time, so it is probably lost now.
For activity manager, I found some interesting lines said "4294967294 messages downloaded" seems the counter is mess up? I'll attach the screenshot here FYR.
> POP3 and local mail folder case? Or IMAP and IMAP folder case?
POP3 and local mail folders only.
> Is the "filter move" (i) "Filter before Junk Classificaation"? Or (ii) "Filter after Junk Classification"?
It is (i), and I've disabled all Junk filter options because our mail system has antispam built-in.
> If problem when (i), can you see your problem with (ii)?
I only come across this problem once somehow so I'm now sure yet.
Thanks.
Comment 5•9 years ago
|
||
(In reply to Tomofumi from comment #4)
> Screenshot-Activity Manager.png
4294967294 == 0xFFFFFFFE == 32bits unsigned integer interpretation of -2 of 32bits signed integer
New mail count like 4294967294(0xFFFFFFFE, -2), 4294967295(0xFFFFFFFF, -1) is known phenomenon.
It's perhaps one of next:
- When new mail count=0 is set after filter move, 1 is extraacted by filter move,
and when new mail count=-1, 1 is extracted by filter move.
- When new mail count=0 is set, 2 is extracted by filter move of 2 new mails.
Rough sketch of "POP3 new mail download and filter move2 + "Bulk move from A folder to B folder"
POP3 new mail download and filter move Bulk move from A folder to B folder
CurrentFileSize=fileSize Request MoveMail from A to B
MsgKey=fileSize of Inbox for mail of MsgKey=MM_1 to MM_N in A
While(NewMail exists) for(X=1;X<=N;X++){
RETR a new mail, Increment count of Inbox Copy MsgKey=MM_X in A
append mail data to file name Inbox to MsgKey=CurentFileSize of B,
If move is needed, copy to B folder Offset at CurentFileSize of B
Increment count of B Increment count of B
truncte at CurrentFileSize, Update CurentFileSize of B
Decrement count of Inbox Delete MsgKey=MM_X in A
Else If move is not needed, MsgKey++ Decrement count of A
If moved to B folder, }
invoke Junk filter on new mail in B folder It may be split to Copy Phase and Delete Phase
Else invoke Junk filter on new mail in Inbox
}
Even when "Copy from Inbox to B by message filter" failed due to contension of B folder with BulkMove,
New mail count of Inbox is decremented by filter move?
Comment 6•9 years ago
|
||
FYI.
Bug 616728 - 4294967295 messages downloaded
It was closed as dup of following, so I couldn't find it by pretty clear search keyword of "4294967295".
Bug 589870 - Too large number for downloaded messages displayed in status bar after automatic e-mail download
In bug 589870 etc., it looks that focus is always on "New mail count like 4294967295" only. It looks that analysis like "When such phenomenon happens" etc. is not done,
Just wonder if there is any locking mechanism during operation of B folder, rather than all the jobs done in parallel?
My idea is to lock the folder B for moving operation, when it is done, release the lock, and the deferred job (message filter's) move message operation is run. Instead of leaving the message in inbox without any warning or prompt that it is failed to move.
Thanks.
Comment 8•9 years ago
|
||
If locked by Bulk Move, Filter Move can do nothing, because it's executed while a POP3 new mail is being dwonloded to Inbox.
If concurrent "Bulk Move from FolderA to FolderX" and "Bulk Move from FolderB to FolderX", concurrent "Bulk Move from FolderX to FolderA" and "Bulk Move from FolderX to FolderB", concurrent "Bulk Move from FolderA to FolderB" and "Bulk Move from FolderB to FolderA", like one, at least Copy phahe of "Move = Copy + Delete" works concurrently, even if funny henomenon occurred in Delete phase due to "other had already deleted".
Because "Filter Move Before Junk Classification" is executed while downloading a new POP3 mail to Inbox, both (a) "create new msgDBHdr at move trget" and (b) "copy mail data(append mail data) to msgStore file for move target" should be executed continuously and succesfully.
Because executed while downloading a new POP3 mail to Inbox, filter move can not wait for copletion of activity by other job.
If "Filter Move After Classification", it's executed after "Download of all new POP3 mails to Inbox" + "Junk Filter/Junk Move on new mails in Inbox".
"Filter Move After Classification" is similar to manual "Run Filters on Inbox".
Differences are : mails filter applied = new mail only, used Filter Rule = "Getting new mail" only.
"Filter Move After Classification" is similar to "Bulk Move from Inbox to Move Target".
for(nn=0;nn<MoveTargetArray.length;nn++){
Do Move from Inbox to MoveTargetArray[nn].msgFolder for all msgDBHdr in MoveTargetArray[nn].msgDBHdrs;
}
"Filter Move Before Junk Classification" is initially implemented to avoid Junk Move of filter moved mail.
After it, Junk Filter is enhanced to "Apply Junk Filter to filter moved mail in filter move target folder".
In order to avoid this Junk Move of filter moved mail, user need to set "Non Junk" to filter moved mail.
Therefore, if user does not do "set Non Junk on filter moved mail by message filter", there is no difference between "Before Junk Classifiction" and "After Junk Classification" from perspective of Junk Filter applicaation on filter moved mail.
This is main reson why I asked for result with "After Junk Classification".
,
Comment 10•8 years ago
|
||
bug query for related issues https://mzl.la/2d3WLmV
Updated•7 years ago
|
Status: UNCONFIRMED → RESOLVED
Closed: 7 years ago
Resolution: --- → DUPLICATE
Whiteboard: [filterfail
Comment 12•5 years ago
|
||
I expected this bug to be fixed by now. But with TB 60.7.1 (64-bit) (MacOS) I observed it again.
Comment 13•5 years ago
|
||
(In reply to Martin Trautmann from comment #12)
Created attachment 9072421 [details]
Screen Shot 2019-06-16 at 07.54.19.pngI expected this bug to be fixed by now. But with TB 60.7.1 (64-bit) (MacOS) I observed it again.
Oops, wrong ID - should have been for bug 589870
You need to log in
before you can comment on or make changes to this bug.
Description
•