Open Bug 195077 Opened 22 years ago Updated 3 years ago

Using mail filter to move too many messages when low on disk space causes crash

Categories

(MailNews Core :: Filters, defect)

x86
All
defect

Tracking

(Not tracked)

People

(Reporter: jon.roland, Unassigned)

References

(Depends on 1 open bug)

Details

(Keywords: crash, dataloss)

User-Agent: Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.3b) Gecko/20030221 Build Identifier: Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.3b) Gecko/20030221 Created mail filter "archive" to move old messages to folder in Local Folders on external drive, and set it to move email before 1/1/2003 and label=0, about 15000 messages. Succeeded in copying over to target folder, but when tried to remove messages from source Inbox folder, Mozilla crashed. Repeating the process with a new target folder incrementally by month worked, but about 2000 messages were lost from source Inbox (although saved okay in first target folder being used when crash occurred). My system has 128MB RAM, 100MB remaining disk space on drive where Inbox kept. Reproducible: Didn't try Steps to Reproduce: 1. 2. 3. Suggest may need to have filter test for system resources, partition move of many messages into groups, remove a group from source folder before copying over next group, or at least remove in groups, to avoid exceeding system resources.
I should add that before beginning the message moving the source Inbox folder contained about 32000 messages and had a file size of about 1000 MB.
taking - I haven't been able to reproduce this myself. However, is it possible you've run out of disk space? Moving messages doesn't reclaim disk space in the source folder until you compact the folder. I see you have an external drive for the destination. 1000 MB shouldn't be the actual problem - we use a 32 bit key for messages, the offset into the message folder and that should give us 2000MB or 4000MB at least.
Assignee: naving → bienvenu
Status: UNCONFIRMED → NEW
Ever confirmed: true
I thought it might be disk space, too, but since then I have run it the same way with later versions and have not encountered the problem. Can't say it is solved, though. I had run it before the several crashes, on the previous version (1.2?), then had a run of the problem while using the version I had at the time. What I suspected was that even though Mozilla programs were installed on drive D: and the profiles on drive E: Mozilla might be trying to write a temp file to drive C: which is really maxed, as it always is on any system I have, and is the main limiting factor on what software I can install, and the reason I seem to wind up needing more than one system to run all the software I need to use. I really need to direct Mozilla to write any temp files to a large external drive (G: by default, if it is present, 120 GB).
Severity: normal → critical
Keywords: crash, dataloss
changing summary to reflect low disk space
Summary: Using mail filter to move too many messages causes crash → Using mail filter to move too many messages when low on disk space causes crash
Product: MailNews → Core
*** Bug 285354 has been marked as a duplicate of this bug. ***
QA Contact: laurel → filters
Product: Core → MailNews Core
If you OS crashes when running out of disk space you should file a bug there not here. Though mozilla could probably be more efficient with disk usage that is not a critical bug. If you can determine that it is using excessive disk space by using temp files or duplicating that should probably be reported as separate bug. It does tend to be a bit heavy handed. In view of the date why is this still open?!
It was not an OS crqash, but a Mozilla crash, and I was later able to duplicate it using Thunderbird. There are two problems, each with its own solution: 1. Inability to manually set location for temp files to a filesystem where there is more space; and 2. Lack of a warning when disk space is too low to allow for removal of deleted messages from Inbox, or a way to remove them incrementally so disk space limits are not exceeded. Any well-designed product, ready for commercial use, should be able to detect dangerous situations and warn or provide for them.
Has this been reproduced at all on somewhat recent versions? If yes, it would be good to add a crash signature to this bug. If not, we should resolve the bug as WORKSFORME and wait for seeing something like this ever again, then either reopening with current info including crash reports or file a new bug with that info.
Depends on: 339805
Assignee: dbienvenu → nobody
from bug 710717 (I haven't tested) 1) Create in the inbox the following messages: A 2Kb B 2Kb C 3Mb D 2Kb 2) Fill the disk leaving just 2Mb free 3) Move the above messages to another folder (eg. Sent) 4) Thunderbird shows a message saying there wasn't enough space to move them 5) The state is now this: Inbox: A B C D Sent: A B (messages became duplicated) Given that the desired state is unreachable, it should be left in either: Inbox: A B C D Sent: or Inbox: C D Sent: A B

Another example where lack of IO error checking gets us in trouble

Severity: critical → S3
OS: Windows 98 → All

I hope I can get to solve these and other low-level I/O issues. Day work workload pressure should be easing soon.

You need to log in before you can comment on or make changes to this bug.