User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; hu; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729) Build Identifier: 2.0.0.23 (20090812) (all) I've been synchronizing tons of archived mails between two of my imap servers. Both accounts on both imap servers are added into thunderbird as mailing accounts. Copied whole subfolders from imap server A to imap server B. After the copy was done (it was successful, no error messages or anything), i went to the mailbox on the target imap box, and opened some of the subfolders to see if the messages are there, etc. So basically to check if everything works. (Same number of messages on both servers, etc.) Opened some messages randomly to check if they work etc. During this check, i noticed, that most of the copied emails have their incoming date displayed correctly in the message list pane's "Date" field, but not all. Some messages display the time (hours:minutes) only (most likely the time of the copy operation), like if these messages were received today. Checked the header of these messages, and they are intact. Incoming dates are there, etc. So I assume, it's Thunderbird that displays the date incorrectly for some reason. This occurs seemingly randomly, there were like 10 messages with wrong dates out of ca. 1500-2000 messages total. Checked this with different windows OS'es, including vista business 64bit, xp professional 32bit, windows 7 rc, Ubuntu linux 7.04 & 8.04, with different versions of thunderbird, all displayed the same wrong date on the same messages. Reproducible: Always Steps to Reproduce: 1. Copy tons of messages and folders and structures from IMAP A to IMAP B (both added to TB's mailboxes), either by right-click and "Copy..." or by drag'n'drop. 2. After the copy progress finished, open the newly copied structure 3. Check the message list pane for correct dates displayed. Actual Results: Some random message after copying from the original imap-server-A's mailbox to imap-server-B's mailbox, as seen in the message list pane: Size Sender Title Date 1kb x@y.z something 10:34 Expected Results: The original message in imap-server-A's mailbox, as seen in the list: Size Sender Title Date 1kb x@y.z something 2006.05.04 14:09

What data is really set in Date: header of the mail? (View/Message Source) Same Date: header for same mail at server-A and server-B?

this is the header of the ORIGINAL message: ******************************************************** From - Thu Feb 01 10:31:13 2007 X-Account-Key: account2 X-UIDL: 1170321665.63687.fmx09 X-Mozilla-Status: 0001 X-Mozilla-Status2: 00000000 X-Mozilla-Keys: Return-Path: <www-data@forum.msi.com.tw> Delivered-To: xxxxxxxxxx@xxxxxxxxxxxx.xx Received: (qmail 63683 invoked from network); 1 Feb 2007 10:21:05 +0100 Received: from 2245.sprintweb.de (HELO forum.msi.com.tw) (80.190.215.245) by fmx09.xxxxxxxxxx.xx with SMTP; 1 Feb 2007 10:21:04 +0100 Received: by forum.msi.com.tw (Postfix, from userid 33) id 23BDE3E83BE; Thu, 1 Feb 2007 10:00:13 +0100 (CET) To: xxxxxxxxx@xxxxxxxxxxxx.xx Subject: Topic reply: yet another RAM question From: "MSI HQ User to User Forum" <do_not_reply@no_reply.forum> Date: Thu, 01 Feb 2007 09:00:13 +0000 Message-ID: <aa496c1d0380b383fb755a67c77cb4af-m774825@no_reply.forum> X-Mailer: SMF Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Freemail: message scanned X-Antivirus: avast! (VPS 000709-1, 2007.01.31), Inbound message X-Antivirus-Status: Clean ******************************************************** and this is the header of the message AFTER the copying: ******************************************************** X-Account-Key: account2 X-UIDL: 1170321665.63687.fmx09 X-Mozilla-Keys: Return-Path: <www-data@forum.msi.com.tw> Delivered-To: xxxxxxxxx@xxxxxxxxx.xx Received: (qmail 63683 invoked from network); 1 Feb 2007 10:21:05 +0100 Received: from 2245.sprintweb.de (HELO forum.msi.com.tw) (80.190.215.245) by fmx09.xxxxxxxx.xx with SMTP; 1 Feb 2007 10:21:04 +0100 Received: by forum.msi.com.tw (Postfix, from userid 33) id 23BDE3E83BE; Thu, 1 Feb 2007 10:00:13 +0100 (CET) To: xxxxxxx@xxxxxxxxxx.xx Subject: Topic reply: yet another RAM question From: "MSI HQ User to User Forum" <do_not_reply@no_reply.forum> Date: Thu, 01 Feb 2007 09:00:13 +0000 Message-ID: <aa496c1d0380b383fb755a67c77cb4af-m774825@no_reply.forum> X-Mailer: SMF Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Freemail: message scanned X-Antivirus: avast! (VPS 000709-1, 2007.01.31), Inbound message X-Antivirus-Status: Clean ********************************************************

(In reply to comment #2) >(snip) > Received: (qmail 63683 invoked from network); 1 Feb 2007 10:21:05 +0100 >(snip) > Date: Thu, 01 Feb 2007 09:00:13 +0000 >(snip) How can above mail be displayed as next? Actual Results: 1kb x@y.z something 10:34 and/or Expected Results: 1kb x@y.z something 2006.05.04 14:09 > Actual Results: > Some random message after copying from the original imap-server-A's mailbox to imap-server-B's mailbox, > as seen in the message list pane: > Size Sender Title Date > 1kb x@y.z something 10:34 > Expected Results: > The original message in imap-server-A's mailbox, as seen in the list: > Size Sender Title Date > 1kb x@y.z something 2006.05.04 14:09 This Actual Result and Expected Result at thread pane is really for same mail? Do you mean next? some mails are displayed in HH:MM format some other mails are displayed in YYYY.MM.DD HH:MM format Date: header value is displayed at message header box at message pane too. Is there any mismatch between next for above mail? (a) Date: column value of a mail at thread pane (b) Date: display at message header box at message pane Is (a) and (b) of above mail is different for server-A and for server-B? > this is the header of the ORIGINAL message: > ******************************************************** > From - Thu Feb 01 10:31:13 2007 > X-Account-Key: account2 > X-UIDL: 1170321665.63687.fmx09 > X-Mozilla-Status: 0001 > X-Mozilla-Status2: 00000000 > X-Mozilla-Keys: This is format of mail in local mail folder. And, if IMAP folder of offline use = enabled, order is From - ..., X-Mozilla-Status:, X-Mozilla-Status2:, then X-Account-Key:, ... usually. Local mail? If IMAP, offline use = enabled? This is uploaded mail from local mail folder which was downloaded from POP3 server? (AFTER the copy at Server-B is mail data display for IMAP, non offline use folder)

> How can above mail be displayed as next? > Actual Results: > 1kb x@y.z something 10:34 > and/or > Expected Results: > 1kb x@y.z something 2006.05.04 14:09 that's not the above mail. that's just an example i made up... > > Actual Results: > > Some random message after copying from the original imap-server-A's mailbox to > imap-server-B's mailbox, > > as seen in the message list pane: > > Size Sender Title Date > > 1kb x@y.z something 10:34 > > Expected Results: > > The original message in imap-server-A's mailbox, as seen in the list: > > Size Sender Title Date > > 1kb x@y.z something 2006.05.04 14:09 > > This Actual Result and Expected Result at thread pane is really for same mail? > Do you mean next? > some mails are displayed in HH:MM format > some other mails are displayed in YYYY.MM.DD HH:MM format yes, really really for the same mail. no, i don't mean the hh:mm format. i mean, TB displays the "time of when i copyed mails from serverA to serverB", in hh:mm format. (only for some random mail). but the hh:mm format is interesting too. here's a screenshot: http://img199.imageshack.us/img199/9475/imapdate.jpg > Date: header value is displayed at message header box at message pane too. > Is there any mismatch between next for above mail? > (a) Date: column value of a mail at thread pane > (b) Date: display at message header box at message pane > Is (a) and (b) of above mail is different for server-A and for server-B? i am not sure what you mean by (a), but see screenshot. date is NOT displayed in the message view box, only in this case. > This is format of mail in local mail folder. And, if IMAP folder of offline use > = enabled, order is From - ..., X-Mozilla-Status:, X-Mozilla-Status2:, then > X-Account-Key:, ... usually. > > Local mail? If IMAP, offline use = enabled? This is uploaded mail from local > mail folder which was downloaded from POP3 server? > (AFTER the copy at Server-B is mail data display for IMAP, non offline use > folder) history of the mails: they were received from pop3 accounts, and were downloaded to local mailbox. (i always download mail to the local hard drive, as there's just not enough space on my pop3 accounts.) then i move old mail to another local folder (THE local folder, not just another local mailbox file) for archiving. i do this once in year, i archive all mail from previous year. i just move them out of the actual mailbox into the local folders' archive folder. then at some time, i decided, this is not good, as i have no access to locally stored mail when i use another computer (often), so i set up an imap server (A), and moved all archived mail from the local folder to the imap server's archive folder, but this was done without losing any of the message dates. then i set up another imap server (B), bacause serverA is not online all the time, but serverB is always online. so the history: pop3 mailbox -> download to local mailbox (date is OK) -> moved to local folders (date is OK) -> uploaded to imap folder on serverA (date is ok) -> copy to imap serverB (date is wrong for some mail)

(In reply to comment #4) > here's a screenshot: http://img199.imageshack.us/img199/9475/imapdate.jpg Aha! I thought blank lines you pasted to this bug is produced when you pasted. Mail source you pasted. >(snip) > Subject: Topic reply: yet another RAM question > From: "MSI HQ User to User Forum" <do_not_reply@no_reply.forum> > <= null line == end of header > Date: Thu, 01 Feb 2007 09:00:13 +0000 <= 1st line of mail text > <= 2nd line of mail text > Message-ID: <aa496c1d0380b383fb755a67c77cb4af-m774825@no_reply.forum> >(snip) Because null line exists before Date: line, following Data: line, null line, Message-ID: line, ... are mail body text lines. (See RFC2822) In screenshot, the "null line == end of header" is seen between From: line and Reply-To: line, then lines from Reply-To: line are displayed as mail body text. These mails are mail of no Date: header. It's reason why no Date: is displayed at header box of mail display window in screenshot. Phenomenon when no Date: header was Bug 73565. But "What is displayed at Date column for mail of no Date: header" depends on Tb's version because some changes around "no Date: header" were done several times. And it depends also on "How mail is newly processed by Tb"(downloaded via POP3, Imported, FETCHED via IMAP, rebuild-index is executed or not, ...). AFAIK, there are three cases. (A) ECPOC time(1970/1/1 00:00:00 GMT) => Phenomenon of Bug 73565 (B) Downloaded time => HH:MM format because today is mail downloaded date. (see http://kb.mozillazine.org/Date_display_format for HH:MM format) This date is seen in first "From - ..." line in View/Message Source display, when downloaded POP3, imported mail, mail in IMAP folder of offline use. (C) rebuild-index execution time. Similar phenomenon occurs also when malformed Date: header (Bug 32216). Do next for mails of different Date: column value at thread pane. 1. Check mail source(whether no Date: header or malformed Date: header). 2. Compare Date column value of mail of server-A and mail of server-B. What is difference of Date column value?

(In reply to comment #4) > so the history: > pop3 mailbox -> download to local mailbox (date is OK) -> moved to local > folders (date is OK) -> uploaded to imap folder on serverA (date is ok) -> copy > to imap serverB (date is wrong for some mail) Do you have backup of mail local mail box or local folders? "Excess null line before Date:" is possibly generated by serverA. (example. mixed [CRLF], [LF], [CR] was passed to Tb by POP3 server. Tb passed thru it serverA, then serverA generated null before Date:.)

(In reply to comment #6) > (In reply to comment #4) > > so the history: > > pop3 mailbox -> download to local mailbox (date is OK) -> moved to local > > folders (date is OK) -> uploaded to imap folder on serverA (date is ok) -> copy > > to imap serverB (date is wrong for some mail) > > Do you have backup of mail local mail box or local folders? > "Excess null line before Date:" is possibly generated by serverA. > (example. mixed [CRLF], [LF], [CR] was passed to Tb by POP3 server. Tb passed > thru it serverA, then serverA generated null before Date:.) I still have the mails in the local folders, but not anymore on serverA (i have deleted them after copying to serverB) this is the header of the above mail from the local folder: *************************************************************** From - Thu May 04 14:09:55 2006 X-Account-Key: account2 X-UIDL: 1146744515.13348.fmx10 X-Mozilla-Status: 0001 X-Mozilla-Status2: 00000000 X-Mozilla-Keys: Return-Path: <www-data@mobile.yamigo.com> Delivered-To: xxxxxxxxxxx@xxxxxxxxxxxxxxxxxxx.xx Received: (qmail 13222 invoked from network); 4 May 2006 14:08:31 +0200 Received: from alpha.links2world.com (64.246.48.110) by fmx10.freemail.hu with SMTP; 4 May 2006 14:08:28 +0200 Received: (qmail 20564 invoked from network); 4 May 2006 11:58:11 -0000 Received: from 59-25-251-64.serverpronto.com (HELO mobile.yamigo.com) (64.251.25.59) by links2world.com with SMTP; 4 May 2006 11:58:11 -0000 Received: from www-data by mobile.yamigo.com with local (Exim 3.35 #1 (Debian)) id 1FbcQD-0003FG-00 for <xxxxxxxxxxxx@xxxxxxxxxxxx.xx>; Thu, 04 May 2006 14:55:05 +0300 To: xxxxxxxxx@xxxxxxxxxxxxx.xx Subject: New User Details From: Administrator <support@yamigo.com> Reply-To: <support@yamigo.com> X-Priority: 3 X-MSMail-Priority: Low X-Mailer: Mambo Open Source 4.5 Message-Id: <E1FbcQD-0003FG-00@mobile.yamigo.com> Sender: www-data <www-data@mobile.yamigo.com> Date: Thu, 04 May 2006 14:55:05 +0300 X-Freemail: message scanned Hello Xxxxxxxxx Xxxxxxxxx, You have been added as a user to http://www.yamigo.com. (message body continues here...) *************************************************************** and this is the header of the mail on serverB: *************************************************************** X-Account-Key: account2 X-UIDL: 1146744515.13348.fmx10 X-Mozilla-Keys: Return-Path: <www-data@mobile.yamigo.com> Delivered-To: xxxxxxxxxx@xxxxxxxxx.xx Received: (qmail 13222 invoked from network); 4 May 2006 14:08:31 +0200 Received: from alpha.links2world.com (64.246.48.110) by fmx10.freemail.hu with SMTP; 4 May 2006 14:08:28 +0200 Received: (qmail 20564 invoked from network); 4 May 2006 11:58:11 -0000 Received: from 59-25-251-64.serverpronto.com (HELO mobile.yamigo.com) (64.251.25.59) by links2world.com with SMTP; 4 May 2006 11:58:11 -0000 Received: from www-data by mobile.yamigo.com with local (Exim 3.35 #1 (Debian)) id 1FbcQD-0003FG-00 for <xxxxxxxx@xxxxxxxx.xx>; Thu, 04 May 2006 14:55:05 +0300 To: xxxxxxx@xxxxxxxxxx.xx Subject: New User Details From: Administrator <support@yamigo.com> Reply-To: <support@yamigo.com> X-Priority: 3 X-MSMail-Priority: Low X-Mailer: Mambo Open Source 4.5 Message-Id: <E1FbcQD-0003FG-00@mobile.yamigo.com> Sender: www-data <www-data@mobile.yamigo.com> Date: Thu, 04 May 2006 14:55:05 +0300 X-Freemail: message scanned Hello Xxxxxxx Xxxxxxxxxx, You have been added as a user to http://www.yamigo.com. (message body continues here...) *************************************************************** I don't think the imap server would touch any part of the message.

(ewwww. no editing of comments?) So, the above message in the local folder displays in thunderbird message list view as: Date: 2006.05.04. 14:09 the only difference between the one in the local folder and the one copied onto imap, is the added lines of X-mozilla.... and that's not been added by the imap server. And the Date: field is separated from the header by a blank line, surely that's causing the problem. I have also checked other mail that behaves similarly (ie. wrong date is displayed after copying, and only HH:MM format.) in one case, there was no date field at all in the original. in other cases, date fields were separated by a blank line too. I know not much about this, but looks like thunderbird figures out the date by itself, even if the message header has no date field or is wrong formatted. I just wonder, why is it able to "figure out" the date when the mail is in a local folder, and not, when the mail is on the imap server?

(In reply to comment #7) > this is the header of the above mail from the local folder: > *************************************************************** > From - Thu May 04 14:09:55 2006 >(snip) > Subject: New User Details > From: Administrator <support@yamigo.com> > <== null line=end of header > Reply-To: <support@yamigo.com> >(snip) > Date: Thu, 04 May 2006 14:55:05 +0300 >(snip) (In reply to comment #8) > So, the above message in the local folder displays in thunderbird message list view as: > Date: 2006.05.04. 14:09 Mail is generated at 2006/05/04 14:55:05 +0300 of sender's PC. (Date: in mail body) This mail was downloaded at 2006/05/04 14:09:55 of your local time. (First line of "From - Thu May 04 14:09:55 2006". Tb doesn't write time-zone in the "From - ..." line which is mail separator/envelope of Unix Mbox.) And, Tb you used on 2006/05/04 saved "download time" as "date of mail", because mandatory Date: header doesn't exist in the mail. What value is displayed in Date column for the mail at server-B? By the way, please don't paste data to bug if data is long. Save in text file and attach the text file to this bug via "Add an attachment" link of this bug, please.

The date displayed on serverB is the date when I copied the mail there. (in HH:MM format if it was today, in YYYY:MM:DD HH:MM format for older, as usual.) Just deleted this mail from serverB and copied again, this time from the local mailbox, and it's the same behaviour: in the local mailbox, the mail has the correct date and is displayed correctly, after copying, it displays the current time (time of the copy) as the mail's date. I wonder why this didn't happen earlier, when i copied from local to serverA? Probably because i was using some older version of TB that time, and maybe it handled this better?

Wrt. comment #5, I'm having the same problem with TB 3.0.1 (Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.23) Gecko/20090812 Thunderbird/2.0.0.23 Mnenhy/0.7.5.0). I have tons of mail that have no 'Date:' header, and they all show up as of today (when I accessed them via IMAP), even if all other headers show that these mails are years old. Imho, TB should sort these emails by the oldest "Received:" header if no "Date:" header is present. Mutt does it that way, as it seems, because it doesn't sort the emails that wrong.

(In reply to comment #11) Date: is Date:, Received: is Received: Tb 3 already supports Received column for Received: header value. - Local mail folder : rebuild-index is required for existent mails. - IMAP folder : after workaround of bug 184490, rebuild-index.

I'm having the same problem. Every message I sent for myself from my imap webmail account, somehow is delivered without "date" in header. The "received" field is OK, however, in Tb3 in the Received column I get the same as in Date column, that is: timeNow. I have no problem with this in my mobile mail client or even in outlook.

I'm having the same problem also. Mail without a "Date:" header is sorted as if it was sent when TB fetches mail from the server (via IMAP). (I'm using TB3). Imo, TB should sort the mail by the Received: header if no Date: header is present. My mobile mail client, Pine, and Mutt do so.

Changing bug summary(similar to title or abstract of research papar) to that I think appropriate. To Janos Kövari(bug opener), do you agree? If no, what is real problem of this bug you are thinking? If yes, can you open separate bug for problem stated in current bug sumary? This bug is lengthy, because mail data was not attached from initial, pasted instead, then it was very hard to know what happens and it took many comments to find what is problem. And, due to many comments required to find what is problem, irrelevat comments to real problem of this bug, comments for problems or request after real problem, were already added. Fixing of problem in this bug is very hard. Clean, crips bug report is required to resolve problem.

sorry, i am a bit late... for me the new description is hard to understand, but i don't really mind, if a developer finds this better and this helps him/her to fix the bug (or the feature) :) i don't understand why should i open a separate bug and what should i put in there.

All of a sudden I experience a similar (or same problem) with TB 45.2. Apparently some received emails (a long time ago) have no "Date" field, only a "Received" field. When I repair the folder in which they are, those emails are displayed according to the time at which the folder was rebuild not the received date. Another IMAP client (i.e. Roundcube) don't have this problem.

Using the "IMAP Received Date" add-on is solving the problem (for now... We all know the drawback of using add-ons....)

Hi, I noticed the same issue recently on Thunderbird 45.7.0 on linux. Issue happened for an email with a missing "date" header as shown by amavis added header: 'X-Amavis-Alert: BAD HEADER SECTION, Missing required header field: "Date"'. In such case, Thunderbird uses current date. Wouldn't it be possible to make Thunderbird take the last server receiving date instead ?