Project

General

Profile

Actions

Defect #24910

open

Issue processing UTF7 mails

Added by Falk Eckert about 7 years ago. Updated over 3 years ago.

Status:
New
Priority:
Low
Assignee:
-
Category:
Email receiving
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Resolution:
Affected version:

Description

Hello,

we have an issue with processing UTF7 mails:

exception: code converter not found (UTF-7 to UTF-8)
["/srv/redmine/public_html/lib/redmine/codeset_util.rb:25:in `encode'", "/srv/redmine/public_html/lib/redmine/codeset_util.rb:25:in `to_utf8'"

Are there any ideas to solve this issue?

Thx
Falk


Files

converter_not_found.patch (1.45 KB) converter_not_found.patch Karel Pičman, 2020-09-14 13:27
converter_not_found2.patch (2.78 KB) converter_not_found2.patch Karel Pičman, 2020-09-17 14:37
Actions #1

Updated by Go MAEDA about 7 years ago

  • Category set to Email receiving
Actions #2

Updated by Toshi MARUYAMA about 7 years ago

$ cat /etc/redhat-release 
CentOS Linux release 7.3.1611 (Core)

$ irb
1.9.3-p551 :001 > str = "test".force_encoding("UTF-7")
 => "\x74\x65\x73\x74" 
1.9.3-p551 :002 > str = str.encode("UTF-8", :invalid => :replace,:undef => :replace, :replace => '?')
Encoding::ConverterNotFoundError: code converter not found (UTF-7 to UTF-8)
    from (irb):2:in `encode'
    from (irb):2
    from /home/xxxx/.rvm/rubies/ruby-1.9.3-p551/bin/irb:12:in `<main>'
Actions #3

Updated by Toshi MARUYAMA about 7 years ago

  • Priority changed from Normal to Low

It seems Ruby does not have UTF-7 converter.

"Code converter not found (UTF-8 to EUC-TW)": https://bugs.ruby-lang.org/issues/6995

Actions #4

Updated by Fred Sanger almost 7 years ago

This encyclopedia article for UTF7 seems to be a good place to start

Actions #5

Updated by Pavel Rosický almost 7 years ago

toshio harita: utf-7 is relevant only for email processing. Ruby still supports it, but it's a little bit tricky. This will work:

require "net/imap" 
Net::IMAP.decode_utf7(mail_body)
Actions #6

Updated by Karel Pičman over 3 years ago

The same problem with Windows-1258. Attached patch should cover all not supported code pages.

Actions #7

Updated by Pavel Rosický over 3 years ago

@karel
could you add a more realistic test case with an email as a fixture?
https://github.com/redmine/redmine/blob/3ac569c4d8c8b04a9cc33e3c2a05f8553d99827e/test/unit/mail_handler_test.rb#L542

it should be already fixed by
https://github.com/mikel/mail/pull/1112

Actions #8

Updated by Karel Pičman over 3 years ago

A test with a real Vietnamese email added into the patch.

Actions

Also available in: Atom PDF