Project

General

Profile

Actions
Copy link

Defect #20730

closed

Fix tokenization of phrases with non-ascii chars

Added by Jens Krämer over 8 years ago. Updated over 8 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Jean-Philippe Lang
Category:
Search engine
Target version:
3.0.6
Start date:
Due date:
% Done:

0%

Estimated time:
Resolution:
Fixed
Affected version:

Description

\w only matches ASCII characters, we should either use [:alnum:] instead or simply match all non-" characters for the phrase. Test case included.

Files

fix-tokenization-for-phrases-with-non-ascii-characte.patch (1.39 KB) fix-tokenization-for-phrases-with-non-ascii-characte.patch Jens Krämer, 2015-09-13 05:53
Actions
Copy link

Also available in: Atom PDF