Patent Number: 7,711,673

Title: Automatic charset detection using SIM algorithm with charset grouping

Abstract: The invention relates, in an embodiment, to a computer-implemented method for automatic charset detection, which includes detecting an encoding scheme of a target document. The method includes training, using a plurality of text document samples, to obtain a set of machine learning models. Training includes using SIM (Similarity Algorithm) to generate the set of machine learning models from feature vectors obtained from the plurality of text document samples. The method also includes applying the set of machine learning models against a set of target document feature vectors converted from the target document to detect the encoding scheme.

Inventors: Diao; Lili (Nanjing, CN)

Assignee: Trend Micro Incorporated

International Classification: G06F 15/18 (20060101); G06F 15/00 (20060101)

Expiration Date: 5/04/12018