Information Technology Journal1812-56381812-5646Asian Network for Scientific Information10.3923/itj.2014.2309.2317WangHaitao LiuShufeng JiaZongpu 1220141314This study proposes a kind of fingerprint of paragraph generation approach
for similar documents detection which mainly includes three parts, select long
sentence, obtain feature set of paragraph by calculate weight value of sentence
and generate the fingerprint of paragraph. As a result, a document is turned
into a set of paragraph fingerprint and a similarity measure is then applied,
the similarity degree is calculated between the input document and each document
in the given collection. A similarity function based on consine function is
employed to determine whether a document is a near duplicate to the input document
by similarity degree between them or not. This study presented can better reveal
the characteristics of the document and reduce the noisy influence on feature
selection effectively. The experiment demonstrates that the method which offered
has the preferable precision and recall ratio, relatively less running time
comparing to the other method.]]>De Carvalho, M.G., A.H.F. Laender, M.A. Goncalves and A.S. da Silva,201224399412Hajishirzi, H., W.T. Yih and A. Kolcz,20102010pp: 419426Henzinger, M.,20062006pp: 284291Huang, L., L. Wang and X. Li,20082008pp: 6272Narayana, V.A., P. Premchand and A. Govardhan,20092009pp: 14921496Kim, J. and H. Lee,20122012pp: 882833Qiu, J. and Q. Zeng,20102010pp: V2-604V2-607Sood, S. and D. Loguinov,20112011pp: 11171126Wang, J.H. and H.C. Chang,20092009pp: 205217Zhao, Z., L. Wang, H. Liu and J. Ye,201125619632Xiao, C., W. Wang, X. Lin, J.X. Yu and G. Wang,20112011Valles, E. and P. Rosso,20112011pp: 2734Theobald, M., J. Siddharth and A. Paepcke,20082008pp: 563570Manku, G.S., A. Jain and A.D. Sarma,20072007pp: 141149Wang, J.Y., Z.M. Xie and M. Lei,200028130132Pang, X.W., Z.L. Yao and Y.J. Li,201038810Huang, R., S. Fen, J.Y. Yang, Y. Liu and M. Ao,20102724892497Zhu, H.M. and N.S. Wang,200621805808Li, X.Y. and C.J. Bao,20073612731275Li, R., K. Chao, W. Zheng and J.M. Wang,201047400406Yong, F. and J.H. Zheng,200945141143Li, A., J. Shu and M.Q. Li,201021916918Broder, A.Z., S.C. Glassman, M.S. Manasse and G. Zweig,19972911571166Manber, U.,19941994pp: 2Brin, S., J. Davis and H. Garcia-Molina,199524398409