A Short Survey of Document Structure Similarity Algorithms [electronic resource].
- Washington, D.C. : United States. Dept. of Energy, 2004.
Oak Ridge, Tenn. : Distributed by the Office of Scientific and Technical Information, U.S. Dept. of Energy.
- Physical Description:
- PDF-file: 9 pages; size: 0.2 Mbytes
- Additional Creators:
- Lawrence Berkeley National Laboratory
United States. Department of Energy
United States. Department of Energy. Office of Scientific and Technical Information
- This paper provides a brief survey of document structural similarity algorithms, including the optimal Tree Edit Distance algorithm and various approximation algorithms. The approximation algorithms include the simple weighted tag similarity algorithm, Fourier transforms of the structure, and a new application of the shingle technique to structural similarity. We show three surprising results. First, the Fourier transform technique proves to be the least accurate of any of approximation algorithms, while also being slowest. Second, optimal Tree Edit Distance algorithms may not be the best technique for clustering pages from different sites. Third, the simplest approximation to structure may be the most effective and efficient mechanism for many applications.
- Published through SciTech Connect.
Presented at: The 5th International Conference on Internet Computing, Las Vegas, NV, United States, Jun 21 - Jun 24, 2004.
- Funding Information:
View MARC record | catkey: 14344893