simhash

中文文本相似度计算器

A fast python implementation of the SimHash algorithm.

semantic-sh is a SimHash implementation to detect and group similar texts by taking power of word vectors and transformer-based language models (BERT).

Open Source Implementation of Simhash in Python

招商银行FinTech-复赛-财经新闻分析

SuperMinHash: A New Minwise Hashing Algorithm for Jaccard Similarity Estimation, Simhash and SimhashIndex

Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.

Find duplicate text files.

This system evaluates a collection of mementos (archived web pages) to determine which are off topic. The collection can be part of an Archive-It collection, a single TimeMap, or stored in a WARC file.

Code plagiarism system based on Simhash and Nicad.

Privacy-preserving federated experience memory for agents — share only a DP-noised count of an opaque signature; never content or gradients.

爬虫内容处理服务（自用）

⌨️ User Verification based on Keystroke Dynamics / Two-factor Authentication technology based on Key-Stroke

The extended version of simhash supports fingerprint extraction of documents and images.

Analysis of Massive Datasets FER labs

🐾 Create a behavioral fingerprint based on your zsh command line history

Python library for MUVERA multi-vector retrieval via Fixed Dimensional Encodings. ColBERT / ColQwen2 / ColQwen3.5 compatible.

Finds duplicates across every file type, not just photos. Compares images by appearance, audio by acoustic fingerprint, video by keyframes, and documents and source code by content similarity, catching renames, re-encodes, and format conversions that byte-comparison tools miss. Native app for macOS, Windows, and Linux.

Illegal Copyright Detection System WEB

A portable similarity digest for prompt attacks, so reworded jailbreaks correlate instead of reading as unrelated items.