Fuzzy dedup uses Jaro-Winkler string similarity (_MERGE_THRESHOLD = 92.0) and
incorrectly merges entities that are similar but semantically distinct.
Example cases:
Label A Label B Jaro-Winkler Result
───────── ───────── ───────────── ─────────────────
ASR1603 ASR1605 ~95.2 falsely merged
ASR1603 ASR1606 ~95.2 falsely merged
cranel cranelr ~96.3 falsely merged
cranel cranelrh ~95.2 falsely merged
cranelr cranelrh ~96.3 falsely merged
These are different chip name / hardware variants, not typos or formatting
variants. Merging them causes:
Nodes disappear from the graph (only the winner survives)
All edges are rewired to the survivor, creating false relationships
The merged entity appears connected to everything all variants were connected to
Do you have any suggestions regarding this issue?
Fuzzy dedup uses Jaro-Winkler string similarity (_MERGE_THRESHOLD = 92.0) and
incorrectly merges entities that are similar but semantically distinct.
Example cases:
Label A Label B Jaro-Winkler Result
───────── ───────── ───────────── ─────────────────
ASR1603 ASR1605 ~95.2 falsely merged
ASR1603 ASR1606 ~95.2 falsely merged
cranel cranelr ~96.3 falsely merged
cranel cranelrh ~95.2 falsely merged
cranelr cranelrh ~96.3 falsely merged
These are different chip name / hardware variants, not typos or formatting
variants. Merging them causes:
Nodes disappear from the graph (only the winner survives)
All edges are rewired to the survivor, creating false relationships
The merged entity appears connected to everything all variants were connected to
Do you have any suggestions regarding this issue?