5

I have a product categories tree with names like apparel, jeans, beauty & wellness etc. I need to 'match' external categories with this category tree. For example, I'd need to match: lenses color to lens colour.

I currently use a fuzzy string matching approach (using python and FuzzyWuzzy), and when there is no match, it is done manually and saved as a synonym. I was wondering if a machine learning classification method would make sense here since:

  • We're talking about single words (or 2 to 3 words like in beauty & wellness). It seems like classification works better on sentences, or words inside sentences.
  • There are very few examples for each 'class'. Even after gathering a lot of synonyms, there aren't more than 4 or 5 ways to say a category. So not sure the training will be consistent.

I'm more familiar with neural nets than other machine learning techniques, but maybe someone is familiar with this matter and will suggest other techniques.

Ferdi
  • 4,882
  • 7
  • 42
  • 62
Graham Slick
  • 405
  • 1
  • 6
  • 14

1 Answers1

1

I would use word stemming. That means we map words like indexer, indexing, indexes all to index. There are several possible approaches for this. Check Wikipedia for a good summary on algorithms that do that: https://en.wikipedia.org/wiki/Stemming

Mohammed Ajil
  • 11
  • 2
  • 1
    It would be better to give a fuller answer rather than relying on an external link. There seems little in the original question to suggest that this would solve his/her problem though. – mdewey Apr 04 '17 at 11:10