sense2vec: Semantic Analysis of the Reddit Hivemind · Explosion

We parsed every comment posted Reddit in 2015 and 2019, and trained different word2vec models for each year.

How does this work? We used spaCy to tag and parse comments posted to Reddit in 2015 and 2019, and trained word vectors for more precise contexts using words and phrases and their part-of-speech tags and entity label. This allows querying synonyms of duck|VERB and duck|NOUN separately and getting meaningful vectors for multi-word expressions. Read the blog post Try sense2vec The sense2vec library is a Python implementation for loading and querying sense2vec models. It can be used as a standalone module, or as a spaCy pipeline component. from sense2vec import Sense2Vec s2v =…

related reading

• The Illustrated Word2vec – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• 1301.3781arxiv.org
• Semantic Search - Sentence Transformers documentationsbert.net
• Parsed | Custom, interpretable AI systems that continuously learnparsed.com
• Word Embeddingslena-voita.github.io
• Voyage AI | Homevoyageai.com
• GitHub - ansonyuu/matchmaking: Embedding space of names clustered based on their interests using the sentence-transformers all-MiniLM-L6-v2 modelgithub.com
• Trending Papers - Hugging Facepaperswithcode.com
• Vector embeddings | OpenAI APIdevelopers.openai.com
• The Illustrated Word2vec – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Embeddings: What they are and why they mattersimonwillison.net
• Neuronpedianeuronpedia.org