Skip to content

Latest commit

 

History

History
76 lines (54 loc) · 2.55 KB

File metadata and controls

76 lines (54 loc) · 2.55 KB

Sentence Transformers Workshop

Introduction to Sentence Transformers and NLP for Semantic Searching

Table of Contents
  1. About The Workshop
  2. Getting Started
  3. Roadmap
  4. License
  5. Authors
  6. Acknowledgements

About the Workshop

This workshop introduces the concept of sentence transformers and how to use them to build a text searching algorithm with semantic searching. We will also cover basic NLP techniques, such as removing stopwords and lemmatization for optimizing the algorithm.

Getting Started

Usage

This workshop is taught and developed in Google Colab, which is an online Jupyter Notebook editor. To access the workshop notebook, follow this link:

Sentence Transformer Colab

Installation (Optional)

If you instead want to run the colab locally, follow the steps below to setup the Jupyter Notebook and install the proper pip requiements.

  1. (Optional) If you wish to use a virutal environment with python, run python -m venv venv followed by venv/Scripts/activate if on Windows and venv/bin/activate on MacOS/Linux
  2. Run pip install -r requirements.txt in this directory. This will install the python requirements for the project.
  3. Open the Jupyter Notebook Sentence-Transformer-Workshop.ipynb and choose either your python environment or the virtual environment if you made one.

Roadmap

  1. Introduction to basic text searching algorithms
  2. Theory behind semantic searching
  3. Utilizing sentence transformers for semantic searching
  4. Optimization with NLP techniques
  5. Hands on development in Google Colab

License

Distributed under the MIT License. See LICENSE for more information.

Authors

Tristan Pank @tristanpank

Workshop Link Link

Acknowledgements

  • Data Science and Informatics for hosting the workshop.
  • Marielle Doenges for peer reviewing the material.

Thank you