SWIRL SEARCH 1.5

[sidprobstein]

SWIRL SEARCH 1.5

This version consists of a new relevancy model supported by stemmed matching and cleaning of source responses.

⚠️ Installing the new packages is required before upgrading. Read more: Upgrading to 1.5

Changes

🔹 New relevancy model which weights and aggregates the similarity of each query match against the most relevant section of text, and normalizes results by length

🔹 Matching on stems using nltk and highlighting of actual matches

🔹 Removal of html tags and entities with Beautiful Soup

🔹 Relevancy scores are now broken by date_published, descending

Issues Resolved

🔹 Re-run and re-score now remove previous search.messages, and provide an update with timestamp

🔹 Fixed highlighting interaction with tags by removing tags prior to highlighting

🔹 Fix newsdata.io

Upgrading

For all platforms other than docker, run the following from the command line, in the swirl installation folder:

python install.py
./install.sh

(Windows users, run install.bat)

If these scripts don't work for any reason, install manually:

pip install -r requirements.txt
python -m spacy download en_core_web_lg

⚠️ Docker users need to restart their image to get the new version. Containers using sqlite3 for storage delete all content upon shut down! Read more: Docker Build for SWIRL

Known Issues

🔹 Creating searches from a browser with q= can sometimes create two Search objects.

This is because of browser prefetch. Turn off Chrome prefetch. Turn off Safari prefetch

Please report any issues with this to support.

Documentation

• Quick Start
• User Guide

Support

🔹 Create an Issue if something doesn't work, isn't clear, or should be documented - we'd love to hear from you!

🔹 Paid support and consulting are available... contact SWIRL for more information.

---

This discussion was created from the release SWIRL SEARCH 1.5.