| ๋ด์ค ๋ถ์์ ์ํ ํดํท์ ๋๋ค.
Main features
-
news data indexing
-
news data processing
-
provide api for service server
Inked-news-crawler ์์ ์๋ก์ด ๋ด์ค๋ฐ์ดํฐ๋ฅผ ๋ฐ์์จํ, ์ธ๋ฑ์ฑ๊ณผ pre-proccessing ์ ํฉ๋๋ค. ์๋น์ค ์๋ฒ์์ ์์ฒญํ๋ ์ ๋ณด๋ฅผ ๋ถ์ํ์ฌ ์๋น์ค ์๋ฒ๋ก ์ ๋ฌํ๋ฉฐ, ์๋น์ค ์๋ฒ์์ ํด๋ผ์ด์ธํธ๋ก ๋ด์ค ์ ๋ณด๋ฅผ ์ ๊ณตํฉ๋๋ค.
- tags : { company : [], namedEntities: [], keywords: []}
- content
- origin
- title
- time
sudo apt-get install python3-pip
sudo pip3 install virtualenv
virtualenv venv
http://konlpy.org/en/v0.4.4/install/
sudo apt-get install g++ openjdk-8-jdk
bash <(curl -s https://raw.githubusercontent.com/konlpy/konlpy/master/scripts/mecab.sh)
daphne server.asgi:application
restart server
sudo supervisorctl restart asgi_daphne
you can see
server/settings/production.py
credentials/db-connection.json
from .gitignore
which two files you will have to provide manually to run this project.
- duplicate news checker โ
- spam news detector ๐ซ
- word2vec โ (wiki) ๐ซ (news)
develped by softmarshmallow