Web Mining Detection and Reporting Tool

The Web Mining Detection and Reporting Tool was developed during the course INCS 870 at New York Institute of Technology (Vancouver, BC campus) under the supervision of Dr. Amin Milani Fard by students:

• Juan Fu
• Saba Mohammadi
• Elina Kuznetsova

About The Project

The tool is aimed to analyze, detect and report about mining activities on a website. Also, it saves the screenshot of the tested web domain.

Built With

For bootstraping this project, the next major frameworks/libraries were used:

• NodeJS
• Google Puppeteer
• telegraf.js

Getting Started

For setting up our project locally, you will need to get a local copy up and follow these simple steps.

Prerequisites

• Install NodeJS
• Install Google Puppeteer
• Install telegraf.js
• Install Telegram Messenger

Installation

For installation you will need to follow these steps:

1. Clone the repo

   git clone https://github.com/nyit-vancouver/MiningDetection

2. Install NPM packages

   npm install

3. Install Telegraf package

   npm install telegraf

4. Update the Mining Database

   npm run update-miners-list

(back to top)

Usage

For using the Web Mining Detection and Reporting Tool, you need to follow only two steps:

1. Open your cloned folder in Terminal and launch for updating database:

npm run update-miners-list

2. Run for launching the Telegram bot:

   node telegram.js

3. In any browser, open https://t.me/MiningDetection_bot
4. In the bot, click 'Start' and enter the web addresses for testing

Reporting

After the script analyzed the URLs, you will see the reports about found activities

Contact

Elina Kuznetsova

New York Institute of Technology

(back to top)