This is the Spider of the SearchSECO project. The Spider is responsible for retrieving data (source files and author data) from (Git-based) sources on the internet and communicating this data to the Controller component of the system. The spider needs a stable internet connection to the source in question to be able to clone projects, to then process these locally.
Download the .zip containing the source files and extract the files.
- c++20
- Windows 10. Might also work on other systems, but has not been tested.
Open a command line at the root of the project file structure, and run
mkdir build && cd build
cmake ../SearchSECOSpider
cmake --build .
This will build an executable file called SearchSECOSpider, which can be run.
Open the solution file and build the project in Visual Studio 2019, with SearchSECOSpider as the startup project. The standalone project was made for testing purposes to be able to run the project, as opposed to only building a library. There are no practical uses for the standalone project apart from testing the SearchSECOSpider library.
The spider can be built as a library using both Visual Studio 2019 and CMake.
Open the solution file and build the Spider-Revisited project in Visual Studio 2019. The library can then be found under ../x64/Debug/libSearchSECOSpider.lib.
Make sure to have CMake https://cmake.org/ installed. Open a command line at the root of the project file structure, and run
mkdir build && cd build
cmake ../libSearchSECOSpider
cmake --build .
The library can then be found from the build directory under /Debug/spider.lib.
This project is licensed under the GNU Affero General Public License v3.0. See LICENSE for more info.
This program has been developed by students from the bachelor Computer Science at Utrecht University within the Software Project course. © Copyright Utrecht University (Department of Information and Computing Sciences)