Skip to content

Latest commit

 

History

History
53 lines (44 loc) · 2.37 KB

DESIGN.md

File metadata and controls

53 lines (44 loc) · 2.37 KB

This document explains all the different decisions that were made when designing MediaDepot. It'll discuss the final choice, alternatives that were considered and any compromises that were necessary.

OS

Storage

Union/Local JBOD

Distributed File Systems

https://www.reddit.com/r/DataHoarder/comments/4ey8zj/looking_for_a_distributed_media_storage_solution/ https://www.reddit.com/r/HomeServer/comments/4ey3qw/looking_for_a_distributed_media_storage_solution/

  • GlusterFS
  • CephFS
  • LizardFS
  • MooseFS
  • infinit.one

#Downloaders

Torrents

  • deluge
  • transmission
  • rtorrent

There are a couple of core requirements for our downloader:

  • catchall watch folder (/mnt/blackhole/*.torrent) should work correctly and download to "unsorted"
  • dynamic watch directories
  • download all torrents to /mnt/processing directory
  • redirect rtorrent daemon logs to STDOUT
  • move completed downloads into dynamic /mnt/downloads subdirectories. 1 2
  • DEPOT default user/password authentication for webui
  • auto-labeling by watch folder compatible with flood
  • scheduling/QoS
  • Auto cleanup? Completed torrents that are stopped and older than 2 months?
  • stop seeding when download is complete
  • Performance tuning
  • logrotate
  • better logging.
  • ensure that deleting a partially downloaded/inprogress torrent will actually delete the associated data
    • when deleting a torrent we should always delete the .torrent file too
    • when deleting a torrent, sometimes the download directory is not deleted.