Damit der Spider endlich auch auf einer Hetzner-VM durchläuft #363
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
marians
commented
May 9, 2024
|
|
||
| echo "" | ||
| echo "Set 'sysctl vm.overcommit_memory=1' to avoid OOM errors and allow background saving in redis" | ||
| $SSHCMD sysctl "vm.overcommit_memory=1" |
There was a problem hiding this comment.
Ohne das loggt redis, dass es beim Persistieren von Daten zu Fehlern kommen kann.
marians
commented
May 9, 2024
|
|
||
| echo "" | ||
| echo "Creating volume directories for redis" | ||
| $SSHCMD mkdir -p ./volumes/redis-data && chmod 777 ./volumes/redis-data |
There was a problem hiding this comment.
Sicher stellen, dass das Volume für den Redis Prozess schreibbar ist.
marians
commented
May 9, 2024
| echo "" | ||
| echo "Allow writing to various paths in the redis container" | ||
| $SSHCMD docker compose exec redis chown -R redis:redis /var/spool/cron | ||
| $SSHCMD docker compose exec redis chown -R redis:redis /etc |
There was a problem hiding this comment.
Redis hat laut logs versucht, in diese Verzeichnisse zu schreiben, hatte aber keine Berechtigung.
marians
commented
May 9, 2024
| echo "Pulling container images" | ||
| $SSHCMD docker compose pull --quiet redis manager | ||
| echo "Pulling redis container image" | ||
| $SSHCMD docker compose pull redis |
There was a problem hiding this comment.
Wir pullen erst mal nur das redis image. Das green spider image braucht lang, deshalb machen wir das später.
marians
commented
May 9, 2024
| ports: | ||
| - "6379:6379" | ||
| - "127.0.0.1:6379:6379" |
There was a problem hiding this comment.
Das stellt sicher, dass der Port nur von der lokalen Maschine aus zugänglich ist.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Bisher brach der Spider immer ab, weil irgendwann die Job Queue leer war. Das lag letztlich wohl daran, dass der redis Service für die Welt zugänglich und schreibbar war.
Hier werden noch ein paar andere Dinge verbessert und Chromium aktualisiert.