Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unrepairable repository corruption when using flaky FUSE drive as repository #1164

Open
intgr opened this issue Jun 13, 2024 · 1 comment
Open
Labels
S-triage Status: Waiting for a maintainer to triage this issue/PR

Comments

@intgr
Copy link
Contributor

intgr commented Jun 13, 2024

This is a whole saga and not Rustic's fault.

All of this has been with stable Rustic version v0.7.0

I tried using GNOME's OneDrive integration (gvfs-daemon via FUSE) as my backup repository. Due to memory leaks, gvfsd-onedrive kept crashing (killed by OOM killer), resulting in Rustic reporting an I/O error in the middle of the backup. I retried lot of times and tried to cancel the backup manually before the system ran out of memory, and eventually completed the backup this way. (Some irrelevant details here: #1161 (comment))

But the resulting repository has some unfixable corruption. I would be even more impressed with rustic if were able to fix this mess. 😆


rustic check is now reporting lots of issues. I ran both rustic repair index and rustic repair snapshots a few times. They seemed to complete successfully, but this has not solved the corruption.

During index check there are warnings like:

[WARN] pack 0a9c4874 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.

And later from checking trees I get errors:

[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 4c3eb6e0 is missing in index

I later switched from GVFS to using rclone to access OneDrive. With rclone, on the same repo, I'm seeing following errors and also panics, see comment below.

http: invalid Content-Length of "-4294967260"

Full output from `rustic check`
[INFO] using config /home/[...]/.config/rustic/marti-onedrive.toml
[INFO] repository rclone:[...]:Rustic/[...]: password is correct.
[INFO] using cache at /home/[...]/.cache/rustic/cb7a46d5c182130aef5d93db778cfc00a7bb6f7ae56012f66b7bee0c54bf1424
[00:00:00] checking Snapshot in cache...  ████████████████████████████████████████  23.70 KiB/23.70 KiB  11.59 MiB/s  (ETA 0s)
[00:00:00] checking Index in cache...     ████████████████████████████████████████  20.04 MiB/20.04 MiB  1.46 GiB/s   (ETA 0s)
[00:00:00] reading index...               ████████████████████████████████████████         61/61
[00:00:00] listing packs...               ⠁
[WARN] pack 022d8fbe not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 0a9c4874 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 10d9c666 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 136cae46 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 19ec19df not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 21bc573a not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 2ba9f91f not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 2cc02d93 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 2f0cdf05 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 3530d311 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 3951ae4e not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 3ddc1aad not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 420db463 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 4874f11b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 46fed4d0 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 474c7c9e not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 4b4ff701 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 4dfecfdf not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 50eaef64 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 545a8614 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 55e955cf not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 56ce9c76 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 650e3362 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 6550b4d0 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 6b37d990 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 747b9d33 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 71643f37 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 75691078 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 850446d3 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 876d9b13 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 88e6777b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 912dd04d not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 9a88fbd3 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack 9d52ee22 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack af32416b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack b2624c6b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack b65f12ea not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack b6de6d89 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack ba5f0442 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack bc07e832 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack c7722913 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack ca6c52ca not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack cd7318f8 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack c9767f0c not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack d015e6f1 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack e398c00c not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack e8742332 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack e8d0842c not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack ef6f5329 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[WARN] pack ef8d3a9e not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.
[00:00:08] listing packs...
[00:00:00] cleaning up packs from cache...
[00:00:02] checking packs in cache...     ████████████████████████████████████████  47.12 MiB/47.12 MiB  22.32 MiB/s  (ETA 0s)
[00:00:00] reading snapshots...           ████████████████████████████████████████         44/44
[00:00:00] checking trees...              ███████████████░░░░░░░░░░░░░░░░░░░░░░░░░         17/44
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 72b66821 is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 4c3b7108 is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob c26d59d0 is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob b1c19b66 is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob a6ed1174 is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 88cc57d4 is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 78c6055c is missing in index
[ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob be58285f is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 9efb5d7a is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob f08caef2 is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob ba1638c9 is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 36cb2bfa is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 28b66535 is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 188d037d is missing in index
[ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob ff1e4e12 is missing in index
[ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob e8202087 is missing in index
[ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob 264dc4f9 is missing in index
[ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob 510df1c3 is missing in index
[ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob 29b6e480 is missing in index
[ERROR] file "home/[...]/patched.zip" blob 2602bcdf is missing in index
[ERROR] file "home/[...]/patched.zip" blob e709ab28 is missing in index
[ERROR] file "home/[...]/patched.zip" blob 10954fa3 is missing in index
[ERROR] file "home/[...]/patched.zip" blob 7c57c086 is missing in index
[ERROR] file "home/[...]/patched.zip" blob 3baa20ec is missing in index
[ERROR] file "home/[...]/patched.zip" blob c85bcc59 is missing in index
[ERROR] file "home/[...]/patched.zip" blob 7242f01f is missing in index
[ERROR] file "home/[...]/patched.zip" blob 761c6fdd is missing in index
[00:00:00] checking trees...              ██████████████████░░░░░░░░░░░░░░░░░░░░░░         20/44
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 34bbcc60 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 7592aa0c is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 0fefefe4 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob c0d191d5 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 5e5c671e is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob f209cd78 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 657ae1d8 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 49c8ae01 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 507c8e13 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 69aa35fa is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 08de151d is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 3d337be2 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 2c5b07f2 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 91eaab56 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 62c5f1a1 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob ab8709ca is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob f5e4d313 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 261d3a60 is missing in index
[ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 3167a61a is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 4ec93d0b is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 74853669 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 8b9941bc is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 5905c174 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 65122353 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 15010372 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 96240ba4 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 5a45f750 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 86633c65 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob aa16e46e is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob eb48beec is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 193f5653 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 77bb1e66 is missing in index
[ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob c001682a is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 00a9edf0 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 74d92352 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 0b42f0b9 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4d7ed4b9 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 319ee5f7 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob e460645e is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob c3835f11 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 5cd2a440 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 5839e80b is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 5c3e564a is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4a6d8a67 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 24598d33 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob fb108c24 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob f2f2e15a is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob d8a1d357 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 49a66195 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4f3558c5 is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 7173d21f is missing in index
[ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4afe71a7 is missing in index
[ERROR] file "home/[...]/loader.sin" blob 0de5e0c8 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 9efb5d7a is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob f08caef2 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob ba1638c9 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 36cb2bfa is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 28b66535 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 188d037d is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob ff1e4e12 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 9efb5d7a is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob f08caef2 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob ba1638c9 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 36cb2bfa is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 28b66535 is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob 188d037d is missing in index
[ERROR] file "home/[...]/system.new.dat.br" blob ff1e4e12 is missing in index
[00:00:00] checking trees...              ███████████████████░░░░░░░░░░░░░░░░░░░░░         21/44
[ERROR] file "home/[...]/.supersu" blob 2a7c8f80 is missing in index
[ERROR] file "home/[...]/loader.sin" blob 0de5e0c8 is missing in index
[ERROR] file "home/[...]/partition-image.sin" blob 8a95556e is missing in index
[ERROR] file "home/[...]/simlock.ta" blob 22fb01d5 is missing in index
[ERROR] file "home/[...]/system.sin" blob 7f485271 is missing in index
[ERROR] file "home/[...]/system.sin" blob aff78f42 is missing in index
[ERROR] file "home/[...]/system.sin" blob 8975f647 is missing in index
[ERROR] file "home/[...]/system.sin" blob 3a93473e is missing in index
[ERROR] file "home/[...]/system.sin" blob cc327927 is missing in index
[ERROR] file "home/[...]/system.sin" blob 7e264cc5 is missing in index
[ERROR] file "home/[...]/system.sin" blob c692f6fd is missing in index
[ERROR] file "home/[...]/system.sin" blob 8a7aeab4 is missing in index
[ERROR] file "home/[...]/system.sin" blob a9a5cbaf is missing in index
[ERROR] file "home/[...]/system.sin" blob 16b3f059 is missing in index
[ERROR] file "home/[...]/system.sin" blob c45fbf2e is missing in index
[ERROR] file "home/[...]/system.sin" blob 43e84ebc is missing in index
[ERROR] file "home/[...]/system.sin" blob 3bfa72a6 is missing in index
[ERROR] file "home/[...]/system.sin" blob a238ce69 is missing in index
[ERROR] file "home/[...]/system.sin" blob e03355d2 is missing in index
[ERROR] file "home/[...]/userdata.sin" blob f573ff0a is missing in index
[ERROR] file "home/[...]/userdata.sin" blob e9b73e36 is missing in index
[ERROR] file "home/[...]/userdata.sin" blob 20346769 is missing in index
[ERROR] file "home/[...]/userdata.sin" blob e7c42c76 is missing in index
[ERROR] file "home/[...]/loader.sin" blob 0de5e0c8 is missing in index
[ERROR] file "home/[...]/partition-image_S1-SW-LIVE-DE72-PID1-0002-MBR.sin" blob 8a95556e is missing in index
[ERROR] file "home/[...]/userdata_S1-SW-LIVE-DE72-PID1-0002-S1-PARTITION.sin" blob 20346769 is missing in index
[00:00:00] checking trees...              █████████████████████████░░░░░░░░░░░░░░░         28/44
[ERROR] file "home/[...]//CERT.RSA" blob 6617381d is missing in index
[ERROR] file "home/[...]/CERT.SF" blob f514803a is missing in index
[ERROR] file "home/[...]/MANIFEST.MF" blob 43ac727d is missing in index
[00:00:00] checking trees...              ██████████████████████████░░░░░░░░░░░░░░         29/44
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob c7c281bd is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 4c3eb6e0 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 6c49e7cb is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob fafddba0 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 046d1af2 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob bc97df21 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob e826908d is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 61aae48c is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 61f23dea is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob a9b76a30 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 29664bd4 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 4559e0cd is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 9dfa6f6c is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 2f48f15f is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob ba743a69 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob e4bcd365 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 7f5adadb is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 77101d97 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 30753dbe is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 5d78b5a6 is missing in index
[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob f0800c21 is missing in index
[00:00:00] checking trees...              ███████████████████████████░░░░░░░░░░░░░         30/44
[ERROR] file "home/[...]" blob 10a114a0 is missing in index
[00:00:00] checking trees...              ████████████████████████████████████████         44/44
@github-actions github-actions bot added the S-triage Status: Waiting for a maintainer to triage this issue/PR label Jun 13, 2024
@intgr
Copy link
Contributor Author

intgr commented Jun 13, 2024

After switching from GVFS to rclone, I'm getting new errors about invalid Content-Length.

It's also weird that rustic repair index gives different results from different invocations. Every time I run it, it seems to "switch" between the two following behaviors...

[WARN] error reading pack 850446d3 (not processed): Failed reading binary representation of the pack header
[00:00:00] reading pack headers           ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░          1/50
[INFO] rclone output: 2024/06/13 18:03:48 http: invalid Content-Length of "-4294967292"
[...]
[00:00:16] reading pack headers           ████████████████████████████████████████         50/50

And at other times this makes repair index panic and abort. Running with RUST_BACKTRACE=1

[INFO] pack ef8d3a9e: size computed by index: 36, actual size: 0, will re-read header
[INFO] pack b65f12ea: size computed by index: 36, actual size: 0, will re-read header
[INFO] pack 50eaef64: size computed by index: 36, actual size: 0, will re-read header
[00:00:00] reading index...               ████████████████████████████████████████         62/62
[00:00:00] reading pack headers           ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░          0/50                                            
[INFO] rclone output: 2024/06/13 18:08:42 http: invalid Content-Length of "-4294967260"


The application panicked (crashed).
Message:  split_off out of bounds: 32 <= 0
Location: /build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/bytes-1.5.0/src/bytes.rs:363

  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ BACKTRACE ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
   1: __libc_start_main<unknown>
      at <unknown source file>:<unknown line>

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.
Run with RUST_BACKTRACE=full to include source snippets.
zsh: IOT instruction (core dumped)  RUST_BACKTRACE=1 rustic --use-profile=marti-onedrive repair index

When I re-build with debug profile, it fails with a different error quite early:

[INFO] using config /home/[...]/.config/rustic/marti-onedrive.toml
[INFO] repository rclone:[...]:Rustic/[...]: password is correct.
[INFO] using cache at /home/[...]/.cache/rustic/cb7a46d5c182130aef5d93db778cfc00a7bb6f7ae56012f66b7bee0c54bf1424
[00:00:07] listing packs...
[00:00:00] reading index...               ████████████████████████████████████████         61/61
[00:00:00] reading pack headers           ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░          0/50
The application panicked (crashed).
Message:  attempt to subtract with overflow
Location: /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/repofile/packfile.rs:273

  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ BACKTRACE ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
                                ⋮ 8 frames hidden ⋮
   9: core::panicking::panic::h8ddd58dc57c2dc00
      at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panicking.rs:145
  10: rustic_core::repofile::packfile::PackHeader::from_file::hff56f5fbde035331
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/repofile/packfile.rs:273
  11: rustic_core::commands::repair::index::RepairIndexOptions::repair::hd355066ea134323b
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/commands/repair/index.rs:132
  12: rustic_core::repository::Repository<P,S>::repair_index::h5e3f7c65ddc36b56
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/repository.rs:1165
  13: rustic_rs::commands::repair::IndexSubCmd::inner_run::h691bfa9802d6bd96
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:64
  14: <rustic_rs::commands::repair::IndexSubCmd as abscissa_core::runnable::Runnable>::run::hcd79e93179d8ac5c
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:53
  15: rustic_rs::commands::repair::_DERIVE_Runnable_FOR_RepairSubCmd::<impl abscissa_core::runnable::Runnable for rustic_rs::commands::repair::RepairSubCmd>::run::hcf42d39c02b230c6
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:18
  16: <rustic_rs::commands::repair::RepairCmd as abscissa_core::runnable::Runnable>::run::hf55ad7e4798d73f6
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:47
  17: rustic_rs::commands::_DERIVE_Runnable_FOR_RusticCmd::<impl abscissa_core::runnable::Runnable for rustic_rs::commands::RusticCmd>::run::hc9fe3f27537c2212
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands.rs:66
  18: <rustic_rs::commands::EntryPoint as abscissa_core::runnable::Runnable>::run::h1e13c05e0b539332
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands.rs:162
  19: abscissa_core::application::Application::run::h7e1d4be225564626
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/abscissa_core-0.7.0/src/application.rs:61
  20: abscissa_core::application::boot::h7426452f266f429c
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/abscissa_core-0.7.0/src/application.rs:176
  21: rustic::main::h95a53ce26a54442e
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/bin/rustic.rs:28
  22: core::ops::function::FnOnce::call_once::h89fb5b7a2d8c3881
      at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250
                                ⋮ 15 frames hidden ⋮

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.
Run with RUST_BACKTRACE=full to include source snippets.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-triage Status: Waiting for a maintainer to triage this issue/PR
Projects
None yet
Development

No branches or pull requests

1 participant