Code

Async rewrite#49

Code

Open

IsaacKhor wants to merge 86 commits intomainCCI-MOC/lsvd-rbd:mainfrom async_rewriteCCI-MOC/lsvd-rbd:async_rewriteCopy head branch name to clipboard

+3,857-13,482

Commits

Commits on Aug 13, 2024

• Change some error handling to results

  IsaacKhor

  committed
  e1220b4

  Copy full SHA for e1220b4

• Move tools to tool directory

  IsaacKhor

  committed
  382155a

  Copy full SHA for 382155a

Commits on Aug 28, 2024

• Move experiments to separate repo

  IsaacKhor

  committed
  8511638

  Copy full SHA for 8511638

• Add concurrencpp

  IsaacKhor

  committed
  735466e

  Copy full SHA for 735466e

Commits on Sep 4, 2024

• Fix folly linking

  IsaacKhor

  committed
  b61d3ce

  Copy full SHA for b61d3ce

• Add some coro utils

  IsaacKhor

  committed
  b4b7b2f

  Copy full SHA for b4b7b2f

• some changes

  IsaacKhor

  committed
  152835d

  Copy full SHA for 152835d

Commits on Sep 5, 2024

• Fix some stuff

  IsaacKhor

  committed
  b3a0581

  Copy full SHA for b3a0581

Commits on Sep 16, 2024

• Get started on complete rewrite

  IsaacKhor

  committed
  2f6cf69

  Copy full SHA for 2f6cf69

• Add cereal dep

  IsaacKhor

  committed
  67e4414

  Copy full SHA for 67e4414

Commits on Sep 18, 2024

• Implement most of the logobj code

  IsaacKhor

  committed
  76ea220

  Copy full SHA for 76ea220

Commits on Sep 19, 2024

• Implement more of lsvd

  IsaacKhor

  committed
  486a609

  Copy full SHA for 486a609

• Replace cereal with zpp_bits

  IsaacKhor

  committed
  5dc9840

  Copy full SHA for 5dc9840

• Remove unused deps

  IsaacKhor

  committed
  825dbbd

  Copy full SHA for 825dbbd

Commits on Sep 20, 2024

• Move rewrite into main src dir

  IsaacKhor

  committed
  128a909

  Copy full SHA for 128a909

• Clean up dependencies

  IsaacKhor

  committed
  75543ec

  Copy full SHA for 75543ec

Commits on Sep 24, 2024

• More implementation

  IsaacKhor

  committed
  435aa50

  Copy full SHA for 435aa50

Commits on Sep 25, 2024

• Get main running

  IsaacKhor

  committed
  2afeb4b

  Copy full SHA for 2afeb4b

Commits on Sep 26, 2024

• Get everything into a runnable state

  IsaacKhor

  committed
  8dbfbd4

  Copy full SHA for 8dbfbd4

Commits on Sep 27, 2024

• Pass sequential test

  IsaacKhor

  committed
  9456f52

  Copy full SHA for 9456f52

• Integrate back into spdk bdevs

  IsaacKhor

  committed
  ec1a2b2

  Copy full SHA for ec1a2b2

• Reorganise tests

  IsaacKhor

  committed
  000dd73

  Copy full SHA for 000dd73

• Add cachelib and zppbits wraps

  IsaacKhor

  committed
  6d3e944

  Copy full SHA for 6d3e944

• Fix ci

  IsaacKhor

  committed
  ca8fce1

  Copy full SHA for ca8fce1

Commits on Oct 1, 2024

• Set max rw size and other code review

  IsaacKhor

  committed
  d28d8e5

  Copy full SHA for d28d8e5

• Add vcpkg build files

  IsaacKhor

  committed
  def84f8

  Copy full SHA for def84f8

• Fix meson subprojects

  IsaacKhor

  committed
  e2618ae

  Copy full SHA for e2618ae

Commits on Oct 2, 2024

• Fix meson and cmake build

  IsaacKhor

  committed
  0bf5dae

  Copy full SHA for 0bf5dae

Commits on Oct 3, 2024

• Delete unused utils

  IsaacKhor

  committed
  47670db

  Copy full SHA for 47670db

• Fix build and turn lto back onn

  IsaacKhor

  committed
  a2cb5d0

  Copy full SHA for a2cb5d0

• Add tool to analyse logobjs

  IsaacKhor

  committed
  d10ce5d

  Copy full SHA for d10ce5d

Commits on Oct 4, 2024

• Fix multiple buffer mismatch bugs

  IsaacKhor

  committed
  858f897

  Copy full SHA for 858f897

• Fix read cache using the wrong key and add debug exe

  IsaacKhor

  committed
  0c046cf

  Copy full SHA for 0c046cf

• Fix rados memory leak

  IsaacKhor

  committed
  326704d

  Copy full SHA for 326704d

• Change to throwing asserts to fail ios instead of crashing

  IsaacKhor

  committed
  1482788

  Copy full SHA for 1482788

Commits on Oct 7, 2024

• Fix more bugs

  IsaacKhor

  committed
  f6e1c4e

  Copy full SHA for f6e1c4e

Commits on Oct 8, 2024

• Add more integrity verification code

  IsaacKhor

  committed
  c4045bc

  Copy full SHA for c4045bc

• Add new noop bdev type

  IsaacKhor

  committed
  3af65f0

  Copy full SHA for 3af65f0

• Add more benchmarking code

  IsaacKhor

  committed
  e022772

  Copy full SHA for e022772

• Remove vcpkg and add conan instead

  IsaacKhor

  committed
  d6102c4

  Copy full SHA for d6102c4

Commits on Oct 10, 2024

• Add latency measures

  IsaacKhor

  committed
  c57d04a

  Copy full SHA for c57d04a

Commits on Oct 14, 2024

• Swap to abseil for error handling

  IsaacKhor

  committed
  8022aa5

  Copy full SHA for 8022aa5

Commits on Oct 15, 2024

• Add more profiling code

  IsaacKhor

  committed
  3a844be

  Copy full SHA for 3a844be

Commits on Oct 16, 2024

• Fix thread pool core pin bug

  IsaacKhor

  committed
  9ceb7f3

  Copy full SHA for 9ceb7f3

• Cleanup old conan and instrumentation code

  IsaacKhor

  committed
  2b9a1a1

  Copy full SHA for 2b9a1a1

Commits on Oct 17, 2024

• Cleanup config, add uring and journal write

  IsaacKhor

  committed
  6f3b560

  Copy full SHA for 6f3b560

• Get journal fully working

  IsaacKhor

  committed
  a9df6f1

  Copy full SHA for a9df6f1

• Re-enable checkpointing

  IsaacKhor

  committed
  b9fd989

  Copy full SHA for b9fd989

Commits on Oct 18, 2024

• Fix hang on sigint exit

  IsaacKhor

  committed
  4d8e4c1

  Copy full SHA for 4d8e4c1

• Fix exit leak

  IsaacKhor

  committed
  91364e5

  Copy full SHA for 91364e5

• Update spdk to v24.09

  IsaacKhor

  committed
  aa9454e

  Copy full SHA for aa9454e

• Add support for multiple images

  IsaacKhor

  committed
  9005117

  Copy full SHA for 9005117

• Switch uring worker to poll sqes

  IsaacKhor

  committed
  e41814e

  Copy full SHA for e41814e

Commits on Oct 21, 2024

• add conanfile to dockerfile

  IsaacKhor

  committed
  11afcfa

  Copy full SHA for 11afcfa

• remove noop bdev

  IsaacKhor

  committed
  f9670f7

  Copy full SHA for f9670f7

• add more instrumentation

  IsaacKhor

  committed
  788ee7c

  Copy full SHA for 788ee7c

• switch back to meson wraps

  IsaacKhor

  committed
  51d426e

  Copy full SHA for 51d426e

• add liburing dep

  IsaacKhor

  committed
  5cd08be

  Copy full SHA for 5cd08be

• switch docker to 2404

  IsaacKhor

  committed
  5c8e8e3

  Copy full SHA for 5c8e8e3

Commits on Oct 22, 2024

• add tools to dockerfile and fix test

  IsaacKhor

  committed
  63b8800

  Copy full SHA for 63b8800

• remove obselete tools

  IsaacKhor

  committed
  120de39

  Copy full SHA for 120de39

• add python3-rados to dockerfile

  IsaacKhor

  committed
  3ba03d8

  Copy full SHA for 3ba03d8

• add cache size and path to gflags

  IsaacKhor

  committed
  3f3d3e2

  Copy full SHA for 3f3d3e2

• document new cmdline flags

  IsaacKhor

  committed
  b756614

  Copy full SHA for b756614

• Merge branch 'main' into async_rewrite

  IsaacKhor

  committed
  539f0e5

  Copy full SHA for 539f0e5

• remove old incorrect docs

  IsaacKhor

  committed
  ef3c155

  Copy full SHA for ef3c155

Commits on Oct 25, 2024

• add timing info

  IsaacKhor

  committed
  7614980

  Copy full SHA for 7614980

• Reorganise imports

  IsaacKhor

  committed
  a31a6fa

  Copy full SHA for a31a6fa

Commits on Nov 11, 2024

• Use buildx

  IsaacKhor

  committed
  002b7e2

  Copy full SHA for 002b7e2

Commits on Nov 13, 2024

• Add entrypoint to dockerfile

  IsaacKhor

  committed
  90370c6

  Copy full SHA for 90370c6

Commits on Nov 14, 2024

• Change cache stat reporting to a flag

  IsaacKhor

  committed
  beefe54

  Copy full SHA for beefe54

• Move report long ops into a flag

  IsaacKhor

  committed
  d330744

  Copy full SHA for d330744

• Move iotiming into a flag

  IsaacKhor

  committed
  0ea5c84

  Copy full SHA for 0ea5c84

• Fix iotiming flag

  IsaacKhor

  committed
  d486e81

  Copy full SHA for d486e81

Commits on Nov 15, 2024

• Move threadpool numthreads into a flag

  IsaacKhor

  committed
  202e291

  Copy full SHA for 202e291

Commits on Nov 18, 2024

• Remove hardcoded pool for new command

  IsaacKhor

  committed
  e604519

  Copy full SHA for e604519

Commits on Nov 21, 2024

• Add uring to spdk

  IsaacKhor

  committed
  10be600

  Copy full SHA for 10be600

Commits on Nov 22, 2024

• normalise nqn and port across scripts

  IsaacKhor

  committed
  f41acd0

  Copy full SHA for f41acd0

• Fix numa issues

  IsaacKhor

  committed
  cbe2e70

  Copy full SHA for cbe2e70

• Make worker thread numa restriction a flag

  IsaacKhor

  committed
  a8325c0

  Copy full SHA for a8325c0

• Default numa restriction to false

  IsaacKhor

  committed
  2414100

  Copy full SHA for 2414100

• Write simple config parser

  IsaacKhor

  committed
  2b728dc

  Copy full SHA for 2b728dc

• Print number of workers correctly

  IsaacKhor

  committed
  87a2174

  Copy full SHA for 87a2174

Commits on Nov 25, 2024

• Add dynamic scheduler

  IsaacKhor

  committed
  3a620ab

  Copy full SHA for 3a620ab

• Change spdk reactor mask to a flag

  IsaacKhor

  committed
  90d1de9

  Copy full SHA for 90d1de9

• Unset default spdk scheduler

  IsaacKhor

  committed
  7ab57bc

  Copy full SHA for 7ab57bc