Skip to content

Commit

Permalink
feat(serialization): Store relative offsets for tensor data and headers
Browse files Browse the repository at this point in the history
Instead of storing the absolute file position of header entries
and tensor data, this change stores their offsets relative to the
beginning of their respective segment (e.g. the header segment, or the
data segment). This makes it easier to create and edit headers without
needing to already know where all prior segments end.

Information about absolute offsets are instead stored on a
segment-by-segment basis in a "layout" section of the metadata,
preceding the metadata and header sections.
  • Loading branch information
Eta0 committed Jul 18, 2024
1 parent d7ecd23 commit fae932e
Show file tree
Hide file tree
Showing 2 changed files with 286 additions and 121 deletions.
Loading

0 comments on commit fae932e

Please sign in to comment.