Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add more workers support and data trimming #585

Merged
merged 38 commits into from
Oct 17, 2024
Merged

feat: add more workers support and data trimming #585

merged 38 commits into from
Oct 17, 2024

Commits on Sep 5, 2024

  1. Configuration menu
    Copy the full SHA
    21fc43c View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. Configuration menu
    Copy the full SHA
    9655dfc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0042174 View commit details
    Browse the repository at this point in the history
  3. feat(worker/paraswap): add paraswap worker (#507)

    fix: re-add paraswap content
    FrankLi123 authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    e63bc15 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    937b944 View commit details
    Browse the repository at this point in the history
  5. feat(worker/linea): add linea worker (#516)

    fix: add missing linea indexer in factory
    naaive authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    82c5ac6 View commit details
    Browse the repository at this point in the history
  6. feat(worker/base): add base worker (#499)

    Co-authored-by: frank <[email protected]>
    2 people authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    109bd19 View commit details
    Browse the repository at this point in the history
  7. build(deps): bump peter-evans/create-pull-request from 6 to 7 (#527)

    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    3dbe633 View commit details
    Browse the repository at this point in the history
  8. build(deps): bump github.com/go-playground/validator/v10 from 10.22.0…

    … to 10.22.1 (#528)
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    7fa17c7 View commit details
    Browse the repository at this point in the history
  9. build(deps): bump github.com/prometheus/client_golang from 1.20.2 to …

    …1.20.3 (#529)
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    0dc5a42 View commit details
    Browse the repository at this point in the history
  10. build(deps): bump golang.org/x/net from 0.28.0 to 0.29.0 (#530)

    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    8035458 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    c3c62f5 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    89488f9 View commit details
    Browse the repository at this point in the history
  13. feat(monitor): automatically release cronjob lock when program exits (

    …#538)
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Co-authored-by: pseudoyu <[email protected]>
    3 people authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    0361de6 View commit details
    Browse the repository at this point in the history
  14. feat(source): implement near client, data source, core worker and LiN…

    …EAR worker (#524)
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Co-authored-by: polebug <[email protected]>
    fix: missing near source
    
    fix(monitor): init near source network client in monitor (#541)
    pseudoyu authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    51c209f View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    76858c4 View commit details
    Browse the repository at this point in the history
  16. feat(worker/activitypub):implement additional support for complete Ac…

    …tivityPub Integration with full engine capability (#542)
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Co-authored-by: pseudoyu <[email protected]>
    Co-authored-by: polebug <[email protected]>
    feat(engine/worker, provider/activitypub): add files for basic activitypub data-sourcing workflow
    
    add files for basic activitypub data-sourcing workflow
    
    fix: modified the files and removed unused files for clarity
    
    feat: create 'federated' worker directory and adjust the server work logic with both 'decentralized' and 'federated' workers
    
    fix: additional modification for adoption of federated worker directory and new kafka client
    
    fix: add platform_string and worker_string to pass lint test
    FrankLi123 authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    9635a1a View commit details
    Browse the repository at this point in the history
  17. feat(worker/activitypub): implement mastodon worker to transform AP o…

    …bjects (#431)
    
    fix: include federated schema in decentralzied schema
    
    fix: replace federated schema paths with decentralized
    
    fix: fix lint errors
    
    fix: remove Type field from config file
    
    fix: set and apply the defaultStartTime value pulled from VSL
    
    feat: initialize ActivityPub network client for monitoring service
    
    fix: resolve the issue of missing module params in func fetchWorkerInfo
    
    fix: fix lint error
    
    fix: add nil check case to debug
    
    fix: fix the typo in extracting mastodon endpoint
    
    fix: add missing ActivityPub network souce cases
    
    feat: support the processing of Worker Status for independent federated workers
    
    fix: debug for missing mastodon worker status
    
    fix: initialize mastodon worker status successfully
    
    fix: add `index count` to mastodon worker status
    
    fix: combine federated handles functions into one
    
    feat(deploy): add mastodon worker template for deployment (#554)
    FrankLi123 authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    6a0b906 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    3e3d45b View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    e76695a View commit details
    Browse the repository at this point in the history
  20. feat: add networks/config api that returns all config details (#555)

    feat: add mastodon related config details (#556)
    
    
    feat: change rss to object and add default network endpoint url (#557)
    
    
    feat: add title and key in config detail (#558)
    
    
    chore: reorder the worker configs (#559)
    
    fix: change mastodon endpoint type to string (#560)
    
    
    feat: add default value and type for worker endpoint config
    pseudoyu authored and kallydev committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    d50a812 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    6384e43 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2024

  1. Configuration menu
    Copy the full SHA
    7c28cb5 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Configuration menu
    Copy the full SHA
    f9b6f81 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    39bcbc7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    054a89b View commit details
    Browse the repository at this point in the history
  4. feat(worker/mastodon): make mastodon worker revision and add federate…

    …d api modification (#574)
    
    Co-authored-by: brucexc <[email protected]>
    FrankLi123 and brucexc authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    2c1be2d View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. Configuration menu
    Copy the full SHA
    d6ef163 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6d2563c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    88ef3b0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    401ecbb View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    60689f8 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. feat(worker/mastodon): apply Postgres DB for mastodon handle storage …

    …and modify query functions (#578)
    
    Co-authored-by: brucexc <[email protected]>
    FrankLi123 and brucexc authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    47c389c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ed9a138 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Configuration menu
    Copy the full SHA
    338bbd7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fb08004 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4d9c09f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ba8f4ce View commit details
    Browse the repository at this point in the history