Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bedrock: initial sync for S3DataSource attached to KnowledgeBase #408

Open
2 tasks
jlosito opened this issue Apr 25, 2024 · 2 comments
Open
2 tasks

bedrock: initial sync for S3DataSource attached to KnowledgeBase #408

jlosito opened this issue Apr 25, 2024 · 2 comments
Labels
backlog enhancement New feature or request

Comments

@jlosito
Copy link

jlosito commented Apr 25, 2024

Describe the feature

I would like the ability to run an initial sync of a Data source that is associated with a Knowledge base through a property.

Use Case

I have a use case where I have an S3 bucket with objects already in it. I'm using this library to provision the Knowledge Base and Data source via the KnowledgeBase and S3DataSource. When the stack completes, I have to go an start an ingestion job through a script, but much rather do this via a property.

Other constructs have similar functionality, but not exactly. For instance, the Bucket construct has an autoDeleteObjects property. It does this via a custom resource. I think something similar could be achieved for the Data sources via a custom resource that simply calls StartIngestionJob.

Proposed Solution

new bedrock.S3DataSource(this, "KnowledgeBaseDataSource", {
    knowledgeBase: myKnowledgeBase,
    bucket: myBucket,
    dataSourceName: myDataSourceName,
    initialSync: true,
});

Other Information

No response

Acknowledgements

  • I may be able to implement this feature request
  • This feature might incur a breaking change
@jlosito jlosito added the needs-triage This issue or PR still needs to be triaged. label Apr 25, 2024
@krokoko krokoko added the enhancement New feature or request label Apr 25, 2024
@1vinodsingh1
Copy link

+1, Ingestion job is needed to sync with existing s3 contents.

@krokoko krokoko added backlog and removed needs-triage This issue or PR still needs to be triaged. labels Jul 15, 2024
@vaughngit
Copy link

+1, Ingestion job is needed to sync with existing s3 contents.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backlog enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants