Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Atlassian Confluence] verified source #578

Open
3 of 6 tasks
t0momi219 opened this issue Oct 31, 2024 · 0 comments
Open
3 of 6 tasks

[Atlassian Confluence] verified source #578

t0momi219 opened this issue Oct 31, 2024 · 0 comments
Labels
verified source dlt source with tests and demos

Comments

@t0momi219
Copy link

t0momi219 commented Oct 31, 2024

Quick source info

  • Name of the source: atlassian confluence cloud
  • What is the data source: Rest API document

Current Status

  • I plan to write it
  • I've written it and run it for fun
  • I run it on my local laptop
  • I run it in production
  • I tried following destinations with it:
    • Snowflake
    • duckdb

What source does/will do

Please provide descriptions up to 3 most important use cases that users of this source do. Those use cases will be:

  • implemented
  • reviewed
  • demonstrated in source demo pipeline script
  • documented
    use case description is not only targeted at the developers but also by people creating test account and doing demos.

Atlassian confluence is a corporate wiki service.
Users can use it to analyze Wiki document statistics and load them into databases for RAG applications.

Test account / test data

  • I'd like dltHub to create a test account before we start
  • I have test account and can share my test data or a test account with dltHub after we merge the source

It has a free plan available, but I haven’t checked the detailed differences between the free and paid options.
https://www.atlassian.com/en/software/confluence/pricing

Additional context

I already write a source for confluence cloud here which support some endpoints.
https://github.com/t0momi219/confluence_doc_insights/tree/main/load

I created this for demonstration purposes. Confluence comes in two models, SaaS and Self-Hosting, and they have different Rest API specifications. This only supports to the Cloud version. For me, I no longer need this source for business purposes, but if there is a demand for it, I would be happy to help make it publicly available.

@t0momi219 t0momi219 added the verified source dlt source with tests and demos label Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
verified source dlt source with tests and demos
Projects
Status: Planned
Development

No branches or pull requests

1 participant