Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix dataset duplicates #1872

Open
kentsanggds opened this issue Nov 7, 2024 · 1 comment
Open

Fix dataset duplicates #1872

kentsanggds opened this issue Nov 7, 2024 · 1 comment
Assignees
Labels
DGU data.gov.uk (CKAN)

Comments

@kentsanggds
Copy link
Contributor

Datasets are being duplicated on datasets created by the Scottish Spatial harvest source.

Upon further investigation no other publishers have datasets which are duplicated to the same degree which is on a daily basis.

It seems like the dataset is being duplicated because it doesn't have a current status and is not passing validation.

So we need to prevent datasets from being duplicated before running a script to clean up the data.

@kentsanggds kentsanggds added the DGU data.gov.uk (CKAN) label Nov 7, 2024
@kentsanggds kentsanggds self-assigned this Nov 7, 2024
@kentsanggds
Copy link
Contributor Author

kentsanggds commented Nov 7, 2024

PR to prevent duplicates from happening #1868 - which is bringing in updates on this PR alphagov/ckanext-spatial#11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DGU data.gov.uk (CKAN)
Projects
None yet
Development

No branches or pull requests

1 participant