Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does the script works with the updated english website? #1

Open
CeMSc opened this issue Dec 22, 2022 · 2 comments
Open

Does the script works with the updated english website? #1

CeMSc opened this issue Dec 22, 2022 · 2 comments

Comments

@CeMSc
Copy link

CeMSc commented Dec 22, 2022

Hi, I have tried unsuccessfully to use your script to download articles from the English website. Is the script still working with the new KCNA website?
Thank you.

@ivantor0
Copy link
Owner

ivantor0 commented Jan 8, 2023

Hi there @CeMSc!

It probably doesn't work with the new version since you ran into some issues and I haven't updated the code since 2021. I will look into what I could do with the updated website in the nearest timeframe, hopefully 2-3 weeks. Expect an update then! In the meantime, I recommend using scrapy as a temporary solution.

@CeMSc
Copy link
Author

CeMSc commented Jan 9, 2023

Thank you for the reply and providing a recommended solution. I eventually opted to download all the articles as HTML files using Cyotek webcopy and then converting the pages in Python with Beautifulsoup. Anyway, I am sure other people will find useful an updated script.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants