Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

twarc-cloud filter and search #6

Open
melaniewalsh opened this issue Apr 8, 2020 · 2 comments
Open

twarc-cloud filter and search #6

melaniewalsh opened this issue Apr 8, 2020 · 2 comments

Comments

@melaniewalsh
Copy link

I just discovered twarc-cloud, and I'm very excited about it! Thanks for this awesome tool.

As I've been playing around with it, however, I've run into a few problems. After configuring everything, I was able to successfully collect and download tweets from specific user timelines with the user_timeline collection template and twarc_cloud.py collection schedule /twarc_cloud.py collection download.

However, when I try to collect tweets with the filter and search collection templates, I'm encountering some issues. When I download the tweets, I get a bunch of tweet zip files, but they're all empty.

Screen Shot 2020-04-08 at 2 20 56 PM

And when I look at my cluster on AWS, it seems like something's going wrong...

Screen Shot 2020-04-08 at 2 22 46 PM

Just wondering if you know what might be happening here, or why twarc-cloud's user timeline functions might be working but not search and filter.

@justinlittman
Copy link
Owner

Hey @melaniewalsh. I'm not actively working on twarc-cloud now. You might want to check out https://gwu-libraries.github.io/sfm-ui/ as an alternative.

@Shaimaai
Copy link

Hi @justinlittman I am using twarc to generate tweets from specific hashtags but I can not get more than 30 tweets from each hashtag. could you please help?

I am using the following command: twarc search "lang:ar AND (#first_hashtag OR #socend_hashtag)" --format csv --split 100000 --output tweets_2020.csv

and I am following these steps: https://github.com/DocNow/twarc

Regards,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants