Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Twitter API conection - Twitter pipeline #1

Open
stefi-says opened this issue Jul 4, 2023 · 4 comments
Open

Twitter API conection - Twitter pipeline #1

stefi-says opened this issue Jul 4, 2023 · 4 comments
Assignees
Labels
build somethign that need to be build or integrated to the project crtical

Comments

@stefi-says
Copy link
Member

From users feedback, been able to verifiy basic twitter information is keen. but we had no sucesss acessing the APi and using the possible endpoint that would retrive the information '2/users '( "https://api.twitter.com/2/users/by")
attached there is a text file with the code ( an example from the twitter examples folder on their github)
The error received was : 403 - user forbitten

example code
twitter_pipeline.txt
Any feedback on the code? Is this the right path to get a data pipeline and retrieve users informations like : creation_date , number_of_users , a ditribution of number of tweets trought time?

if you dont have a twitter developer account and know ho to help, reach to @stefi-says so you can schedule a meeting and she can pass app credentials .
thenaks

@stefi-says stefi-says added good first issue Good for newcomers group: sandbox crtical build somethign that need to be build or integrated to the project and removed good first issue Good for newcomers group: sandbox labels Jul 4, 2023
@stefi-says stefi-says added this to the Next Grants Round milestone Jul 4, 2023
@baokiddy
Copy link

baokiddy commented Jul 4, 2023

@stefi-says from my review, it looks like you would need at least a basic account to search for tweets and a pro to review archival data. I looked at the API documentation and noticed the pricing/ access. Do you have the Free/Basic access?

Screenshot 2023-07-04 at 21 34 04

@stefi-says
Copy link
Member Author

stefi-says commented Jul 6, 2023

@baokiddy I have a free one . I got confused because here on this page
it does not specify wich type of account I would need , only the developer account with the APP Keys and so on.
image

@stefi-says stefi-says pinned this issue Jul 6, 2023
@poupou-web3
Copy link
Member

Using the tweepy library may be useful here as it will abstract the complexity of writing the requests and handling all the error cases.
https://github.com/tweepy/tweepy
Documentation for API v2: https://docs.tweepy.org/en/latest/client.html I would recommend using this as it is the last one and the project is just starting.
An example I pushed is available here, please set your environment variable using the template.env and rename it to .env and verify the requirements.
https://github.com/poupou-web3/Mirall0x/blob/main/main/main/twitter.ipynb
With the free tier only 3 endpoints are available. Using the basic tier should be enough.

@stefi-says stefi-says self-assigned this Sep 19, 2023
@stefi-says
Copy link
Member Author

@gus-araujo is working on the issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build somethign that need to be build or integrated to the project crtical
Projects
None yet
Development

No branches or pull requests

3 participants