Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] Support for Google Search API keys #529

Open
advanced4 opened this issue Sep 14, 2020 · 2 comments
Open

[Enhancement] Support for Google Search API keys #529

advanced4 opened this issue Sep 14, 2020 · 2 comments

Comments

@advanced4
Copy link

Feature Request
Support using an API key for Google search, which would include Google dependent sources like Linkedin, Twitter, & Trello. Google & Linkedin are particularly great sources of information, but Google is very quick to rate limit requests.

Describe the feature request or bug or other
Add a new source, "google_api" which supports using a Google Search API/CSE key

@NotoriousRebel
Copy link
Collaborator

Google's rate limiting is a bit much which is why we plan on adding socks5 proxy capabilities eventually. Once that is added do you think pursuing the Google API key would still be worth it?

@advanced4
Copy link
Author

I'm not sure - it would certainly help, but I tried earlier today with regular HTTP proxies and they are all already rate-limited by Google, so thus far proxies aren't helpful.

Google API includes (I think) 100 queries per day for free, which would go a long way. A similar project https://github.com/sundowndev/PhoneInfoga/blob/v1.11/lib/googlesearch.py#L99 implemented it this way. I've only glossed over theHarvester's code base, but hopefully this is a light lift to integrate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants