Skip to content

Issues: apify/crawlee

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

109 Open 711 Closed
109 Open 711 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Consider porting over ContextPipeline from the Python counterpart t-tooling Issues with this label are in the ownership of the tooling team.
#2479 opened May 20, 2024 by janbuchar 4.0
Replace spaces with tabs for indentation t-tooling Issues with this label are in the ownership of the tooling team.
#2476 opened May 20, 2024 by janbuchar 4.0
Rename Job from statistics module to RequestProcessingRecord debt Code quality improvement or decrease of technical debt. t-tooling Issues with this label are in the ownership of the tooling team.
#2474 opened May 17, 2024 by janbuchar 4.0
Improve docs about request locking feature Issues that represent new features or improvements to existing features.
#2467 opened May 15, 2024 by drobnikj
1
handledRequestCount from requestQueue.getInfo() after restart is 0 bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2465 opened May 14, 2024 by Bec-k
1 task
1
Trouble unzipping sitemap.xml (zlib: incorrect header check) bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2461 opened May 14, 2024 by barjin
1 task done
5
Support reading sitemap from a variable feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2460 opened May 14, 2024 by AAverin
AdaptivePlaywrightCrawler: programmatically deciding when to render JS feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2446 opened May 5, 2024 by blinjrm
3
Refactor retireOnBlockedStatusCodes to isBlockedStatusCode and move the retiring out of the Session class t-tooling Issues with this label are in the ownership of the tooling team.
#2441 opened May 2, 2024 by janbuchar 4.0
Handle Crawl-delay directive in robots.txt feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2436 opened Apr 29, 2024 by janbuchar
Race conditions in CI/CD bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2417 opened Apr 10, 2024 by barjin
@vladfrangu
4
Statistics does not use crawler log bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2412 opened Apr 9, 2024 by rougsig
1 task
1
Support for crawling from secondary IP address feature Issues that represent new features or improvements to existing features. t-c&c Team covering store and finance matters. t-console Issues with this label are in the ownership of the console team. t-tooling Issues with this label are in the ownership of the tooling team.
#2409 opened Apr 8, 2024 by teammakdi
1
The request queue scans all 450k (99.999% of which are done towards the end) requests for each iteration bug Something isn't working. t-c&c Team covering store and finance matters. t-console Issues with this label are in the ownership of the console team. t-tooling Issues with this label are in the ownership of the tooling team.
#2406 opened Apr 7, 2024 by zopieux
1 task
@vladfrangu
2
Issue with decoding quotation mark bug Something isn't working. t-c&c Team covering store and finance matters. t-console Issues with this label are in the ownership of the console team. t-tooling Issues with this label are in the ownership of the tooling team.
#2401 opened Apr 4, 2024 by HonzaKirchner
1 task
2
Control proxy-chain's 'host' parameter from Apify's launchContext t-tooling Issues with this label are in the ownership of the tooling team.
#2434 opened Mar 27, 2024 by zuccon
@barjin
2
Pass options to browser context feature Issues that represent new features or improvements to existing features.
#2383 opened Mar 17, 2024 by cybairfly
Rename Snapshotter to something more accurate t-tooling Issues with this label are in the ownership of the tooling team.
#2378 opened Mar 12, 2024 by janbuchar 4.0
Adopt a code formatter and enforce it with CI t-tooling Issues with this label are in the ownership of the tooling team.
#2366 opened Feb 26, 2024 by janbuchar
1
Tor as proxy feature Issues that represent new features or improvements to existing features.
#2365 opened Feb 26, 2024 by atefBB
Adaptive crawling Epic An epic is a large body of work that can be broken down into a number of smaller issues. product roadmap Issues contributing to product roadmap. t-tooling Issues with this label are in the ownership of the tooling team.
#2351 opened Feb 21, 2024 by B4nan
Write an e2e test of adaptive playwright crawler t-tooling Issues with this label are in the ownership of the tooling team.
#2350 opened Feb 21, 2024 by janbuchar
@janbuchar
querySelector should be propagated to all crawling contexts t-tooling Issues with this label are in the ownership of the tooling team.
#2349 opened Feb 21, 2024 by janbuchar
@janbuchar
RestrictedCrawlingContext should not extend Record<string, unknown> bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2325 opened Feb 8, 2024 by janbuchar 4.0
2
Multiple calls to enqueueLinks with Promise.all result in a crash bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2322 opened Feb 7, 2024 by janbuchar
1 task
@vladfrangu
1
ProTip! Mix and match filters to narrow down what you’re looking for.