Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

handledRequestCount from requestQueue.getInfo() after restart is 0 #2465

Open
1 task
Bec-k opened this issue May 14, 2024 · 1 comment
Open
1 task

handledRequestCount from requestQueue.getInfo() after restart is 0 #2465

Bec-k opened this issue May 14, 2024 · 1 comment
Labels
bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.

Comments

@Bec-k
Copy link

Bec-k commented May 14, 2024

Which package is this bug report for? If unsure which one to select, leave blank

@crawlee/cheerio (CheerioCrawler)

Issue description

Create a queue with a name.
Add 5 requests into the queue to it.
Exit before queue is depleted.
Restart app and check requestQueue.getInfo()
It will have handledRequestCount:0, even though totalRequestCount will be 5.

Code sample

No response

Package version

3.9.2

Node.js version

v22.1.0

Operating system

Ubuntu

Apify platform

  • Tick me if you encountered this issue on the Apify platform

I have tested this on the next release

3.9.3-beta.42

Other context

There are also problems with actual

queueInfo: {
  accessedAt: 2024-05-14T15:33:01.889Z,
  createdAt: 2024-05-14T15:32:59.541Z,
  hadMultipleClients: false,
  handledRequestCount: 1,
  id: 'c7f9d136-652e-48e1-aa44-1519a159f2c7',
  modifiedAt: 2024-05-14T15:33:01.871Z,
  name: 'foobar',
  pendingRequestCount: 0,
  stats: {},
  totalRequestCount: 2,
  userId: '1'
}

handledRequestCount:1 is incorrect, i have fetched queueInfo after await crawler.run();

@Bec-k Bec-k added the bug Something isn't working. label May 14, 2024
@Bec-k
Copy link
Author

Bec-k commented May 14, 2024

I guess that this counter is representing current runtime handled requests and not the whole handled requests of the queue...
I guess you need another counter, which will represent totalHandledRequestCount or lifetimeHandledRequestCount or overallHandledRequestCount.

@B4nan B4nan added the t-tooling Issues with this label are in the ownership of the tooling team. label May 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
Projects
None yet
Development

No branches or pull requests

2 participants