Skip to content

feat: support new parameters for KeyValueStore.listKeys #2974

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
barjin opened this issue May 16, 2025 · 0 comments
Open

feat: support new parameters for KeyValueStore.listKeys #2974

barjin opened this issue May 16, 2025 · 0 comments
Assignees
Labels
feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.

Comments

@barjin
Copy link
Contributor

barjin commented May 16, 2025

Recent changes in Apify API added ?prefix= and ?collection= query params to the KVS /keys endpoint. We should add these to Crawlee's interfaces (and likely support this in MemoryStorage-based KVS too to keep the parity).

Motivation

parity / enabling new features from Apify API

Ideal solution or implementation, and any additional constraints

Expand the interfaces with prefix?: string and collection?: string fields. Implement a simple startsWith filter in MemoryStorage KVS implementation (for prefix). See below for collection.

Other context

While the implementation of the prefix filter is quite straightforward, I'm not sure about the collection parameter. It seems like higher-level logic and deeper investigation (whether we should / shouldn't implement this) is required.

@barjin barjin added the feature Issues that represent new features or improvements to existing features. label May 16, 2025
@github-actions github-actions bot added the t-tooling Issues with this label are in the ownership of the tooling team. label May 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
Projects
None yet
Development

No branches or pull requests

1 participant