You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
barjin opened this issue
May 16, 2025
· 0 comments
Assignees
Labels
featureIssues that represent new features or improvements to existing features.t-toolingIssues with this label are in the ownership of the tooling team.
Recent changes in Apify API added ?prefix= and ?collection= query params to the KVS /keys endpoint. We should add these to Crawlee's interfaces (and likely support this in MemoryStorage-based KVS too to keep the parity).
Motivation
parity / enabling new features from Apify API
Ideal solution or implementation, and any additional constraints
Expand the interfaces with prefix?: string and collection?: string fields. Implement a simple startsWith filter in MemoryStorage KVS implementation (for prefix). See below for collection.
Other context
While the implementation of the prefix filter is quite straightforward, I'm not sure about the collection parameter. It seems like higher-level logic and deeper investigation (whether we should / shouldn't implement this) is required.
The text was updated successfully, but these errors were encountered:
barjin
added
the
feature
Issues that represent new features or improvements to existing features.
label
May 16, 2025
featureIssues that represent new features or improvements to existing features.t-toolingIssues with this label are in the ownership of the tooling team.
Uh oh!
There was an error while loading. Please reload this page.
Recent changes in Apify API added
?prefix=
and?collection=
query params to the KVS/keys
endpoint. We should add these to Crawlee's interfaces (and likely support this inMemoryStorage
-based KVS too to keep the parity).Motivation
parity / enabling new features from Apify API
Ideal solution or implementation, and any additional constraints
Expand the interfaces with
prefix?: string
andcollection?: string
fields. Implement a simplestartsWith
filter inMemoryStorage
KVS implementation (forprefix
). See below forcollection
.Other context
While the implementation of the prefix filter is quite straightforward, I'm not sure about the
collection
parameter. It seems like higher-level logic and deeper investigation (whether we should / shouldn't implement this) is required.The text was updated successfully, but these errors were encountered: