Skip to content

Conversation

guilload
Copy link
Member

@guilload guilload commented Sep 9, 2025

No description provided.

@guilload guilload force-pushed the guilload/remove-search-streaming-endpoint branch from 88ebceb to 04f1e7a Compare September 9, 2025 15:54
@guilload guilload force-pushed the guilload/remove-search-streaming-endpoint branch from 04f1e7a to d4c9cef Compare September 9, 2025 16:15
Copy link
Contributor

@Abdul-Andha Abdul-Andha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, I just left a question

partial_request_cache_capacity: ByteSize::mb(64),
max_num_concurrent_split_streams: 100,
max_num_concurrent_split_searches: 100,
_max_num_concurrent_split_streams: None,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we keep this in SearcherConfig if search streams is no longer supported?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SearcherConfig has the following serde attribute: #[serde(deny_unknown_fields)]. It means that when attempting to parse a searcher config, serde will error during deserialization when encountering unknown fields. If we remove the field totally, this won't be backward compatible, so we just ignore it.

@guilload guilload merged commit 4a1d9cd into main Sep 9, 2025
8 checks passed
@guilload guilload deleted the guilload/remove-search-streaming-endpoint branch September 9, 2025 18:27
@tandr
Copy link

tandr commented Sep 10, 2025

Omg, guys, why did you remove it??? I was about to use it, as I need only one field returned (id) from tens if not 100s of indexed fields, so I can verify presence of said ID in some other storage. Now I am guessing I have to use a search endpoint, paging, and send the whole indexed data over the wire just to pick up a single field? I don't remember seeing ability to pick which fields I need in search results (like Solr allows).

@guilload
Copy link
Member Author

Hi @tandr,
Maintenance burden was high and nobody is using this seriously as far as we know. Yes, you're right, Quickwit does not support field projections in the regular search endpoint. Wanna take a stab at it? I suggest adding support in the Elastic API.

fulmicoton-dd pushed a commit that referenced this pull request Sep 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants