GEODES STAC API Search #753

gjmooney · 2025-06-11T15:51:30Z

Description

This adds a STAC browser implementing the GEODES API.

Checklist

PR has a descriptive title and content.
PR description contains references to any issues the PR resolves, e.g. Resolves #XXX.
PR has one of the labels: documentation, bug, enhancement, feature, maintenance
Checks are passing.
Failing lint checks can be resolved with:
- pre-commit run --all-files
- jlpm run lint

📚 Documentation preview: https://jupytergis--753.org.readthedocs.build/en/753/
💡 JupyterLite preview: https://jupytergis--753.org.readthedocs.build/en/753/lite

github-actions · 2025-06-11T15:51:39Z

👈 Launch a Binder on branch gjmooney/jupytergis/stac_browser_rebase

github-actions · 2025-06-11T16:02:25Z

Integration tests report: appsharing.space

martinRenou

Thanks! I only tested it briefly for now, will dive deeper into the code later.

packages/base/src/stacBrowser/hooks/useStacSearch.ts

packages/schema/src/schema/project/layers/stacLayer.json

martinRenou · 2025-06-23T06:46:01Z

packages/base/src/stacBrowser/hooks/useStacSearch.ts

+  isLoading: boolean;
+}
+
+const API_URL = 'https://geodes-portal.cnes.fr/api/stac/search';


Maybe for a future PR, we should think of making this user-provided. Maybe an input element in the UI to provide your endpoint for the STAC API. Or a setting.

We should also provide a way to add some API token if needed.

I was thinking we could have a drop down in the UI to select which endpoint to use, or an option in the settings would be good too.

Being able to set a specific endpoint is very important in my view. I don't think it must be in this PR, but perhaps we could have a dropdown with many options from stacindex.org pre-populated for users who might not already have an endpoint in mind, but allow them to fallback to a custom endpoint.

mfisher87

Running this locally, I'm getting CORS failures and so results always shows as 0. My proxy URL is set by default to corsproxy.io; what might I be missing?

Perhaps we could add an error indicator to the UI when the requests are failing.

I'm not sure how I feel about the STAC browser being in the sidebar. Layers are always added by dialogs and I think we should go for consistency. Do you think it would be reasonable to move it into the layer browser dialog in this PR, or should that be separate? Or should we consider a completely separate dialog?

.gitignore

mfisher87 · 2025-06-23T20:34:12Z

packages/base/src/stacBrowser/hooks/useStacSearch.ts

+  isLoading: boolean;
+}
+
+const API_URL = 'https://geodes-portal.cnes.fr/api/stac/search';


Being able to set a specific endpoint is very important in my view. I don't think it must be in this PR, but perhaps we could have a dropdown with many options from stacindex.org pre-populated for users who might not already have an endpoint in mind, but allow them to fallback to a custom endpoint.

martinRenou · 2025-06-24T06:54:14Z

we could have a dropdown with many options

👍🏽 we had the exact same discussion with Greg yesterday. Greg is looking into adding such dropdown.

I'm getting CORS failures and so results always shows as 0. My proxy URL is set by default to corsproxy.io

I have the same. It works well in plain jupyterlab, but fails for the jupyterlite deployment.

gjmooney · 2025-06-24T07:23:29Z

I'm getting CORS failures and so results always shows as 0. My proxy URL is set by default to corsproxy.io

I have the same. It works well in plain jupyterlab, but fails for the jupyterlite deployment.

(This all only applies to Lab) Just for the record, because of how the fetchWithProxies function works (it loops over proxy strategies) it still prints the error messages from attempting to use corsproxy.io even though it's the internal proxy that's meant to work. I don't really like this behavior but I didn't want to mess up anything that relies on the fallbacks so I left it as is for now.

So if you're getting 0 results something else is happening. Did you select a start time? I have it defaulted to the start of yesterday, which might be too recent.

martinRenou · 2025-06-24T07:38:33Z

I don't really like this behavior

Totally agreed. Instead of looping of the URLs and trying them all, I feel we should:

do direct fetch if on localhost
do fetch through the jupytergis-core proxy if not on localhost and not on lite
try the external CORS proxy if not on localhost and on lite.

mfisher87 · 2025-06-24T12:30:10Z

So if you're getting 0 results something else is happening. Did you select a start time? I have it defaulted to the start of yesterday, which might be too recent.

Hmm... yes, I tried to mimic the exact settings from your video recording! I'll try again today :)

gjmooney · 2025-06-24T14:07:43Z

So if you're getting 0 results something else is happening. Did you select a start time? I have it defaulted to the start of yesterday, which might be too recent.

Hmm... yes, I tried to mimic the exact settings from your video recording! I'll try again today :)

GEODES is down for maintenance until the 26th so you won't get any results today either 🙃
https://geodes.cnes.fr/infos-ops/

packages/base/src/tools.ts

martinRenou · 2025-06-25T12:11:02Z

One working API (not down today) one can try https://openveda.cloud/api/stac/search

mfisher87 · 2025-06-27T14:40:54Z

Since new commits are still coming through, could we convert to draft until it's stable for review?

martinRenou

Some comments/questions

packages/base/src/formbuilder/objectform/layer/layerform.ts

packages/base/style/shared/checkbox.css

packages/base/src/dialogs/layerBrowserWidget.tsx

packages/base/src/mainview/mainView.tsx

packages/base/style/shared/badge.css

martinRenou

Thanks!!! 💯 🥇

gjmooney mentioned this pull request Jun 11, 2025

Stac browser #737

Closed

4 tasks

gjmooney added the enhancement New feature or request label Jun 12, 2025

gjmooney force-pushed the stac_browser_rebase branch 3 times, most recently from 33532fc to 75d32d6 Compare June 18, 2025 16:05

gjmooney marked this pull request as ready for review June 18, 2025 16:30

gjmooney requested review from martinRenou and mfisher87 June 18, 2025 16:47

gjmooney mentioned this pull request Jun 19, 2025

Add architecture docs #576

Merged

4 tasks

gjmooney force-pushed the stac_browser_rebase branch 2 times, most recently from 769def8 to 42461fe Compare June 20, 2025 07:32

martinRenou requested changes Jun 23, 2025

View reviewed changes

mfisher87 reviewed Jun 23, 2025

View reviewed changes

martinRenou reviewed Jun 24, 2025

View reviewed changes

packages/base/src/tools.ts Outdated Show resolved Hide resolved

gjmooney force-pushed the stac_browser_rebase branch 2 times, most recently from 72ea9be to 71966c3 Compare June 26, 2025 07:40

gjmooney changed the title ~~Stac browser~~ GEODES STAC API Search Jun 27, 2025

martinRenou reviewed Jun 27, 2025

View reviewed changes

gjmooney force-pushed the stac_browser_rebase branch 2 times, most recently from 7b851d5 to 49a1b8b Compare June 30, 2025 15:01

Add a STAC browser

a94de63

gjmooney added 25 commits July 2, 2025 11:53

What does pre commit even do?

09b74f8

Change proj4 version

eec5fc9

types

efb6668

Add test

b8d8ef0

Use name from STAC item

18946ce

Fix STAC layer visibility bug

1ca5a6c

Fix zoom to layer for STAC layers

fb86c4b

Fix error spam in console when selecting STAC layer

88969d4

Update fetchWithProxies

54e6d8b

Update lite detection logic

3afb137

Fix and debouce bbox update signal

036ff9c

Rename signal

257d687

Add checkbox to toggle whole world bbox

60da6a3

Update test for new proxy fetch

277b993

Really though

f9029cc

Fix proxy startegy logic

acfeef9

Update pagination number labels

ead07d9

Re-fetch query on bbox change

16566c7

Remove old file

387fd38

Fix duplicate import

00c1f62

Remove layer metadata stuff

780aabc

Prepend all shared component css classnames

5815ba9

No model No fetch

ad00cab

Don't move map when adding result

184244d

Playwright appeasement

26ccb54

gjmooney force-pushed the stac_browser_rebase branch from 49a1b8b to 26ccb54 Compare July 2, 2025 09:55

martinRenou approved these changes Jul 2, 2025

View reviewed changes

martinRenou merged commit 89fd8fb into geojupyter:main Jul 2, 2025
14 checks passed

martinRenou mentioned this pull request Jul 2, 2025

Explore allowing other STAC APIs than the current Geodes one #795

Open

gjmooney deleted the stac_browser_rebase branch July 2, 2025 12:00

GEODES STAC API Search #753

GEODES STAC API Search #753

Uh oh!

Conversation

gjmooney commented Jun 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Checklist

Uh oh!

github-actions bot commented Jun 11, 2025

Uh oh!

github-actions bot commented Jun 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

martinRenou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

martinRenou Jun 23, 2025

Choose a reason for hiding this comment

Uh oh!

gjmooney Jun 23, 2025

Choose a reason for hiding this comment

Uh oh!

mfisher87 Jun 23, 2025

Choose a reason for hiding this comment

Uh oh!

mfisher87 left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

mfisher87 Jun 23, 2025

Choose a reason for hiding this comment

Uh oh!

martinRenou commented Jun 24, 2025

Uh oh!

gjmooney commented Jun 24, 2025

Uh oh!

martinRenou commented Jun 24, 2025

Uh oh!

mfisher87 commented Jun 24, 2025

Uh oh!

gjmooney commented Jun 24, 2025

Uh oh!

Uh oh!

martinRenou commented Jun 25, 2025

Uh oh!

mfisher87 commented Jun 27, 2025

Uh oh!

martinRenou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

martinRenou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

gjmooney commented Jun 11, 2025 •

edited

Loading

github-actions bot commented Jun 11, 2025 •

edited

Loading

mfisher87 left a comment •

edited

Loading