Skip to content

Conversation

ravi-mosaicml
Copy link
Contributor

Switched the object store provider to take key_environ and secret_environ instead of key and secret, so secrets are not stored in the config and instead must be specified via env variables.

Closes #242

Switched the object store provider to take `key_environ` and `secret_environ` instead of `key` and `secret`, so secrests are not stored in the config and instead must be specified via env variables.
@ravi-mosaicml
Copy link
Contributor Author

@moinnadeem
Copy link
Contributor

I can confirm that this works.

To confirm that secrets aren't logged, see this WandB run, and you can view that the secrets aren't shown.

To confirm that the run directory is still uploaded properly, this GCS link shows the YAML that corresponds with the WandB run.

Overall, LGTM. Great work getting that in so quickly @ravi-mosaicml!

@hanlint
Copy link
Contributor

hanlint commented Jan 22, 2022

We will merge this after the CI/CD re-run is finished.

@hanlint hanlint merged commit c9bdaab into dev Jan 22, 2022
@hanlint hanlint deleted the ravi/remove_secrests branch January 22, 2022 01:54
coryMosaicML pushed a commit to coryMosaicML/composer that referenced this pull request Feb 23, 2022
Switched the object store provider to take `key_environ` and `secret_environ` instead of `key` and `secret`, so secrests are not stored in the config and instead must be specified via env variables.

Co-authored-by: hanlint <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Don't upload certain hparams to experiment tracking services
3 participants