Merge branch 'main' into feat/dynamic_resource

Author: d4l3k

.github/ISSUE_TEMPLATE/bug-report.md

@@ -37,7 +37,7 @@ Steps to reproduce the behavior:
 
 ## Environment
 
-<!-- Please run and include the output from https://github.com/pytorch/torchx/blob/main/scripts/collect_env.py. -->
+<!-- Please run and include the output from https://github.com/meta-pytorch/torchx/blob/main/scripts/collect_env.py. -->
 
  - torchx version (e.g. 0.1.0rc1):
  - Python version:

.github/ISSUE_TEMPLATE/questions-help-support.md

@@ -10,7 +10,7 @@ about: Do you need support? We have resources.
 ### Please note that this issue tracker is not a help form and this issue will be closed.
 
 Before submitting, please ensure you have gone through our
-[documentation](https://pytorch.org/torchx).
+[documentation](https://meta-pytorch.org/torchx).
 
 
 ### Question

.github/workflows/components-integration-tests.yaml

@@ -24,8 +24,6 @@ jobs:
             platform: ubuntu-latest
           - scheduler: "local_docker"
             platform: linux.24_04.4x
-          - scheduler: "ray"
-            platform: ubuntu-latest
       fail-fast: false
     runs-on: ${{ matrix.platform }}
     permissions:
@@ -61,13 +59,6 @@ jobs:
           pip install -r dev-requirements.txt
           pip install -e .[kubernetes]
 
-      - name: Start Ray
-        if: ${{ matrix.scheduler == 'ray' }}
-        run: |
-          ray start --head
-          sleep 5 # wait till the node joins so that `status` command displays the head node info
-          ray status
-
       - name: Start Kubernetes
         if: ${{ matrix.scheduler == 'kubernetes' }}
         run: |

.github/workflows/container.yaml

@@ -32,8 +32,8 @@ jobs:
         run: |
           set -eux
           torchx/runtime/container/build.sh
-          docker tag torchx "ghcr.io/pytorch/torchx:$VERSION"
+          docker tag torchx "ghcr.io/meta-pytorch/torchx:$VERSION"
       - name: Push containers
         run: |
           set -eux
-          docker push "ghcr.io/pytorch/torchx:$VERSION"
+          docker push "ghcr.io/meta-pytorch/torchx:$VERSION"

.github/workflows/gcp-batch-integration-tests.yaml

@@ -10,7 +10,7 @@ jobs:
   unittest:
     strategy:
       matrix:
-        python-version: [3.9, "3.10", 3.11, 3.12]
+        python-version: ["3.10", 3.11, 3.12]
         platform: [linux.24_04.4x]
         include:
           - python-version: 3.12

.github/workflows/kfp-integration-tests.yaml

@@ -75,7 +75,7 @@
 
 ## torchx-0.5.0
 
-* Milestone: https://github.com/pytorch/torchx/milestone/7
+* Milestone: https://github.com/meta-pytorch/torchx/milestone/7
 
 * `torchx.schedulers`
   * Kubernetes MCAD Scheduler (Prototype)
@@ -116,7 +116,7 @@
 
 ## torchx-0.4.0
 
-* Milestone: https://github.com/pytorch/torchx/milestone/6
+* Milestone: https://github.com/meta-pytorch/torchx/milestone/6
 
 * `torchx.schedulers`
   * GCP Batch (Prototype)
@@ -142,7 +142,7 @@
 
 ## torchx-0.3.0
 
-* Milestone: https://github.com/pytorch/torchx/milestone/5
+* Milestone: https://github.com/meta-pytorch/torchx/milestone/5
 
 * `torchx.schedulers`
   * List API (Prototype)
@@ -189,7 +189,7 @@
 
 ## torchx-0.2.0
 
-* Milestone: https://github.com/pytorch/torchx/milestone/4
+* Milestone: https://github.com/meta-pytorch/torchx/milestone/4
 
 * `torchx.schedulers`
     * DeviceMounts
@@ -245,7 +245,7 @@
 
 ## torchx-0.1.2
 
-Milestone: https://github.com/pytorch/torchx/milestones/3
+Milestone: https://github.com/meta-pytorch/torchx/milestones/3
 
 * PyTorch 1.11 Support
 * Python 3.10 Support
@@ -285,7 +285,7 @@ Milestone: https://github.com/pytorch/torchx/milestones/3
     * Ax runner now lives in the Ax repo https://github.com/facebook/Ax/commit/8e2e68f21155e918996bda0b7d97b5b9ef4e0cba
 * `torchx.cli`
   * `.torchxconfig`
-    * You can now specify component argument defaults `.torchxconfig` https://github.com/pytorch/torchx/commit/c37cfd7846d5a0cb527dd19c8c95e881858f8f0a
+    * You can now specify component argument defaults `.torchxconfig` https://github.com/meta-pytorch/torchx/commit/c37cfd7846d5a0cb527dd19c8c95e881858f8f0a
     * `~/.torchxconfig` can now be used to set user level defaults. #378
     * `--workspace` can be configured #397
   * Color change and bug fixes #419
@@ -301,7 +301,7 @@ Milestone: https://github.com/pytorch/torchx/milestones/3
 
 ## torchx-0.1.1
 
-* Milestone: https://github.com/pytorch/torchx/milestone/2
+* Milestone: https://github.com/meta-pytorch/torchx/milestone/2
 
 * `torchx.schedulers`
   * #287, #286 - Implement `local_docker` scheduler using docker client lib

.github/workflows/python-unittests.yaml

@@ -39,11 +39,6 @@ lintrunner init
 lintrunner -a
 ```
 
-## Integration Tests
-
-See the [KFP integration test](scripts/kfpint.py) file for more details on setup
-and running them.
-
 ## License
 By contributing to TorchX, you agree that your contributions will be licensed
 under the LICENSE file in the root directory of this source tree.

CHANGELOG.md

@@ -1,7 +1,7 @@
 [![PyPI](https://img.shields.io/pypi/v/torchx)](https://pypi.org/project/torchx/)
-[![License](https://img.shields.io/badge/License-BSD%203--Clause-blue.svg)](https://github.com/pytorch/torchx/blob/main/LICENSE)
-![Tests](https://github.com/pytorch/torchx/actions/workflows/python-unittests.yaml/badge.svg)
-![Lint](https://github.com/pytorch/torchx/actions/workflows/lint.yaml/badge.svg)
+[![License](https://img.shields.io/badge/License-BSD%203--Clause-blue.svg)](https://github.com/meta-pytorch/torchx/blob/main/LICENSE)
+![Tests](https://github.com/meta-pytorch/torchx/actions/workflows/python-unittests.yaml/badge.svg)
+![Lint](https://github.com/meta-pytorch/torchx/actions/workflows/lint.yaml/badge.svg)
 [![codecov](https://codecov.io/gh/pytorch/torchx/branch/main/graph/badge.svg?token=ceHHIm0hXy)](https://codecov.io/gh/pytorch/torchx)
 
 
@@ -19,19 +19,17 @@ TorchX currently supports:
 * AWS Batch
 * Docker
 * Local
-* Ray (prototype)
-* GCP Batch (prototype)
 
-Need a scheduler not listed? [Let us know!](https://github.com/pytorch/torchx/issues?q=is%3Aopen+is%3Aissue+label%3Ascheduler-request)
+Need a scheduler not listed? [Let us know!](https://github.com/meta-pytorch/torchx/issues?q=is%3Aopen+is%3Aissue+label%3Ascheduler-request)
 
 ## Quickstart
 
-See the [quickstart guide](https://pytorch.org/torchx/latest/quickstart.html).
+See the [quickstart guide](https://meta-pytorch.org/torchx/latest/quickstart.html).
 
 ## Documentation
 
-* [Stable Documentation](https://pytorch.org/torchx/latest/)
-* [Nightly Documentation](https://pytorch.org/torchx/main/)
+* [Stable Documentation](https://meta-pytorch.org/torchx/latest/)
+* [Nightly Documentation](https://meta-pytorch.org/torchx/main/)
 
 ## Requirements
 
@@ -55,15 +53,9 @@ pip install torchx
 # install torchx sdk and CLI -- all dependencies
 pip install "torchx[dev]"
 
-# install torchx kubeflow pipelines (kfp) support
-pip install "torchx[kfp]"
-
 # install torchx Kubernetes / Volcano support
 pip install "torchx[kubernetes]"
 
-# install torchx Ray support
-pip install "torchx[ray]"
-
 # install torchx GCP Batch support
 pip install "torchx[gcp_batch]"
 ```
@@ -79,22 +71,22 @@ pip install torchx-nightly[dev]
 
 ```bash
 # install torchx sdk and CLI from source
-$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx
+$ pip install -e git+https://github.com/meta-pytorch/torchx.git#egg=torchx
 
 # install extra dependencies
-$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]
+$ pip install -e git+https://github.com/meta-pytorch/torchx.git#egg=torchx[dev]
 ```
 
 ### Docker
 
 TorchX provides a docker container for using as as part of a TorchX role.
 
-See: https://github.com/pytorch/torchx/pkgs/container/torchx
+See: https://github.com/meta-pytorch/torchx/pkgs/container/torchx
 
 ## Contributing
 
-We welcome PRs! See the [CONTRIBUTING](https://github.com/pytorch/torchx/blob/main/CONTRIBUTING.md) file.
+We welcome PRs! See the [CONTRIBUTING](https://github.com/meta-pytorch/torchx/blob/main/CONTRIBUTING.md) file.
 
 ## License
 
-TorchX is BSD licensed, as found in the [LICENSE](https://github.com/pytorch/torchx/blob/main/LICENSE) file.
+TorchX is BSD licensed, as found in the [LICENSE](https://github.com/meta-pytorch/torchx/blob/main/LICENSE) file.