cube-studio/job-template/job/tf
2024-11-10 18:50:51 +08:00
..
build.sh 升级20240901版本 2024-11-10 18:50:51 +08:00
Dockerfile 补充tf分布式模板 2024-01-31 16:39:01 +08:00
launcher.py 升级20240901版本 2024-11-10 18:50:51 +08:00
README.md 升级20240801版本 2024-08-19 18:51:28 +08:00

镜像ccr.ccs.tencentyun.com/cube-studio/tf:20230801

账号kubeflow-pipeline

参数:

{
    "shell": {
        "--image": {
            "type": "str",
            "item_type": "str",
            "label": "worker镜像直接运行你代码的环境镜像",
            "require": 1,
            "choice": [],
            "range": "",
            "default": "ccr.ccs.tencentyun.com/cube-studio/ubuntu-gpu:cuda11.8.0-cudnn8-python3.9",
            "placeholder": "",
            "describe": "worker镜像直接运行你代码的环境镜像 <a href='https://github.com/data-infra/cube-studio/tree/main/images'>基础镜像</a>",
            "editable": 1
        },
        "--working_dir": {
            "type": "str",
            "item_type": "str",
            "label": "命令的启动目录",
            "require": 1,
            "choice": [],
            "range": "",
            "default": "/mnt/xxx/pytorchjob/",
            "placeholder": "",
            "describe": "命令的启动目录",
            "editable": 1
        },
        "--command": {
            "type": "str",
            "item_type": "str",
            "label": "启动命令,例如 python3 xxx.py",
            "require": 1,
            "choice": [],
            "range": "",
            "default": "",
            "placeholder": "启动命令,例如 python3 xxx.py",
            "describe": "启动命令,例如 python3 xxx.py",
            "editable": 1
        },
        "--num_worker": {
            "type": "str",
            "item_type": "str",
            "label": "分布式训练worker的数目",
            "require": 1,
            "choice": [],
            "range": "",
            "default": "3",
            "placeholder": "分布式训练worker的数目",
            "describe": "分布式训练worker的数目",
            "editable": 1
        }
    }
}

环境变量

NO_RESOURCE_CHECK=true
TASK_RESOURCE_CPU=2
TASK_RESOURCE_MEMORY=4G
TASK_RESOURCE_GPU=0

示例代码

启动脚本

python demo.py

示例代码 demo.py