20 lines
657 B
Markdown
20 lines
657 B
Markdown
# tritonserver
|
|
|
|
Based on `nvcr.io/nvidia/tritonserver` container, but this add [Miniconda3](https://www.anaconda.com/docs/getting-started/miniconda/main), [Golang](https://go.dev/), [Singularity](https://docs.sylabs.io/guides/4.3/user-guide/)
|
|
|
|
## Mounting
|
|
|
|
| Directory | Uses |
|
|
| -------------------------- | ----------------- |
|
|
| `/workspace` | Default workspace |
|
|
| `/root/.cache/huggingface` | Huggingface cache |
|
|
|
|
## Building
|
|
|
|
```bash
|
|
TRITON_RELEASE="25.01"
|
|
docker build \
|
|
-t git.athichal.com/tonkaew131/tritonserver:${TRITON_RELEASE}-py3-sdk \
|
|
--build-arg TRITON_RELEASE=${TRITON_RELEASE} \
|
|
.
|
|
``` |