Skip to content
View 100-JM's full-sized avatar

Block or report 100-JM

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
100-JM/README.md

백지명 (Jimyeong Baek)

AI infrastructure engineer. GPU serving on Kubernetes, LLM inference runtimes, and MLPerf Inference benchmarking.

Most of my day job lives in private repositories, so this page tracks what I have been able to contribute upstream.

Upstream contributions

Merged
NVIDIA/TensorRT-LLM#18865 Warn when a tool parser detects markup but extracts no tool calls a silently dropped tool call now leaves a diagnostic naming the configured parser
NVIDIA/TensorRT-LLM#18856 Cover /v1/responses in per-request perf metrics tests closed the regression gap left by an earlier fix
NVIDIA/deepops#1397 Run nvidia-smi tasks outside the ssh cgroup GPU tasks no longer die with the login session that started them
NVIDIA/deepops#1394 Do not replace the DCGM that DGX OS already ships
NVIDIA/deepops#1390 Prefer in-tree nvidia_peermem over legacy nv_peer_mem
NVIDIA/deepops#1389 Use ssh.service on Debian-family when hiding GPUs from login shells

In review
vllm-project/vllm#56582 Keep a plain CUDA arch requested alongside its a/f variant sm_100a-only kernels failed to load on B300 (CC 10.3)
NVIDIA/gpu-operator#2870 Configurable ServiceAccount for the DCGM Exporter lets IRSA / Workload Identity bind to the operator-managed exporter
mlcommons/inference#2668 Bound and pre-load the DeepSeek-R1 LiveCodeBench grader workers a grader that OOM-died was scoring its own failure as a wrong answer
mlcommons/inference#2669 Pin anthropic<1.0 in the DeepSeek-R1 evaluation requirements
mlcommons/inference#2670 Fix the llama3.1-8b Offline vLLM SUT on current vLLM
mlcommons/inference#2671 Make the llama3.1-8b run scripts and README accuracy flow runnable
mlcommons/inference#2672 Default --audit-conf to audit.config in the reference entry points
kubeflow/trainer#4045 Do not allocate a worker when runLauncherAsNode is set
kubeflow/katib#2720 Keep the skopt suggestion service from stalling and OOMing

What I work on

  • GPU serving on Kubernetes — operators, autoscaling (KEDA), multi-instance GPU, DCGM metrics
  • LLM inference runtimes — TensorRT-LLM and vLLM, quantization (FP8 / NVFP4), disaggregated serving
  • MLPerf Inference — benchmarking and submission pipelines on NVIDIA B300

Popular repositories Loading

  1. deepops deepops Public

    Forked from NVIDIA/deepops

    Tools for building GPU clusters

    Shell 1

  2. model-tuning model-tuning Public

    모델 파인튜닝

    Python 1

  3. TensorRT-LLM TensorRT-LLM Public

    Forked from NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

    Python

  4. katib katib Public

    Forked from kubeflow/katib

    Automated Machine Learning on Kubernetes

    Python

  5. trainer trainer Public

    Forked from kubeflow/trainer

    Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

    Go

  6. gpu-operator gpu-operator Public

    Forked from NVIDIA/gpu-operator

    NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

    Go