I'm integrated PhD student in Seoul National University advised by professofr Jinho Lee.

I'm currently interested in developing optimzied distributed system for deep learning.

Skills

• High-level Synthesis (HLS)
• Verilog HDL
• CUDA, OpenCL
• PyTorch, Python
• C/C++
• Git
• Javascript, Typescript

Papers

• Pipette: Automatic Fine-Grained Large Language Model Training Configurator for Real-World Clusters (DATE'24), to appear
• Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System (HPCA'24), to appear
• Fast Adversarial Training with Dynamic Batch-level Attack Control (DAC'23) [Paper]
• Pipe-BD: Pipelined Parallel Blockwise Distillation (DATE'23) [Paper] [Github]
• Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression (ASPLOS'23) [Paper]