Krishna Neupane, PhD
projects
Phase IV – Production Cloud Migration & GitOps
Deploy Edge Configurations to Cloud Prod (e.g. AWS EKS) To run this in production, use Terraform to provision an AWS...
Phase III – Containerization & Local Deployment
Fix Container Inter-Process Communication (IPC) and Manage VRAM Build a custom Docker image (triton-custom:24.08) that bundles Triton Server with PyTorch,...
Phase II – Config Compilation Engine
Automate Triton Configs with Jinja2 Hand-crafting Triton’s config.pbtxt files for multiple models leads to broken setups. Instead, build a simple...
Phase I- Host Prerequisites & K3s Runtime Patching
Configure GPU Access on Bare-Metal K3s First, set up your local workspace by creating directories for code, deployment files, scripts,...
Cloud-Agnostic Multi-Modal Model Serving Engine
This guide walks through setting up a local multi-modal model serving stack on single-node K3s and migrating it to AWS...
I’m fascinated by how Machine Learning and Corporate Governance can help us navigate information gaps and the beautiful, complex human networks that power our financial world.