Agentic Compiler Engineer

Kog builds a co-designed inference stack for real-time AI agents on standard datacenter GPUs, spanning model architecture, inference engines, compilers, and low-level GPU kernels. As an Agentic Compiler Engineer, you will work directly on AGCO, Kog's agentic compiler designed to optimize LLMs across different GPUs and optimization targets. The goal is to build a system that can explore ways to optimize LLM execution, generate changes, compile them, check correctness, run them on real hardware, measure results, and use feedback to guide the next optimization.

You will contribute to compiler and IR design, optimization passes, lowering and code generation, search methods for exploring implementations, verification and correctness checks, GPU execution and profiling, and LLM inference optimization. The team has 10 people including 9 engineers and researchers with 4 PhDs, working on cutting-edge problems in AI infrastructure.