Founding Senior AI Infrastructure Engineer

The posting, as Goaly wrote it

ABOUT US

We’re building toward a world where every company can become its own AI lab.
Goaly is a stealth AI startup founded by ex-Meta MSL engineers and researchers. Our mission is to dramatically lower the cost, time, and talent barriers to building proprietary AI — and make each generation of models faster and cheaper to build than the last.

Backed by leading AI investors and endorsed by frontier AI researchers and builders, we’re looking for exceptional new grads who want to work on hard, foundational AI systems problems with outsized ownership from day one.

ABOUT THE ROLE

Running modern AI workloads at scale creates systems problems that rarely fit within a single layer of the stack. A slowdown that appears in a training job may originate in a GPU kernel, collective communication, data movement, container runtime, storage path, scheduler, or interaction between model architecture and hardware topology.

You will identify these bottlenecks and build systems that improve the throughput, efficiency, and robustness of our largest distributed workloads. Your scope will span post-training, agentic reinforcement learning, model training, rollout inference, and the GPU cluster platform beneath them. You will work closely with researchers and systems engineers, develop a quantitative understanding of performance, and turn one-off investigations into durable infrastructure improvements.

This role is a strong fit for an exceptional systems or performance engineer who wants to work on frontier AI infrastructure. Deep ML experience is valuable but not required; we care most about a track record of solving difficult systems problems at scale and the ability to become fluent in new parts of the ML stack quickly.

WHAT YOU'LL DO

• Profile end-to-end AI workloads and identify limiting resources across model code, GPU kernels, memory, collective communication, networking, storage, orchestration, and environment execution.
• Build low-latency, high-throughput sampling and inference systems for large language models, including batching, scheduling, caching, load balancing, and efficient weight updates.
• Optimize GPU execution through kernel and graph profiling, memory-layout improvements, reduced-precision computation, communication overlap, compilation, and targeted CUDA or Triton work.
• Improve distributed training and reinforcement-learning performance across heterogeneous GPU and CPU workloads, variable-length rollouts, complex network topologies, and changing model architectures.
• Design quantitative performance and capacity models that predict bottlenecks, explain scaling behavior, guide hardware and topology choices, and prioritize engineering work.
• Build scheduling and load-balancing mechanisms that improve accelerator utilization while respecting memory, locality, topology, latency, and fault-domain constraints.
• Design fault-tolerant distributed systems that detect failures early, isolate their impact, recover effici

[…]
k, collective algorithms, network topology, or topology-aware workload placement.

• Experience with Linux or operating-system internals, container runtimes, Kubernetes, cluster schedulers, storage systems, or production observability.
• Familiarity with transformer architectures, language-model training, reinforcement learning, online sampling, or the performance characteristics of mixture-of-experts models.
• Meaningful contributions to open-source systems, ML frameworks, compilers, kernels, networking software, or performance tooling.

HOW WE WORK

• Mission first. We choose work for its impact on the mission and take responsibility for the outcome, not just our assigned tasks.
• High agency. We identify what is missing, form a plan, and move without waiting for perfect clarity.
• Speed with rigor. We ship, measure, and iterate quickly while protecting correctness, safety, and reliability.
• Flexible scope. We cross team and technical boundaries when that is the fastest way to solve the real problem.
• Low ego, high standards. We give direct feedback, change our minds when the evidence changes, and help the whole team win.
• Continuous learning. The stack changes quickly; we are willing to learn unfamiliar systems, methods, and domains as the work demands.

A note on qualifications. We care more about exceptional evidence than a perfect keyword match. If the work excites you and you can show unusual strength, learning speed, or ownership, we encourage you to apply even if your background does not match every preferred qualification.

EQUAL OPPORTUNITY

We are an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, genetic information, or any other characteristic protected by applicable law. We provide reasonable accommodations for candidates who need them during the hiring process.