AI Fabric Architect
About this role
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.
As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.
About this role
You are the architect of the network that our GPU clusters run on. You own the fabric end to end, from the NIC in each GPU server through the spine and leaf across the AI fabric, and you know that in AI infrastructure the network is core to the machine. As fal brings its own GPU capacity online across multiple sites, you will define the fabric architecture every site is built from, and then personally make sure it gets built and performs. This is not an architecture-only role. We are a small team moving fast, and the right person is as comfortable writing a port map, tracing a bad optic, or tuning congestion control on the data center floor as they are setting technical direction.
What you will do:
Own the fabric architecture for every site: GPU backend fabric (InfiniBand and/or RoCEv2), and GPU frontend Fabric
Choose topologies and make the key calls: rail-optimized vs. other designs, InfiniBand vs. Ethernet, oversubscription ratios, and how the fabric scales from one pod to many
Turn the architecture into a repeatable network blueprint: cabling plans, port maps, fabric addressing and routing design, and a fabric bill of materials (switches, NICs, optics, cables)
Get hands-on with bring-up at each site: be on the floor for the first racks, validate cabling and firmware, configure the fabric manager and switches, and run performance acceptance (NCCL tests, burn-in) before capacity goes live
Tune for real workload performance: congestion control, PFC/ECN, adaptive routing, and NCCL settings for both inference and training traffic
Debug fabric problems wherever they show up, from a flapping link to a job that’s mysteriously slow
Evaluate and select AI Fabric vendors and hardware, and push back with data when something doesn’t meet spec
Collaborate across automation and software to help build network monitoring, telemetry, and automation that let a small team run a large fleet, and be the top escalation point for AI Fabric incidents
Document as you go so each new site is faster than the last, and help hire and mentor the network engineers who join after you
Qualifications:
7+ years in data center or HPC networking, including direct responsibility for production GPU cluster fabrics
A track record of taking GPU fabrics from empty racks to production, with your own hands on the work, not only through vendors or integrators
Deep expertise in InfiniBand (NDR/XDR, UFM, subnet management) and/or RoCEv2 lossless Ethernet
Strong command of rail-optimized and Clos/fat-tree designs, BGP/ECMP, and EVPN/VXLAN
A clear understanding of how fabric design and tuning affect collective communication and real workload performance
Comfortable automating with Python, Ansible, or similar
Strong Linux skills and the ability to debug across the boundary between host, NIC, and fabric
Sound judgment on tradeoffs between cost, performance, reliability, and time to deploy
NVIDIA Quantum/Spectrum-X, ConnectX-7/8, BlueField-3 SuperNICs, and/or Broadcom Tomahawk 5-class Ethernet
400G/800G OSFP optics, AOC/DAC, MPO trunking
Nice to have:
Experience at a neocloud, hyperscaler AI infrastructure team, NVIDIA networking, or an AI factory integrator
Experience with NVLink / NVL72-class rack-scale systems and how they change scale-out fabric design
Experience with GPUDirect RDMA and GPUDirect Storage networks
Experience building out multiple sites in parallel or on aggressive timelines
Willingness to travel frequently to data center sites, especially during build-outs
What we offer at fal:
Interesting and challenging work
Competitive salary and equity
A lot of learning and growth opportunities
We offer relocation assistance to San Francisco.
Health, dental, and vision insurance (US)
Regular team events and offsite
U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION:
fal provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.
Find Jobs in Germany on Arbeitnow