Senior System Engineer

We are looking for a Senior Systems Software Engineer to help design and build the core infrastructure powering high-performance distributed systems. In this role, you will work on fault-tolerant, scalable infrastructure components, optimize system performance, and contribute to the architecture of low-level software that supports modern distributed computing and AI workloads.

This is an opportunity to work on technically challenging problems in systems programming, virtualization, storage, distributed systems, and performance optimization while collaborating with experienced engineers in a culture that values ownership, continuous learning, and data-driven decision-making.

Responsibilities

• Design, develop, and optimize core infrastructure components with a focus on performance, scalability, and fault tolerance.
• Own systems throughout their lifecycle—from architecture and implementation to deployment, monitoring, and production support.
• Build reliable distributed systems and improve their performance, resiliency, and operational efficiency.
• Collaborate with cross-functional engineering teams to integrate infrastructure services across the platform.
• Participate in architectural discussions and contribute to long-term technical strategy.
• Troubleshoot complex production issues involving distributed systems and low-level infrastructure.
• Analyze system performance using profiling and monitoring tools and implement performance improvements.
• Practice distributed technical leadership by leading initiatives, collaborating with peers, and supporting team success.
• Foster a collaborative engineering culture focused on continuous improvement, knowledge sharing, and learning from experience.
• Support data-driven engineering decisions through benchmarking, testing, and performance analysis.

Requirements

• 5+ years of experience developing systems software or infrastructure platforms.
• Strong expertise in at least one of the following areas:
  • Virtualization
  • Storage systems
  • Service modeling and REST API/SDK generation
  • Scientific or High-Performance Computing (HPC)
  • Kernel development
• Strong understanding of distributed systems design, implementation, and troubleshooting.
• Proficiency in at least one systems programming language such as C, C++, or Go (Golang).
• Experience with scripting languages such as Python or Bash.
• Strong Linux/Unix command-line and operating system knowledge.
• Experience with low-level monitoring and performance profiling tools (e.g. perf, eBPF, PCM).
• Bachelor's degree in Computer Science, Software Engineering, or a related technical field, or equivalent practical experience.
• Curiosity and willingness to learn new technologies and work across different areas of infrastructure engineering.

Nice to Have

• Experience with distributed AI or LLM inference frameworks such as OpenVINO or llama.cpp.
• Familiarity with distributed SQL databases such as SingleStore, CockroachDB, ScyllaDB, ClickHouse, or similar technologies.
• Experience working with high-performance networking or storage technologies.
• Knowledge of cloud infrastructure and containerized environments.
• Experience contributing to open-source systems software projects.

What We Offer

• Opportunity to work on complex, large-scale distributed infrastructure.
• Collaborative engineering culture with high technical standards.
• Ownership of impactful systems from design through production.
• Exposure to modern AI infrastructure and high-performance computing technologies.
• Long-term project with opportunities for professional growth and technical leadership.

Originally posted on Himalayas