Arc Compute operates high-performance GPU clusters and is focused on improving efficiency, throughput, and reliability at scale. We’re looking for an Senior Embedded Software Engineer to help build the software that makes our GPU infrastructure faster and more efficient.
What You’ll Be Doing
- Build and improve GPU performance telemetry using CUDA, DCGM and low-level profiling data.
- Participate in exploring scheduling and optimization strategies to make multi-GPU workloads run more efficiently.
- Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI.
- Scale performance of DL models across different architectures and types of NVIDIA accelerators.
- Collaborate with team members and other partners.
What We’re Looking For
- 7+ years of work experience in software development, design patterns and software engineering principles.
- 3+ years of experience in CUDA development and GPU performance concepts.
- Proven experience owning and architecting performance-critical systems or telemetry pipelines.
- Mentorship experience or demonstrated ability to guide junior and mid-level engineers.
- C/C++ programming and software design skills. Python experience is a plus.
- Modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU.
- Familiarity with Linux environments and debugging on real hardware.
- Comfortable working onsite with GPU servers and real workloads.
- Experience with Git.
Nice to Have
- Experience deploying or operating systems in Kubernetes, Docker-based environments, or other job orchestration frameworks.
- Understanding of AI model serving backends, ML runtimes, or AI compilers (e.g., TensorRT, TVM, XLA).
- Experience with performance profiling tools such as Nsight Systems/Compute.
- Experience leading performance investigations or driving cross-team initiatives. (added senior signal)
To apply for this job email your details to zahid.iqbal@hardbootinc.com
