Application Guide

How to Apply for Senior Software Engineer (AI Inference & Runtime Platform)

at AZX, PBC.

🏢 About AZX, PBC.

AZX, PBC. is a public benefit corporation founded in 2024, profitable from inception, and focused on AI transformation for climate and sustainability. They work with industry leaders in real estate, energy, logistics, and utilities, applying physics-informed ML to solve critical environmental challenges.

About This Role

This role is central to AZX's AI infrastructure, owning the inference control plane and Kubernetes layer that powers their models. You'll work on scale-to-zero economics, cold-start optimization, and per-token cost accounting, directly impacting the efficiency and scalability of AI solutions for climate and sustainability.

💡 A Day in the Life

You'll start by reviewing system metrics and alerts for the inference platform, then collaborate with ML engineers to deploy new models. You might spend time writing Kubernetes operators or tuning autoscaling policies, and end the day by documenting decisions and planning for cost optimization.

🎯 Who AZX, PBC. Is Looking For

  • Expert in Kubernetes operators, autoscaling, and node lifecycle management in production environments.
  • Strong background in building and operating inference platforms for open-weight models, with experience in GPU cloud management.
  • Proficient in cost optimization strategies for AI workloads, including scale-to-zero and per-token accounting.
  • Comfortable with remote work and passionate about applying AI to climate and sustainability challenges.

📝 Tips for Applying to AZX, PBC.

1

Highlight specific projects where you built or operated inference platforms on Kubernetes, mentioning scale-to-zero and cost accounting.

2

Demonstrate experience with open-weight models (e.g., Llama, Mistral) and custom model deployment.

3

Quantify impact: e.g., 'Reduced inference costs by 40% through autoscaling' or 'Improved cold-start times by 50%'.

4

Show alignment with the company's mission by discussing any climate or sustainability-related work or interests.

5

Tailor your resume to emphasize infrastructure, reliability, and cost-efficiency, not just feature development.

✉️ What to Emphasize in Your Cover Letter

['Express genuine interest in climate and sustainability, linking your technical skills to positive impact.', 'Emphasize your experience with Kubernetes and inference platforms, providing concrete examples of challenges you solved.', 'Mention your comfort with remote work and ability to thrive in a fast-paced, profitable startup environment.', 'Highlight your ability to work with cross-functional teams and manage complex infrastructure with a focus on reliability and cost.']

Generate Cover Letter →

🔍 Research Before Applying

To stand out, make sure you've researched:

  • Read about AZX's mission and recent projects on their website, especially their work with CBRE, LevelTen Energy, and Flexe.
  • Understand their use of physics-informed ML and how it applies to climate risk and energy systems.
  • Look into their engineering blog or any public talks to understand their technical stack and culture.
  • Check their LinkedIn for employee backgrounds and recent achievements to tailor your application.

💬 Prepare for These Interview Topics

Based on this role, you may be asked about:

1 Design a scale-to-zero inference platform: how would you handle cold starts and cost accounting?
2 Describe a time you optimized Kubernetes autoscaling for GPU workloads. What metrics did you use?
3 How do you ensure per-token cost accuracy when clients disconnect mid-stream?
4 What strategies do you use to manage node lifecycle and spot instances for cost savings?
5 How would you approach deploying a new open-weight model into production with minimal downtime?
Practice Interview Questions →

⚠️ Common Mistakes to Avoid

  • Don't submit a generic cover letter; show you've researched AZX and its mission.
  • Avoid focusing only on AI model development; emphasize infrastructure and platform engineering.
  • Don't neglect to mention remote work experience and your ability to work asynchronously.

📅 Application Timeline

This position is open until filled. However, we recommend applying as soon as possible as roles at mission-driven organizations tend to fill quickly.

Typical hiring timeline:

1

Application Review

1-2 weeks

2

Initial Screening

Phone call or written assessment

3

Interviews

1-2 rounds, usually virtual

Offer

Congratulations!

Ready to Apply?

Good luck with your application to AZX, PBC.!