Principal AI/ML Platform Engineer (CA)

Key responsibilities

• Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
• Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
• Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
• Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
• Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.

Qualifications & Skills

• Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
• Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow).
• Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.

Preferred experience

• Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
• Experience with CI/CD pipelines and automation for AI model deployment and platform operations
• Strong knowledge of authentication and authorization frameworks integrated into AI platforms.…