ironquill.tech/board

$ cat jobs/principal-product-manager-ai-infrastructure-and-orchestratio-datarobot-60ef6231ab93.json

Principal Product Manager, AI Infrastructure and Orchestration

datarobot·US·United States·senior
kubernetes
Apply on himalayas → Get AI match score →
Job Description: DataRobot delivers AI that maximizes impact and minimizes business risk. Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale. DataRobot empowers practitioners to deliver predictive and generative AI, and enables leaders to secure their AI assets. Organizations worldwide rely on DataRobot for AI that makes sense for their business — today and in the future. We run agents and models in production for enterprises that cannot move their workloads to a public cloud: regulated industries, sovereign deployments, air-gapped and customer-managed clusters. The control plane is the layer that makes that possible. It deploys the agents, it deploys the models those agents call, and it decides how every workload is placed, scaled, isolated, routed to, and torn down across Kubernetes clusters and heterogeneous accelerators, on our cloud and on the customer's. Agents and models are one deployment problem here. An agent is a long-lived workload with session state and unpredictable fan-out, calling models with wildly uneven cost profiles, and both land on the same finite pool of accelerators. Allocating that pool correctly is the job. You will own this layer as a product. You will spend your time in design reviews, in the API contract, and in production data. What you will own The deployment and workload API. Resource model, lifecycle semantics, versioning, backward compatibility, and the error behavior customers integrate against. Placement and capacity. How workloads land on nodes and accelerators, how quota and priority work across tenants, and what happens under contention. Scaling. Autoscaling signals, cold start and scale-to-zero economics, headroom policy, and the cost-versus-latency trade-off as a customer-facing control. Agent runtime. Where an agent runs and for how long, how it is isolated, how its tool calls execute, and how its state survives a restart or an eviction. Traffic and conn

Similar remote roles

Cloud Engineer - Fully Remote | Upto $85/hr
mercor · EU · mid
Product Manager
Smithsgroup2 · Worldwide · mid
Senior Software Engineer
Smithsgroup2 · Worldwide · senior
[IT Delivery Center] Test Automation Engineer
Eurofins · Worldwide · mid
Senior Full Stack Developer
miratech · APAC · senior
Spark Developer
infracloud · APAC · mid
Développeur C# .NET (H/F)
everience benelux · EU · mid
Senior DevOps Engineer /BP
inetum · EU · senior