Baseten Model Inference Hosting Platform Diagram

Strengths

• Truss open-source framework lowers the barrier to entry and provides a seamless deployment experience
• Prioritizes online inference stability and supports scaling to zero during idle periods to save costs

Weaknesses

• Does not develop proprietary models; relies on the open-source model ecosystem and customer-provided models
• High GPU procurement costs; gross margins are sensitive to GPU supply fluctuations

Opportunities

• Enterprise model spending is shifting toward customized and post-trained models, accounting for 30-50% of budgets
• Capital and brand dividends from the AI inference infrastructure investment boom

Threats

• Intense price competition from inference platforms like RunPod, Modal, and major cloud providers
• Model vendors offering their own inference endpoints and advancements in inference efficiency may compress demand for hosting services