Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
The developers of the open source project vLLM have he announced that he turned a popular tool into a VC-backed startup, Inferact, raising $150 million in seed funding at a valuation of $800 million.
The round was led by Andreessen Horowitz and Lightspeed Venture Partners, TechCrunch’s confirmed. previous report that vLLM has raised money from a16z.
The start of Inferact reflects the recent marketing of the SGlang project as RadixArk, which sources told us has raised $ 400 million led by Accel, as. we reported on the third.
As interest in AI shifts from training models to programming, a process known as inference, technologies like vLLM and SGLang that make these AI tools faster and cheaper are attracting the attention of vendors.
Both vLLM and SGlang were coined in 2023 at the UC Berkeley lab of Databricks co-founder Ion Stoica.
Inferact CEO Simon Mo, one of the founders of the project, told Bloomberg that vLLM users include Amazon’s cloud service and shopping software.
