Edge 433: Our series about SSM continues with the introduction of the SAMBA model and the concept and SSMs for long-context windows. We review the original SAMBA paper and Microsoft's Task Weaver agent for analytic workloads. Mega financing rounds are the norm in this wave of generative AI, but have you ever wondered where the money comes from' One might assume that venture capital (VC) funds are driving the massive valuations of foundation model startups. After all, firms like Thrive Capital have been active in major rounds at OpenAI. However, that assumption would be misleading. The traditional VC industry is simply too small to sustain regular rounds of tens of billions of dollars. The main source of capital for foundation model makers is coming from strategic investors, specifically the hyperscalers such as Microsoft, Google, Amazon, and NVIDIA. Just this week, Microsoft and BlackRock announced a massive $30 billion fund focused on AI infrastructure. The alliance combines...
learn more
