Anyscale today announced a partnership with Microsoft and the private preview of a new AI-native compute service, co-developed with Microsoft and delivered as a fully managed, first-party offering on ...
Microsoft sets AI inference speed record with Azure ND GB300 v6 VMs, achieving 1.1M tokens/sec using Nvidia GB300 GPUs.