Inception Launches Mercury 2, the Fastest Reasoning LLM — 5x Faster Than Leading Speed-Optimized LLMs, with Dramatically Lower Inference Cost

Inception, the company behind the first commercial diffusion large language models (dLLMs), today announced the launch of ...
VentureBeat

Nous Research just launched an API that gives developers access to AI models that OpenAI and Anthropic won’t build

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Nous Research, the New York-based AI ...
insideHPC

AI Inference: Meta Collaborates with Cerebras on Llama API

Sunnyvale, CA — Meta has teamed with Cerebras on AI inference in Meta’s new Llama API, combining Meta’s open-source Llama models with inference technology from Cerebras. Developers building on the ...
Business Wire

Elasticsearch Open Inference API now Supports Jina AI Embeddings and Rerank Model

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, announced the Elasticsearch Open Inference API now supports Jina AI’s latest embedding models and reranking products.
Nasdaq

Elasticsearch Open Inference API Extends Support for Hugging Face Models with Semantic Text

Applications using Hugging Face embeddings on Elasticsearch now benefit from native chunking “Developers are at the heart of our business, and extending more of our GenAI and search primitives to ...

AI inference cast in silicon: Taalas announces HC1 chip

The startup Taalas wants to deliver a hardwired Llama 3.1 8B with almost 17,000 tokens/s with the HC1 – almost 10 times ...
SiliconANGLE

OpenRouter nabs $40M in funding for its AI inference API

OpenRouter Inc., a startup working to ease the development of artificial intelligence applications, today announced that it has secured $40 million in funding. The company raised the capital over two ...
Business Wire

Elasticsearch Open Inference API Now Supports Anthropic’s Claude

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, today announced the Elasticsearch Open Inference API now integrates with Anthropic, providing developers with seamless ...
InfoWorld

Meta will offer its Llama AI model as an API too

Enterprises will be able to access Llama models hosted by Meta, instead of downloading and running the models for themselves. Meta has unveiled a preview version of an API for its Llama large language ...
Security Boulevard

From Shadow APIs to Shadow AI: How the API Threat Model Is Expanding Faster Than Most Defenses

The shadow technology problem is getting worse.  Over the past few years, organizations have scaled microservices, ...
insideHPC

AI Inference: Meta Teams with Cerebras on Llama API

Sunnyvale, CA — Meta has teamed with Cerebras on AI inference in Meta’s new Llama API, combining Meta’s open-source Llama models with inference technology from Cerebras. Developers building on the ...