Chipmakers Nvidia and Groq entered into a non-exclusive tech licensing agreement last week aimed at speeding up and lowering the cost of running pre-trained large language models. Why it matters: Groq ...

Snowflake has thousands of enterprise customers who use the company's data and AI technologies. Though many issues with generative AI are solved, there is still lots of room for improvement. Two such ...

You train the model once, but you run it every day. Making sure your model has business context and guardrails to guarantee reliability is more valuable than fussing over LLMs. We’re years into the ...

CISOs know precisely where their AI nightmare unfolds fastest. It's inference, the vulnerable stage where live models meet real-world data, leaving enterprises exposed to prompt injection, data leaks, ...

The CNCF is bullish about cloud-native computing working hand in glove with AI. AI inference is the technology that will make hundreds of billions for cloud-native companies. New kinds of AI-first ...

The generative AI market is experiencing rapid growth, driven by the increasing parameter size of Large Language Models (LLMs). This growth is pushing the boundaries of performance requirements for ...

Kubernetes has become the leading platform for deploying cloud-native applications and microservices, backed by an extensive community and comprehensive feature set for managing distributed systems.

You're currently following this author! Want to unfollow? Unsubscribe via the link in your email. Follow Alistair Barr Every time Alistair publishes a story, you’ll get an alert straight to your inbox ...