In a world of ongoing global uncertainties, the stability of systems stands as a cornerstone for businesses seeking growth. Peter Man, General Manager – Hong Kong, Taiwan & Macau at Red Hat, noted that local enterprises tend to approach AI (Artificial Intelligence) technology with caution. They require proof of AI’s capacity to facilitate business expansion before fully committing, with robust systems serving as the bedrock for enterprises.
Responding to the impact of AI technology, Peter Man observed and summarised the current AI market development into two primary directions:
Large Artificial Intelligence Models
Enterprise AI Application Tools
Peter highlighted that while the first category is rapidly expanding and extensive, concerns linger over its stability and profitability. The second category, on the other hand, is more grounded and tends to be the initial consideration for enterprises. Citing local examples, Peter revealed that out of the ten new clients added over the past year, all were AI-related, transitioning AI technologies from testing to practical application.
Most of these clients are from the financial and banking sectors, with some in maritime services, indicating a general trend towards conservatism and a focus on stability.
In response to the burgeoning interest in AI among enterprises, Red Hat has introduced the Red Hat AI Enterprise platform to assist businesses in deploying and managing artificial intelligence models, intelligent agents, and applications in hybrid cloud environments. Peter explained that this new platform integrates commonly used AI solutions for faster and more efficient deployment of AI applications, incorporating objectivity into statement cycle management, and offering the flexibility of hybrid cloud environments.
Furthermore, Red Hat has partnered with NVIDIA to launch the AI Factory solution, combining the Red Hat AI Enterprise platform with NVIDIA’s accelerated computing software. Peter emphasised that while many enterprises claim to deliver AI capabilities and applications, they often fall short in execution. The newly introduced AI Factory solution enables enterprises to align with cutting-edge AI technologies, provide support for NVIDIA hardware architecture from Day 0, ensuring synchronised software-hardware performance, and effectively facilitating AI applications within enterprises.
The jointly developed software platform combines Red Hat and NVIDIA’s expertise in open-source collaboration, engineering design, and support, offering enterprises the following advantages:
- Shortening the Value Realization Cycle: Accelerating the transformation of enterprises to production-grade AI through simplified workflows and real-time connection to pre-configured models. This includes IBM Granite series products, NVIDIA Nemotron, and NVIDIA Cosmos open models.
- Optimizing Performance and Cost: The “Red Hat AI Factory with NVIDIA” incorporates observability features, combining vLLM, NVIDIA TensorRT-LLM, and NVIDIA Dynamo with Red Hat AI inference technology to meet precise AI service levels.
- Intelligent GPU Orchestration: On-demand access to GPU resources through smart scheduling and pooling infrastructure, with an automatic checkpoint mechanism to safeguard long-running operations.
- Enhancing Enterprise Security: Leveraging Red Hat Enterprise Linux’s flexible and reliable infrastructure, enterprises can utilize its built-in advanced security and compliance features from the outset, reducing risks, saving time, and minimizing downtime.
Leave a comment