Supermicro unveils new portfolio to enhance edge computing environments with AI offerings
Supermicro, an IT solution manufacturer of AI, cloud, storage, and 5G/edge, is expanding its portfolio of AI solutions to enable its customers to leverage AI in edge locations, including public spaces, retail stores, or industrial infrastructure.
Supermicro’s application-optimized servers include NVIDIA GPUs to make it easier to fine-tune pre-trained models and for AI inference solutions to be deployed at the edge where the data is generated, improving response times and decision-making, the company notes.
“Supermicro has the broadest portfolio of edge AI solutions, capable of supporting pre-trained models for our customers’ edge environments,” says Charles Liang, president and CEO of Supermicro.
“The Supermicro Hyper-E server, based on the dual 5th Gen Intel Xeon processors, can support up to three NVIDIA H100 Tensor Core GPUs, delivering unparalleled performance for edge AI. With up to 8TB of memory in these servers, we are bringing data center AI processing power to edge locations. Supermicro continues to provide the industry with optimized solutions as enterprises build a competitive advantage by processing AI data at their edge locations.”
The company adds that with these server advancements, users no longer need to send data back to the cloud for processing, only to retrieve the information back to the edge, where it’s required.
Customers will have the ability to use pre-trained large language models (LLMs) models, optimized for performance and available with NVIDIA AI enterprise at their edge locations where the data is needed for accurate, real-time decision-making close to the data origination.
“Businesses across industries, including healthcare, retail, manufacturing, and auto, are increasingly looking to leverage AI at the edge,” adds Kevin Connors, vice president of partner alliances at NVIDIA.
“The new Supermicro NVIDIA-Certified Systems, powered by the NVIDIA AI platform, are built to deliver the highest-performing accelerated computing infrastructure, as well as NVIDIA AI Enterprise software to help run edge AI workloads.”
Currently, Supermicro’s Hyper-E server, the SYS-221HE, is optimized for edge training and inferencing and supports dual socket CPUs in a short-depth, front I/O system. The system holds up to 3 double-width NVIDIA Tensor Core GPUs, including the NVIDIA H100, A10, L40S, A40, and A2 GPUs. These GPUs give the Supermicro Hyper-E sufficient computing power to process AI workloads at edge environments where data is collected, analyzed, and stored.
“Eviden’s AI-powered retail solution, based on the Supermicro edge systems and NVIDIA technologies, completely transforms the way people navigate through and interact with spaces such as stores,” adds Jacque Istok, CEO of StoreGenius, specializing in smart applications for the retail industry.
“This enhances the shopping experience by offering customers interactive and personalized shopping through 3D models of the stores and interactive chatbots that can communicate appropriate information. The blend of lifelike facial animations, advanced speech recognition, and 3D modeling can make virtual shopping nearly as tangible as visiting a physical store.”
The company notes that the Supermicro SYS-221HE is available with front or rear servicing options, allowing this server to be installed in various environments.
The SYS-E300-13AD is a compact IoT server featuring a 13th Gen Intel Core processor and is sized at just 265×226 mm. The company claims that the server is ideal for delivering distributed AI capabilities to the edge.
Read more:
Supermicro enhances server offerings to meet telco and edge demand
SuperMicro adds new edge systems for telco, industrial markets
Article Topics
edge AI | LLMs | Nvidia | server | Supermicro
Comments