Connect with us
MARE BALTICUM Gaming & TECH Summit 2024

Artificial Intelligence

Supermicro Launches Three NVIDIA-Based, Full-Stack, Ready-to-Deploy Generative AI SuperClusters That Scale from Enterprise to Large LLM Infrastructures

Published

on

supermicro-launches-three-nvidia-based,-full-stack,-ready-to-deploy-generative-ai-superclusters-that-scale-from-enterprise-to-large-llm-infrastructures

The Full-Stack SuperClusters Include Air- and Liquid-Cooled Training and Cloud-Scale Inference Rack Configurations with the Latest NVIDIA Tensor Core GPUs, Networking, and NVIDIA AI Enterprise Software
SAN JOSE, Calif., March 18, 2024 /PRNewswire/ — Supermicro, Inc. (NASDAQ: SMCI), a Total IT Solution Provider for AI, Cloud, Storage, and 5G/Edge, is announcing its latest portfolio to accelerate the deployment of generative AI. The Supermicro SuperCluster solutions provide foundational building blocks for the present and the future of large language model (LLM) infrastructure.

The three powerful Supermicro SuperCluster solutions are now available for generative AI workloads. The 4U liquid-cooled systems or 8U air-cooled systems are purpose-built and designed for powerful LLM training performance, as well as large batch size and high-volume LLM inference. A third SuperCluster, with 1U air-cooled Supermicro NVIDIA MGX™ systems, is optimized for cloud-scale inference.
“In the era of AI, the unit of compute is now measured by clusters, not just the number of servers, and with our expanded global manufacturing capacity of 5,000 racks/month, we can deliver complete generative AI clusters to our customers faster than ever before,” said Charles Liang, president and CEO of Supermicro. “A 64-node cluster enables 512 NVIDIA HGX H200 GPUs with 72TB of HBM3e through a couple of our scalable cluster building blocks with 400Gb/s NVIDIA Quantum-2 InfiniBand and Spectrum-X Ethernet networking. Supermicro’s SuperCluster solutions combined with NVIDIA AI Enterprise software are ideal for enterprise and cloud infrastructures to train today’s LLMs with up to trillions of parameters. The interconnected GPUs, CPUs, memory, storage, and networking, when deployed across multiple nodes in racks, construct the foundation of today’s AI. Supermicro’s SuperCluster solutions provide foundational building blocks for rapidly evolving generative AI and LLMs.”
To learn more about the Supermicro AI SuperClusters, visit: www.supermicro.com/ai-supercluster
“NVIDIA’s latest GPU, CPU, networking and software technologies enable systems makers to accelerate a range of next-generation AI workloads for global markets,” said Kaustubh Sanghani, vice president of GPU Product Management at NVIDIA. “By leveraging the NVIDIA accelerated computing platform with Blackwell architecture-based products, Supermicro is providing customers with the cutting-edge server systems they need that can easily be deployed in data centers.”
Supermicro 4U NVIDIA HGX H100/H200 8-GPU systems double the density of the 8U air-cooled system by using liquid-cooling, reducing energy consumption and lowering data center TCO. These systems are designed to support the next-generation NVIDIA Blackwell architecture-based GPUs. The Supermicro cooling distribution unit (CDU) and manifold (CDM) are the main arteries for distributing cooled liquid to Supermicro’s custom direct-to-chip (D2C) cold plates, keeping GPUs and CPUs at optimal temperature, resulting in maximum performance. This cooling technology enables up to a 40% reduction in electricity costs for the entire data center and saves data center real estate space. Learn more about Supermicro Liquid Cooling technology: https://www.supermicro.com/en/solutions/liquid-cooling
The NVIDIA HGX H100/H200 8-GPU equipped systems are ideal for training Generative Al. The high-speed interconnected GPUs through NVIDIA® NVLink®, high GPU memory bandwidth, and capacity are key for running LLM models, cost effectively. The Supermicro SuperCluster creates a massive pool of GPU resources acting as a single AI supercomputer.
Whether fitting an enormous foundation model trained on a dataset with trillions of tokens from scratch or building a cloud-scale LLM inference infrastructure, the spine and leaf network topology with non-blocking 400Gb/s fabrics allows it to scale from 32 nodes to thousands of nodes seamlessly. With fully integrated liquid cooling, Supermicro’s proven testing processes thoroughly validate the operational effectiveness and efficiency before shipping. 
Supermicro’s NVIDIA MGX™ system designs featuring the NVIDIA GH200 Grace Hopper Superchips will create a blueprint for future AI clusters that address a crucial bottleneck in Generative Al: the GPU memory bandwidth and capacity to run large language (LLM) models with high inference batch sizes to lower operational costs. The 256-node cluster enables a cloud-scale high-volume inference powerhouse, easily deployable and scalable.
SuperCluster with 4U Liquid-cooled System in 5 Racks or 8U Air-cooled System in 9 Racks
256 NVIDIA H100/H200 Tensor Core GPUs in one scalable unitLiquid cooling enabling 512 GPUs, 64-nodes, in the same footprint as the air-cooled 256 GPUs, 32-node solution20TB of HBM3 with NVIDIA H100 or 36TB of HBM3e with NVIDIA H200 in one scalable unit1:1 networking delivers up to 400 Gbps to each GPU to enable GPUDirect RDMA and Storage for training large language models with up to trillions of parameters400G InfiniBand or 400GbE Ethernet switch fabrics with highly scalable spine-leaf network topology, including NVIDIA Quantum-2 InfiniBand and NVIDIA Spectrum-X Ethernet Platform.Customizable AI data pipeline storage fabric with industry-leading parallel file system optionsNVIDIA AI Enterprise 5.0 software, which brings support for new NVIDIA NIM inference microservices that accelerate the deployment of AI models at scaleSuperCluster with 1U Air-cooled NVIDIA MGX System in 9 Racks
256 GH200 Grace Hopper Superchips in one scalable unitUp to 144GB of HBM3e + 480GB of LPDDR5X unified memory suitable for cloud-scale, high-volume, low-latency, and high batch size inference, able to fit a 70B+ parameter model in one node.400G InfiniBand or 400GbE Ethernet switch fabrics with highly scalable spine-leaf network topologyUp to 8 built-in E1.S NVMe storage devices per nodeCustomizable AI data pipeline storage fabric with NVIDIA BlueField®-3 DPUs and industry leading parallel file system options to deliver high-throughput and low-latency storage access to each GPUNVIDIA AI Enterprise 5.0 softwareWith the highest network performance achievable for GPU-GPU connectivity, Supermicro’s SuperCluster solutions are optimized for LLM training, deep learning, and high volume and high batch size inference. Supermicro’s L11 and L12 validation testing combined with its on-site deployment service provides customers with a seamless experience. Customers receive plug-and-play scalable units for easy deployment in a data center and faster time to results.
About Super Micro Computer, Inc.
Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first to market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions manufacturer with server, AI, storage, IoT, switch systems, software, and support services. Supermicro’s motherboard, power, and chassis design expertise further enable our development and production, enabling next generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions® allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).
Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.
All other brands, names, and trademarks are the property of their respective owners.
Photo – https://mma.prnewswire.com/media/2365342/Super_Micro_Computer_Inc.jpg
Logo – https://mma.prnewswire.com/media/1443241/Supermicro_Logo.jpg

View original content:https://www.prnewswire.co.uk/news-releases/supermicro-launches-three-nvidia-based-full-stack-ready-to-deploy-generative-ai-superclusters-that-scale-from-enterprise-to-large-llm-infrastructures-302092055.html

Continue Reading

Artificial Intelligence

New Opportunities for International Businesses: TerraPay Partners with Multipass

Published

on

new-opportunities-for-international-businesses:-terrapay-partners-with-multipass

DUBAI, UAE, May 7, 2024 /PRNewswire/ — TerraPay, a leading global money movement company, has joined forces with Multipass, a bank challenger in the financial technology sector, to redefine cross-border payment solutions for corporate customers. This strategic collaboration aims to offer unparalleled reliability, efficiency, and cost optimisation to businesses operating in the UK, Europe, and beyond.

Through this partnership, Multipass gains access to TerraPay’s extensive global payments network, expanding its reach to new jurisdictions and local payouts in multiple currencies, ensuring efficient cross-border payment solutions to its clients. Both organizations offer 24/7 customer support and dedicated personal account managers, emphasising the importance of human interaction alongside technological advancement.
Sudhesh Giriyan, President – Cross-Border Payments at TerraPay, expressed enthusiasm about the partnership, stating, “TerraPay is thrilled to collaborate with Multipass to revolutionize cross-border payments for their corporate customers. This partnership underscores our dedication to providing innovative solutions that drive efficiency, reliability, and cost optimisation.”
Rami Chedid, CEO of Multipass for the UAE and the Middle East, commented, “Our partnership with TerraPay represents a significant step forward in our commitment to deliver secure and fast payment solutions to medium-sized entrepreneurs trading internationally. All while prioritizing security and efficiency in speed and costs. As we continue to work on our expansion plans in the UAE, this trusted partnership gives a new level of importance, offering our clients practically a global payment reach.”
He continued to state that Multipass has initiated the application process for a financial services license in UAE to be regulated by The Dubai Financial Services Authority (DFSA), and having received the in-principal approval, the company will launch operations very soon. “This operational expansion will broaden the global payment reach for UAE-based businesses from the very first day, providing them with a competitive edge and opportunities for business growth”, he explains.
About TerraPay:
TerraPay simplifies global money movement – by providing a single connection to the most expansive cross-border payments network regulated in 31 global markets and enabling payments to 144 receive countries, 210+ send countries, 7.5Bn+ bank accounts and 2.1Bn+ mobile wallets. TerraPay is on a mission to connect a borderless financial world, making moving money everywhere instant, reliable, transparent, and fully compliant. TerraPay pushes the boundaries for global businesses – ranging from banks, fintechs and money-transfer operators to travel businesses, creator economy platforms and e-commerce marketplaces – while driving financial inclusion in even the most inaccessible markets. Founded in 2014, TerraPay is headquartered in London, with global offices in Bangalore, Dubai, Miami, Bogota, Dar es Salaam, Kampala, Hague, Dakar, Joburg, Nairobi, Milan, Singapore and is expanding rapidly, having received funding from leading investors, including the IFC (the World Bank), Prime Ventures, Partech Africa, and Visa.
About Multipass:
Multipass a part of Dyninno Group of Companies, is a bank challenger that provides modern financial solutions for businesses with cross-border activity. It offers a multi-currency business account with an instant FX desk and a corporate card that allows international companies to manage their bank transfers in foreign markets in a simple way. Multipass’s customer offering includes local UK, US, and EU (European Union) accounts, as well as a single multi-currency IBAN supporting over 70 currencies and 200 global payment destinations. The company was founded in 2017 and is led by Dmitry Tsymber.
Media Contact:[email protected]
Logo: https://mma.prnewswire.com/media/1222771/TerraPay_Logo.jpg

View original content:https://www.prnewswire.co.uk/news-releases/new-opportunities-for-international-businesses-terrapay-partners-with-multipass-302135467.html

Continue Reading

Artificial Intelligence

Rainbow Robotics participates in ICRA 2024 in Yokohama, Japan: Bimanual Mobile Manipulator ‘RB-Y1’ debuts overseas

Published

on

rainbow-robotics-participates-in-icra-2024-in-yokohama,-japan:-bimanual-mobile-manipulator-‘rb-y1’-debuts-overseas

Participating in the International Conference on Robotics and Automation (ICRA 2024) from the 13th to the 16th AI expert research platform, Bimanual Mobile Manipulator RB-Y1 pre-order beginsDAEJEON, South Korea, May 7, 2024 /PRNewswire/ — Rainbow Robotics (CEO Jungho Lee), a robot platform specialized company, will participate as a bronze sponsor at the IEEE International Conference on Robotics and Automation (ICRA 2024), which will be held at Pacifico Yokohama, Japan on May 13.

During this exhibition, Rainbow Robotics will demonstrate its Bimanual Mobile Manipulator ‘RB-Y1’. RB-Y1 is a humanoid-shaped research platform equipped with two arms with 7 degrees of freedom per arm, a single leg with 6 degrees of freedom, and a wheel-type mobile platform.
In particular, in line with the recent trend of the AI era, Rainbow Robotics plans to provide various APIs and options so that SW developers can easily utilize them for research purposes.
Throughout the exhibition period, various demonstrations will be shown of RB-Y1 with real-time remote operation technology, which links the data arm and simulation system. Additionally, Rainbow Robotics plans to exhibit the small-sized high-precision collaborative robot RB3-730 and the quadruped robot RBQ-10.
ICRA (International Conference on Robotics and Automation) is an event hosted by IEEE (Institute of Electrical and Electronics Engineers) and is the world’s largest robotics conference held annually.
Meanwhile, Rainbow Robotics will begin pre-orders for its Bimanual Mobile Manipulator RB-Y1 from May 8. Customers who purchase during the pre-order period will receive free after-sales service for one year, and products are scheduled to be delivered sequentially starting in October. The research platform is sold for US $ 80,000 and the commercial platform is sold for USD $120,000 (VAT excluded). If you would like to pre-order RB-Y1, please contact us through enquiry page or email us at [email protected].
Photo – https://mma.prnewswire.com/media/2405117/Caption__Rainbow_Robotics_participates_in_ICRA_2024.jpg

View original content:https://www.prnewswire.co.uk/news-releases/rainbow-robotics-participates-in-icra-2024-in-yokohama-japan-bimanual-mobile-manipulator-rb-y1-debuts-overseas-302136589.html

Continue Reading

Artificial Intelligence

Solar EV Charging to Bypass the Grid: A US$2.5 Billion Market by 2034, Says IDTechEx

Published

on

solar-ev-charging-to-bypass-the-grid:-a-us$2.5-billion-market-by-2034,-says-idtechex

Unreliable and fossil fuel-intense electrical grids
BOSTON, May 6, 2024 /PRNewswire/ — Electrification of cars, buses, and trucks drastically reduces CO2 emissions at the point of use compared to a diesel or petrol alternative. The adoption of EVs across all sectors, with IDTechEx predicting over 180 million electric vehicles to be sold annually by 2044. This will contribute to a drastic reduction in tailpipe emissions. However, the overall emissions are usually highly dependent on the energy mix that goes into grid electricity production. In many economies, this contains significant amounts of fossil fuels such as coal and natural gas. Beyond CO2 emissions, some grids are already at capacity, and the increased load of an electric transport sector risks blackouts and power supply issues. South Africa is an EV market with both of these issues, and several innovations have been made using distributed power generation to tackle these challenges. IDTechEx’s research report, “Off-Grid Charging For Electric Vehicles 2024-2034: Technologies, Benchmarking, Players and Forecasts”, explores the challenges and solutions associated with charging EVs in the context of constrained electricity grids.

The South African utility grid is subject to frequent load-shedding, periods when demand exceeds supply, and utility operators are forced to impose rolling black or brownouts of up to 50% capacity. This is a problem for all forms of domestic and industrial electrical use but becomes an especially pronounced problem for commercial EV operators. Fleet operators often must charge at predesignated times to maximize uptime and complete all planned routes. If the grid fails during a charging spot, the entire schedule may be adversely affected by factors beyond an operator’s control. This is an unusual grid situation; however, it presents a possible worst-case scenario for grid-congested and EV-saturated regions. In 2022, a heatwave in California prompted the state government to ask EV owners not to charge to conserve energy. The growth in electric vehicle sales will only make such problems more widespread.
South Africa also has a very carbon-intensive energy mix, with approximately 70% of power generation being from coal. This directly translates into higher lifecycle CO2 emissions from EVs powered by the electrical grid. Whilst South Africa has a particularly fossil fuel energy mix, the source of electricity plays a critical role in the lifecycle emissions of an electric vehicle.  
Disturbed generation gives renewable and grid-independent electricity
One possible solution being trialed in South Africa, amongst other places, is harnessing distributed renewable microgrids to form the backbone of charging networks. By integrating a solar farm, large-scale energy storage (ES), and high-powered charging outlets, Vrendal-based Zero Carbon Charge plans to build an etruck charging network. Not only does this decouple charging from an unreliable grid, it also avoids placing excess electrical demand on utilities, avoids the need for costly grid expansions, and provides free and 100% renewable energy for the trucks to operate on. This is not limited to South Africa; the USA, in particular, has also seen a boom in companies offering grid-free solar-powered charging. In the US, many of the products are smaller scale and transportable, allowing easy setup for EV users who want quick access to EV charging.
Easy setup, no grid connection, but slow charging rates
The main challenge with distributed solar generation for EV charging is the low power output of photovoltaic panels. Most produce around 250 Watts per square meter, which is relatively low. In fact, to charge at 22kW (generally considered Level 2 fast charging), a solar canopy would need to be at least 10 x 10 meters, a considerable footprint, especially in an urban environment. The other challenge is storing energy, as charging will not always be required constantly, so an on-site battery is required to store the generated electricity. Without an integrated on-site battery, charging is impossible when there is no sunlight, such as inclement weather or overnight. On-site battery storage can combat this intermittency.
 
 
Larger solar farms with integrated energy storage can become islanded microgrids, and with enough on-site storage and photovoltaic production, potential grid-independent fast charging is possible. This is the approach proposed for the South African etruck charging network. It is important to note that purely solar solutions are likely to be geographically restricted to areas with high photovoltaic potential. Thus, it is no surprise that the leading regions are Western regions of the US and places like South Africa. Beam Global, a supplier of EV canopy chargers, recently announced its first sales in the European market to the United Kingdom Ministry of Defense. However, the chargers will not be deployed in the mainland of the UK; they will be deployed on a military base in Cyprus, one of the sunniest regions on the continent.
Despite technical challenges, the aging and fossil fuel-heavy nature of grids combined with high EV uptake call for new charging solutions, and IDTechEx predicts that solar charging systems will make up a sizeable portion of the overall US$16 billion off-grid charging infrastructure hardware market by 2034. IDTechEx research also indicates several other technologies likely to be adopted for off-grid EV charging. Hydrogen fuel cell charging is likely to emerge as a key solution for use cases requiring much greater power per area, with a particular expected focus on electrified construction sites. More niche technologies include AWE (airborne wind energy), which harnesses high altitude winds for distributed power generation. For an in-depth look at solar EV charging, as well as alternative technology options such as AWE and hydrogen see IDTechEx’s latest research on the topic, “Off-Grid Charging For Electric Vehicles 2024-2034: Technologies, Benchmarking, Players and Forecasts”.
To find out more about this IDTechEx report, including downloadable sample pages, please visit www.IDTechEx.com/OffGridEV.
For the full portfolio of electric vehicle market research from IDTechEx, please see www.IDTechEx.com/Research/EV.
About IDTechEx:
IDTechEx provides trusted independent research on emerging technologies and their markets. Since 1999, we have been helping our clients to understand new technologies, their supply chains, market requirements, opportunities and forecasts. For more information, contact [email protected] or visit www.IDTechEx.com. 
Image download:
https://www.dropbox.com/scl/fo/1huh00wjpi6t8tnbrs199/AAjT0rKs4s40ouXmeQ1wefA?rlkey=97jswk3tkb744by19o7cyid47&dl=0 
Media Contact:
Lucy RogersSales and Marketing [email protected] +44(0)1223 812300
Social Media Links:
Twitter: www.twitter.com/IDTechEx
LinkedIn: www.linkedin.com/company/IDTechEx
Photo – https://mma.prnewswire.com/media/2406005/Solar_Canopy_Charging.jpgLogo – https://mma.prnewswire.com/media/2338688/4690629/IDTechEx_logo.jpg
 
 

View original content:https://www.prnewswire.co.uk/news-releases/solar-ev-charging-to-bypass-the-grid-a-us2-5-billion-market-by-2034–says-idtechex-302137347.html

Continue Reading
Advertisement
Advertisement

Latest News

Trending