DEEPX, a leading AI semiconductor technology company makes significant advancements towards creating an expansive Edge AI ecosystem by introducing innovative Edge AI Development Kits that transcend the limitations of GPUs. The company, known for its pioneering work in artificial intelligence semiconductors for Edge devices, is gearing up to participate in the AI Hardware & Edge AI Summit in Silicon Valley, set to run from September 12th to 14th.

At this prestigious event, DEEPX's CEO Lokwon Kim will share the stage with luminaries like Professor Andrew Ng of Landing AI and Tenstorrent CEO Jim Keller. More than 100 major tech companies, including Microsoft, Google, Intel, AMD, and Qualcomm, will converge to discuss the latest trends and insights in AI hardware and edge AI.

d-Matrix, the leader in high-efficiency generative AI compute for data centers, has closed $110 million in a Series-B funding round led by Singapore-based global investment firm Temasek. The goal of the fundraise is to enable d-Matrix to begin commercializing Corsair, the world's first Digital-In Memory Compute (DIMC), chiplet-based inference compute platform, after the successful launches of its prior Nighthawk, Jayhawk-I and Jayhawk II chiplets.

d-Matrix's recent silicon announcement, Jayhawk II, is the latest example of how the company is working to fundamentally change the physics of memory-bound compute workloads common in generative AI and large language model (LLM) applications. With the explosion of this revolutionary technology over the past nine months, there has never been a greater need to overcome the memory bottleneck and current technology approaches that limit performance and drive up AI compute costs.

TSMC Chairman Mark Liu was asked to comment on all things artificial intelligence-related at the SEMICON Taiwan 2023 industry event. According to a Nikkei Asia report, he foresees supply constraints lasting until the tail end of 2024: "It's not the shortage of AI chips. It's the shortage of our chip-on-wafer-on-substrate (COWOS) capacity...Currently, we can't fulfill 100% of our customers' needs, but we try to support about 80%. We think this is a temporary phenomenon. After our expansion of advanced chip packaging capacity, it should be alleviated in one and a half years." He cites a recent and very "sudden" spike in demand for COWOS, with numbers tripling within the span of a year. Market leader NVIDIA relies on TSMC's advanced packaging system—most notably with the production of highly-prized A100 and H100 series Tensor Core compute GPUs.

These issues are deemed a "temporary" problem—it could take around 18 months to eliminate production output "bottlenecks." TSMC is racing to bolster its native activities with new facilities—plans for a new $2.9 billion advanced chip packaging plant (in Miaoli County) were disclosed during summer time. Liu reckons that industry-wide innovation is necessary to meet growing demand through new methods to "connect, package and stack chips." Liu elaborated: "We are now putting together many chips into a tightly integrated massive interconnect system. This is a paradigm shift in semiconductor technology integration." The TSMC boss reckons that processing units fielding over one trillion transistors are viable within the next decade: "it's through packaging with multiple chips that this could be possible.".

NVIDIA today announced an extensive collaboration with Tata Group to deliver AI computing infrastructure and platforms for developing AI solutions. The collaboration will bring state-of-the-art AI capabilities within reach to thousands of organizations, businesses and AI researchers, and hundreds of startups in India. The companies will work together to build an AI supercomputer powered by the next-generation NVIDIA GH200 Grace Hopper Superchip to achieve performance that is best in class.

"The global generative AI race is in full steam," said Jensen Huang, founder and CEO of NVIDIA. "Data centers worldwide are shifting to GPU computing to build energy-efficient infrastructure to support the exponential demand for generative AI.

In a major step to support India's industrial sector, NVIDIA and Reliance Industries today announced a collaboration to develop India's own foundation large language model trained on the nation's diverse languages and tailored for generative AI applications to serve the world's most populous nation. The companies will work together to build AI infrastructure that is over an order of magnitude more powerful than the fastest supercomputer in India today. NVIDIA will provide access to the most advanced NVIDIA GH200 Grace Hopper Superchip and NVIDIA DGX Cloud, an AI supercomputing service in the cloud. GH200 marks a fundamental shift in computing architecture that provides exceptional performance and massive memory bandwidth.

The NVIDIA-powered AI infrastructure is the foundation of the new frontier into AI for Reliance Jio Infocomm, Reliance Industries' telecom arm. The global AI revolution is transforming industries and daily life. To serve India's vast potential in AI, Reliance will create AI applications and services for their 450 million Jio customers and provide energy-efficient AI infrastructure to scientists, developers and startups across India.

Andes Technology, a leading supplier of high efficiency, low-power 32/64-bit RISC-V processor cores and Founding Premier member of RISC-V International, today proudly announces general availability of the high-performance AndesCore AX45MPV multicore vector processor IP. The AX45MPV is the third generation of the award winning AndesCore vector processor series. Equipped with powerful RISC-V vector processing and parallel execution capability, it targets the applications with large volumes of data such as ADAS, AI inference and training, AR/VR, multimedia, robotics, and signal processing.

Andes and Meta started collaboration on datacenter AI with RISC-V vector core from early 2019. Andes later unveiled the AndesCore NX27V, marking a significant milestone as the industry's first commercial RISC-V vector processor core with the capability of generating up to 4 512-bit vector (VLEN) results per cycle, at the end of 2019. It immediately attracted the attention of worldwide SoC design teams working on AI accelerators, and has landed over a dozen datacenter AI projects. Since then, the RISC-V vector processor cores have become the choice for ML and AI chip vendors.

GIGABYTE, the world's leading computer hardware brand, featured its AORUS 17X laptop in two influential AI-content-focused Youtubers by Hugh Hou and MDMZ. Both Youtubers took the new AORUS 17X laptop to the AI image and AI video generation test and found the great potential of how the laptops benefit their workflow. The AORUS 17X laptop is powered by NVIDIA GeForce RTX 40 series GPUs to unlock new horizons for creativity and become the go-to choice for art and tech enthusiasts.

Hugh Hou: Unleashing the Power of AI Arts with the AORUS 17X Laptop
Hugh Hou's journey into AI arts, powered by Stable Diffusion XL, garnered viral success. The AORUS 17X laptop emerged as a game-changer with up to 16G of VRAM, enabling local AI photo and video generation without bearing hefty cloud-rendering costs. It empowers creators and outperforms competitors in AI-assisted tasks and enhances AI artistry.

According to a new research report from the analyst firm Jon Peddie Research (JPR), unit shipments in the add-in board (AIB) market increased in Q2'23 from last quarter, while AMD gained market share. Quarter to quarter, graphics AIB shipments increased modestly, by 2.9%; however, shipments decreased by -36% year to year.

Since Q1 2000, over 2.10 billion graphics cards, worth about $476 billion, have been sold. The market shares for the desktop discrete GPU suppliers shifted in the quarter, as AMD's market share increased from last quarter and Nvidia's share increased from last year. Intel, which entered the AIB market in Q3'22 with the Arc A770 and A750, will start to increase market share in 2024.

Lanner Electronics, a leading provider of advanced network appliances and edge AI computing platforms, is excited to introduce the new PCIe AI Acceleration Card, Falcon Lite, powered by Hailo-8 AI processors. The Falcon Lite's modular PCIe form factor provides a flexible solution for solution providers looking to accelerate edge AI workloads with deployment flexibility and power efficiency.

The Lanner Falcon Lite PCIe AI Acceleration Card is designed to meet the soaring demand for scalable intelligent video analytics applications in smart retail, Industry 4.0, and intelligent transportation. With high-density AI processors, the Falcon Lite can accommodate 2, 3, and 4 Hailo-8 AI processors, offering up to 104 tera operations per second (TOPS) of AI performance to offload the CPU for low-latency deep learning inference.

IBM has formally introduced watsonx, the company's next generation enterprise-focused artificial intelligence and data platform. Global business leaders remain unclear about the real, transformative power of AI and how to leverage it. The campaign is designed to define and differentiate watsonx as a force multiplier that can accelerate impact for global business leaders as they look to apply AI solutions in new and innovative ways.

The two distinct spots feature a fast-paced, multi-media technique that aims to provide inspiration and guidance around the value proposition of watsonx, while underscoring the need to identify the right AI that will empower businesses to advance objectives and accelerate workloads. These concepts come to life through potential use cases that spotlight the importance of applying AI that is trusted, targeted, and built on the best open technology available.

Today Lenovo is announcing its top-of-the-line Lenovo Legion 9i (16", 8), the first 16-inch gaming laptop in Lenovo Legion's ecosystem—and in the world—with a self-contained liquid-cooling system, designed for gamers and creators with heavy graphic workflow requirements who need a full development studio in their bag. The Lenovo Legion 9i caps out the Lenovo Legion lineup that also includes the Lenovo Legion Pro series for competitive gamers and the Lenovo Legion Slim series for gamers who value agility, as well as Lenovo Legion displays and peripherals. Also announced today are the Lenovo Legion 16" Gaming Backpack GB700 and GB400, two backpack options that give gamers a choice between slim and lightweight agility or extra storage without sacrificing protection for their Lenovo Legion 9i (16", 8) or any other laptops and accessories.

"The introduction of the Lenovo Legion 9i (16", 8) marks the latest pinnacle of Lenovo Legion's gaming laptop innovation. The Lenovo Legion 9i is first laptop in the Lenovo Legion ecosystem with an integrated liquid-cooling system and hardware AI chip tuning. The forged carbon A-cover, which in addition to its 'unique-to-each-laptop aesthetics' means a lighter laptop for gamers and creators who demand nothing but the best." said Jun Ouyang, Lenovo's vice president and general manager of the Consumer Business Segment, Intelligent Devices Group. "We are constantly challenging ourselves to push the limits when designing gaming solutions. The Lenovo Legion 9i (16", 8) has set a new benchmark for us that we are excited to meet—and exceed—in the future."

collaboration with diverse industries and support various applications
Samsung Electronics, a world leader in advanced memory technology, today announced that it has developed the industry's first and highest-capacity 32-gigabit (Gb) DDR5 DRAM using 12 nanometer (nm)-class process technology. This achievement comes after Samsung began mass production of its 12 nm-class 16Gb DDR5 DRAM in May 2023. It solidifies Samsung's leadership in next-generation DRAM technology and signals the next chapter of high-capacity memory.

"With our 12 nm-class 32Gb DRAM, we have secured a solution that will enable DRAM modules of up to 1-terabyte (TB), allowing us to be ideally positioned to serve the growing need for high-capacity DRAM in the era of AI (Artificial Intelligence) and big data," said SangJoon Hwang, Executive Vice President of DRAM Product & Technology at Samsung Electronics. "We will continue to develop DRAM solutions through differentiated process and design technologies to break the boundaries of memory technology."

TrendForce research reveals that, due to the impacts of high inflation and economic downturn, CSPs are adopting more conservative strategies when it comes to capital expenditure and consistently reducing their annual server demand forecasts. Currently, CSPs in China have reported a decline in cloud orders compared to last year, leading to a subsequent decrease in annual procurement volumes for enterprise SSDs. In North America, some clients have postponed mass production timelines for new server platforms while ramping up investments in AI servers. These factors have resulted in enterprise SSD orders falling below expectations. Consequently, global enterprise SSD revenue hit an all-time low in the second quarter, totaling just $1,500 million—a QoQ decrease of 24.9%.

Demand for AI servers remains strong in the third quarter, while orders and shipment momentum for general-purpose servers have yet to show signs of recovery. This continues to put pressure on the purchasing volume of enterprise SSDs, and annual bit volume is expected to be lower than last year. Meanwhile, vendors have once again reduced capacity utilization to slow down inventory growth. Server customers still maintain high inventory levels, and their purchasing momentum remains insufficient. This is expected to lead to an approximate 15% QoQ decline in the average price of enterprise SSDs in the third quarter, which may further result in a lackluster revenue performance for the peak season.

TrendForce expects that memory suppliers will continue their strategy of scaling back production of both DRAM and NAND Flash in 2024, with the cutback being particularly pronounced in the financially struggling NAND Flash sector. Market demand visibility for consumer electronic is projected to remain uncertain in 1H24. Additionally, capital expenditure for general-purpose servers is expected to be weakened due to competition from AI servers. Considering the low baseline set in 2023 and the current low pricing for some memory products, TrendForce anticipates YoY bit demand growth rates for DRAM and NAND Flash to be 13% and 16%, respectively. Nonetheless, achieving effective inventory reduction and restoring supply-demand balance next year will largely hinge on suppliers' ability to exercise restraint in their production capacities. If managed effectively, this could open up an opportunity for a rebound in average memory prices.

PC: The annual growth rate for average DRAM capacity is projected at approximately 12.4%, driven mainly by Intel's new Meteor Lake CPUs coming into mass production in 2024. This platform's DDR5 and LPDDR5 exclusivity will likely make DDR5 the new mainstream, surpassing DDR4 in the latter half of 2024. The growth rate in PC client SSDs will not be as robust as that of PC DRAM, with just an estimated growth of 8-10%. As consumer behavior increasingly shifts toward cloud-based solutions, the demand for laptops with large storage capacities is decreasing. Even though 1 TB models are becoming more available, 512 GB remains the predominant storage option. Furthermore, memory suppliers are maintaining price stability by significantly reducing production. Should prices hit rock bottom and subsequently rebound, PC OEMs are expected to face elevated SSD costs. This, when combined with Windows increasing its licensing fees for storage capacities at and above 1 TB, is likely to put a damper on further growth in average storage capacities.

FUJIFILM Corporation (President and CEO, Representative Director: Teiichi Goto) and IBM today announced the development of a 50 TB native tape storage system, featuring the world's highest native data tape cartridge capacity. Fujifilm has commenced production of a high-density tape cartridge for use with IBM's newest enterprise tape drive, the TS1170. The sixth-generation IBM 3592 JF tape cartridge incorporates a newly developed technology featuring fine hybrid magnetic particles to enable higher data storage capacity.

Innovations in achieving 50 TB Native Capacity
Fujifilm has succeeded in achieving this innovative cartridge capacity by evolving the technologies developed in previous tape generations. This involved enhancing both the areal recording density (the amount of data that can be recorded per square inch) and the overall recording area (the surface area capable of recording data).

Liu Qingfeng, the founder and chairman of Chinese AI firm iFlytek (or HKUST Xunfei according to ITHome) shared his opinions of incoming Huawei GPU technology at this year's Yabuli Entrepreneurs Forum. His team has been collaborating with key figures at the multinational technology corporation on a product that he reckons is just as capable as NVIDIA's very mature A100 tensor core accelerator. Liu referred to the model as a "compute GPU" which implies that this is an all-new product—Huawei has kept quiet on the AI hardware front since the 2019 launch of its Ascend 910 AI accelerator, so the iFlytek presentation has hinted about Huawei's ambitions to take on Team Green within the Chinese deep learning and artificial intelligence market sector.

NVIDIA's latest financial report for FY2Q24 reveals that its data center business reached US$10.32 billion—a QoQ growth of 141% and YoY increase of 171%. The company remains optimistic about its future growth. TrendForce believes that the primary driver behind NVIDIA's robust revenue growth stems from its data center's AI server-related solutions. Key products include AI-accelerated GPUs and AI server HGX reference architecture, which serve as the foundational AI infrastructure for large data centers.

TrendForce further anticipates that NVIDIA will integrate its software and hardware resources. Utilizing a refined approach, NVIDIA will align its high-end, mid-tier, and entry-level GPU AI accelerator chips with various ODMs and OEMs, establishing a collaborative system certification model. Beyond accelerating the deployment of CSP cloud AI server infrastructures, NVIDIA is also partnering with entities like VMware on solutions including the Private AI Foundation. This strategy extends NVIDIA's reach into the edge enterprise AI server market, underpinning steady growth in its data center business for the next two years.

NVIDIA (NASDAQ: NVDA) today reported revenue for the second quarter ended July 30, 2023, of $13.51 billion, up 101% from a year ago and up 88% from the previous quarter. GAAP earnings per diluted share for the quarter were $2.48, up 854% from a year ago and up 202% from the previous quarter. Non-GAAP earnings per diluted share were $2.70, up 429% from a year ago and up 148% from the previous quarter.

"A new computing era has begun. Companies worldwide are transitioning from general-purpose to accelerated computing and generative AI," said Jensen Huang, founder and CEO of NVIDIA. "NVIDIA GPUs connected by our Mellanox networking and switch technologies and running our CUDA AI software stack make up the computing infrastructure of generative AI.

The Exascale supercomputer arms race is making everyone invest their resources into trying to achieve the number one spot. Some countries, like China, actively participate in the race with little proof of their work, leaving the high-performance computing (HPC) community wondering about Chinese efforts on exascale systems. Today, we have some information regarding the next-generation Sunway system, which is supposed to be China's first exascale supercomputer. Replacing the Sunway TaihuLight, the next-generation Sunway will reportedly boast over 40 million cores in its system. The information comes from an upcoming presentation for Supercomputing 2023 show in Denver, happening from November 12 to November 17.

The presentation talks about 5 ExaFLOPS in the HPL-MxP benchmark with linear scalability on the 40-million-core Sunway supercomputer. The HPL-MxP benchmark is a mixed precision HPC benchmark made to test the system's capability in regular HPC workloads that require 64-bit precision and AI workloads that require 32-bit precision. Supposedly, the next-generation Sunway system can output 5 ExaFLOPS with linear scaling on its 40-million-core system. What are those cores? We are not sure. The last-generation Sunway TaihuLight used SW26010 manycore 64-bit RISC processors based on the Sunway architecture, each with 260 cores. There were 40,960 SW26010 CPUs in the system for a total of 10,649,600 cores, which means that the next-generation Sunway system is more than four times more powerful from a core-count perspective. We expect some uArch and semiconductor node improvements as well.

Today, at VMware Explore 2023 Las Vegas, AMD continued to showcase its proven performance and growing adoption of AMD EPYC CPUs, AMD Pensando data processing units (DPUs) and adaptive computing products as ideal solutions for the most efficient and innovative virtualized environments. For instance, a system powered by a 4th Gen AMD EPYC 9654 CPUs and a Pensando DPU, delivers approximately 3.3x the Redis application performance and 1.75x the aggregate network throughput when compared to a 4th Gen EPYC system with standard NICs. Additionally, servers with 2P 4th Gen EPYC 9654 CPUs alone can enable using up to 35% fewer servers in an environment running 2000 virtual machines (VMs) compared to 2P Intel Xeon 8490H based servers.

"AMD is helping enterprise customers fully realize the benefits of their virtualized data centers with the latest generation EPYC CPUs and Pensando DPUs," said Forrest Norrod, executive vice president and general manager, Data Center Solutions Business Group, AMD. "Consolidation and modernization enable businesses to increase server utilization and efficiency while delivering impressive performance for critical enterprise workloads. Our ongoing collaboration with VMware enables customers to get more efficient and agile to reach their digital transformation goals."

International Data Corporation (IDC) today published its second forecast for the worldwide quantum computing market, projecting customer spend for quantum computing to grow from $1.1 billion in 2022 to $7.6 billion in 2027. This represents a five-year compound annual growth rate (CAGR) of 48.1%. The forecast includes base quantum computing as a service as well as enabling and adjacent quantum computing as a service.

The new forecast is considerably lower than IDC's previous quantum computing forecast, which was published in 2021. In the interim, customer spend for quantum computing has been negatively impacted by several factors, including: slower than expected advances in quantum hardware development, which have delayed potential return on investment; the emergence of other technologies such as generative AI, which are expected to offer greater near-term value for end users; and an array of macroeconomic factors, such as higher interest and inflation rates and the prospect of an economic recession.

Today, AMD announced Amazon Web Services (AWS) has expanded its 4th Gen AMD EPYC processor-based offerings with the general availability of Amazon Elastic Compute Cloud (EC2) M7a and Amazon EC2 Hpc7a instances, which offer next-generation performance and efficiency for applications that benefit from high performance, high throughput and tightly coupled HPC workloads, respectively.

"For customers with increasingly complex and compute-intensive workloads, 4th Gen EPYC processor-powered Amazon EC2 instances deliver a differentiated offering for customers," said David Brown, vice president of Amazon EC2 at AWS. "Combined with the power of the AWS Nitro System, both M7a and Hpc7a instances allow for fast and low-latency internode communications, advancing what our customers can achieve across our growing family of Amazon EC2 instances."

Today, AMD released the findings from a new survey of global IT leaders which found that 3 in 4 IT leaders are optimistic about the potential benefits of AI—from increased employee efficiency to automated cybersecurity solutions—and more than 2 in 3 are increasing investments in AI technologies. However, while AI presents clear opportunities for organizations to become more productive, efficient, and secure, IT leaders expressed uncertainty on their AI adoption timeliness due to their lack of implementation roadmaps and the overall readiness of their existing hardware and technology stack.

AMD commissioned the survey of 2,500 IT leaders across the United States, United Kingdom, Germany, France, and Japan to understand how AI technologies are re-shaping the workplace, how IT leaders are planning their AI technology and related Client hardware roadmaps, and what their biggest challenges are for adoption. Despite some hesitations around security and a perception that training the workforce would be burdensome, it became clear that organizations that have already implemented AI solutions are seeing a positive impact and organizations that delay risk being left behind. Of the organizations prioritizing AI deployments, 90% report already seeing increased workplace efficiency.

Edifier International, prominent designer and award-winning manufacturer of consumer audio electronics for both the lifestyle and multimedia markets announces an update to the popular TWS1 earbuds: the TWS1 Pro 2. The TWS1 Pro 2 is a pair of truly wireless in-earbuds which combine Active Noise Cancellation (ANC) technology, Ambient Sound Mode and a Titanized Hybrid Diaphragm to provide you with the ultimate true wireless, musical experience.

The new Edifier TWS1 Pro 2 feature Active Noise cancellation with multiple ANC mode, the earbuds boast a noise cancellation performance of up to -42dB, furnishing users with an exclusive, quiet experience. Users can customize different levels of noise cancellation in the Edifier Connect App - eg - High or Low Noise Cancellation; Wind Reduction or even Noise Cancellation Off.

The global server market, grappling with the impact of worldwide inflation, saw significant shifts in 2023. Server OEMs and CSPs revamped their investment strategies, resulting in cutbacks in both annual shipments and ODM production plans. TrendForce observes that as the server market continues to decline, demand for AI surges. These combined factors have had a domino effect, compressing the rollout of new server platforms across the board.

Forecasts predict that this year's shipments of server motherboards are expected to decline by a market of 6~7%. Concurrently, shipments of whole servers aren't faring much better, with a projected decrease of 5~6%.