Last Tuesday, Alibaba announced its intentions to put out its own artificial intelligence (AI) chatbot product called Tongyi Qianwen - another rival to take on OpenAI's pioneering ChatGPT natural language processing tool. The Chinese technology giant is hoping to retrofit the new chatbot system into several arms of its business operations. Alibaba had revealed initial plans for chatbot integration earlier this year, and mentioned that it was providing an alternative to the already well established ChatGPT tool. Alibaba's workplace messaging application - DingTalk - is slated to receive the first AI-powered update in the near future, although the company did not provide a firm timeline for Tongyi Qianwen's release window.

The product name "Tongyi Qianwen" loosely translates to "seeking an answer by asking a thousand questions" - Alibaba did not provide an official English language translation at last week's press conference. Their chatbot is reported to function in both Mandarin and English language modes. Advanced AI voice recognition is set for usage in the Tmall Genie range of smart speakers (similar in function to the Amazon Echo). Alibaba expects to expand Tongyi Qianwen's reach into applications relating to e-commerce and mapping services.

According to TrendForce's latest survey of the server market, many cloud service providers (CSPs) have begun large-scale investments in the kinds of equipment that support artificial intelligence (AI) technologies. This development is in response to the emergence of new applications such as self-driving cars, artificial intelligence of things (AIoT), and edge computing since 2018. TrendForce estimates that in 2022, AI servers that are equipped with general-purpose GPUs (GPGPUs) accounted for almost 1% of annual global server shipments. Moving into 2023, shipments of AI servers are projected to grow by 8% YoY thanks to ChatBot and similar applications generating demand across AI-related fields. Furthermore, shipments of AI servers are forecasted to increase at a CAGR of 10.8% from 2022 to 2026.

The four major North American cloud service providers (CSPs) have made cuts to their server procurement quantities for this year because of economic headwinds and high inflation. Turning to server OEMs such as Dell and HPE, they are observed to have scaled back the production of server motherboards at their ODM partners. Given these developments, TrendForce now projects that global server shipments will grow by just 1.31% YoY to 14.43 million units for 2023. This latest figure is a downward correction from the earlier estimation. The revisions that server OEMs have made to their outlooks on shipments shows that the demand for end products has become much weaker than expected. They also highlight factors such as buyers of enterprise servers imposing a stricter control of their budgets and server OEMs' inventory corrections.

AMD and Arm have been gaining up on Intel in the server CPU market in the past few years, and the margins of the share that AMD had won over were especially large in 2022 as datacenter operators and server brands began finding that solutions from the number-2 maker growing superior to those of the long-time leader, according to Frank Kung, DIGITIMES Research analyst focusing primarily on the server industry, who anticipates that AMD's share will well stand above 20% in 2023, while Arm will get 8%.

Prices are one of the three major drivers that resulted in datacenter operators and server brands switching to AMD. Comparing server CPUs from AMD and Intel with similar numbers of cores, clockspeed, and hardware specifications, the price tags of most of the former's products are at least 30% cheaper than the latter's, and the differences could go as high as over 40%, Kung said.

The United States has recently imposed several sanctions on technology exports to China. These sanctions are designed to restrict the transfer of specific technologies and sensitive information to Chinese entities, particularly those with ties to the Chinese military or government. The primary motivation behind these sanctions is to protect American national security interests, as well as to protect American companies from unfair competition. According to Financial Times, we have information that Chinese tech Giant, Alibaba, can not access Arm licenses for Neoverse V1 technology. Generally, the technology group where Neoverse V-series falls in is called Wassenaar -- multilateral export control regime (MECR) with 42 participating states. This agreement prohibits the sale of technology that could be used for military purposes.

The US argues that Arm's Neoverse V1 IP is not only a product from UK's Arm but a design made in the US as well, meaning that it is a US technology. Since Alibaba's T-Head group responsible for designing processors that go into Alibaba's cloud services can not use Neoverse V1, it has to look for alternative solutions. The Neoverse V1 and V2 can not be sold in China, while Neoverse N1 and N2 can. Alibaba's T-Head engineer argued, "We feel that the western world sees us as second-class people. They won't sell good products to us even if we have money."

In what can only be called an unusual move, several Chinese fabless chip makers—such as Alibaba and Biren Technology—who manufacturers at TSMC, are looking at running their chips slower. The reason for this is that they're trying to circumvent the US sanctions against Chinese chip makers. It should be noted that these are chips that have already taped out and gone into sample production, such as Biren's BR100 GPU.As reported earlier today, Alibaba even had one of its chips delisted from the official SPEC ranking, due to being unavailable and it's possible that it's one of the chips that's affected by the US sanctions.

Considering that the Chinese chip makers are dependent on the same cutting edge nodes at TSMC as the likes of Nvidia, AMD, Qualcomm etc. it would potentially lead to more capacity for these companies at TSMC. According to the report by the Financial Times, Biren has had to stop shipments of its GPUs, as the company is going to have to prove that its chips don't violate the US export control restrictions. Apparently the rules to work out if a chip falls under the US sanctions or not are anything but clear. One metric is apparently based on the bidirectional transfer rate, which is capped at below 600 GB/s between chips, but the tricky part is that this metric can be calculated in several different ways. As such, Biren has dropped the transfer rate from 640 to 576 GB/s according to the Financial Times. The sanctions are likely to cause longer term concerns for TSMC as well, as the company is likely to lose several big customers for its cutting edge nodes, at least for the time being.

When Alibaba announced the development of an Armv9-based processor, it claimed to be some of the most performant designs that the company has laid its hand on, claiming to win the SPEC 2017 CPU benchmark and place itself in the top spot for the world record. Reportedly, the Yitian 710 CPU was able to score an integer score of 440 points in SPECint2017, which is comparable to a dual-socket Xeon Platinum 8362 system. The SPEC 2017 benchmark represents an industry-standard suite of tests that have a combination of 43 different test scenarios that measure the performance of a specific processor. Alibaba's Yitian 710 was claiming to possess the performance target where it is the fastest CPU on the leaderboard, with one major flaw. The Chinese company hasn't mentioned this processor's lack of general availability, making its scoreboard efforts invalid.

As Alibaba plans to use its design almost exclusively in-house and maybe offer it to a few partners, the processor is not sold commercially. This is apparently a requirement for the SPEC CPU 2017 benchmark to be completed, so the SPEC committee has overruled the result to make it invalid, stating the following:

SPEC CommitteeSPEC has determined that this result does not comply with the SPEC OSG Guidelines for General Availability and the SPEC CPU 2017 run and reporting rules. Specifically, the submitter has notified SPEC that General Availability requirements were not met.

TikTok's parent company ByteDance has recently begun hiring chip designers to help develop specialized processors for fields where they haven't been able to find existing suppliers. The company is looking to design chips that are optimized for hosting their video, information, and entertainment apps without any plans to sell these processors to other companies. This latest announcement follows various other Chinese companies such as Alibaba and Baidu in developing custom processors to decrease their reliance on foreign companies and improve performance in specific tasks. The initial job listings only include 31 openings for positions such as experts, specialists, and interns with more staff likely required in the future.

One of the largest cloud providers in China, Alibaba, has today announced a preview for a new instance powered by Yitian 710 processor. The new processor is a collection of Alibaba's efforts to develop a home-grown design capable of powering cloud instances and the infrastructure needed for it and its clients. Without much further ado, the Yitian 710 is based on Armv9 ISA and features 128 cores. Ramping up to 3.2 GHz, these cores are paired with eight-channel DDR5 memory to enable sufficient data transfer. In addition, the CPU supports 96 PCIe 5.0 lanes for IO with storage and accelerators. These are most likely custom designs, and we don't know if they are using a blueprint based on Arm's Neoverse. The CPU is manufactured at TSMC's facilities on 5 nm node and features 60 billion transistors.

Alibaba offers these processors as a part of their Elastic Compute Service (ECS) instance called g8m, where users can select 1/2/4/8/16/32/64/128 vCPUs, where each vCPU is equal to one CPU core physically. Alibaba is running this as a trial option and notes that users should not run production code on these instances, as they will disappear after two months. Only 100 instances are available for now, and they are based in Alibaba's Hangzhou zone in China. The company notes that instances based on Yitian 710 processors offer 100 percent higher efficiency than existing AMD/Intel solutions; however, they don't have any useful data to back it up. The Chinese cloud giant is likely trying to test and see if the home-grown hardware can satisfy the needs of its clients so that they can continue the path to self-sustainability.

Tachyum today announced it has completed validation of its Prodigy Universal Processor and software ecosystem with the operating system FreeBSD, and completed the Prodigy instruction set architecture (ISA) for FreeBSD porting. FreeBSD powers modern servers, desktops, and embedded platforms in environments that value performance, stability, and security. It is the platform of choice for many of the busiest websites and the most pervasive embedded networking and storage devices.

The validation of FreeBSD extends Tachyum's support for open-source operating systems and tools, including Linux, Yocto Project, PHP, MariaDB, PostgreSQL, Apache, QEMU, Git, RabbitMQ, and more.

Arm announced today that its board of directors has appointed 35-year semiconductor industry leader Rene Haas as chief executive officer and member of the board of directors, effective immediately. Mr. Haas succeeds Simon Segars, who has stepped down as chief executive officer and member of the board of directors after 30 years with the company. In the near-term, Mr. Segars will support the leadership transition in an advisory role for Arm.

"Rene is the right leader to accelerate Arm's growth as the company starts making preparations to re-enter the public markets," said Masayoshi Son, Representative Director, Corporate Officer, Chairman & CEO of SoftBank Group Corp. "I would like to thank Simon for his leadership, contributions and dedication to Arm over the past 30 years."

With the x86 architecture, large hyperscale cloud providers have been experiencing all sorts of troubles, from high power consumption to the high pricing structure of these processors. Companies like Amazon Web Services (AWS) build their processors based on 3rd party instruction set architecture designs. Today, Alibaba, the Chinese giant, has announced the launch of two processors made in-house to serve everything from edge to central server processing. First in line is the RISC-V-based Xuantie series of processors, which can run anything from AliOS, FreeRTOS, RT-Thread, Linux, Android, etc., to other operating systems as well. These processors are open-source, capable of modest processing capabilities, and designed as IPs that anyone can use. You can check them out on T-Head GitHub repositories here.

The other thing that Alibaba announced is the development of a 128-core custom processor based on the Arm architecture. Called Yitian 710 server SoC, TSMC manufactures it on the company on 5 nm semiconductor node. So far, Alibaba didn't reveal any details about the SoC and what Arm cores are used. However, this signifies that the company seeks technology independence from outside sources and wants to take it all in-house. With custom RISC-V processors for lower-power tasks and custom Arm server CPUs, the whole infrastructure is covered. It is just a matter of time before Alibaba starts to replace x86 makers in full. However, given the significant number of chips that the company needs, it may not happen at any sooner date.

The ramp-up of the Intel Ice Lake and AMD Milan processors is expected to not only propel growths in server shipment for two consecutive quarters from 2Q21 to 3Q21, but also drive up the share of high-density products in North American hyperscalers' enterprise SSD purchases, according to TrendForce's latest investigations. In China, procurement activities by domestic hyperscalers Alibaba and ByteDance are expected to increase on a quarterly basis as well. With the labor force gradually returning to physical offices, enterprises are now placing an increasing number of IT equipment orders, including servers, compared to 1H21. Hence, global enterprise SSD procurement capacity is expected to increase by 7% QoQ in 3Q21. Ongoing shortages in foundry capacities, however, have led to the supply of SSD components lagging behind demand. At the same time, enterprise SSD suppliers are aggressively raising the share of large-density products in their offerings in an attempt to optimize their product lines' profitability. Taking account of these factors, TrendForce expects contract prices of enterprise SSDs to undergo a staggering 15% QoQ increase for 3Q21.

The demands of data center workloads and internet traffic are growing exponentially, and new solutions are needed to keep up with these demands while reducing the current and anticipated growth of power consumption. But the variety of workloads and applications being run today means the traditional one-size-fits all approach to computing is not the answer. The industry demands flexibility; design freedom to achieve the right level of compute for the right application.

As Moore's Law comes to an end, solution providers are seeking specialized processing. Enabling specialized processing has been a focal point since the inception of our Neoverse line of platforms, and we expect these latest additions to accelerate this trend.

Enterprise demand for cloud services has been rising steady in the past two years owing to the rapidly changing global markets and uncertainties brought about by the COVID-19 pandemic. TrendForce's investigations find that most enterprises have been prioritizing cloud service adoption across applications ranging from AI to other emerging technologies as cloud services have relatively flexible costs. Case in point, demand from clients in the hyperscale data center segment constituted more than 40% of total demand for servers in 4Q20, while this figure may potentially approach 45% for 2021. For 2021, TrendForce expects global server shipment to increase by more than 5% YoY and ODM Direct server shipment to increase by more than 15% YoY.

Today the Hot Chips program committee officially announced the August conference line-up, posted to hotchips.org. For this first-ever live-streamed Hot Chips Symposium, the program is better than ever!

In a session on deep learning training for data centers, we have a mix of talks from the internet giant Google showcasing their TPUv2 and TPUv3, and a talk from startup Cerebras on their 2nd gen wafer-scale AI solution, as well as ETH Zurich's 4096-core RISC-V based AI chip. And in deep learning inference, we have talks from several of China's biggest AI infrastructure companies: Baidu, Alibaba, and SenseTime. We also have some new startups that will showcase their interesting solutions—LightMatter talking about its optical computing solution, and TensTorrent giving a first-look at its new architecture for AI.

Today, Alibaba, Cisco, Dell EMC, Facebook, Google, Hewlett Packard Enterprise, Huawei, Intel Corporation and Microsoft announce the incorporation of the Compute Express Link (CXL) Consortium, and unveiled the names of its newly-elected members to its Board of Directors. The core group of key industry partners announced their intent to incorporate in March 2019, and remain dedicated to advancing the CXL standard, a new high-speed CPU-to-Device and CPU-to-Memory interconnect which accelerates next-generation data center performance.

The five new CXL board members are as follows: Steve Fields, Fellow and Chief Engineer of Power Systems, IBM; Gaurav Singh, Corporate Vice President, Xilinx; Dong Wei, Standards Architect and Fellow at ARM Holdings; Nathan Kalyanasundharam, Senior Fellow at AMD Semiconductor; and Larrie Carr, Fellow, Technical Strategy and Architecture, Data Center Solutions, Microchip Technology Inc.

NVIDIA today reported revenue for the first quarter ended April 28, 2019, of $2.22 billion compared with $3.21 billion a year earlier and $2.21 billion in the previous quarter. GAAP earnings per diluted share for the quarter were $0.64, compared with $1.98 a year ago and $0.92 in the previous quarter. Non-GAAP earnings per diluted share were $0.88 compared with $2.05 a year earlier and $0.80 in the previous quarter.

"NVIDIA is back on an upward trajectory," said Jensen Huang, founder and CEO of NVIDIA. "We've returned to growth in gaming, with nearly 100 new GeForce Max-Q laptops shipping. And NVIDIA RTX has gained broad industry support, making ray tracing the standard for next-generation gaming.

Tencent Holdings, China's second most valuable tech firm after Alibaba, was mauled at the markets Tuesday (31/07), with its share value dropping 25 percent from its January peak. This translates to a stunning USD $143 billion (yes, billion) in investor wealth being wiped out. The crash has had a domino effect on tech stocks worldwide, as FANG block member Facebook lost an equally stunning $136 billion in market value, over the past three trading sessions. Apparently, buzzwords of the season such as AI and big-data aren't proving enough to keep investors interested in tech stocks as many are beginning to question the stability of the tech industry. All eyes are now on Tencent's August 15 release of its Q2-2018 financial results.

NVIDIA will host thousands of the world's leading AI experts at its ninth annual GPU Technology Conference (GTC) on March 26-29 at the San Jose McEnery Convention Center. NVIDIA founder and CEO Jensen Huang will deliver a keynote address on Tuesday, March 27, at 9 a.m. Pacific time to an expected 8,000 attendees representing the diverse, rapidly expanding AI and GPU computing community.

"GTC is where the world's leading researchers and business leaders learn how to harness the power of AI," said Greg Estes, vice president of Developer Programs at NVIDIA. "As GPU computing continues to drive the AI revolution, GTC is where you'll see the future take shape."

Spire rolled out the SP-ATX-2000W-BTC/ETH, an ATX/PS2 power-supply for GPU-based crypto-currency mining rigs. With 2000W power on tap, the PSU bears a no-frills design to keep costs low. The design focus is not just on the number of PCIe power connectors, but also the length of the PCIe power cables, so you can have a multitude of graphics cards popping out through risers. The PSU comes with a total of eighteen PCIe power connectors, of which ten are 6-pin, and eight 6+2 pin. You also get a surprisingly high thirteen SATA power connectors, a 4+4 pin EPS, and a 24-pin ATX.

Under the hood, the Spire SP-ATX-2000W-BTC/ETH features a single +12V rail design with so-called "85 Plus Gold" efficiency; APFC, common electrical protection mechanisms against over/under-voltage, overload, short-circuit, and overheat. Two 80 mm fans (one on each end) are used to keep the unit cool. Taking into account its target audience, Spire is rating its life-expectancy at 100,000 hours, and is backing it with a 2-year warranty. It is priced at USD $219.99 a piece Stateside, or 199.95€ a piece in the EU. Currently, the company is only selling it on B2B platforms such as Alibaba, in 200-unit minimum orders.

It's no surprise that leading Chinese tech companies have close associations with the Chinese Government and the PLA. Intel has waded into controversial waters as reports point to the chipmaker sharing information about its products' vulnerability to Meltdown and Spectre with Chinese tech companies before warning the United States Government, potentially giving the Chinese government either a head-start into securing its IT infrastructure, or exploiting that of a foreign government.

Lenovo and Alibaba were among the first big tech companies to be informed about Meltdown and Spectre; Lenovo is Intel's biggest PC OEM customer, while Alibaba is the world's largest e-commerce platform and cloud-computing service provider. Both companies are known to have close associations with the Chinese government. The United States Government was not part of the first group of companies informed about the deadly vulnerabilities.

Intel tried desperately in a press note late Wednesday to brush aside allegations that the recent hardware security-vulnerability are a "bug" or a "flaw," and that the media is exaggerating the issue, notwithstanding the facts that the vulnerability only affects Intel x86 processors and not AMD x86 processors (despite the attempt to make it appear in the press-release as if the vulnerability is widespread among other CPU vendors such as AMD and ARM by simply throwing their brand names into the text); notwithstanding the fact that Intel, Linux kernel lead developers with questionable intentions, and other OS vendors such as Microsoft are keeping their correspondence under embargoes and their Linux kernel update mechanism is less than transparent; notwithstanding the fact that Intel shares are on a slump at the expense of AMD and NVIDIA shares, and CEO Brian Kraznich sold a lot of Intel stock while Intel was secretly firefighting this issue.

The exploits, titled "Meltdown," is rather glaring to be a simple vulnerability, and is described by the people who discovered it, as a bug. Apparently, it lets software running on one virtual machine (VM) access data of another VM, which hits at the very foundations of cloud-computing (integrity and security of virtual machines), and keeps customers wanting cost-effective cloud services at bay. It critically affects the very business models of Amazon, Google, Microsoft, and Alibaba, some of the world's largest cloud computing providers; and strikes at the economics of choosing Intel processors over AMD, in cloud-computing data centers, since the software patches that mitigate the vulnerability, if implemented ethically, significantly reduce performance of machines running Intel processors and not machines running AMD processors (that don't require the patch in the first place). You can read Intel's goalpost-shifting masterpiece after the break.

In another business-deal-gone-right for Advanced Micro Devices Inc. in chinese soil, the company is now going to provide China's Alibaba giant with server chips with which to power the company's cloud vision. Whilst Alibaba is most commonly known due to its e-commerce activities (through the Aliexpress and Taobao brands), the chinese company is diversifying, even going so far as entering the entertainment space. Now, Alibaba is bidding to carve itself an even larger piece of the cloud market from the likes of Microsoft's Azure and Amazon's Web Services.

The deal was announced this Friday at the Alibaba Computing Conference by Lisa Su (AMD's CEO) and Simon Hu (president of Alibaba Cloud, the chinese giant's cloud computing arm). Through it, AMD will see its Radeon Pro chips supporting and expanding upon the increasingly-in-demand cloud computing capabilities of the chinese company, which already powers around 35% of China's websites.