Monday, September 16th 2024

Interview with AMD's Senior Vice President and Chief Software Officer Andrej Zdravkovic: UDNA, ROCm for Radeon, AI Everywhere, and Much More!

A few days ago, we reported on AMD's newest expansion plans for Serbia. The company opened two new engineering design centers with offices in Belgrade and Nis. We were invited to join the opening ceremony and got an exclusive interview with one of AMD's top executives, Andrej Zdravkovic, who is the senior vice president and Chief Software Officer. Previously, we reported on AMD's transition to become a software company. The company has recently tripled its software engineering workforce and is moving some of its best people to support these teams. AMD's plan is spread over a three to five-year timeframe to improve its software ecosystem, accelerating hardware development to launch new products more frequently and to react to changes in software demand. AMD found that to help these expansion efforts, opening new design centers in Serbia would be very advantageous.

We sat down with Andrej Zdravkovic to discuss the purpose of AMD's establishment in Serbia and the future of some products. Zdravkovic is actually an engineer from Serbia, where he completed his Bachelor's and Master's degrees in electrical engineering from Belgrade University. In 1998, Zdravkovic joined ATI and quickly rose through the ranks, eventually becoming a senior director. During his decade-long tenure, Zdravkovic witnessed a significant industry shift as AMD acquired ATI in 2006. After a brief stint at another company, Zdravkovic returned to AMD in 2015, bringing with him a wealth of experience and a unique perspective on the evolution of the graphics and computing industry.
Here is the full interview:

Aleksandar: So, regarding the new opening of the center in Serbia, what is it going to be about? Is it going to be about software or hardware, AI or anything else?

Andrej: Primarily it is software for team we have right now. Large part of the team is working on the virtualization of our graphics processor for the data centers. We have a team working on compilers. We have the team working on content protection and security, which is going to be expanding into further security aspects. And we have a team working on AI technologies for data center developing our ROCm subsystem for data center. New team, that we just established, is working on ROCm for Radeon. We're extending our ROCm subsystem to Radeon graphics products, so everybody can get to use AI on AMD APUs and Radeon GPUs. Going further, we are not limiting Serbia team to these technologies. This is going to be a full-fledged design center, we are going to have RTL design, hardware verification and many other hardware and software technologies as an option. It really will depend on the available talent and on the ability to link to [local] universities. Virtually creating talent.

TechPowerUp: What made you come to Serbia, is it the local talent or anything else?

Andrej: Few different things. Definitely the availability of the qualified engineering talent. We started with a provider of outside services. We recognized the capability, and we have grown the initial, relatively small core, to the sizeable team of engineers that are working for us now. I personally have to insist the local talent is phenomenal because I graduated from the university here. It is very important that engineers we hire are very interested to learn and step up to new challenges. We started to work with Serbian universities, to partner and grow the next [generation] talent.

TechPowerUp: So, you were discussing ROCm. How easy it is for development right now and how easy it will be in the future for developers to write ROCm software and adapt from other accelerators for AI and machine learning to AMD ROCm accelerators.

Andrej: Great question. Today the challenge for ROCm developers is that they need to work on a big data center, [Instinct MI] machine intelligence type products. The access to that kind of a high-end product is limited, usually to developers in big companies like Microsoft. Also, the cost of that access is pretty high. We are bringing ROCm as a subsystem on the Radeon graphics products, desktop graphics products, or any Radeon APU powering desktops and notebooks. Developers will be provided with everyday access to ROCm. ROCm subsystem and the language that sits above it, which is "HIP", is very interesting for many developers from a perspective of being completely open. Compared to our competition, we have the system that is open top-to-bottom, completely open source. Any development, any contribution, and debugging is much easier for developers. We also provide the tools that allow a developer to take an AI application designed for CUDA and use the application that is called "HIPIFY" to transfer it from CUDA to run directly on HIP and ROCm.

TechPowerUp: How reliable is HIPIFY for enterprise applications?

Andrej: We find that HIPIFY is very reliable and very straightforward. We also find it's usually quite performant. Further optimizations are always welcomed, of course, but we find that out to the shoot, it works OK. There are some aspects that introduce complexity because the hardware subsystems are not the same. If the application is using these constructs and some of the lower level function calls, that are hardware specific, that is something that HIPIFY cannot translate. We don't find it that often, other than in applications that are extremely, extremely optimized. But then, if somebody had a will to optimize the application to an extreme level, we are going to help them optimize for HIP/ROCm

TechPowerUp: So AMD's strategy is to provide ROCm support across the entire stack, edge-to-core-to-cloud. All of these cases?

Andrej: Correct.

TechPowerUp: Regarding the new UDNA: We heard that UDNA is combining RDNA and CDNA to single architecture for GPU. So if that's going to be something that's going to be developed here or parts of it developed here or something else?

Andrej: Yeah, that's new. The portions of that new work will be developed in Serbia. We are working to define the next aspects of what's going to be developed here. The technology is moving very, very fast, so access to good engineers thank can learn quickly is extremely, extremely important. This is what we have in Serbia. Along the lines of your question on the combination of new technologies in notebook computers powered by AMD, we are major player in what we call an "AI PC", That is actually immersion of everything. This is the device that has a CPU, that has GPU, and it has a new unit, the NPU. We are opening the world of low power AI using the NPU in combination with the new Windows operating system, supporting the new features that Microsoft announced for NPU. In addition to running the most advanced AI on the NPU you can also execute AI applications on AMD GPU and on AMD CPU.

TechPowerUp: That's very exciting. Exciting because the true power of architecture lies in low power solutions, not high-power high-performance solutions when you give them power and massive TDPs, it is much easier to run than something constrained like smaller NPUs.

Andrej: That is correct. The interesting way to look at it is: we always need to find the balance. There are applications that require high-power solutions, that they are natively designed to work on, let's say with larger data formats, FP16, FP32... and large data sizes. So, some of the applications of the artificial intelligence require these formats and large memory would be run on various types of GPUs. Either RDNA or Machine Intelligence [Instinct MI] GPUs. If you go into the large language models, something like ChatGPT, or that kind of apps, a lot of these actually run perfectly well on the data formats like INT8 or INT4. So, we run that on the NPU on the low power executing very, very quickly, equally quickly, or even faster, as you would on GPU, using much less power. And that's where the AI PC starts playing. NPU combined with APU offers something for every aspect of human need in a PC, AI PC. And beauty of AMD is that we have all the solutions to offer to all these aspects of the need.

TechPowerUp: Take an application and distribute it across all teams. Get it developed fast?

Andrej: Exactly. That is where Serbia team comes. One more ace in our portfolio.

TechPowerUp: What is the future product you are most excited about? Is it something from the software side that is upcoming or something from the hardware side?

Andrej: Of course, you know that I cannot disclose the future products until we are ready to disclose them. Coming from the software world, the innovations in software and in AI are phenomenal. I think we are going to see the combination of both. The way we are looking at technology at AMD is that we are offering solutions for more and more verticals. Everything that we are doing recently, acquisition of Silo, which is bringing huge AI knowledge and competency, or just recently announced plan to acquire ZT Systems. We want to position ourselves as system provider, not to compete with system providers, but to grow that knowledge how to build systems and solutions. The next thing from AMD in general will be more of a combination of everything to provide solutions to our customer. Looking at that software becomes a huge part of it. My title, the Chief Software Officer, kind of shows that importance and level of recognition that AMD is putting into software. We are far from the classical semiconductor company that we were maybe 20 years ago. We are creating solutions to the world's most important challenges.
Add your own comment

40 Comments on Interview with AMD's Senior Vice President and Chief Software Officer Andrej Zdravkovic: UDNA, ROCm for Radeon, AI Everywhere, and Much More!

#1
Onasi
While the interview is interesting and appreciated, I think one question that is important and wasn’t asked (possibly due to a fear of it being too direct) is this - how exactly does AMD plan on pulling away existing NV customers (i.e most of the market) from CUDA with this? Yes, it’s an alternative, sure, but WHY do they think that those who got used to and organized their workflow already around CUDA and its established software support just to go for an untested “new thing”, regardless of whether or not HIPIFY will be easy or not to use as a translation for their software? Like, what’s the carrot here? Especially since he admits that there are cases when HIPIFY either won’t work perfectly or require extensive optimization. So far it seems like the plan is “it’s gonna be great, totally, and it would be REALLY nice if a lot of customers would adopt it instead of staying with established player because of… reasons”.
Posted on Reply
#2
Wirko
Onasihow exactly does AMD plan on pulling away existing NV customers (i.e most of the market)
I'll just note that there are also potential NV customers out there. A considerable number of them. If AMD focuses on those and offers good software and support, as they are promising to do, they can capture a good share of customers who would otherwise go elsewhere (not just to NV!)

Compare that to the rise of Epyc. How was AMD able to sell any chips when everyone already had all the CPUs they could ever need, and no one was ever fired for buying Intel?
Posted on Reply
#3
AusWolf
OnasiWhile the interview is interesting and appreciated, I think one question that is important and wasn’t asked (possibly due to a fear of it being too direct) is this - how exactly does AMD plan on pulling away existing NV customers (i.e most of the market) from CUDA with this? Yes, it’s an alternative, sure, but WHY do they think that those who got used to and organized their workflow already around CUDA and its established software support just to go for an untested “new thing”, regardless of whether or not HIPIFY will be easy or not to use as a translation for their software? Like, what’s the carrot here? Especially since he admits that there are cases when HIPIFY either won’t work perfectly or require extensive optimization. So far it seems like the plan is “it’s gonna be great, totally, and it would be REALLY nice if a lot of customers would adopt it instead of staying with established player because of… reasons”.
Imo, the correct approach is focusing on what they can offer to the customer, and not on what they have compared to Nvidia. A penis measurement contest always results in losers. For that, this is a good interview.

What I would have liked to know more about is the future of Radeon. Namely, when is RDNA 4 coming, what's next, and what can we expect with the arrival of UDNA (the answer to that question was vague as heck).
Posted on Reply
#4
Kyan
AusWolfWhat I would have liked to know more about is the future of Radeon. Namely, when is RDNA 4 coming, what's next, and what can we expect with the arrival of UDNA (the answer to that question was vague as heck).
I think considering the role of Andrej Zdravkovic, all question directly specified to Radeon and the video games side of thing will just be too far from him and what he do at AMD. The question about UDNA was the closest thing related to RDNA he answered and he wasn't able to say (too) much about it, so I don't think there's more to dig with him.
Posted on Reply
#5
Geofrancis
I still don't understand why it's taken so long for them to do this, I remember cracking passwords on the X1950XTX as it was a compute monster for its time. it was obvious to everyone that GPU computing was going to be a thing.
Posted on Reply
#6
Daven
WirkoCompare that to the rise of Epyc. How was AMD able to sell any chips when everyone already had all the CPUs they could ever need, and no one was ever fired for buying Intel?
That’s a good comparison but I feel Epyc rose up due to computing power density. So many more cores per 1U space than Intel during the first generations of Epyc. I’m not sure if density advantages will play out in the compute GPU space.
Posted on Reply
#7
Dr. Dro
AusWolfImo, the correct approach is focusing on what they can offer to the customer, and not on what they have compared to Nvidia. A penis measurement contest always results in losers. For that, this is a good interview.

What I would have liked to know more about is the future of Radeon. Namely, when is RDNA 4 coming, what's next, and what can we expect with the arrival of UDNA (the answer to that question was vague as heck).
I agree. I have never read so much to make out practically nothing of it, though. It clearly looks like this guy has no vision or authority to make final decisions, which seems to be the problem with AMD nowadays. I fully expect this venture to fail yet again, if I may be perfectly honest here.
Posted on Reply
#8
Steevo
GeofrancisI still don't understand why it's taken so long for them to do this, I remember cracking passwords on the X1950XTX as it was a compute monster for its time. it was obvious to everyone that GPU computing was going to be a thing.
Rainbow tables and the first generation of Folding at Home GPU powered.

The biggest reason ATI was able to do compute was Nvdia was improving performance through rounding and fewer bits and thus had incorrect math for it.
Posted on Reply
#9
Geofrancis
SteevoRainbow tables and the first generation of Folding at Home GPU powered.

The biggest reason ATI was able to do compute was Nvdia was improving performance through rounding and fewer bits and thus had incorrect math for it.
I forgot about running folding@home on them. I was more of a SETI guy lol
Posted on Reply
#10
Dragokar
Open up in Serbia is kind of dangerous. Yeah, in short and midterm you can gain many cheap staff and assets. In the long run, you will sooner or later lose that knowledge to Russian partners. You also should be prepared for paying and getting offered bribe money, since that is pretty common down there. How do I know, I have family & friends there and made some loose business......and let it put this mildly.....the mentality in this area of Europe is totally different compared to middle and Western Europe. Especially in regard to laws.....

Of course, AMD isn't stupid and will have contracts and many lawyers overwatch it, but I wouldn't go down this route just because it is cheap (which is the main reason why company open up stuff there).
Posted on Reply
#11
Geofrancis
DragokarOpen up in Serbia is kind of dangerous. Yeah, in short and midterm you can gain many cheap staff and assets. In the long run, you will sooner or later lose that knowledge to Russian partners. You also should be prepared for paying and getting offered bribe money, since that is pretty common down there. How do I know, I have family & friends there and made some loose business......and let it put this mildly.....the mentality in this area of Europe is totally different compared to middle and Western Europe. Especially in regard to laws.....

Of course, AMD isn't stupid and will have contracts and many lawyers overwatch it, but I wouldn't go down this route just because it is cheap (which is the main reason why company open up stuff there).
its all open source software, they just need to go to github.
Posted on Reply
#12
Neo_Morpheus
AusWolfImo, the correct approach is focusing on what they can offer to the customer, and not on what they have compared to Nvidia
Adding to that, availability and price.

Ngreedias backorder log is huge and same for their prices.

But if you have similar hardware at lower price and available AND tools to pass the CUDA trap, then you will have an option to your AI needs.

So situation like this wont be repeated: :)

www.tomshardware.com/tech-industry/elon-musk-and-oracle-founder-begged-nvidia-ceo-jensen-huang-for-ai-gpus-at-dinner
Posted on Reply
#13
Dr. Dro
Neo_MorpheusAdding to that, availability and price.

Ngreedias backorder log is huge and same for their prices.

But if you have similar hardware at lower price and available AND tools to pass the CUDA trap, then you will have an option to your AI needs.

So situation like this wont be repeated: :)

www.tomshardware.com/tech-industry/elon-musk-and-oracle-founder-begged-nvidia-ceo-jensen-huang-for-ai-gpus-at-dinner
All of this assumes AMD can develop a competent software stack. They have repeatedly proven that they cannot. Until they overcome this problem with a reliability track record, AMD will never be competitive... and the time it takes for that to happen, Nvidia will certainly increase their hardware's performance even further and improve their software as well.

This is going to be an Herculean task
Posted on Reply
#14
Neo_Morpheus
Dr. DroAll of this assumes AMD can develop a competent software stack. They have repeatedly proven that they cannot. Until they overcome this problem with a reliability track record, AMD will never be competitive... and the time it takes for that to happen, Nvidia will certainly increase their hardware's performance even further and improve their software as well.

This is going to be an Herculean task
I will admit that I dont know much about the difference between current AI craze and the supercomputer markets, but I will assume that AMD is not that far back since they keep winning those contracts, especially the supercomputers ones.

I mean, software must be taking advantage of their hardware.

That said, as stated in the interview, one of their biggest obstacle is that their software is running as expected on very expensive hardware (MI300), so few have access to transition/migrate away of CUDA.

But your point stands, they need to provide the tools for the customers. It does seems that they are taking that seriously and hopefully dont fail as before.
Posted on Reply
#15
Dr. Dro
Neo_MorpheusI will admit that I dont know much about the difference between current AI craze and the supercomputer markets, but I will assume that AMD is not that far back since they keep winning those designs.

I mean, software must be taking advantage of their hardware.

That said, as stated in the interview, one of their biggest obstacle is that their software is running as expected on very expensive hardware (MI300), so few have access to transition/migrate away of CUDA.

But your point stands, they need to provide the tools for the customers. It does seems that they are taking that seriously and hopefully dont fail as before.
Instinct's carved some marketshare because the hardware itself is extremely powerful, and software is being developed specifically for it as a result... but yeah
Posted on Reply
#16
Dragokar
Geofrancisits all open source software, they just need to go to github.
Yeah but now how you build up and train/teach your staff ;)

Also look how EKWB Serbia went.....well it was good for EK Serbias Manager xD
Posted on Reply
#17
GoldenX
Finally, just 17-20 years late.
Posted on Reply
#18
Neo_Morpheus
Dr. DroInstinct's carved some marketshare because the hardware itself is extremely powerful, and software is being developed specifically for it as a result... but yeah
Then fingers crossed they can bring the software stack up to speed asap.
Posted on Reply
#19
Geofrancis
AMD was trying to do what all the big RISC companies did back in the day by having supercomputer silicone, the problem is the developers need systems to work on and if your only option is 10k workstations then you are screwed, this is how x86 took over the server market, not because it was technically better but because it could be set up and ran from cheap hardware that developers could work on. a lot of webservers used to just be desktop pcs that were good enough, this is where Nvidia is, they have consumer hardware developers can use before they scale up and this is what AMD is missing, they can't get developers to work on AMD software if they do not have the hardware to run it.
Posted on Reply
#20
Makaveli
Dr. DroAll of this assumes AMD can develop a competent software stack. They have repeatedly proven that they cannot. Until they overcome this problem with a reliability track record, AMD will never be competitive... and the time it takes for that to happen, Nvidia will certainly increase their hardware's performance even further and improve their software as well.

This is going to be an Herculean task
Nothing is impossible they however will need to throw the kitchen sink and everything they have at it.

This is not like competing with Intel who fumbles the ball from time to time. Nvidia is a totally different animal.
Posted on Reply
#21
z1n0x
If the AI market is as BIG as some make it out be, AMD is poised to take its slice of the AI pie. nVidia can't supply and support it all. I hear the concerns around the software stack and ROCm, but i also hear that AMD is making significant progress on that front.
Posted on Reply
#22
chstamos
DragokarOpen up in Serbia is kind of dangerous. Yeah, in short and midterm you can gain many cheap staff and assets. In the long run, you will sooner or later lose that knowledge to Russian partners. You also should be prepared for paying and getting offered bribe money, since that is pretty common down there. How do I know, I have family & friends there and made some loose business......and let it put this mildly.....the mentality in this area of Europe is totally different compared to middle and Western Europe. Especially in regard to laws.....

Of course, AMD isn't stupid and will have contracts and many lawyers overwatch it, but I wouldn't go down this route just because it is cheap (which is the main reason why company open up stuff there).
While I agree with what you're saying about corruption, I think AMD is way too big and way too high profile an investor to face these sort of issues that small businesses will regularly face in the balkans (albania, north macedonia, bulgaria are pretty much the same situation). They're going to have "special attention" of sorts, from the higher levels of government, and probably skip all the corruption roadblocks.
Posted on Reply
#23
Neo_Morpheus
GeofrancisAMD was trying to do what all the big RISC companies did back in the day by having supercomputer silicone, the problem is the developers need systems to work on and if your only option is 10k workstations then you are screwed, this is how x86 took over the server market, not because it was technically better but because it could be set up and ran from cheap hardware that developers could work on. a lot of webservers used to just be desktop pcs that were good enough, this is where Nvidia is, they have consumer hardware developers can use before they scale up and this is what AMD is missing, they can't get developers to work on AMD software if they do not have the hardware to run it.
Pretty much what I said, you said way more eloquent than myself.
Posted on Reply
#24
Visible Noise
WirkoI'll just note that there are also potential NV customers out there. A considerable number of them. If AMD focuses on those and offers good software and support, as they are promising to do, they can capture a good share of customers who would otherwise go elsewhere (not just to NV!)

Compare that to the rise of Epyc. How was AMD able to sell any chips when everyone already had all the CPUs they could ever need, and no one was ever fired for buying Intel?
Epyc runs existing (Intel) code without having to touch it at all.

The same can’t be said of AMD’s AI/compute products.
Posted on Reply
#25
Makaveli
Visible NoiseThe same can’t be said of AMD’s AI/compute products.
It sounds way worse when you put it like this without even a slight breakdown.

There problem isn't hardware its the software stack.

If it was both hardware and software then yes I would agree. They just need to put in a huge amount of money and resources into that software stack which they have committed to doing.
Posted on Reply
Add your own comment
Nov 21st, 2024 06:45 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts