nvidia-unveils-the-egx,-its-supercomputer-for-5g-edge-processing
The Nvidia EGX platform is designed to handle 5G data at the edge. (Image source: Nvidia)

Nvidia kicked off Mobile World Congress (MWC) 2019 in Los Angeles with a big investment on the future of 5G via what the company is calling “the world’s first edge supercomputer.” Nvidia wants to position its EGX supercomputer platform as the go-to platform for processing the enormous streams of sensor data that 5G will be bringing in from smart factories, IoT devices, and even city streets. The goal, Jensen Huang, NVIDIA founder and CEO, explained, is to place powerful compute at the edge of the 5G network for high-performance, low latency processing for tasks as varied as enhanced retail experiences all the way to autonomous, connected cars.

Delivering a keynote a MWC 2019, Huang emphasized that for 5G to bring about the next great technological leap, data centers are going to need the computing power to process the new streams of data that will be coming in as 5G connects more and more devices. “We’ve entered a new era, where billions of always-on IoT sensors will be connected by 5G and processed by AI,” Huang said. “Its foundation requires a new class of highly secure, networked computers operated with ease from far away.”

That’s where the Nvidia EGX comes in. The configurable platform runs with an Nvidia Cuda Tensor Core GPU and can be optimized for processing a variety of sensor information (including LiDAR) and also for artificial intelligence and robotics applications. Nvidia says that one core can run at processing speeds up to 240 teraflops. “One [EGX] rack will replace hundreds of CPU servers,” Huang told the MWC audience. The EGX is scalable and can go from a single, maker-friendly Jetson Nano to a high horsepower rack of T4 servers depending on engineers’ needs. The EGX also runs a proprietary software stack that Nvidia says is enterprise-grade and optimized for running on edge-based servers.

New SDKs, More Powerful AI

Huang announced that Nvidia is already making strategic partnerships and rolling out developer applications around the EGX. Samsung, for example, will be deploying the EGX in its factories to assist with semiconductor design and manufacturing processes. “Samsung has been an early adopter of both GPU computing and AI from the beginning,” Charlie Bae, executive vice president of foundry sales and marketing at Samsung Electronics, said in a press statement. “NVIDIA’s EGX platform helps us to extend these manufacturing and design applications smoothly onto our factory floors.”

On the developer end, Nvidia is looking to the EGX to accelerate and enhance some of its AI efforts already under development. First announced two years ago, Nvidia’s Isaac platform for training collaborative robots in virtual reality could see a much-needed processing boost from the EGX platform. The EGX should allow for faster and more robust simulation training of robots as well as faster and more reliable deployments into physical systems. Nvidia said that an official Isaac SDK will launch for developers in January 2020.

Nvidia also unveiled new developer tools in the form of Metropolis IoT, an open-source reference application for utilizing sensors in smart manufacturing and smart city applications. Metropolis, which is now available, runs on the EGX and will allow developers to experiment with developing for predictive maintenance, logistics, manufacturing, and other applications, all while leveraging the EGX’s computing power.

Arguably the most intriguing demo of the presentation was the EGX’s ability to facilitate multimodal, or multi-sensor, AI applications. Nvidia introduced a software platform dubbed Jarvis (yes, like Tony Stark’s computer assistant) that can handle such tasks.

In one demo a couple driving a car asked a system about restaurants in the area (Yelp rating, directions, ect.) while also seamlessly having a conversation with each other. In another a woman in a retail space was able to have an AI answer questions about the various products on the shelves by pointing at them or describing them (i.e. “How much is that white water bottle?”).

What was most notable about the demo was the lack of a hot word (no need to say, “Hey Alexa” or another term) and how the system was able to continue the interaction even with breaks in the conversation. There was a recognition of context. The AI tracked users’ faces to recognize when they were looking into a camera to ask it a question – meaning it once someone asked about a sushi restaurant they could come back moments later and simply ask, “How far away is it?” without having to resupply context, such as the restaurant’s name, to the system.

Enhanced by the EGX, Nvidia’s Jarvis SDK can enable multimodal AI applications that can recognize context and handle queries without the need for special words or phrases to activate. (Image source: Nvidia) 

Huang said such a system also has clear implications for the manufacturing space, particularly with collaborative robots. “You could tell a robot to ‘pass me that,’ ‘hold that,’ or ‘hold this while I do that,’ all things that require context,” he said.

Nvidia is releasing its Jarvis SDK for early access in December. Included in the SDK will be several pre-trained AI models for tasks such as speech recognition, natural language processing, text-to-speech, speech synthesis, computer vision, and pose classification. Developers will be able to use Jarvis’ pre-trained models to create AI applications that take advantage of multiple sensor and data streams.

The elephant in the room however is that such functionality would seem to require some degree of continuous monitoring. How can the AI know you’re looking into a camera, for example, unless the camera is always-on and checking for such a thing? Nvidia did not comment any further on this, but there’s little doubt it will become of a growing and ongoing conversation around AI ethics and privacy.

But even with the moral and ethical implications Huang said the next computing revolution – the one that will create a seismic shift on par with the introduction of the first iPhone – won’t happen until engineers rethink the data sensor with technologies like the EGX – transforming them into software-defined solutions.

“With 5G the edge can no longer be a pipe,” Huang said. “The edge has to become a computing platform.”

Chris Wiltz is a Senior Editor at  Design News covering emerging technologies including AI, VR/AR, blockchain, and robotics

90 comments

  1. Heya i’m for the primary time here. I found this board and I in finding It really helpful & it helped me
    out much. I hope to present one thing again and help others such as you aided me.

  2. My brother suggested I would possibly like this blog.
    He was once entirely right. This post truly made my day.
    You cann’t imagine simply how much time I had spent for this information! Thanks!

  3. Thank you for the good writeup. It in fact was a amusement account
    it. Look advanced to more added agreeable from you! By the way, how
    could we communicate?

  4. Good day! Would you mind if I share your blog with my facebook group?
    There’s a lot of people that I think would really enjoy your
    content. Please let me know. Thanks

  5. It’s very trouble-free to find out any topic on net as compared to textbooks,
    as I found this piece of writing at this web site.

  6. I do not know whether it’s just me or if perhaps everybody else encountering issues
    with your site. It seems like some of the written text on your posts are running off the screen. Can someone else please comment and let me know if this is happening to them
    as well? This could be a problem with my web browser because I’ve had this happen before.
    Thanks

  7. of course like your web site but you need to test the spelling on several of
    your posts. Several of them are rife with spelling problems and I
    find it very bothersome to tell the truth then again I’ll surely come again again.

  8. Its like you read my mind! You appear to know
    a lot about this, like you wrote the book in it or something.

    I think that you can do with a few pics to drive the message home a bit, but other than that, this is magnificent blog.
    An excellent read. I will definitely be back.

  9. Quality articles or reviews is the key to invite the visitors to go to see the website, that’s what this web
    site is providing.

  10. At this time it looks like BlogEngine is the best blogging platform out there right
    now. (from what I’ve read) Is that what you are using on your blog?

  11. Article writing is also a excitement, if you be familiar with after that
    you can write otherwise it is difficult to
    write.

  12. It’s remarkable to go to see this web site and reading the
    views of all mates about this piece of writing, while I am also zealous of getting familiarity.

  13. Great site you’ve got here.. It’s hard to find high quality
    writing like yours these days. I honestly appreciate individuals like
    you! Take care!!

  14. A person necessarily lend a hand to make critically posts I would state.
    This is the first time I frequented your web page
    and to this point? I surprised with the research you made to make this actual
    publish amazing. Magnificent job!

  15. Howdy! This is my 1st comment here so I just wanted to
    give a quick shout out and tell you I truly enjoy reading through your articles.

    Can you recommend any other blogs/websites/forums that deal with
    the same topics? Appreciate it!

  16. You really make it seem so easy with your presentation but
    I find this topic to be really something that I think I would never understand.
    It seems too complex and very broad for me. I am looking
    forward for your next post, I will try to get the hang of it!

  17. certainly like your web-site but you need to test the spelling on several of your posts.
    A number of them are rife with spelling issues and I to find it very bothersome to inform the reality however I’ll surely come back again.

  18. This design is steller! You obviously know how to keep a reader entertained.

    Between your wit and your videos, I was almost moved to start
    my own blog (well, almost…HaHa!) Excellent job. I really enjoyed what
    you had to say, and more than that, how you presented it.
    Too cool!

  19. You really make it seem so easy with your presentation but I find this topic to
    be really something which I think I would never understand.
    It seems too complex and extremely broad for me. I’m looking
    forward for your next post, I’ll try to
    get the hang of it!

  20. Good day! Do you use Twitter? I’d like to follow you if that would be
    ok. I’m undoubtedly enjoying your blog and look forward to new posts.

  21. Wonderful blog! I found it while surfing around on Yahoo
    News. Do you have any suggestions on how to get listed in Yahoo News?
    I’ve been trying for a while but I never seem to get there!
    Thank you

  22. Hello, i read your blog from time to time and i own a similar one and i was just wondering if
    you get a lot of spam responses? If so how do you stop it,
    any plugin or anything you can advise? I get so
    much lately it’s driving me mad so any support is very much appreciated.

  23. I think the admin of this web site is really working hard in favor
    of his website, for the reason that here every material is quality based data.

  24. Very great post. I simply stumbled upon your blog and wanted to say that I’ve
    really loved surfing around your blog posts. In any case I’ll
    be subscribing on your rss feed and I am hoping you write again soon!

  25. I blog quite often and I truly thank you for your information. This great article has truly peaked my interest.
    I will take a note of your site and keep checking for new information about once a week.
    I opted in for your RSS feed as well.

  26. Hello, i think that i saw you visited my blog so i came to “return the favor”.I’m attempting to
    find things to enhance my website!I suppose its
    ok to use a few of your ideas!!

  27. Hi there, I discovered your web site via Google even as looking for
    a comparable subject, your website got here up, it seems good.
    I’ve bookmarked it in my google bookmarks.
    Hello there, just become alert to your blog thru Google, and located that it
    is truly informative. I’m gonna watch out for brussels.
    I will be grateful in the event you continue this {in future}.
    A lot of other folks can be benefited out of your writing.
    Cheers!

  28. Hi there, I desire to subscribe for this weblog to take most
    recent updates, therefore where can i do it please help out.

  29. Excellent article. Keep posting such kind of info on your page.

    Im really impressed by your blog.
    Hey there, You have done an excellent job. I’ll definitely digg it and in my view suggest to my friends.
    I’m sure they’ll be benefited from this website.

  30. First of all I want to say excellent blog! I had a quick question in which I’d like
    to ask if you do not mind. I was interested to find out how you center yourself and clear your head before writing.
    I have had difficulty clearing my thoughts in getting my ideas out.
    I truly do take pleasure in writing however it just seems
    like the first 10 to 15 minutes are usually lost just trying to figure out how to begin. Any recommendations or hints?
    Appreciate it!

  31. What’s Happening i am new to this, I stumbled upon this I have found It absolutely helpful and it has aided me out loads.
    I’m hoping to contribute & assist different users like its helped me.
    Good job.

  32. What’s up mates, its wonderful paragraph regarding tutoringand completely explained, keep it up all the time.

  33. I am really enjoying the theme/design of your weblog.
    Do you ever run into any web browser compatibility issues?
    A few of my blog visitors have complained about my site not operating correctly in Explorer but looks great in Chrome.

    Do you have any solutions to help fix this problem?

  34. Thank you for the auspicious writeup. It in fact was a amusement account it.
    Look advanced to far added agreeable from you! However, how could we
    communicate?

  35. Hello, i believe that i saw you visited my blog
    thus i got here to go back the prefer?.I am trying to in finding things to enhance
    my site!I guess its ok to make use of a few of your ideas!!

  36. Wonderful work! This is the kind of info that should be shared around the
    internet. Disgrace on the search engines for not positioning this post higher!
    Come on over and visit my site . Thank you =)

  37. What i do not realize is in truth how you are not actually much more smartly-favored than you may be
    now. You’re very intelligent. You already know therefore significantly in the case of this topic, made me in my view
    believe it from so many varied angles. Its
    like women and men don’t seem to be fascinated unless it’s one thing to do with Girl gaga!
    Your personal stuffs excellent. At all times handle
    it up!

  38. I have been browsing online more than three hours these days,
    yet I by no means discovered any attention-grabbing article like yours.
    It’s lovely value sufficient for me. Personally, if all website owners
    and bloggers made excellent content as you did, the internet shall be much more useful than ever before.

  39. May I simply just say what a comfort to find somebody who really
    understands what they’re talking about on the internet.
    You definitely understand how to bring an issue to light and
    make it important. A lot more people ought to read this and understand
    this side of your story. I was surprised that you aren’t
    more popular since you certainly possess the gift.

  40. I was suggested this blog by my cousin. I am not sure whether this post
    is written by him as nobody else know such detailed about my
    problem. You are amazing! Thanks!

  41. It’s appropriate time to make a few plans for the future and it is time to
    be happy. I have learn this submit and if I could I desire to suggest you some fascinating things or advice.
    Maybe you can write next articles relating to this article.
    I desire to read more things approximately it!

  42. Hmm it seems like your website ate my first comment (it was extremely long) so I guess I’ll just sum it up what I submitted and
    say, I’m thoroughly enjoying your blog. I too am an aspiring blog
    blogger but I’m still new to the whole thing. Do you have any points for
    inexperienced blog writers? I’d really appreciate it.

  43. I know this if off topic but I’m looking into starting my own blog and was
    wondering what all is required to get set up? I’m assuming having a blog like yours would cost
    a pretty penny? I’m not very web savvy so I’m not 100% positive.
    Any suggestions or advice would be greatly appreciated.
    Thank you

  44. Nice post. I learn something new and challenging on blogs I
    stumbleupon every day. It will always be exciting to read through articles from other authors and practice something from their web sites.

  45. My programmer is trying to persuade me to move to .net from PHP.

    I have always disliked the idea because of the expenses.
    But he’s tryiong none the less. I’ve been using WordPress
    on a number of websites for about a year and am concerned about switching to another platform.
    I have heard fantastic things about blogengine.net.
    Is there a way I can transfer all my wordpress content into it?
    Any help would be really appreciated!

  46. I like the valuable info you provide in your articles.
    I’ll bookmark your blog and check again here frequently.
    I am quite certain I will learn many new stuff right here! Best of luck for the next!

  47. Hello there I am so glad I found your website, I really found you by mistake,
    while I was searching on Yahoo for something else, Anyways I am here now and would just like to
    say thank you for a remarkable post and a all round enjoyable blog (I also love the theme/design), I don’t have time to browse it
    all at the moment but I have bookmarked it and also added your RSS feeds,
    so when I have time I will be back to read more, Please do keep up the great job.

  48. Undeniably believe that which you said. Your favorite reason seemed to be on the
    net the easiest thing to be aware of. I say to you, I certainly get annoyed while people
    consider worries that they plainly do not know about.
    You managed to hit the nail upon the top and also defined out the whole thing without having side-effects , people could take a
    signal. Will probably be back to get more. Thanks

  49. It’s really very complicated in this full of activity life to listen news on Television, so I only use
    the web for that purpose, and obtain the newest news.

  50. Hi my loved one! I wish to say that this post is awesome, nice written and come with approximately all significant infos.
    I would like to look extra posts like this .

  51. I’ve been browsing online greater than three
    hours today, yet I never found any interesting article like
    yours. It’s pretty worth enough for me. Personally, if all web owners and bloggers made excellent content as you probably did, the net will
    probably be much more useful than ever before.

  52. Hello would you mind letting me know which hosting
    company you’re using? I’ve loaded your blog in 3 different
    internet browsers and I must say this blog loads a lot quicker then most.
    Can you recommend a good web hosting provider at a honest price?
    Thanks a lot, I appreciate it!

  53. Magnificent beat ! I would like to apprentice even as
    you amend your website, how could i subscribe for a blog site?
    The account aided me a appropriate deal. I had been tiny
    bit familiar of this your broadcast offered shiny transparent
    idea

  54. I was suggested this web site by my cousin. I am not sure
    whether this post is written by him as no one else
    know such detailed about my difficulty. You are amazing!
    Thanks!

  55. What’s Taking place i am new to this, I stumbled upon this I have found It positively useful and it has aided me out loads.

    I am hoping to give a contribution & help other users like
    its helped me. Good job.

  56. I’m impressed, I must say. Rarely do I come across a blog that’s both educative and amusing, and without a doubt, you’ve hit the nail on the head.
    The problem is an issue that too few men and women are speaking intelligently about.
    Now i’m very happy I found this during my hunt for something regarding this.

  57. Greetings! I know this is somewhat off topic but I was wondering which blog platform are you using for
    this site? I’m getting sick and tired of WordPress because
    I’ve had issues with hackers and I’m looking at options
    for another platform. I would be fantastic if you could point
    me in the direction of a good platform.

  58. You actually make it appear so easy together with your presentation but I in finding this topic to be really one thing which I believe I would by no means understand.
    It sort of feels too complicated and extremely wide for me.
    I’m having a look ahead for your next put up, I will attempt to get
    the hold of it!

  59. Wonderful web site. A lot of useful information here. I’m sending it to a
    few buddies ans additionally sharing in delicious. And obviously, thank you to your effort!

  60. Thank you for any other informative site. Where else
    may I get that type of info written in such a perfect method?

    I’ve a undertaking that I am just now running on, and I’ve been on the glance out for
    such information.

  61. Do you mind if I quote a couple of your posts as long as I
    provide credit and sources back to your webpage? My blog site is in the
    exact same niche as yours and my users would genuinely benefit from a lot of the information you provide here.
    Please let me know if this alright with you.
    Appreciate it!

  62. Excellent beat ! I would like to apprentice while you
    amend your website, how could i subscribe
    for a blog web site? The account aided me a acceptable deal.
    I had been a little bit acquainted of this your broadcast provided bright
    clear concept

Leave a Reply

Your email address will not be published.