Hacker News

Nvidia announces native GPU programming in Rust

• 79 Comments
• > The launch is checked rather than trusted.
  Damn even Nvidia is putting out fully Claude-written articles.

  By claiir 3 hours ago

• That's actually a magnificent observation. This is not only an indication of a keen eye, but a trained brilliant mind as well.

  By bayindirh 2 hours ago

• One might even say it is load-bearing on the seam!

  By jubilanti 26 minutes ago

• You’re absolutely right!

  By hitekker 2 hours ago

• > even Nvidia
  Why "even Nvidia"?
  They are fully behind using AI for basically everything.
  What's next? "Damn, even McDonald's is putting out unhealthy food"

  By keybrd-intrrpt 2 hours ago

• I think implication being organizations with 40,000+ employees and even more consultants and contractors plus a lot of budget are also using LLMs to draft public facing content instead of paying for content writers or even just proof readers .
  It points to friction rather than cost economics. Same reason we are always surprised why multi billion dollar product companies with millions of install base prefer electron instead of a native app.

  By manquer 28 minutes ago

• McDonald's food is not even that unhealthy. I just tried a Burger King burger the other day and it's terrible. I think it's like 2000 calories in a single burger or something.

  By dprkh 9 minutes ago

• Sure, but even Anthropic doesn't appear to use Claude for blog posts. (I don't think anyone should. The prose stinks.)

  By jchw 2 hours ago

• Anthropic _absolutely_ does
  They are just better at hiding it or configuring Claude.
  I have several skills that reformat text to remove AI-speak tells.

  By keybrd-intrrpt an hour ago

• Prove it.

  By jchw an hour ago

• https://news.ycombinator.com/item?id=49249269
  I put the "humanized" output through Pangram and it still comes out as 100% AI generated.

  By WD-42 an hour ago

• I believe most of their marketing videos use fairly convincing text to speech too, not voice actors.

  By dannyw 21 minutes ago

• What are we for, I ask? What the hell are we now. Chatters to LLMs now? Is this our future? It really is starting to feel like it now.

  By karim79 an hour ago

• Dude I am in slop fucking hell right now. There is still room for a human touch, without which the agents will lever us harder and faster into a world of incomprehensible garbage.

  By arcanemachiner 31 minutes ago

• I totally concur. I'm almost lost for words at this stage. I need me some land to grow vegetables on and that's about it. Maybe some chickens. Every single day brings more despair (and not the prosperity we were promised).

  By karim79 26 minutes ago

• I get the impression that Nvidia employees don't care too much - I started seeing fully AI-written "documentation" on some of their smaller projects more than a year ago (i.e., before it was even slightly a good idea).

  By daemonologist an hour ago

• People never really read documentation before. Agents do read it now, and they seem to understand LLM-written text just fine.

  By DonsDiscountGas an hour ago

• > People never really read documentation before.
  The heck you talking about? How do you think we wrote software for the last 50 years?

  By WD-42 an hour ago

• Yeah lol it’s basically the only reliable way to know how things work. Pre-AI, I read documentation for libraries that I used almost every day.
  And now with AI I’m using it to fact check Claude. And still reading it for myself to understand why other peoples code is written a certain way. It’s basically the most important thing to reference when coding.
  Sure today Claude can just read the library code and tell you what a function does or how to do something. But it still won’t tell you why something is a certain way or won’t figure out specifically-designed usage patterns as reliably as the author telling you “this is an example of doing x”

  By californical an hour ago

• I really appreciated a friend reaching out to me with some PHP questions today. It was, to me, fairly basic but he was having a hard time grokking the documentation vs reading what his coworker wrote (some code using output buffering).
  I brushed up on the docs since I haven't touched it in a couple years, explained my understanding of the ob_* functions, and gave him a very brief demo on a PHP playground.
  He could have asked any LLM to tell him what that chunk of code did, and to explain the three functions, and instead he reached out to me. That felt _good_. Talking shop has always been a good way for me to form connections, because the pressure to socialize becomes task-oriented and you start to learn about how people think and feel, and that opens up easier paths for actual connection. It was nice.
  Just like the Old Internet still exists - niche websites, mailing lists, probably a BBS or two (likely more right?), the pre-LLM world will trudge on, for a time. I hope LLMs actually lead to good things for people in the long run, and for now I personally will remain sparse in my usage of them.

  By phatskat a minute ago

• only reliable way to know how things work is to reverse engineer them

  By stevemk14ebr 12 minutes ago

• A small percentage of engineers

  By groundzeros2015 6 minutes ago

• when you start to internalize that these kinds of statements are an indication of how the average developer of the last 10-15 years operated the adoption rate of AI makes a lot more sense

  By Barrin92 an hour ago

• This is extremely depressing, I think I'm coming around to the realization that you may be right and I've been naive my entire career.

  By WD-42 44 minutes ago

• What? People never read documentation?
  I start with reading and exploring documentation first; with the codebase as a secondary tab.
  When it’s not LLM generated, documentation is supposed to be easier to read and more insightful than code.

  By dannyw 19 minutes ago

• I hadn't read the article and read this comment as though NVIDIA themselves were implying that this library was checked but not trusted by them since it was fully LLM generated.

  By written-beyond an hour ago

• not to worry, they have an 'AI generated summary' box too

  By manyatoms 2 hours ago

• Its a recursive summarization pyramid

  By greenavocado 2 hours ago

• It gets fun when someone uses an uncensored model to bypass a refusal, but they accidentally pick one that was trained for erotic writing and brings its particular talent to the documentation task.

  By smallmancontrov 24 minutes ago

• This thread flags an honest assessment of AI signal detection.

  By pizzafeelsright 2 hours ago

• Thanks, saved me a few minutes

  By mahboi 2 hours ago

• Is that your honest load bearing assessment you’re going to flag?

  By api an hour ago

• Claude, rewrite my graphics card in Rust. Make no mistakes.

  By fwlr 41 minutes ago

• Since NVIDIA owns huggingface now and huggingface has the excellent Candle [1] crate for inference on Rust, this seems like a good step towards nice native Rust kernels.
  [1] https://github.com/huggingface/candle

  By dllu 3 hours ago

• Nobody cares if kernels are written in Rust. Kernels were meant to be written in C, but if you want to go more high-level try Triton or a similar DSL that nicely abstract tile sizes etc.

  By jacobgorm 2 hours ago

• kernels aren't meant to be written by any defined language. C is just a traditionally good default language that took over from assembly. No particular reason we have to stick with C.

  By keithnz 2 hours ago

• And quite a few reasons that something better than C should be used. Rust seems a good candidate.

  By chadcmulligan 25 minutes ago

• oh no no no, this is going to break the CPP hold on AI and game dev.

  By cpill 2 hours ago

• I strongly dislike CUDA. Once you have allowed that proprietary cr*p into your C++ codebase, it is very hard to get rid, and you end up with code that is either tied to a single vendor or an #ifdef hell, probably both.
  The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually, like in Metal, OpenCL, and D3D12, etc. These days we even have DSLs like Triton that make kernel writing much more ergonomic than anything you would hope to achieve in Rust.

  By jacobgorm 2 hours ago

• > I strongly dislike CUDA. Once you have allowed that proprietary cr*p
  Genuine question...why not just type "crap"? It's not even that much of a curse, but I've never really understood the point of self-censorship. If you don't want to curse then you could just use a non-curse word.

  By tombert an hour ago

• * is used to give emphasis and show that they are using the word as curse word rather just calling it bad

  By xbmcuser 39 minutes ago

• It may be to bypass censorship, rather than self-censorship. Some platforms block or shadowban comments with curse words. Not sure about this platform.

  By lovelearning an hour ago

• HN definitely doesn't give a crap about that word.

  By arcanemachiner 28 minutes ago

• I have written many words far worse than "crap" on this site. I haven't gotten in trouble over it yet.
  I do find it a little amusing, because commenters stopped criticizing my cursing the moment I started getting a good chunk of karma here. I remember in 2016 someone criticized me for using the term "shitposting"...I don't think I've gotten that kind of criticism since 2016 though.

  By tombert 2 minutes ago

• can confirm, looks like crap is not on a list

  By smnplk 11 minutes ago

• > Once you have allowed that proprietary cr*p into your C++ codebase
  People have been doing that all the time for every kind of codebase. It's just part of the business. I don't see how it's worth having any emotions or opinions about it. Seems like you are wasting your energy.
  Are win32 APIs proprietary? So you decide to use them, use a wrapper/UI framework, or don't develop for Windows. Easy choice.
  Developing for embedded devices? So you read the manufacturers manual and implement based on the spec, use some sort of HAL if they are available, or you don't have a job. Even simpler.

  By fg137 2 hours ago

• CUDA is not an API, CUDA is a language, so you cannot make that comparison.

  By jacobgorm 2 hours ago

• > The CUDA runtime is a special case of one of the libraries provided by the CUDA Toolkit. The CUDA runtime provides both an API and some language extensions to handle common tasks such as allocating memory, copying data between GPUs and other GPUs or CPUs, and launching kernels. The API components of the CUDA runtime are referred to as the CUDA runtime API.
  From: https://docs.nvidia.com/cuda/cuda-programming-guide/01-intro...

  By esseph an hour ago

• Launching kernels manually is an error prone PITA which I believe is the principle reason for CUDA's popularity. Having the compiler give an error when you mess up is a huge benefit. But having the compiler allow you to express "I want to launch this kernel over a grid with these dimensions, with these arguments" as a single expression is where the vast majority of the value comes from.
  The having it all in a single file is mostly an artefact of the fact that it is C++, because C++ is single file at a time compilation. In D (which is multiple files in a single compiler invocation) with DCompute (which targets CUDA and OpenCL with upcoming support for Vulkan and Metal), you are required to write the kernels in a separate module, but you get all the benefits of the compiler complaining when you mess up _and_ the expressivity of "launch me this kernel".

  By nicwilson 31 minutes ago

• > The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually
  Isn't that how CUDA code is normally written?

  By pavon 2 hours ago

• No. CUDA allows you to write all the code in a single file, and uses a preprocessor to split it back out and pass it through separate compilers, one for host and one for device.

  By jacobgorm 2 hours ago

• This true, but you can write the two separately if you want.
  The disadvantages of writing them together are listed in the various parent posts. But some code authors really like the convenience of having the two in the same file.

  By compiler-guy 2 hours ago

• You could also use Mojo, one language for all targets.

  By melodyogonna 2 hours ago

• Or julia if you want a much more mature ecosystem.

  By adgjlsfhk1 an hour ago

• I highly recommend Julia for (scientific) GPU programming but it would be nice if there was a larger community and/or funding behind the GPU side of things. It has very few core devs for what it is.

  By patagurbon 41 minutes ago

• I began to lose interest after the acquisition. Have you been following along, are they still going to open source it?

  By carefree-bob 2 hours ago

• The Mojo compiler has been open source for over a month now.
  And the Mojo standard library has been open source for over a year.
  It’s all open source. Go check it out!

  By ecl3ctic 2 hours ago

• Nice, thank you. There is an old python project I've been thinking about converting to Mojo.

  By carefree-bob an hour ago

• I thought they already did and released the compiler source code under Apache 2.0.

  By YuechenLi 2 hours ago

• yeah, just write a stub/wrapper around it and abstract. it's the classic coupling problem. nothing to do with CUDA

  By cpill 2 hours ago

• Is this satire? D3D12 and Metal aren't any less proprietary than CUDA.

  By bigyabai 2 hours ago

• In this age of LLM written everything which has softly killed my motivation for learning Rust somewhat, this has revived my interest if not only for the fact the LLMs haven't yet been trained on this yet!

  By LarsDu88 2 hours ago

• LLM don't need to be trained in a library to use it well. It's just Rust which they know well.

  By impulser_ 2 hours ago

• And what prevent you exactly ?
  There were humans far superior than you for writting Rust before LLM, now there's a LLM. The only difference is price and time execution.
  You get an awesome teacher (LLM) ready to answer all your questions about Rust.
  And you still find excuses not to learn it ?
  At some point, just realize you've been lazy to learn it and LLMs are just an excuse.

  By w4yai 2 hours ago

• I think OP’s point is that the payoff in learning a new language has diminished in this AI era. You can call that lazy, I’d consider it smart to consider whether you could be doing other, better, things with your time.

  By afavour 2 hours ago

• If the sole motivation for learning things are payoff, then sure.

  By w4yai an hour ago

• Been waiting for something like this. CUDA C++ is a pain; Rust's safety for kernel programming could be a game changer.

  By Driftbench 18 minutes ago

• How does this compare to vectorware? (https://www.vectorware.com/blog/)

  By manyatoms 2 hours ago

• I'm looking forward to trying these when they stabilize! I currently use WGPU for graphics, and cudarc for CUDA.
  Note: Cuda-oxide is similar to Cudarc's host component, but uses a rust-style kernel dialect. Advantage: Share structs between host and device. Disadvantage: Trading standard Cuda kernels for a new, WIP dialect.
  I haven't tried the tile API yet; looking forward to it.
  The last time I checked, Cuda Oxide was Linux only, and required Async; these are why I haven't tried it yet.

  By the__alchemist 3 hours ago

• cudarc been great for me, because it's easy to look up existing examples and references, and it maps 1-to-1 with what I see. I'm already having a tough time with CUDA itself, a dialect of it makes a tad harder to rely on previous work.
  Seems more ergonomic in general though, both approaches they share, compared to cudarc, and less build infrastructure and fiddling with environments, which is great.

  By embedding-shape 3 hours ago

• Will it then be possible to query TJunc hotspot temps on linux?

  By bt1a 2 hours ago

• First of all, this is a pre-1.0 release that requires a nightly Rust compiler (if you choose the SIMT track with cuda-oxide) so that one is going to be unstable software.
  Secondly, When an issue occurs with a kernel or you want to write your own custom kernel in Rust, now we need to diagnose if the problem came from either cuda-oxide (SIMT), Rust's side, CUDA or Tile (If you decide to choose the Tile track).
  Another dependency into the list and course everything is open source except CUDA itself. So any issue that happens on the CUDA level, you are forced to wait for them to fix it.

  By rvz 3 hours ago

• what this article tells me is that no one at Nvidia actually cares about this project whatsoever. otherwise, they would have had a person actually write the announcement.

  By nicebyte 2 hours ago

• Nvidia only? Typical.
  This is more promising: https://github.com/Rust-GPU/rust-gpu/

  By shmerl an hour ago

• AI slop article, how can I trust on this?

  By mococa 2 hours ago

• The world is unsafe

  By mococa 2 hours ago

• Rust just makes you sign a waiver first.

  By Xeoncross an hour ago

• Rust for GPU programming? My CUDA debugging sessions just got a whole lot less painful, hopefully.

  By dunlin 37 minutes ago