Request for a talk on Parrot’s design and roadmap

[ynikitenko]

Dear CCCL Team,

There is a C++ pipeline library, Parrot, in NVlabs, which builds on modern CUDA CCCL and provides a higher-level interface.

In a previous CCCL discussion on a pipeline library in the CUDA ecosystem, I mentioned high-level optimizations as its advantage and provided a benchmark showing a possible 50% speedup due to such optimizations. The developer of Parrot became interested in that idea, we had useful discussions and agreed to implement it.

Unfortunately, I got the impression that Parrot may not have received full attention from the core software team. It was not mentioned in the previous discussion. It looks 99% completed high-quality code, yet it remains confined to NVlabs, which underutilizes its strong ideas and the resources already invested.

I believe that Parrot is strategically important for the CUDA ecosystem. As I have mentioned in the previous discussion, computational pipelines/graphs are increasingly being supported by Apple (MLX) or Intel (oneAPI SYCL). While this is not yet the ultimate solution, it is still worth developing within NVIDIA as well.
Another example is its drastic 2-5 times C++ code reduction. The previous discussion also highlighted that benefit of a pipeline library. This is fully in line with the modern CCCL trend for user-friendliness and toward a more delightful CUDA C++.

That said, I agree that Parrot has not yet reached its full potential. There are still some exciting open opportunities for that, and there are issues that may preclude its use in professional libraries.

To my understanding, some of the architectural proposals for Parrot were made by the CCCL team. However, there are some differing perspectives regarding our architectural decisions, which is why I would like to get in contact with you.

I suggest scheduling a short call to save both your time and mine. There is no need to discuss minor technical details, but I would welcome the opportunity to establish a sustainable collaboration.

[danielfrg]

Hi @ynikitenko,

Yeah we work with @codereport and the Parrot team a lot!

Because it's part of NVLabs we don't send customers directly to it but we do work with some teams who use it.

I am happy to chat to see what other things you have in mind. If you give me your email i can set something up.

[ynikitenko]

Hi Daniel, many thanks for the quick reply!

My email is metst13 (at) gmail (dot) com. Looking forward to hearing from you!