NVIDIA recently announced its new RTX Broadcast Engine ahead of TwitchCon. As described on its official blog, the software development kit (SDK) is designed for GeForce RTX series GPUs and its built-in Tensor cores.
With the RTX Broadcast Engine, NVIDIA is hoping to transform the way livestreams are conducted. In terms of features, the new SDKs will provide livestreamers with virtual greenscreens, style filters, as well as augmented reality effects. Specifically, these new SDKs will be the RTX Greenscreen, RTX AR, and RTX Styler Filters.
First on the list is RTX Greenscreen. In essence, the SDK is an AI-assisted green-screen tool for streamers. Traditionally, streamers will physically have a green screen behind them when broadcasting live in order to remove the background. With RTX Greenscreen, a livestreamer will no longer need a physical green screen; with the SDK, the RTX Broadcast Engine can isolate the background via AI computations.
Next on the list is the RTX AR SDK that essentially provides the RTX Broadcast Engine with face detection and tracking. As an extra added bonus, developers can use the feature to create AR effects, including overlaying 3D content on to a face. Similar to Apple’s Memoji.
Last but not least, there’s RTX Style Filters. Simply put the SDK utilises an AI-based technique called “Style Transfer”. Basically, it allow users to transform the look and feel of a webcam feed based on a style or image that the developer likes. which instead of isolating the background behind you, the features will put you on a style of art or images.
At current, all SDKs for the RTX Broadcast Engine are available in early access, and interested developers will need to apply for them. For those who would rather wait, you’ll have to wait for OBS and other streaming software vendors to release software versions that support the new NVIDIA feature at a later date.
