Gotta talk to Nvidia and see what exactly is needed to get this speedup with Automatic1111's WebUI.Īs for the older GTX cards, I'm also curious if there's any benefit from these drivers. I don't think the older GTX cards can get a 2X perf improvement uplift, unlike the RTX GPUs, since they obviously lack specific dedicated hardware.Looks like I have something else to try and figure out. said:The 2x performance claim is certainly interesting, given we can more or less get 50% uplift with SD using hardware-specific optimized models.
I don't think the older GTX cards can get a 2X perf improvement uplift, unlike the RTX GPUs, since they obviously lack specific dedicated hardware. It'd be interesting to see if these older-architecture cards that don't sport any Tensor cores see a similar 2x performacne improvement in ML acceleration or not. NVIDIA's NeMo LLM for conversational AI is also coming soon, although there is no ETA. Kind of off topic, and not directly related to this news, but if anyone is interested now, for preliminary testing generative AI models, the Dolly 2.0 large language model is actually now on Hugging Face, which is also an Olive-optimized version. Also interested to know the relative memory requirements between using the optimized pipeline vs the current SD pipeline, since they haven't mentioned this. Though it looks like this optimized version has to be executed through an ONNX pipeline which is not out of the box for SD webui as of now. The 2x performance claim is certainly interesting, given we can more or less get 50% uplift with SD using hardware-specific optimized models.
0 kommentar(er)
