Embedded ROCm version is getting old #8156
Description
Currently, container version of LocalAI for AMD GPUs utilizes ROCm 6.4.3. That version is relatively old and lacks performance improvements from 7.x line, including support for smaller data types. It would be great to have ROCm updated to 7.2.0.