Yes, and generic multicore ARM CPUs can run ARM's standard compute library regar... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		smoldesu on May 16, 2023 \| parent \| context \| favorite \| on: Apple previews Live Speech, Personal Voice, and mo... Yes, and generic multicore ARM CPUs can run ARM's standard compute library regardless of their hardware: https://github.com/ARM-software/armnn Plus, the benchmark you've linked to is comparing hardware accelerated inferencing to the notoriously crippled MKL execution. A more appropriate comparison would test Apple's AMX units against the Ryzen's AVX-optimized inferencing.

microtonal on May 16, 2023 [–]

Nope, the benchmarks are done by disabling the MKL AMD cripple (I did these benchmarks). It’s not faster with eg. AMD BLIS.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact