Practical Llama 3.x inference implemented in Scala 3

Low-precision GEMM library + PyTorch GPU operators for recommendation systems applications

Apache Spark plug-in that enables Spark execution on the SX-Aurora TSUBASA Vector Engine (VE)

A simple but practical Llama 3.x inference engine designed to be lightweight, high-performant, and scalable for application development.

Test Article