[MLX] Add off-graph KV-cache flat runtime#21501

kiymetakdemir merged 5 commits into

pytorch:mainpytorch/executorch:mainfrom

kiymetakdemir:kv-cache-mlx-flatkiymetakdemir/executorch:kv-cache-mlx-flatCopy head branch name to clipboard