Support for Apple MLX backend

[notnotrishi]

Would be nice to have support for language models on Apple MLX

[Harsha-Nori]

Hi @notnotrishi, I'm a bit new to the MLX world. Do most people use the mlx_lm subpackage to interface with MLX based transformer models? https://github.com/ml-explore/mlx-examples/blob/main/llms/README.md

[notnotrishi]

@Harsha-Nori yes, that's my understanding.

also, awni from mlx team is very helpful should your team has any questions