Instructions to use kernels-community/sage_attention with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/sage_attention with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/sage_attention") - Notebooks
- Google Colab
- Kaggle
| { | |
| description = "Flake for Torch kernel extension"; | |
| inputs = { | |
| kernel-builder.url = "github:huggingface/kernel-builder/redo-capabilities"; | |
| }; | |
| outputs = { self, kernel-builder, }: | |
| kernel-builder.lib.genFlakeOutputs { | |
| path = ./.; | |
| rev = self.shortRev or self.dirtyShortRev or self.lastModifiedDate; | |
| }; | |
| } | |