README.md 514 B

ai

Repo that allows me to build AI tools on top of Hugging Face

How to do fast inference using API

Verify GPU working

  • Reference PyTorch site
  • numba -s | grep cuda
  • run python utils/verify_cuda_pytorch.py
  • run nvidia-smi should show a GPU