Troubleshooting
“CUDA kernel not found”
- Ensure you ran
pip install -e .. - Check if
nvccis in your path:nvcc --version.
“OutOfMemoryError”
- Decrease
max_batch_size. - Decrease
kv_cache_managerblock count.
“ImportError: attempted relative import…”
- Ensure you are running the
yaiecommand, or running python as a modulepython -m src.cli.main. - Do not run scripts directly like
python src/engine.py.