Skip to content

Latest commit

 

History

History
234 lines (209 loc) · 9.03 KB

File metadata and controls

234 lines (209 loc) · 9.03 KB

Dumped from <path-to-conda-env> (Python 3.11).

System Info:

  • CUDA Version: 12.9 (Release 12.9.86)
  • NVIDIA Driver: 575.57.08
  • GPU: NVIDIA H100 80GB HBM3
  • Date: 2025-12-09

Core Runtime Dependencies

Package Version Description
vllm 0.17.0 High-throughput LLM inference engine
torch 2.10.0 PyTorch deep learning framework
transformers 5.3.0 Hugging Face transformers library
fastapi 0.135.1 Web framework for API server
uvicorn 0.41.0 ASGI server for FastAPI
anthropic 0.84.0 Anthropic SDK for proxy
openai 2.24.0 OpenAI SDK
outlines 0.1.11 Structured LLM generation
llguidance 1.3.0 LLGuidance framework

CUDA/NVIDIA Stack (CUDA 12.9)

Package Version Description
cuda-python 12.9.4 CUDA Python bindings
cuda-bindings 12.9.4 CUDA bindings
nvidia-cublas-cu12 12.8.4.1 cuBLAS library
nvidia-cudnn-cu12 9.10.2.21 cuDNN library
nvidia-cudnn-frontend 1.19.1 cuDNN frontend
nvidia-nccl-cu12 2.27.5 NCCL communication library
nvidia-cusolver-cu12 11.7.3.90 cuSOLVER library
nvidia-cusparse-cu12 12.5.8.93 cuSPARSE library
nvidia-cusparselt-cu12 0.7.1 cuSPARSELt library
nvidia-cufft-cu12 11.3.3.83 cuFFT library
nvidia-curand-cu12 10.3.9.90 cuRAND library
nvidia-cufile-cu12 1.13.1.3 cuFile library
nvidia-cutlass-dsl 4.4.1 CUTLASS DSL
nvidia-nvjitlink-cu12 12.8.93 NVJITLINK
nvidia-nvshmem-cu12 3.4.5 NVSHMEM
nvidia-cuda-runtime-cu12 12.8.90 CUDA runtime
nvidia-cuda-cupti-cu12 12.8.90 CUPTI
nvidia-cuda-nvrtc-cu12 12.8.93 NVRTC
nvidia-ml-py 13.590.48 NVIDIA ML Toolkit
cupy-cuda12x 14.0.1 CuPy for GPU arrays

ML/Framework Dependencies

Package Version Description
torchaudio 2.10.0 PyTorch audio library
torchvision 0.25.0 PyTorch vision library
triton 3.6.0 Triton programming language
xformers 0.0.29.post2 Memory-efficient transformers
accelerate 1.13.0 Hugging Face accelerator
safetensors 0.7.0 Safe tensor format
flashinfer-python 0.6.4 Flash attention inference
compressed-tensors 0.13.0 Tensor compression
quack-kernels 0.3.2 Flash attention kernels
xgrammar 0.1.29 Grammar-guided generation
lm-format-enforcer 0.11.3 Format enforcement
mistral_common 1.9.0 Mistral utilities

Language Processing & Parsing

Package Version Description
tokenizers 0.22.2 Fast tokenizers
tiktoken 0.12.0 OpenAI tokenizers
sentencepiece 0.2.1 SentencePiece tokenizer
lark 1.2.2 Parsing toolkit
pydantic 2.12.5 Data validation
pydantic-settings 2.13.1 Pydantic settings
jsonschema 4.26.0 JSON Schema validation
partial-json-parser 0.2.1.1.post7 Incremental JSON parsing

Supporting Libraries

Package Version Description
numpy 2.4.3 Numerical computing
scipy 1.17.1 Scientific computing
pillow 12.1.1 Image processing
pyyaml 6.0.3 YAML parser
requests 2.32.5 HTTP library
httpx 0.28.1 Async HTTP client
aiohttp 3.13.3 Async HTTP framework
jinja2 3.1.6 Template engine
pycountry 26.2.16 Country data
pybase64 1.4.3 Base64 encoding
cbor2 5.8.0 CBOR parser
msgspec 0.20.0 Fast serialization
msgpack 1.1.2 MessagePack serialization

System/Infrastructure

Package Version Description
python 3.11 Python runtime
pip 26.0.1 Package installer
setuptools 82.0.1 Build system
wheel 0.46.3 Wheel builder
ray 2.54.0 Distributed computing
psutil 7.2.2 System utilities
loguru 0.7.3 Logging
tqdm 4.67.3 Progress bars
tabulate 0.10.0 Table formatting
setproctitle 1.3.7 Process title
nest-asyncio 1.6.0 Nesting asyncio
filelock 3.25.1 File locking
fsspec 2026.2.0 Filesystem spec
huggingface_hub 1.6.0 HF Hub utilities

Networking & HTTP

Package Version Description
starlette 0.52.1 ASGI toolkit
anyio 4.12.1 Async interface
sniffio 1.3.1 Async library detection
h11 0.16.0 HTTP/1.1 interpreter
httptools 0.7.1 HTTP tools
websockets 16.0 WebSocket protocol
pyzmq 27.1.0 ZeroMQ bindings
dnspython 2.8.0 DNS toolkit
certifi 2026.2.25 CA bundle
charset-normalizer 3.4.5 Charset detection
idna 3.11 IDNA codec
urllib3 2.6.3 HTTP client

Async Event Loop

Package Version Description
uvloop 0.22.1 Fast event loop
asyncio built-in Async I/O
aiosignal 1.4.0 Async signals
aiohappyeyeballs 2.6.1 Happy eyeballs
frozenlist 1.8.0 Frozen lists
multidict 6.7.1 Multi.dict
yarl 1.23.0 URL library
propcache 0.4.1 Property cache

Monitoring & Telemetry

Package Version Description
opentelemetry-api 1.40.0 OpenTelemetry API
opentelemetry-sdk 1.40.0 OpenTelemetry SDK
opentelemetry-exporter-otlp 1.40.0 OTLP exporter
opentelemetry-semantic-conventions 0.61b0 OTEL semantics
prometheus_client 0.24.1 Prometheus client
prometheus-fastapi-instrumentator 7.1.0 Prometheus metrics
sentry-sdk 2.54.0 Sentry SDK
python-json-logger 4.0.0 JSON logging

CLI & Development Utilities

Package Version Description
typer 0.24.1 CLI framework
click 8.3.1 CLI toolkit
rich 14.3.3 Rich text
rich-toolkit 0.19.7 Rich toolkit
shellingham 1.5.4 Shell detection
watchfiles 1.1.1 File watching
fastapi-cli 0.0.24 FastAPI CLI
supervisor 4.3.0 Process control

Miscellaneous

Package Version Description
deprecated 1.3.1 Deprecation decorators
wrapt 2.1.2 Wrapper library
cffi 2.0.0 C Foreign Function
pycparser 3.0 C parser
cryptography 46.0.5 Cryptography primitives
pyjwt 2.11.0 JSON Web Token
python-dotenv 1.2.2 Environment variables
cachetools 7.0.5 Caching tools
diskcache 5.6.3 Disk caching
networkx 3.6.1 Graph library
sympy 1.14.0 Symbolic math
mpmath 1.3.0 MP math
docstring_parser 0.17.0 Docstring parser
googleapis-common-protos 1.73.0 Google APIs
grpcio 1.78.0 gRPC
protobuf 6.33.5 Protocol buffers
ijson 3.5.0 Incremental JSON
astor 0.8.1 AST manipulation
dill 0.4.1 Serialization
cloudpickle 3.1.2 Pickle extension
interegular 0.3.3 Regex FSM
regex 2026.2.28 Regex engine
blake3 1.0.8 Blake3 hash
airportsdata 20260304 Airport data
gguf 0.18.0 GGUF format
fastar 0.8.0 Fast archive reader
annotated-types 0.7.0 Annotated types
typing_extensions 4.15.0 Typing extensions
zipp 3.23.0 Backport of zip
importlib_metadata 8.0.0 Metadata API
distro 1.9.0 Linux distro
python-multipart 0.0.22 Multipart parser
sse-starlette 3.3.2 SSE support
httpx-sse 0.4.3 SSE for httpx
kaldi-native-fbank 1.22.3 Audio features
numba 0.61.2 JIT compiler
llvmlite 0.44.0 LLVM bindings
ninja 1.13.0 Build system
jmespath 1.1.0 JSON query
pygments 2.19.2 Syntax highlighting
markdown-it-py 4.0.0 Markdown parser
mdurl 0.1.2 Markdown URLs
referencing 0.37.0 JSON referencing
rpds-py 0.30.0 RPDS library
jsonschema-specifications 2025.9.1 JSON schema specs
attrs 25.4.0 Attributes
markdown built-in Markdown
mcp 1.26.0 Model Context Protocol
rignore 0.7.0 Ignore parser
six 1.17.0 Python 2/3 compat
einops 0.8.2 Tensor operations
email-validator 2.0.0 Email validation
decorator 5.1.1 Decorators
packaging 23.1 Packaging utils
openhands-aci 0.1.0 OpenHands ACI
sympy 1.13.3 Symbolic computing

Full pip freeze available via: pip freeze > requirements.txt