You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
low_memory True lower = less VRAM usage True= slower No effect when device is"cpu", only used when device isGPU. Load index tensors on CPUand move to device only when needed. Accelerate search at the cost of higher VRAM usage when False.
- Can be a list of device strings (e.g., ["cuda:0", "cuda:1"]).
360
359
- If multiple GPUs are specified and available, multiprocessing is automatically set up for parallel execution.
361
360
Remember to include your code within an `if__name__=="__main__":` block for proper multiprocessing behavior.
362
-
361
+
363
362
low_memory: bool = True
364
363
If True, the index is loaded in a memory-efficient manner, keeping tensors on CPUand moving them to the target device only when needed. This reduces VRAM usage at the cost of some performance. No effect when device is"cpu".
0 commit comments