MemPool#
- class torch.cuda.memory.MemPool(*args, **kwargs)[source]#
MemPool represents a pool of memory in a caching allocator. Currently, it’s just the ID of the pool object maintained in the CUDACachingAllocator。
- 参数
allocator (torch._C._cuda_CUDAAllocator, optional) – a torch._C._cuda_CUDAAllocator object that can be used to define how memory gets allocated in the pool. If
allocator
isNone
(default), memory allocation follows the default/ current configuration of the CUDACachingAllocator。use_on_oom (bool) – a bool that indicates if this pool can be used as a last resort if a memory allocation outside of the pool fails due to Out Of Memory. This is False by default。
symmetric (bool) – a bool that indicates if this pool is symmetrical across ranks. This is False by default。
- property allocator: Optional[_cuda_CUDAAllocator]#
Returns the allocator this MemPool routes allocations to。