flâneur

Python API reference — nvMatmulHeuristics

docs.nvidia.com · 1,624 words · saved by 1 readers

Extended version of NvMatmulHeuristicsInterface that manages discovery profiles internally and allows precision to be specified per-call rather than at construction time. Initialize the extended interface. backend: Target backend type path: Path to nvMatmulHeuristics library flags: Flags to use for operations load_discovery_implicitly: Whether to automatically load discovery sets when needed gpu: Optional GPU to use. If None, no GPU will be set. Override to track loaded discovery sets. matmulLayout: Matrix layout hardware_descriptor: Hardware descriptor precision: Optional precision override True if the discovery set was loaded successfully Get GEMM configurations with optional precision override. problem: Problem configuration count: Number of configurations to retrieve precision: Optional precision override List of kernel configurations Get GEMM configurations with custom backend and optional precision override. problem: Problem configuration count: Number of configurations to retrie

Python API reference # class nvMatmulHeuristics. GemmConfig # Bases: object A GEMM kernel configuration. class nvMatmulHeuristics. MatmulProblem # Bases: object Description of a matrix multiplication problem. class nvMatmulHeuristics. NvMatmulHeuristicsTarget ( value ) # Bases: IntEnum Enumeration of supported heuristic target libraries and frameworks. GENERIC = 0 # NVFUSER = 1 # CUTLASS = 2 # TRITON = 3 # CUTLASS3 = 4 # RESERVED_1 = 5 # RESERVED_2 = 6 # END = 7 # class nvMatmulHeuristics. NvMatmulHeuristicsFlags ( value ) # Bases: IntEnum Bit-flag options controlling nvMatmulHeuristics behavi

saved by

related reading