Runtime Module

The helion.runtime module handles kernel execution and configuration management.

Key Classes

The runtime module provides the core execution infrastructure. For detailed documentation of individual classes, see:

• Config - Configuration management

• Kernel - Kernel execution

• Settings - Compilation settings

Utility Functions

helion.runtime.get_num_sm(device, *, reserved_sms=0)

Get the number of streaming multiprocessors (SMs) for the specified device.

Parameters:

• device (device) – Device to query.

• reserved_sms (int) – Number of SMs to keep free for other work (e.g., communication kernels). Defaults to 0 meaning all device SMs are available to Helion.

Return type:

int

Returns:

Grid size to use for a persistent kernel on the device after accounting for any reserved SMs. Always at least 1.

helion.runtime.set_triton_allocator()

Return type:

None