CUPTI compatibility (v1.7)
CUPTI compatibility is under active development. The APIs listed in this topic are based on cuda 12.3 and do not yet support APIs introduced in cuda 12.4 or later.
CUPTI API support
Module | Status | Remarks |
Activity API | Supported | Some functions and activity kinds are not supported. |
Callback API | Supported | Some callback domains are not supported. |
Checkpoint API | Supported | |
Event API | Unsupported | |
Metric API | Unsupported | |
PC Sampling API | Unsupported | |
PC Sampling Utility API | Unsupported | |
PM Sampling API | Unsupported | |
Profiler Host API | Unsupported | |
Profiling API | Unsupported | |
SASS Metrics API | Unsupported |
CUPTI activity support
Activity API support
API | Supported | Remarks |
cuptiActivityConfigurePCSampling | Not Supported | |
cuptiActivityConfigureUnifiedMemoryCounter | Not Supported | |
cuptiActivityDisable | Supported | |
cuptiActivityDisableContext | Not Supported | |
cuptiActivityEnable | Supported | Some activity kinds are not supported. |
cuptiActivityEnableAllocationSource | Not Supported | |
cuptiActivityEnableAndDump | Not Supported | |
cuptiActivityEnableContext | Not Supported | |
cuptiActivityEnableDeviceGraph | Not Supported | |
cuptiActivityEnableDriverApi | Supported | |
cuptiActivityEnableLatencyTimestamps | Not Supported | |
cuptiActivityEnableLaunchAttributes | Not Supported | |
cuptiActivityEnableRuntimeApi | Supported | |
cuptiActivityFlush | Supported | Deprecated |
cuptiActivityFlushAll | Supported | |
cuptiActivityFlushPeriod | Supported | |
cuptiActivityGetAttribute | Supported | |
cuptiActivityGetNextRecord | Supported | |
cuptiActivityGetNumDroppedRecords | Supported | |
cuptiActivityPopExternalCorrelationId | Supported | |
cuptiActivityPushExternalCorrelationId | Supported | |
cuptiActivityRegisterCallbacks | Supported | |
cuptiActivityRegisterTimestampCallback | Supported | |
cuptiActivitySetAttribute | Supported | |
cuptiComputeCapabilitySupported | Supported | |
cuptiDeviceSupported | Supported | |
cuptiDeviceVirtualizationMode | Supported | |
cuptiFinalize | Supported | |
cuptiGetAutoBoostState | Not Supported | |
cuptiGetContextId | Supported | |
cuptiGetDeviceId | Supported | |
cuptiGetGraphExecId | Supported | |
cuptiGetGraphId | Supported | |
cuptiGetGraphNodeId | Supported | |
cuptiGetLastError | Supported | |
cuptiGetStreamId | Supported | |
cuptiGetStreamIdEx | Supported | |
cuptiGetThreadIdType | Supported | |
cuptiGetTimestamp | Supported | |
cuptiSetThreadIdType | Supported |
Activity kind support
Activity kind | Supported | Remarks |
CUPTI_ACTIVITY_KIND_MEMCPY | Supported | |
CUPTI_ACTIVITY_KIND_MEMSET | Supported | |
CUPTI_ACTIVITY_KIND_KERNEL | Not Supported | Implemented as |
CUPTI_ACTIVITY_KIND_DRIVER | Supported | |
CUPTI_ACTIVITY_KIND_RUNTIME | Supported | |
CUPTI_ACTIVITY_KIND_EVENT | Not Supported | |
CUPTI_ACTIVITY_KIND_METRIC | Not Supported | |
CUPTI_ACTIVITY_KIND_DEVICE | Supported | |
CUPTI_ACTIVITY_KIND_CONTEXT | Supported | |
CUPTI_ACTIVITY_KIND_CONCURRENT_KERNEL | Supported | |
CUPTI_ACTIVITY_KIND_NAME | Supported | NVTX |
CUPTI_ACTIVITY_KIND_MARKER | Supported | NVTX |
CUPTI_ACTIVITY_KIND_MARKER_DATA | Not Supported | |
CUPTI_ACTIVITY_KIND_SOURCE_LOCATOR | Not Supported | |
CUPTI_ACTIVITY_KIND_GLOBAL_ACCESS | Not Supported | |
CUPTI_ACTIVITY_KIND_BRANCH | Not Supported | |
CUPTI_ACTIVITY_KIND_OVERHEAD | Supported | |
CUPTI_ACTIVITY_KIND_CDP_KERNEL | Not Supported | |
CUPTI_ACTIVITY_KIND_PREEMPTION | Not Supported | |
CUPTI_ACTIVITY_KIND_ENVIRONMENT | Not Supported | |
CUPTI_ACTIVITY_KIND_EVENT_INSTANCE | Not Supported | |
CUPTI_ACTIVITY_KIND_MEMCPY2 | Supported | |
CUPTI_ACTIVITY_KIND_METRIC_INSTANCE | Not Supported | |
CUPTI_ACTIVITY_KIND_INSTRUCTION_EXECUTION | Not Supported | |
CUPTI_ACTIVITY_KIND_UNIFIED_MEMORY_COUNTER | Not Supported | |
CUPTI_ACTIVITY_KIND_FUNCTION | Not Supported | |
CUPTI_ACTIVITY_KIND_MODULE | Not Supported | |
CUPTI_ACTIVITY_KIND_DEVICE_ATTRIBUTE | Not Supported | |
CUPTI_ACTIVITY_KIND_SHARED_ACCESS | Not Supported | |
CUPTI_ACTIVITY_KIND_PC_SAMPLING | Not Supported | |
CUPTI_ACTIVITY_KIND_PC_SAMPLING_RECORD_INFO | Not Supported | |
CUPTI_ACTIVITY_KIND_INSTRUCTION_CORRELATION | Not Supported | |
CUPTI_ACTIVITY_KIND_OPENACC_DATA | Not Supported | |
CUPTI_ACTIVITY_KIND_OPENACC_LAUNCH | Not Supported | |
CUPTI_ACTIVITY_KIND_OPENACC_OTHER | Not Supported | |
CUPTI_ACTIVITY_KIND_CUDA_EVENT | Supported | |
CUPTI_ACTIVITY_KIND_STREAM | Supported | |
CUPTI_ACTIVITY_KIND_SYNCHRONIZATION | Supported | |
CUPTI_ACTIVITY_KIND_EXTERNAL_CORRELATION | Supported | |
CUPTI_ACTIVITY_KIND_NVLINK | Not Supported | |
CUPTI_ACTIVITY_KIND_INSTANTANEOUS_EVENT | Not Supported | |
CUPTI_ACTIVITY_KIND_INSTANTANEOUS_EVENT_INSTANCE | Not Supported | |
CUPTI_ACTIVITY_KIND_INSTANTANEOUS_METRIC | Not Supported | |
CUPTI_ACTIVITY_KIND_INSTANTANEOUS_METRIC_INSTANCE | Not Supported | |
CUPTI_ACTIVITY_KIND_MEMORY | Not Supported | |
CUPTI_ACTIVITY_KIND_PCIE | Not Supported | |
CUPTI_ACTIVITY_KIND_OPENMP | Not Supported | |
CUPTI_ACTIVITY_KIND_INTERNAL_LAUNCH_API | Not Supported | |
CUPTI_ACTIVITY_KIND_MEMORY2 | Not Supported | |
CUPTI_ACTIVITY_KIND_MEMORY_POOL | Not Supported | |
CUPTI_ACTIVITY_KIND_GRAPH_TRACE | Not Supported | |
CUPTI_ACTIVITY_KIND_JIT | Not Supported |
CUPTI callback support
Callback domain support
Callback domain | Supported |
CUPTI_CB_DOMAIN_DRIVER_API | supported |
CUPTI_CB_DOMAIN_RUNTIME_API | supported |
CUPTI_CB_DOMAIN_RESOURCE | partially supported |
CUPTI_CB_DOMAIN_SYNCHRONIZE | supported |
CUPTI_CB_DOMAIN_NVTX | supported |
CUPTI_CB_DOMAIN_STATE | not supported |
Resource domain callback support
Resource callback type | Supported | Remarks |
CUPTI_CBID_RESOURCE_CONTEXT_CREATED | supported | |
CUPTI_CBID_RESOURCE_CONTEXT_DESTROY_STARTING | supported | |
CUPTI_CBID_RESOURCE_STREAM_CREATED | supported | |
CUPTI_CBID_RESOURCE_STREAM_DESTROY_STARTING | supported | |
CUPTI_CBID_RESOURCE_CU_INIT_FINISHED | supported | |
CUPTI_CBID_RESOURCE_MODULE_LOADED | supported | |
CUPTI_CBID_RESOURCE_MODULE_UNLOAD_STARTING | supported | |
CUPTI_CBID_RESOURCE_MODULE_PROFILED | not supported | |
CUPTI_CBID_RESOURCE_GRAPH_CREATED | not supported | |
CUPTI_CBID_RESOURCE_GRAPH_DESTROY_STARTING | not supported | |
CUPTI_CBID_RESOURCE_GRAPH_CLONED | not supported | |
CUPTI_CBID_RESOURCE_GRAPHNODE_CREATE_STARTING | not supported | |
CUPTI_CBID_RESOURCE_GRAPHNODE_CREATED | not supported | |
CUPTI_CBID_RESOURCE_GRAPHNODE_DESTROY_STARTING | not supported | |
CUPTI_CBID_RESOURCE_GRAPHNODE_DEPENDENCY_CREATED | not supported | |
CUPTI_CBID_RESOURCE_GRAPHNODE_DEPENDENCY_DESTROY_STARTING | not supported | |
CUPTI_CBID_RESOURCE_GRAPHEXEC_CREATE_STARTING | not supported | |
CUPTI_CBID_RESOURCE_GRAPHEXEC_CREATED | not supported | |
CUPTI_CBID_RESOURCE_GRAPHEXEC_DESTROY_STARTING | not supported | |
CUPTI_CBID_RESOURCE_GRAPHNODE_CLONED | not supported | |
CUPTI_CBID_RESOURCE_STREAM_ATTRIBUTE_CHANGED | not supported |
Callback API support
API name | Supported | Remarks |
cuptiEnableAllDomains | supported | |
cuptiEnableCallback | supported | |
cuptiEnableDomain | supported | |
cuptiGetCallbackName | supported | |
cuptiGetCallbackState | supported | |
cuptiSubscribe | supported | |
cuptiSupportedDomains | supported | |
cuptiUnsubscribe | supported |
NVTX support
Module | API | Status | Remarks |
marker and range | nvtxDomainMarkEx | Supported | |
nvtxMarkEx | Supported | ||
nvtxMarkA | Supported | ||
nvtxMarkW | Not Supported | ||
nvtxDomainRangeStartEx | Supported | Some event attributes are not supported. | |
nvtxRangeStartEx | Supported | ||
nvtxRangeStartA | Supported | ||
nvtxRangeStartW | Not Supported | ||
nvtxDomainRangeEnd | Supported | ||
nvtxRangeEnd | Supported | ||
nvtxDomainRangePushEx | Supported | ||
nvtxRangePushEx | Supported | ||
nvtxRangePushA | Supported | ||
nvtxRangePushW | Not Supported | ||
nvtxDomainRangePop | Supported | ||
nvtxRangePop | Supported | ||
resource naming | nvtxDomainResourceCreate | Not Supported | |
nvtxNameCuDeviceA | Not Supported | ||
nvtxNameCuDeviceW | Not Supported | ||
nvtxNameCudaDeviceA | Not Supported | ||
nvtxNameCudaDeviceW | Not Supported | ||
nvtxNameClDeviceA | Not Supported | ||
nvtxNameClDeviceW | Not Supported | ||
nvtxDomainResourceDestroy | Not Supported | ||
nvtxDomainNameCategoryA | Not Supported | ||
nvtxDomainNameCategoryW | Not Supported | ||
nvtxNameCategoryA | Not Supported | ||
nvtxNameCategoryW | Not Supported | ||
nvtxNameOsThreadA | Not Supported | ||
nvtxNameOsThreadW | Not Supported | ||
nvtxNameCuContextA | Not Supported | ||
nvtxNameCuContextW | Not Supported | ||
nvtxNameCuStreamA | Not Supported | ||
nvtxNameCuStreamW | Not Supported | ||
nvtxNameCuEventA | Not Supported | ||
nvtxNameCuEventW | Not Supported | ||
nvtxNameCudaStreamA | Not Supported | ||
nvtxNameCudaStreamW | Not Supported | ||
nvtxNameCudaEventA | Not Supported | ||
nvtxNameCudaEventW | Not Supported | ||
nvtxNameClContextA | Not Supported | ||
nvtxNameClContextW | Not Supported | ||
nvtxNameClCommandQueueA | Not Supported | ||
nvtxNameClCommandQueueW | Not Supported | ||
nvtxNameClMemObjectA | Not Supported | ||
nvtxNameClMemObjectW | Not Supported | ||
nvtxNameClSamplerA | Not Supported | ||
nvtxNameClSamplerW | Not Supported | ||
nvtxNameClProgramA | Not Supported | ||
nvtxNameClProgramW | Not Supported | ||
nvtxNameClEventA | Not Supported | ||
nvtxNameClEventW | Not Supported | ||
string registration | nvtxDomainRegisterStringA | Supported | |
nvtxDomainRegisterStringW | Supported | ||
domains | nvtxDomainCreateA | Supported | |
nvtxDomainCreateW | Supported | ||
nvtxDomainDestroy | Supported | ||
synchronization | nvtxDomainSyncUserCreate | Not Supported | |
nvtxDomainSyncUserDestroy | Not Supported | ||
nvtxDomainSyncUserAcquireStart | Not Supported | ||
nvtxDomainSyncUserAcquireFailed | Not Supported | ||
nvtxDomainSyncUserAcquireSuccess | Not Supported | ||
nvtxDomainSyncUserReleasing | Not Supported |
For SAIL SDK v1.5, asight supports the Python nvtx library up to version 0.2.11. You can check your version by running pip show nvtx.
If you are using a newer version, run pip install nvtx==0.2.11 to install the supported version. The next SDK release will support newer versions.
For SAIL SDK v1.6, asight now supports nvtx library version 0.2.13.