Commit Graph

3193 Commits

Author SHA1 Message Date
Raiyan Latif
e0808523ee refactor: Re-enable external semaphore MT test
Related-To: NEO-11488

Signed-off-by: Raiyan Latif <raiyan.latif@intel.com>
2025-04-23 18:20:38 +02:00
Mateusz Jablonski
0dd2535674 refactor: change type of stype member in L0 Core driver extensions
use uint32_t-alias type to avoid casting out of ze_structure_type_t enum range
Related-To: NEO-12901

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-04-18 15:02:31 +02:00
Aravind Gopalakrishnan
b4f95a1a26 feature: Add pidfd option for IPC handle import
Related-To: NEO-10380

Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-04-18 13:01:27 +02:00
Mateusz Hoppe
990fa0d8a9 fix: assign secondary contexts from correct device
- for root device, copy engines from subdevice are used, secondary
contexts must be selected from subdevice in this case

- return low priority BCS from subdevice

Related-To: NEO-14559

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-04-18 10:55:39 +02:00
Young Jin Yoon
05c6612386 refactor: add EncodePostSyncArgs to EncodeDispatchKernelArgs
Refactored various member variables in EncodeDispatchKernel to directly
include EncodePostSync
Changed command encoder and command list to use the modified
EncodeDispatchKernel.

Related-To: NEO-13003
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2025-04-17 20:55:40 +02:00
Fabian Zwoliński
ee769f5983 fix: Add texture cache flush after kernels writing to images on imm cmdlists
- add `hasImageWriteArg` flag to KernelDescriptor,
based on image access qualifier
- add `isPostImageWriteFlushRequired` method to productHelper,
to require cache flush only on selected platforms
- if possible, add the `textureCacheInvalidationEnable` arg to the
existing PC, otherwise add a new PC

Related-To: NEO-13427, HSD-18041321008
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-04-17 16:04:31 +02:00
Young Jin Yoon
5a2a792c34 Revert "refactor: add EncodePostSyncArgs to EncodeDispatchKernelArgs"
This reverts commit 40aef1555e.

Related-To: NEO-13003
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2025-04-17 15:37:05 +02:00
Zbigniew Zdanowicz
66c8f86fd8 performance: make reservation in residency before adding to the container
Related-To: NEO-13916

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-17 11:02:54 +02:00
Young Jin Yoon
40aef1555e refactor: add EncodePostSyncArgs to EncodeDispatchKernelArgs
Refactored various member variables in EncodeDispatchKernel to directly
include EncodePostSync
Changed command encoder and command list to use the modified
EncodeDispatchKernel.

Related-To: NEO-13003
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2025-04-16 17:46:07 +02:00
Zbigniew Zdanowicz
908cd0abb7 performance: unify all specific non append method calls into single conditional
Related-To: NEO-13916

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-16 15:01:21 +02:00
Chandio, Bibrak Qamar
bed2ad1ac0 feature: memAdise for System Allocator
Related-To: NEO-13715

Implements basic functionality for zeCommandListAppendMemoryAdvise for
system allocator

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-04-16 07:11:14 +02:00
Chodor, Jaroslaw
a336d5d772 refactor: remove expicitly deleted copy c-tor in ContextImp
Rely on NEO::NonCopyableAndNonMovableClass instead

Signed-off-by: Chodor, Jaroslaw <jaroslaw.chodor@intel.com>
2025-04-15 22:48:39 +02:00
shubham kumar
48bbf12eb5 fix: correct gfx_core_helper definitions for EUSS
Related-To: NEO-14337

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-04-15 20:02:36 +02:00
Kamil Kopryk
dd3d294f87 performance: cache MOCS values
This change caches the most used MOCS values:

* getMOCS(GMM_RESOURCE_USAGE_OCL_BUFFER_CONST);
* getMOCS(GMM_RESOURCE_USAGE_OCL_BUFFER);
* getMOCS(GMM_RESOURCE_USAGE_OCL_BUFFER_CACHELINE_MISALIGNED);
inside gmmHelper class during initialization to avoid repeated
calls of virtual functions, branches and/or gmm lib access.

and adds more readably corresponding getters:
* getL1EnabledMOCS
* getL3EnabledMOCS
* getUncachedMOCS

If force all resources uncached is called,
these 3 cached mocs values are reinitialized

It also changes the order of gmmHelper members, to avoid
not needed padding after addressWidth
and simplifies logic in getMocsIndex function
for xehp and later products.

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-04-14 14:12:48 +02:00
Zbigniew Zdanowicz
09c9b555f9 fix: correct scope for usm allocations indirect access lock
Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-11 19:39:48 +02:00
Zbigniew Zdanowicz
cf7209ddfe refactor: change queue and immediate command list to accept indirect lock
Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-11 13:45:29 +02:00
Matias Cabral
25ed9d1989 feature: metrics aggregation for EU Stall
Resolves: NEO-13999

Signed-off-by: Matias Cabral <matias.a.cabral@intel.com>
2025-04-10 22:38:19 +02:00
shubham kumar
f5b9d6f459 refactor: prework to read EUSS correctly for next gen core
Related-To: NEO-14545

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-04-10 19:28:13 +02:00
Zbigniew Zdanowicz
9e5ff37b5c fix: process immediate command list internal residency
Related-To: NEO-14625, NEO-14624

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-10 17:29:04 +02:00
Zbigniew Zdanowicz
b31c3bb3ca fix: remove doubled operations when executing regular on immediate
- immediate flush does not need to perform below for command list execution
- handling indirect allocations
- performing page fault migration
- making residency of unified shared memory
- perform prefetching when required

Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-09 11:58:03 +02:00
Zbigniew Zdanowicz
6a313a2f04 feature: add assert kernel support when executing regular from immediate
Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-08 18:17:00 +02:00
Zbigniew Zdanowicz
679d3a2be5 feature: add printf kernel support when executing regular from immediate
Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-08 12:25:17 +02:00
Aravind Gopalakrishnan
f95644fbd7 fix: Fix usage of root device when opening IPC handle
- Use root device if device is implicit scaling capable

Related-To: NEO-13433

Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-04-08 00:01:28 +02:00
Raiyan Latif
7a0deb123d fix: Make external semaphore controller thread safe
Related-To: NEO-11488

Signed-off-by: Raiyan Latif <raiyan.latif@intel.com>
2025-04-07 23:23:07 +02:00
Raiyan Latif
2190c8baf7 fix: properly destroy Ext Semaphore proxy events
External Semaphore proxy events were being destroyed too
early, right after signaling, causing sporadic failures.
These should be destroyed when External Semaphore thread
controller is releasing resources.

Related-To: NEO-11488

Signed-off-by: Raiyan Latif <raiyan.latif@intel.com>
2025-04-07 23:22:53 +02:00
Mateusz Jablonski
58faf6e7f5 fix: Ignore ze_driver_properties_t::pNext if base struct stype is not set
Related-To: NEO-14544
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-04-07 17:16:42 +02:00
Vysochyn, Illia
146a7f7b9b feature: Add support for BUFFER_SIZE explicit argument
Related-To: NEO-13972

Signed-off-by: Vysochyn, Illia <illia.vysochyn@intel.com>
2025-04-07 14:15:26 +02:00
Zbigniew Zdanowicz
58fe89e116 fix: remove doubled memory prefetch operation when executing command list
Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-04 13:55:16 +02:00
Chandio, Bibrak Qamar
424b23eb24 fix: blocking zeContextMakeImageResident
Related-To: NEO-11977, GSD-10293

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-04-04 11:19:17 +02:00
Mateusz Jablonski
bb518adf34 fix: patching payload arguments in inline data in case of indirect kernel
Related-To: NEO-14532
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-04-03 17:21:28 +02:00
Filip Hazubski
504440fc4d feature: Add ftrHeaplessMode flag
Pass hwInfo to isHeaplessModeEnabled and isForceBindlessRequired functions.

Related-To: NEO-14526

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2025-04-02 21:06:05 +02:00
Zbigniew Zdanowicz
f578dc0316 fix: return error when not closed command list is executed
Related-To: NEO-10356

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-04-02 14:32:37 +02:00
Fabian Zwoliński
7ef3880793 feature: implement pool allocator for gpuTimestampDeviceBuffer
The patch applies to Level Zero.
Only allocations < 2MB will be fetched from the pool.
Allocations are shared and reused within a given device.

Additionally, I added a new debug flag to control the allocator:
EnableTimestampPoolAllocator

Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-04-02 14:28:56 +02:00
Aravind Gopalakrishnan
3a7d7e022c fix: Add platform support for reservation on svm heap
Related-To: GSD-10816

Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-04-02 02:46:30 +02:00
Lukasz Jobczyk
0a11a96a53 refactor: Add dedicated method to check if any ULLS light enabled
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-31 16:36:20 +02:00
shubham kumar
92a4f9df1a fix: Correct logic to get valid timestamp bits
Related-To: NEO-14430

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-03-28 18:53:21 +01:00
Fabian Zwoliński
ecc96a9ab4 refactor: Switch EventDescriptor initialization to designated initializers
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-03-28 18:53:06 +01:00
Mateusz Jablonski
2394f9fd91 feature: update base layout of L0 handles to match ze_handle_t layout
this layout is required by L0 DDI Handle extension

Related-To: NEO-13121, NEO-13917
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-03-28 14:40:20 +01:00
Jaroslaw Warchulski
f760731173 fix: correct queryFabricStats in WSL path
Related-To: GSD-10939
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-03-28 14:23:48 +01:00
Szymon Morek
3fff3dd77b fix: set misaligned source memory 1-way coherent
Related-To: NEO-14443

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-28 14:16:45 +01:00
Zbigniew Zdanowicz
ff85d01289 performance: do not consume queue buffer when executing from command list
Related-To: NEO-13916

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2025-03-28 11:21:42 +01:00
Szymon Morek
ead0842763 feature: add L0 API to query kernel argument info
Related-To: NEO-14358

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-27 16:43:33 +01:00
shubham kumar
b06820493a fix: remove overflow check in calculate for Xe2+ core EUSS
Related-To: NEO-14446

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-03-27 10:07:52 +01:00
Jack Myers
0aa2c4f0cb feature: allow removal of heapful code paths
Related-To: NEO-13007

Signed-off-by: Jack Myers <jack.myers@intel.com>
2025-03-27 01:34:35 +01:00
Damian Tomczak
0243004907 feature: additional checkers to enable feature
Resolves: NEO-13973

Signed-off-by: Damian Tomczak <damian.tomczak@intel.com>
2025-03-26 18:06:20 +01:00
Naklicki, Mateusz
890e5c4a5a refactor: extract method for getting CB peer device allocation
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2025-03-26 11:52:52 +01:00
Kamil Kopryk
d1d3e34d11 refactor: add check if allocation imported required
Related-To: NEO-13163
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-03-26 08:55:11 +01:00
Chodor, Jaroslaw
4e9e995dca refactor: Prevent copy/move on ContextImp
Signed-off-by: Chodor, Jaroslaw <jaroslaw.chodor@intel.com>
2025-03-24 17:24:23 +01:00
Kamil Kopryk
73795ced64 refactor: add setupTimestampPacketFlushL3 function
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-03-24 13:10:03 +01:00
Compute-Runtime-Validation
28dd4cf4d8 Revert "feature: additional checkers to enable feature"
This reverts commit c95a67b420.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-03-21 16:48:05 +01:00