Commit Graph

887 Commits

Author SHA1 Message Date
Jaroslaw Warchulski
f50ca4432d refactor: cleanup includes
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-11-20 08:24:13 +01:00
Compute-Runtime-Validation
ff27bb12d1 Revert "fix: use condition variables instead of busy waits in worker threads"
This reverts commit 4406889b39.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-11-14 15:55:47 +01:00
Vysochyn, Illia
dc85f33e49 fix: Disallow USM compression on peer access
Related-To: NEO-15427

Signed-off-by: Vysochyn, Illia <illia.vysochyn@intel.com>
2025-11-12 16:22:57 +01:00
Mateusz Jablonski
00e2ff01a1 fix: correct setting resourceTag in case of system memory storage
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-11-06 14:36:34 +01:00
Dominik Dabek
0f753a98aa feature: optionally immediate internal engine init
If engine type is internal, os context will return immediate
initialization enabled based on product helper.

Related-To: NEO-16633

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-11-06 10:54:48 +01:00
Dominik Dabek
140f787b11 performance: enable l0 host usm growing pools
Related-To: NEO-16084

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-11-05 09:12:42 +01:00
Compute-Runtime-Validation
f9225de6b1 Revert "feature: integrate UsmMemAllocPoolsManager with OpenCL device pool"
This reverts commit 7833d62e3a.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-31 20:44:08 +01:00
Igor Venevtsev
4406889b39 fix: use condition variables instead of busy waits in worker threads
Resolves: NEO-16085, GSD-11678, HSD-14025819208

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2025-10-31 15:28:54 +01:00
Aleksander Czerwionka
7833d62e3a feature: integrate UsmMemAllocPoolsManager with OpenCL device pool
Related-To: NEO-16082

Signed-off-by: Aleksander Czerwionka <aleksander.czerwionka@intel.com>
2025-10-30 14:44:41 +01:00
Mateusz Hoppe
08fc0c1e1f fix: expose single device mode
- return internal engine as default engine when defaultEngineIndex is not
yet set
- return correct internal engine from Device::getInternalEngine()

Resolves: HSD-18043691881

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-10-29 09:27:17 +01:00
Aleksander Czerwionka
0f639dc723 feature: set manager pool sizes based on isExtendedUsmPoolSizeEnabled
Related-To: NEO-16082

Signed-off-by: Aleksander Czerwionka <aleksander.czerwionka@intel.com>
2025-10-28 08:01:27 +01:00
Dominik Dabek
ff48090c11 feature: usm pool residency tracking
Initially under debug flag.
Track residency of pool and chunks.
If pool is already resident or already evicted, we can skip memory
operation on chunk from pool.

Return error on using not allocated chunk in pool.

Related-To: NEO-16303

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-10-24 13:14:37 +02:00
Compute-Runtime-Validation
b7d1c32edd Revert "fix: use condition variables instead of busy waits in worker threads"
This reverts commit 1f6039676f.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-24 10:55:27 +02:00
Lukasz Jobczyk
0bfcd9783c performance: Add flag to aub dump only command stream
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-23 11:50:49 +02:00
Igor Venevtsev
1f6039676f fix: use condition variables instead of busy waits in worker threads
Resolves: NEO-16085, GSD-11678, HSD-14025819208

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2025-10-21 17:37:00 +02:00
Lukasz Jobczyk
a858f159cf refactor: Move PF manager init to first shared alloc create
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-20 16:07:53 +02:00
Szymon Morek
c78c1515de performance: reuse cmd buffer without dc flush
Related-To: NEO-16348

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-16 16:26:54 +02:00
Aleksander Czerwionka
cfbbe04e32 refactor: decrease UsmMemAllocPoolsManager pool sizes in unit tests
Related-To: NEO-16082

Might fix NEO-16307

Signed-off-by: Aleksander Czerwionka <aleksander.czerwionka@intel.com>
2025-10-16 11:48:04 +02:00
Chandio, Bibrak Qamar
49020f234d feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint on zeVirtualMemReserve.
If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-10-16 00:22:00 +02:00
Dominik Dabek
f126203df3 fix: earlier stopping of usm reuse cleaner thread
Usm cleaner needs to stop before usm reuse cleanup.

Related-To: HSD-18043613805

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-10-14 18:18:52 +02:00
Szymon Morek
435c43d142 performance: Use 2MB heap for cl_buffers if possible
Related-To: NEO-16165

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-13 09:14:40 +02:00
Compute-Runtime-Validation
244dd9b0b4 Revert "fix: use condition variables instead of busy waits in worker threads"
This reverts commit db0b4a616c.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-11 03:52:05 +02:00
Dominik Dabek
00ec4c82b2 fix: blocking usm reuse cleanup
Use blocking free policy when cleaning up usm reuse

Also clean usm reuse first when destroying platform,
since there is no point in reusing on closing application.

Related-To: HSD-18043613805, HSD-13013909538

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-10-10 22:32:08 +02:00
Igor Venevtsev
db0b4a616c fix: use condition variables instead of busy waits in worker threads
Resolves: NEO-16085, GSD-11678, HSD-14025819208

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2025-10-10 21:42:02 +02:00
Fabian Zwoliński
226846323f feature: add memsetAllocation helper with blitter support
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-10 15:12:17 +02:00
Lukasz Jobczyk
d4132cf8b0 refactor: Add assert for ContainerReadLockTypeRAIIHelper
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-09 10:52:07 +02:00
Mateusz Jablonski
298fcb868b fix: Set init zero flag for preemption buffer
Related-To: HSD-16028003349
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-08 15:57:56 +02:00
Lukasz Jobczyk
6d6715bebf performance: Lock svm allocs mutex once in appendLaunchKernelWithArgs
Resolves: NEO-15774

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-08 13:35:52 +02:00
Neil R. Spruit
66a0f0d1bb fix: Corrected flag union reserve size and simplified sharedNT flag
Related-To: NEO-16317

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
2025-10-08 13:35:21 +02:00
Dominik Dabek
9d8bad9f49 fix: call_once for starting usm reuse thread
CID 162223

avoid possible deadlock on svmAllocationCachesMutex

Related-To: HSD-16028754950

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-10-07 20:07:21 +02:00
Naklicki, Mateusz
0c619299d0 refactor: cleanup header includes in level_zero
Related-To: NEO-15383
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2025-10-07 19:58:31 +02:00
Dominik Dabek
17199556ca performance: lazy start usm reuse cleaner thread
Delay starting usm reuse cleaner thread to first allocation reuse.

Related-To: HSD-16028754950

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-10-07 13:29:10 +02:00
Bartosz Dunajski
d1a2ec4590 fix: add missing lock in bcs split path 2
Related-To: NEO-14557

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-10-07 08:00:18 +02:00
Compute-Runtime-Validation
bafb847c73 Revert "fix: use condition variables instead of busy waits in worker threads"
This reverts commit 9d1da44e08.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-06 20:38:46 +02:00
Radoslaw Jablonski
54de14a9dc refactor: apply clang-format's InsertBraces rule
Formats code before InsertBraces rule is enabled.

Signed-off-by: Radoslaw Jablonski <radoslaw.jablonski@intel.com>
2025-10-06 15:32:46 +02:00
Igor Venevtsev
9d1da44e08 fix: use condition variables instead of busy waits in worker threads
Resolves: NEO-16085, GSD-11678, HSD-14025819208

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2025-10-06 13:27:34 +02:00
Compute-Runtime-Validation
d3ac2f871b Revert "fix: add missing lock in bcs split path"
This reverts commit 8ea8e78471.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-06 11:38:28 +02:00
Kamil Kopryk
f17ac35108 refactor: improve compilation time
Limit bitset includes,
stl bitset is slow to compile

Related-To: NEO-15390

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-10-03 21:21:25 +02:00
Bartosz Dunajski
8ea8e78471 fix: add missing lock in bcs split path
Related-To: NEO-14557

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-10-03 21:06:28 +02:00
Jack Myers
7b18a66710 fix: ensure proper heap alignment
Noticed an issue on machine with following `sycl-ls`:

When running `sycl-ls` with a recent debug build of NEO, it exposed a
heap alignment problem:

```shell
Assert was called at 324 line in file:
../../src/neo/shared/source/memory_manager/gfx_partition.cpp
```

Related-To: NEO-16287
Signed-off-by: Jack Myers <jack.myers@intel.com>
2025-10-01 14:46:52 +02:00
Kamil Kopryk
2192e0b90e refactor: improve compilation time
Limit chrono includes,
chrono is very slow to compile

Related-To: NEO-15390
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-10-01 13:50:29 +02:00
Szymon Morek
d429f0d8a0 fix: respect uncacheable flag for USM host allocations
Related-To: NEO-14360

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-09-25 16:31:19 +02:00
Dominik Dabek
f54e3fda41 feature: adapt usm pool manager
Change behavior to continue allocating usm pools as needed.
Intended to replace singular usm pools.

Related-To: NEO-16084

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-09-24 15:16:10 +02:00
Fabian Zwoliński
a1c5fa1a13 feature: add pooling of USM global/constant surface
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-09-23 18:24:18 +02:00
Compute-Runtime-Validation
6736378c4d Revert "fix: use condition variables instead of busy waits in worker threads"
This reverts commit 452475a0b9.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-09-23 17:06:18 +02:00
Chandio, Bibrak Qamar
cf21cbc910 feature: Complete madvise for System Allocator
Related-To: NEO-13715

Provides implmentation of getAtomicAccessAttribute using system
allocator.
Completes the implementation of the madvise feature using the
new IOCTLs in xe_drm header.

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-09-23 16:00:35 +02:00
Szymon Morek
797807bea8 fix: reduce USM pool size for platforms prior Xe2
Related-To: NEO-16192

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-09-23 15:06:54 +02:00
Igor Venevtsev
452475a0b9 fix: use condition variables instead of busy waits in worker threads
Resolves: NEO-16085, GSD-11678, HSD-14025819208

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2025-09-23 14:44:39 +02:00
Kamil Kopryk
5f59b4ca08 feature: add host function allocation
Related-To: NEO-14577
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-09-23 11:10:45 +02:00
Compute-Runtime-Validation
16a6c3ca8a Revert "feature: add host function allocation"
This reverts commit 75b4de70cd.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-09-23 02:33:15 +02:00