e687e11ab1
performance: Add CCS Optimization
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-10-23 11:35:57 +02:00
45e78fea76
fix: use productHelper in getPatIndexInfoString() on Windows
...
Fix the PAT-index reporting in logger as currently on Windows reported
values are simply wrong.
The changed logic dependends on `RootDeviceEnvironment` and in order to
avoid introducing such dependencies into logger.[ch] the
`logAllocation()` is no longer a member of `FileLogger` but
a free-function instead (and a separate .cpp file). This is important
because the source files `logger.[ch]` are also used by ocloc library
and there is no point to contaminate ocloc code structure with
unnecessary dependencies.
Related-To: NEO-9421
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2024-10-22 19:27:13 +02:00
a8a40d2afd
feature: support SVM heap in reserveVirtualMem
...
Related-To: NEO-11981
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-10-22 16:47:14 +02:00
fe1fd22371
fix: stop direct submission before oa configuration activation
...
Related-To: NEO-12778
Signed-off-by: Robert Krzemień <robert.krzemien@intel.com>
2024-10-22 14:26:44 +02:00
e10998db45
Revert "performance: Add CCS Optimization"
...
This reverts commit e7b3a40aa7
2024-10-22 05:52:14 +02:00
18d828421d
performance: add debug flag to control huge chunk size on wddm.
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-10-21 16:51:03 +02:00
8a647f6a39
Revert "performance: Ensure hostptrs removed before creating new one"
...
This reverts commit 5b2f2f3d83
2024-10-21 10:36:06 +02:00
e7b3a40aa7
performance: Add CCS Optimization
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-10-21 09:59:14 +02:00
4154e6666b
fix: correct loading L0 loader functions
...
- don't load ze_loader.dll from file system
- to perform self-open on Windows use getModuleHandleA with proper module name
- don't free library loaded with getModuleHandleA
- as loader may be not available during runtime teardown:
- load translate handle function during global setup
- load setDriverTeardown function during global teardown
- when loader is not available during teardown, unset translate handle
function
Related-To: GSD-10147
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-10-17 15:39:20 +02:00
f117b5fb68
Revert "fix: correct loading L0 loader functions"
...
This reverts commit 9c7b3c5e19
2024-10-17 08:20:19 +02:00
9c7b3c5e19
fix: correct loading L0 loader functions
...
on Windows use getModuleHandleA with proper module name
don't load ze_loader.dll from file system
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-10-16 19:53:05 +02:00
2ce3022030
refactor: remove not needed code
...
Related-To: NEO-12949
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-10-15 15:33:12 +02:00
a55a846284
Revert "fix: update slm size based on gt system info in wddm path"
...
This reverts commit d433fd585a
2024-10-11 03:43:37 +02:00
1260023efa
fix: add missing NOLINT to forward declarations
...
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2024-10-10 13:46:14 +02:00
d433fd585a
fix: update slm size based on gt system info in wddm path
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-10-10 11:29:19 +02:00
5b2f2f3d83
performance: Ensure hostptrs removed before creating new one
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-10-08 13:04:56 +02:00
60afb83b3b
Revert "performance: Ensure hostptrs removed before creating new one"
...
This reverts commit a890ed5648
2024-10-08 07:45:55 +02:00
068ceee8bd
performance: improve iterating over residency allocations
...
Related-To: NEO-12698,NEO-12746,NEO-12729
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-10-07 16:12:22 +02:00
a915ef4b7b
fix: Don't program redundant paging fence semaphores
...
Related-To: NEO-12197
Don't program semaphore to wait for paging fence if it was
already programmed with the same value
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-10-07 11:42:06 +02:00
e5658e5327
fix: fix freeing allocations in aub mode
...
- free in operations handler with aub dump must be called to evict
allocations from residentAllocations list
- prior to this change - stale allocations where in the container
leading to crash in aub modes
Related-To: NEO-12869
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-10-03 17:14:07 +02:00
41df1a6f47
Revert "feature: support SVM heap in reserveVirtualMem"
...
This reverts commit bfaeeb01d6
2024-10-03 14:53:50 +02:00
468e309e11
fix: call evict under lock
...
Related-To: NEO-12657
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-25 10:26:01 +02:00
658a0667d4
fix: add missing command buffer header translation for WSL in WDDM2.3 case
...
Related-To: NEO-12648
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-24 13:40:17 +02:00
80f75ceace
fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-09-23 14:43:59 +02:00
a890ed5648
performance: Ensure hostptrs removed before creating new one
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-19 14:34:19 +02:00
e4d2f16632
Revert "performance: Ensure hostptrs removed before creating new one"
...
This reverts commit ac1d203555
2024-09-18 19:31:34 +02:00
ac1d203555
performance: Ensure hostptrs removed before creating new one
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-18 14:23:16 +02:00
64c935a594
fix: Do not defer external hostptr destroy
...
Resolves: NEO-12567
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-17 14:54:01 +02:00
8698b5504b
fix: correctly initialize GfxCoreHelper from HwInfo
...
Related-To: NEO-11983
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-13 14:54:32 +02:00
dd631610b3
refactor: move memory tracking to memory manager
...
- remove wddm specific code
- improve total size reported to be in decimal
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-12 17:32:38 +02:00
da59b88122
refactor: improve logging of allocations
...
add capability to measure total amount of allocated memory
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-12 11:00:27 +02:00
ea5b586c37
fix: move pathExists out of sys calls and do not mock it
...
Moved pathExists from SysCalls to path.h.
In ULTs, use unchanged pathExists and mock stat, getFileAttributesA instead.
Add Windows and Linux ULTs for pathExists.
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-10 19:24:45 +02:00
beaddb55e0
fix: Minor code changes
...
Remove needless checks for module and cmdList.
Add explicit check for surfaceState in setArgImageWithMipLevel.
Explicitly initialize WddmResidencyController::csr.
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-09-10 13:31:15 +02:00
bfaeeb01d6
feature: support SVM heap in reserveVirtualMem
...
Related-To: NEO-11981
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-09 23:22:04 +02:00
e30b8c0300
fix: windows cl_cache fixes and improvements
...
Fixed the function that checks if a directory exists.
Added debug message in case config file creation fails.
Simplified setting pattern for searching all files in a directory.
Adding file search loop skip when found file is a directory.
Fixes : #762
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-09 19:25:52 +02:00
80ef56ef4a
fix: Fix residency handling when out-of-memory occurs
...
Related-To: NEO-12434 , NEO-11755
When OOM was triggered from KMD then reiterate
over allocations again since allocations which
should be resident could be evicted during trim process.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-05 13:23:37 +02:00
d842f65cf1
Revert "fix: submit dummy exec to pin memory during zeContextMakeMemoryReside...
...
This reverts commit f9b87d53e6
2024-09-05 03:28:03 +02:00
f9b87d53e6
fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
Related-To: NEO-11879
2024-09-04 14:07:29 +02:00
99f62ac866
Revert "feature: support SVM heap in reserveVirtualMem"
...
This reverts commit 93cde3ee12
2024-09-03 20:20:25 +02:00
93cde3ee12
feature: support SVM heap in reserveVirtualMem
...
Related-To: NEO-11981
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-03 11:38:51 +02:00
e6abfafa16
fix: drain paging fence queue before waiting for resources
...
Related-To: NEO-12197
If ULLS controller waits for CSR lock, and driver must
wait for resources due to OOM, then draing paging fence queue
directly
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-03 07:45:25 +02:00
fbabe203c1
Revert "fix: update completion data after makeResident"
...
This reverts commit 13ec7ad32a
2024-08-31 20:54:02 +02:00
13ec7ad32a
fix: update completion data after makeResident
...
Completion data can't be updated when makeResident fails
Resources could have updated state but paging fence remains the same.
Wait on paging fence during freeing these resources might result in hang.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-30 13:29:48 +02:00
c934877790
refactor: remove not needed function
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-30 12:18:14 +02:00
df859c6d4a
fix: skip always resident allocations during trim
...
Related-To: NEO-12461
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-30 11:22:44 +02:00
a0b789bf9c
fix: make removal from container thread safe
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-30 09:24:20 +02:00
78d9af04e7
Revert "fix: change mutex when destroying allocation"
...
This reverts commit 7628966f80
2024-08-29 18:14:01 +02:00
2d8397a36f
Revert "fix: skip always resident allocations during trim"
...
This reverts commit c9457bb5eb
2024-08-29 15:57:37 +02:00
7628966f80
fix: change mutex when destroying allocation
...
Current mutex is not preventing destroying resources
when trim callback is currently evicting same allocation.
New mutex does.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-28 15:31:45 +02:00
c9457bb5eb
fix: skip always resident allocations during trim
...
Related-To: NEO-12461
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-27 15:04:50 +02:00
5dbbaa39b9
Revert "fix: ulls controller sleep, windows"
...
This reverts commit 6455d4648c
2024-08-24 06:37:58 +02:00
b8f181d50e
performance: remove trim candidate list
...
Related-To: NEO-11755
Removing trim candidate list reduces overhead
caused by residency handling. Allocations required
for eviction are placed in eviction container managed
by CSR.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-23 12:21:50 +02:00
6455d4648c
fix: ulls controller sleep, windows
...
Request higher resolution for windows periodic timers for ulls
controller sleep.
Allows for controller thread to sleep with granularity of 1ms.
Related-To: NEO-10800
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-08-23 12:05:26 +02:00
7ac41615cd
fix: create thread with function pointer
...
don't create async thread in neo shared tests
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-21 18:02:37 +02:00
8b1bedd1f6
fix: call processFlushResidency on aub operations handler
...
- in Os with AubDump mode
Related-To: NEO-11719
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-20 21:13:10 +02:00
579af57161
refactor: don't call OsLibrary::load directly, use function pointer
...
this allows mocking this call in ULT
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-20 08:59:26 +02:00
efb8240a00
refactor: rename OsLibrary::load function to distinguish functionality
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-16 01:35:41 +02:00
7ebf2e1994
performance: unlock shared mutex during evict
...
Related-To: NEO-11755
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-09 10:35:12 +02:00
556a116987
fix: make paging fence address volatile
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-07 15:09:34 +02:00
d7d6996464
performance: initialize timeout params once
...
Currently this is done per each enqueue
which is not really needed
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-07 14:35:12 +02:00
0d6c506c0b
performance: enable wait on paging fence on semaphore
...
Related-To: NEO-12197
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-07 10:20:03 +02:00
d4c1631ac7
performance: don't wait for paging fence on user thread
...
Related-To: NEO-12197
Currently for new resources user thread must wait before submitting
actual workload. With this commit, instead of waiting on user thread,
request is sent to background ULLS controller thread and additional
semaphore is programmed. ULLS controller will perform actual wait
and signal semaphore when paging fence reaches required value.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-07 08:30:51 +02:00
0002eb3fcc
feature: adding eu stall support on windows
...
Related-To: NEO-12174
Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2024-08-06 06:47:11 +02:00
e9e6cc05e3
fix: mem alloc size tracking safety
...
Make sure local mem alloc size atomic array is initialized with 0.
Add debug breaks to catch possible overflow on unregistering
allocations.
Related-To: NEO-11356
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-08-05 11:51:17 +02:00
26428d5af3
feature: track used memory by allocations
...
Track memory used by memory allocations. System and local per device.
Will be used for heuristics in memory pooling.
Related-To: NEO-11356
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-08-02 17:54:34 +02:00
afc1664fce
fix: fail wddm initialization when cannot create topology map
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-30 09:35:42 +02:00
8a7923c6ee
fix: allow fork() after zeInit()
...
- do not release resources derived from parent process
- zeInit() in child should initilize new driver
Related-To: NEO-11761
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-07-23 15:31:50 +02:00
0800ab54f5
refactor: remove redundant getPid()
...
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-07-22 22:51:47 +02:00
0cb2a22c55
Revert "fix: correct number of slice count in configureHwInfoDrm"
...
This reverts commit b597f47a70
2024-07-19 04:35:03 +02:00
b597f47a70
fix: correct number of slice count in configureHwInfoDrm
...
adjust slice count to proper value based on previously calculated
max slices and max subslice counts
Related-To: NEO-12073
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-18 16:54:51 +02:00
46f2568902
build: fixes for windows clang with -m32
...
Related-To: NEO-10748
Signed-off-by: Grzegorz Choinski <grzegorz.choinski@intel.com>
2024-07-18 14:49:56 +02:00
1d7ce005d7
refactor: extract common logic from wddm and drm product helpers
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-17 11:03:02 +02:00
e3053121cb
Revert "refactor: extract common logic from wddm and drm product helpers"
...
This reverts commit 585caab757
2024-07-17 04:53:28 +02:00
61e08ef4ff
performance: add debug flag to allow non zero for compressed
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-07-16 12:46:10 +02:00
585caab757
refactor: extract common logic from wddm and drm product helpers
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-16 11:17:18 +02:00
80afda1ac9
refactor: extract common logic of setting kmd notify properties
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-15 17:58:34 +02:00
a2fb4da91d
fix: correct fallback path when creating topology map in Wddm
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-15 16:52:47 +02:00
789a008470
fix: setup proper preemption surface size when forcing builtin SIP
...
when getting SIP kernel from IGC, setup related surface size based on IGC data
Related-To: NEO-8188
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-15 15:56:24 +02:00
e78c8edcf3
refactor: prework for adding eu stall support on windows
...
Related-To: NEO-9492
Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2024-07-12 16:27:24 +02:00
e39994f525
fix: setup slm size based on gt system info when not set in capability table
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-09 15:21:35 +02:00
991640f558
Revert "fix: update slm size in capability table based on gt system info"
...
This reverts commit 47e064a686
2024-07-09 03:31:42 +02:00
47e064a686
fix: update slm size in capability table based on gt system info
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-08 09:35:25 +02:00
c679e7df30
Revert "fix: update slm size in capability table based on gt system info"
...
This reverts commit e624a4b0ab
2024-07-06 03:40:49 +02:00
e624a4b0ab
fix: update slm size in capability table based on gt system info
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-05 14:25:33 +02:00
6992cb8aeb
fix: Add experimental debug toggle to force 2M local memory size alignment
...
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-06-27 15:21:35 +02:00
4527d72fde
refactor: remove dead code
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-06-26 10:44:45 +02:00
c817d15b59
fix: residency leak
...
- properly add needsMakeResidentBeforeLock in Wddm Allocation so while
destroying the allocation it is properly removed from wddm residency controller
- add cannot trim further flag after eviction
- fix debug variable
Related-To: NEO-11731
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-06-25 15:17:11 +02:00
0b513fba0d
fix: do not open NT handle when number of allocations is zero
...
Resolves: NEO-11803
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-25 08:59:12 +02:00
dc26b25169
Revert "fix: ulls controller sleep, windows"
...
This reverts commit 672cc0ebc7
2024-06-21 14:10:43 +02:00
63da79798d
refactor: reduce the number of GraphicsAllocation constructors and derivatives
...
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-18 21:31:37 +02:00
daec249430
refactor: remove not needed createGraphicsAllocationFromNTHandle method
...
Related-To: NEO-11498
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-18 14:25:00 +02:00
f910f94ef9
fix: change default wddm low priority context value
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-06-18 11:20:23 +02:00
196f0a6eee
Revert "fix: pass custom alignments for WSL2 device and shared memory allocat...
...
This reverts commit 1c98420518
2024-06-18 07:58:28 +02:00
672cc0ebc7
fix: ulls controller sleep, windows
...
Request higher resolution for windows periodic timers for ulls
controller sleep.
Allows for controller thread to sleep with granularity of 1ms.
Related-To: NEO-10800
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-06-18 06:28:15 +02:00
bca6568e5b
fix: add support for arrays of NV12 surfaces
...
Resolves: NEO-11498
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-12 23:19:29 +02:00
76a05c1cab
refactor: pass arrayIndex to Wddm::openNTHandle function
...
Related-To: NEO-11498
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-12 12:11:35 +02:00
0ac1be7669
refactor: pass arrayIndex to Wddm::openSharedHandle function
...
Related-To: NEO-11498
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-07 09:51:26 +02:00
455f74991e
feature: pass interrupt flag to queue creation api
...
Related-To: NEO-8179
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-06-06 12:36:21 +02:00
dcac701482
feature: add support for receiving FtrWalkerMTP flag
...
Related-To: NEO-8188, NEO-10774
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-06-05 11:03:19 +02:00
9a2fa1dcb1
fix: Override prefer no cpu access for dc flush mitigation
...
Related-To: NEO-10556
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-06-05 10:26:45 +02:00
Lukasz Jobczyk