1f801f412f
fix: don't program mid thread preemption for pre-Xe2 platforms
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-10-08 14:16:14 +02:00
552930a75f
fix: don't setup preemption surface when debugger is active
...
Related-To: NEO-12878
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-10-08 13:58:11 +02:00
73e4b6ae7c
fix: remove w/a which disables wmtp in kernels with ray tracing
...
Related-To: NEO-12872
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-10-07 14:28:08 +02:00
a915ef4b7b
fix: Don't program redundant paging fence semaphores
...
Related-To: NEO-12197
Don't program semaphore to wait for paging fence if it was
already programmed with the same value
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-10-07 11:42:06 +02:00
6abc5eb1a1
fix: using releaseHelper to determine MTP enablement
...
Related-To: NEO-12466
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-10-01 15:06:07 +02:00
edeb7bdd4b
refactor: Allocate copy source for work partition allocation on heap
...
No perforamce impact expected since it is initialized once only,
but has the advantage of using custom allocator by overriding malloc.
Related-To: NEO-12846
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2024-10-01 13:32:55 +02:00
5b1bd4b088
refactor: dont mix aub and hw wait prints
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-26 08:51:23 +02:00
80f75ceace
fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-09-23 14:43:59 +02:00
4a068c8eab
fix: correclty program StateBaseAddress in global bindless mode
...
- prepare bindful ssh when kernel requires ssh heap and
SurfaceStateBaseAddress
- remove lastAppendedKernelBindlesMode - local ssh heap may be needed
for bindless kernels with scratch or misaligned buffer args
- use ssh heap gpu address to program SurfaceStateBaseAddress, global base is
used for BindlessSurfaceState and DynamicState
Related-To: NEO-7063
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-20 11:57:05 +02:00
ec5beaf616
refactor: reduce csr class size
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-18 13:33:55 +02:00
d2bf3e4431
refactor: remove not needed volatile keywords
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-18 11:54:38 +02:00
d3d8b5fcc1
fix: inherit work partition allocation from primary root csr
...
Related-To: NEO-8171
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-16 18:45:16 +02:00
8e7959b243
refactor: remove not needed code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-16 14:55:55 +02:00
78604bd475
refactor: remove not needed code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-16 12:12:43 +02:00
b7dfc5c1de
refactor: remove not used code
...
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-12 13:40:11 +02:00
dd8460beba
refactor: reduce TBX download timeout for unit tests
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-09 19:05:03 +02:00
a54a3bf624
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-06 04:33:41 +02:00
b0e7a11e9a
refactor: Improving information transfer about the copy engine
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-09-05 16:11:52 +02:00
d842f65cf1
Revert "fix: submit dummy exec to pin memory during zeContextMakeMemoryReside...
...
This reverts commit f9b87d53e6
2024-09-05 03:28:03 +02:00
f9b87d53e6
fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
Related-To: NEO-11879
2024-09-04 14:07:29 +02:00
6d7e2760dc
refactor: correct expectations in level zero tests if heapless enabled 3/n
...
Related-To: NEO-10641
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-03 15:11:59 +02:00
dc84b163b5
Revert "performance: Optimize heap handling when mitigate dc flush"
...
This reverts commit 9249c5c65c
2024-09-03 08:33:20 +02:00
e6abfafa16
fix: drain paging fence queue before waiting for resources
...
Related-To: NEO-12197
If ULLS controller waits for CSR lock, and driver must
wait for resources due to OOM, then draing paging fence queue
directly
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-03 07:45:25 +02:00
9249c5c65c
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-02 18:12:19 +02:00
63528e70a7
Revert "performance: Optimize heap handling when mitigate dc flush"
...
This reverts commit 1a8149e91c
2024-08-30 05:59:25 +02:00
1a8149e91c
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-29 17:03:55 +02:00
db611962f7
fix: improve task count handling in tbx download path
...
Related-To: HSD-18039789178
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-28 15:32:15 +02:00
b8f181d50e
performance: remove trim candidate list
...
Related-To: NEO-11755
Removing trim candidate list reduces overhead
caused by residency handling. Allocations required
for eviction are placed in eviction container managed
by CSR.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-23 12:21:50 +02:00
696b02bfd3
fix: improve TBX downloading after L0 Event sync
...
Related-To: HSD-18038498579
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-23 10:42:17 +02:00
7ac41615cd
fix: create thread with function pointer
...
don't create async thread in neo shared tests
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-21 18:02:37 +02:00
cb8063f71d
feature: Append recorded command list into immediate (3/N)
...
- Use correct stream for dispatch
- Add capability to append signal event
- Check available space globally in immediate append call
Related-To: NEO-10356
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2024-08-16 17:40:28 +02:00
9b652f4a34
Revert "feature: Improving information transfer about the copy engine"
...
This reverts commit 17ffdff4f1
2024-08-15 22:06:31 +02:00
17ffdff4f1
feature: Improving information transfer about the copy engine
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-08-14 11:28:29 +02:00
f4ad45eafd
fix: initialize engine in AubMemoryOperationsHandler::makeResident
...
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-08-13 20:57:57 +02:00
d76ac1d1de
fix: scratch controller residency
...
Related-To: HSD-18039519400
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-09 14:47:56 +02:00
f3367c2e6a
refactor: remove not needed task count update
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-09 12:08:46 +02:00
d7d6996464
performance: initialize timeout params once
...
Currently this is done per each enqueue
which is not really needed
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-07 14:35:12 +02:00
d4c1631ac7
performance: don't wait for paging fence on user thread
...
Related-To: NEO-12197
Currently for new resources user thread must wait before submitting
actual workload. With this commit, instead of waiting on user thread,
request is sent to background ULLS controller thread and additional
semaphore is programmed. ULLS controller will perform actual wait
and signal semaphore when paging fence reaches required value.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-07 08:30:51 +02:00
24cfd203ab
fix: dont download tbx allocations on heapless first device submission
...
Related-To: HSD-18039476929
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-06 14:03:42 +02:00
674c4a15ad
fix: use correct gpu address when bindless heaps helper is enabled
...
Related-To: NEO-7063
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-08-05 15:09:57 +02:00
ec34656e0e
fix: debug flag to defer first device submission
...
Related-To: HSD-18039343751
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-02 09:31:25 +02:00
375d65d8e5
refactor: remove unused code
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-01 09:55:46 +02:00
8e8b2582d8
fix: wait for first submission in TBX mode
...
Related-To: HSD-18039343751
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-07-30 16:28:17 +02:00
9e9d5cde70
fix: remove not needed check
...
Related-To: HSD-18039387061
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-07-30 13:22:42 +02:00
5dc01e5764
Revert "performance: remove not needed logic"
...
This reverts commit 0ec4e9333d
2024-07-30 07:21:40 +02:00
0ec4e9333d
performance: remove not needed logic
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-07-29 19:11:19 +02:00
fdf9916cab
performance: do not execute same code twice
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-07-29 17:33:32 +02:00
ace883ca55
performance: don't flush gpgpu if not required
...
Related-To: NEO-12124
If queue is OOQ and there are no cross-engine dependencies,
don't flush CCS before submitting copy on BCS.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-07-26 06:49:45 +02:00
1e7f1df80e
refactor: Release HardwareContext with aubManager
...
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-07-24 14:01:43 +02:00
c3312f21f7
feature: dont initialize in-order TS nodes
...
Related-To: NEO-11925
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-07-23 13:31:23 +02:00
39ec7facee
performance: use BCS for transfers if CCS is busy
...
Related-To: NEO-11501
Also, if device is iGPU, don't use staging buffers
in that case.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-07-22 15:36:26 +02:00
85c8c09990
fix: correct latestSentTaskCount in flushBcsTask
...
Resolves: NEO-12075
Signed-off-by: John Falkowski <john.falkowski@intel.com>
2024-07-19 09:43:31 +02:00
09cbbc2625
fix: don't evict always resident allocations
...
Related-To: NEO-12008
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-07-15 11:39:00 +02:00
778645c11e
feature: add initial support for Xe2 platforms
...
Related-To: NEO-8188, NEO-10774
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-09 10:30:27 +02:00
0db66bb708
feature: add new flag to StateComputeModeProperties
...
Related-To: NEO-8188, NEO-10774
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-07-03 14:05:02 +02:00
51fc9059c2
feature: program debug surface address
...
Related-To: NEO-7986
Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2024-07-01 16:30:14 +02:00
3849bad719
fix: block copy operations CommandStreamReceiver
...
The implicit ones are not sufficient and user-provided does not seem to
be needed.
Related-To: NEO-11825
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2024-06-27 11:45:15 +02:00
fed90f5c8e
fix: Add infrastructure to force dc flush when mitigate dc
...
-force dc on next tag update after RT kernel
-force dc when release shared object
Related-To: NEO-10556
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-06-24 17:15:03 +02:00
2f6eaf149a
fix: Update SIP kernel initialization logic
...
Initialize SIP kernel when shared device is being initialized
instead of api-specific device.
Initialize debugger when shared device is being initialized
instead of during platform or driver initialization.
Add missing makeResident calls for SIP kernel in heapless paths.
Related-To: HSD-18038645398, HSD-18038819112
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-06-20 18:30:46 +02:00
63da79798d
refactor: reduce the number of GraphicsAllocation constructors and derivatives
...
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-06-18 21:31:37 +02:00
296d2bb148
performance: adjust ulls timeout on power saving
...
Use l0 power saving setting to also adjust ulls timeout.
Related-To: NEO-10800
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-06-17 16:51:55 +02:00
b3d72ddd3d
fix: write memory for resident allocations in simulation mode
...
- refactor and call proceesFlushResdiency() on memoryOperationsHandler
- call free() to remove allocation from resident allocations when
graphics allocation is released
Related-To: NEO-11719
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-06-14 18:49:01 +02:00
0cb48901dc
refactor: add AUBDumpCaptureDirPath debug flag
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-06-13 14:17:50 +02:00
8c48dbe39e
feature: pass lowPriority flag when creating context with aubstream
...
Related-To: NEO-10168
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-06-07 13:14:08 +02:00
da9c009b88
feature: assign unique interrupt to queue
...
Related-To: NEO-8179
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-06-07 10:06:31 +02:00
fe6809ac04
feature: prework to initialize BCS state in heapless mode
...
Related-To: NEO-7824
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-05-31 10:06:58 +02:00
38d7e02c28
refactor: remove not needed code
...
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
2024-05-29 13:24:02 +02:00
2c2ff5e369
fix: update task count when object is always resident
...
Related-To: NEO-11537
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-05-27 15:18:00 +02:00
a9269939f6
fix: Defer MOCS to PAT
...
Related-To: NEO-10556
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-05-27 10:26:26 +02:00
ce0ccacef6
Revert "fix: Defer MOCS to PAT"
...
This reverts commit 6c75ec3116
2024-05-25 06:22:22 +02:00
6c75ec3116
fix: Defer MOCS to PAT
...
Related-To: NEO-10556
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-05-24 15:30:49 +02:00
a2a154ba4a
fix: initialize context with first submission in heapless execution
...
- early return from initializeDeviceWithFirstSubmission if flush was
already called
Related-To: NEO-11219
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-05-24 14:56:04 +02:00
e9b81037a9
refactor: add heaplessStateInitialized flag
...
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-05-15 15:39:52 +02:00
ebf09afc42
Revert "performance: Stop direct submission before removing host ptrs"
...
This reverts commit 4fd219cdbb
2024-05-13 10:10:51 +02:00
1707434591
refactor: remove unused variable
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-05-09 15:41:50 +02:00
e39893485c
fix: add cache flush as dependency for bcs ccs synchronization
...
Related-to: NEO-9872
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-05-09 13:43:39 +02:00
902b611179
Revert "fix: Fix front end programming for cooperative dispatch"
...
This reverts commit 36ddfaaf4d
2024-05-08 11:14:37 +02:00
e5882e0d31
feature: pass GraphicsAllocation to fence wait
...
Related-To: NEO-8179
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-05-07 17:59:28 +02:00
4fd219cdbb
performance: Stop direct submission before removing host ptrs
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-05-07 13:25:09 +02:00
d35d8727e5
fix: use primaryCsr allocations when csr has primaryCsr set
...
- global fence allocation
- global stateless heap allocation
- preemption allocation
- debug surface allocation
all above are shared from primary csr
Related-To: NEO-7824
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-05-07 02:41:24 +02:00
c1004b77bf
performance: Limit tlb flush in state cache flush to wddm
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-05-06 12:45:26 +02:00
8342c0ae2f
Revert "fix: add cache flush as dependency for bcs ccs synchronization"
...
This reverts commit 5e57bb2a32
2024-05-01 03:05:47 +02:00
5e57bb2a32
fix: add cache flush as dependency for bcs ccs synchronization
...
Related-to: NEO-9872
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-04-30 11:57:49 +02:00
806da85ec6
refactor: prework to pass interrupt hint
...
Related-To: NEO-8179
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-04-29 11:14:53 +02:00
9df35ac9bb
fix: Add tlb invalidation to render state cache flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-04-26 10:37:51 +02:00
36ddfaaf4d
fix: Fix front end programming for cooperative dispatch
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-04-25 12:55:46 +02:00
d38ac4806b
feature: global bindless sampler offsets
...
- use global heap base for DSH when bindlessHeapsHelper enabled
Related-To: NEO-10505
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-04-24 21:12:17 +02:00
ae139aeffd
refactor: Passing information about the engine
...
Extension of the interface with information
about the engine type passed to the function
Related-To: NEO-10678
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-04-22 13:33:56 +02:00
e47b88f6e4
feature: program fence during bcs tag update
...
Related-To: NEO-10417
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-04-11 13:43:04 +02:00
cb2b572e94
feature: add support for null aub mode
...
In this mode AUB csr will be created, however, no aub file will be created
Related-To: NEO-11097
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-04-09 16:59:42 +02:00
ef35c5cb62
feature: program device to host fence in ocl path
...
Related-To: NEO-10417
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-04-08 14:57:16 +02:00
73d558058c
feature: add heapless and global stateless scratch address patching
...
Related-To: NEO-10381
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-04-03 17:04:35 +02:00
4eae28bd64
feature: introduce heapless state init in L0
...
Related-To: NEO-7824
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-04-02 12:34:53 +02:00
fce016ee7a
refactor: add new semaphore param
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-03-26 15:46:47 +01:00
78a4a92b44
refactor: reorder members to reduce internal padding in structs
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-03-25 15:50:00 +01:00
2b964254d6
performance: debug key for adjust ULLS on battery
...
ULLS controller timeout settings will be adjusted based on ac line
status and lowest queue throttle from submissions.
Lowest queue throttle is reset when controller stops ULLS.
Related-To: NEO-10800
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-03-22 14:24:00 +01:00
04b99de4d6
refactor: Force tlb flush during TC after copy
...
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2024-03-21 07:25:46 +01:00
f71f6d2b72
refactor: remove not needed code
...
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
2024-03-08 18:18:55 +01:00
13a347cbde
refactor: remove not needed code
...
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
2024-03-08 15:10:06 +01:00
168445784e
feature: introduce states programming at driver init heapless ocl
...
Related-To: NEO-7824
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-03-08 12:29:44 +01:00
Mateusz Jablonski