Media
/
compute-runtime
mirror of https://github.com/intel/compute-runtime.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
16,179 Commits 35 Branches 603 Tags 163 MiB
Commit Graph

824 Commits

Author SHA1 Message Date
Zbigniew Zdanowicz 0a99384936 fix: set flushed task count for all cases of post sync task count operations 
- set monitor fence dispatch for all cases task count post sync operation
- stand alone flush task count will not happen when already flushed and so
monitor fence
- monitor fence then must be dispatched together with task count post sync

Related-To: NEO-8395

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-10-03 12:31:45 +02:00
Mateusz Jablonski 09044dfbaa refactor: remove not needed code 
Related-To: NEO-7527

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-09-27 14:35:49 +02:00
Dominik Dabek eebf2bbd26 performance(ocl): timestamp packet count per gfx 
Add support for different timestamp packet counts per gfx family.
Change all packet counts to 1 except for xe-hpc.

Related-To: NEO-8154

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-25 20:34:58 +02:00
Dunajski, Bartosz 80d0c74605 fix: track registered CSR clients 2 
Related-To: NEO-8884

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-25 09:35:55 +02:00
Compute-Runtime-Validation ade538ce54 Revert "fix: track registered CSR clients" 
This reverts commit 53f635e392.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-09-24 10:07:26 +02:00
Zbigniew Zdanowicz d725d454ea performance: emit fence on immediate copy engine only for blocking calls 
- this change handles level zero immediate command lists on copy engine
- monitor fence will be dispatched for blocking calls
- asynchronous mode will dispatch monitor fence only on host synchronization

Related-To: NEO-8395

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-09-22 13:14:37 +02:00
Dunajski, Bartosz 53f635e392 fix: track registered CSR clients 
In L0 its not possible to track objects relations. For example CmdList
may be removed before Event.
In such case, Event needs to safely skip unregister call, without
accessing CmdList/CmdQueue object.

Related-To: NEO-8884

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-22 09:42:55 +02:00
Mateusz Hoppe 69f5ca6345 feature: bindless addressing - flush state cache after reusing SS slot 
- when Surface State is reused for new resource, State Cache needs to be
invalidated

Related-To: NEO-7063

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-09-20 12:53:32 +02:00
Zbigniew Zdanowicz 40e169f8e2 refactor: add batch buffer attribute for explicit monitor fence dispatch 
Related-To: NEO-8395

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-09-20 12:18:32 +02:00
Dominik Dabek 1b7e178b25 performance(ocl): program barrier pc in taskStream 
Program barrier to task stream, before next enqueue kernel.
This will reduce the number of batch buffer starts for sequences of
enqueue, barrier, enqueue, ... .

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-19 11:48:02 +02:00
Dunajski, Bartosz 7562842a58 refactor: remove LogicalStateHelper 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-13 10:29:53 +02:00
Mrozek, Michal d9f938f3db refactor: remove not needed code 
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
 2023-09-12 14:25:04 +02:00
Dunajski, Bartosz 6648065703 feature: add indirect semaphore mode 
Related-To: NEO-8242

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-12 13:15:51 +02:00
Dunajski, Bartosz def3f2e9ad refactor: improve semaphore programming 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-12 11:24:11 +02:00
Compute-Runtime-Validation b5e9c10f64 Revert "performance(ocl): program barrier pc in taskStream" 
This reverts commit 839c2d6737.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-09-12 01:32:28 +02:00
Dominik Dabek 839c2d6737 performance(ocl): program barrier pc in taskStream 
Program barrier immediately to task stream.
This will reduce the number of batch buffer starts.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-11 13:23:26 +02:00
Maciej Plewka 3b3e17e738 performance: Use vector for private allocs to reuse 
Related-To: HSD-18033105655, HSD-18033153203

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-09-04 13:34:38 +02:00
Maciej Plewka 5807d512b3 fix: Reuse private allocations during cmdList dispatch 
Related-To: NEO-8201

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-08-31 14:40:55 +02:00
Zbigniew Zdanowicz 54fce64583 fix: set the indirect object address stream property when not set already 
Related-To: NEO-8281

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-08-30 15:51:24 +02:00
Mateusz Hoppe f5cb7df7cd fix: do not download event allocation in TBX mode 
- only download when allocation was used - inidcated by taskCount
Resolves: NEO-8312

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-08-29 16:27:33 +02:00
Zbigniew Zdanowicz 873b3d4241 fix: do not process scratch space when no surface heap pointer provided 
Related-To: NEO-8281

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-08-22 17:44:35 +02:00
Lukasz Jobczyk 6fcb0f1407 fix: flush dc when blocking flag set 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-08-17 10:10:56 +02:00
Fabian Zwolinski 6fca8ee195 refactor: Remove SourceLevelDebugger 
Removed:
- SourceLevelDebugger (with tests)
- DebuggerLibrary
- DebuggerLibraryRestore
- debuggerSupported field from hwInfo.capabilityTable
- HasSourceLevelDebuggerSupport matcher
- ExperimentalEnableSourceLevelDebugger debug var
- EnableMockSourceLevelDebugger debug var
- DebuggerOptDisable debug var
- lib_names.h.in file
- third_party/source_level_debugger/igfx_debug_interchange_types.h

Related-To: NEO-7213
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-08-10 11:14:02 +02:00
Lukasz Jobczyk fc1f45b630 feature: Dispatch monitor fence from wait 
Resolves: NEO-8240
Related-To: NEO-8067

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-08-08 16:42:27 +02:00
Mateusz Hoppe bcba74f839 feature: bindless global allocator with scratch 
- allocate SSH in cmdContainer when scratch allocation used with
private heaps
- scratch SurfaceStates are addressed relative to
SurfaceStateBaseAddress and have to be placed on SSH
- remove not used SCRATCH_SSH heap type from bindelssHeapHelper

Related-To: NEO-7063

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-08-03 13:24:59 +02:00
Dominik Dabek 12ab74fe96 performance: flag to program barrier in task cs 
Add debug flag ProgramBarrierInCommandStreamTask to program barrier
pipe control in task command stream instead of csr command stream.
This will reduce the number of batch buffer starts.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-08-02 10:26:34 +02:00
Mateusz Hoppe 997b599168 fix(debugger): pass correct sipAllocation to makeResident 
- sipAllocation for context must be resident in Offline mode

Related-To: NEO-7630

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-07-28 20:51:12 +02:00
Dunajski, Bartosz cd9ad1f04c fix: decanonize GPU VA during TBX memory read. 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-26 19:44:19 +02:00
Dunajski, Bartosz a241099dff feature: use WaitUserFence on zeEventHostSynchronize 
Disabled by default. Debug flag is required.

Related-To: NEO-7966

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-26 19:41:09 +02:00
Dunajski, Bartosz 2c50fd9486 fix: waiting for completion in TBX mode 
- use testTaskCountReady method to check TaskCount value
- download all allocations when TaskCount is ready

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-25 11:54:09 +02:00
Baj, Tomasz 4ca213d4d7 fix: commandContainer is nullptr in LinearStream for immediate cmdList 
Related-To: GSD-4084
Signed-off-by: Baj, Tomasz <tomasz.baj@intel.com>
 2023-07-24 15:06:18 +02:00
Lukasz Jobczyk b06f605895 fix: Correctly flush DC when reuse heap 
Related-To: NEO-8067

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-07-20 14:50:37 +02:00
Dominik Dabek 622a3ed89c performance(ocl): flag to not dcFlush on no event 
If waitForBarrier is not passed outEvent then do
dcFlush on the next synchronize call.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-07-18 15:38:54 +02:00
Zbigniew Zdanowicz 1c0285a156 fix: correct alignment of per thread scratch size 
Related-To: NEO-5288

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-12 12:31:47 +02:00
Zbigniew Zdanowicz 3f7269d401 fix: make sip state programing once for all level zero command queues 
Related-To: NEO-7828

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-11 11:34:21 +02:00
Mateusz Hoppe 4aba0f0340 feature: global bindless surface state base support 
- program global bindless ssba when external allocator used (
UseExternalAllocatorForSshAndDsh)

Related-To: NEO-7063

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-07-06 18:31:49 +02:00
Zbigniew Zdanowicz c892b8c6f3 fix: remove redundant check 
Related-To: NEO-7828

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-06 14:58:18 +02:00
Zbigniew Zdanowicz 8836838c7c performance: add one time context init sip state to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-06 14:25:35 +02:00
Zbigniew Zdanowicz 59949bc833 performance: add one time context init csr surface to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-05 16:18:21 +02:00
Zbigniew Zdanowicz 69d80ee5bc performance: add one time context init preemption mode to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-05 14:06:14 +02:00
Lukasz Jobczyk e70f441f52 fix: Idle gpu before invalidate aux table 
Related-To: NEO-8067

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-07-05 13:51:27 +02:00
Zbigniew Zdanowicz e52e4f28f2 fix: correct csr state and command programming 
- global stateless mode should save surface state base address
- correctly retrieve scratch offset for front end programming
- do not override general base address value and use indirect heap property

Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-07-03 15:55:55 +02:00
Mateusz Jablonski 30c5d8a681 fix: pass gmm helper to getDumpSurfaceInfo function 
gmm may not exist for buffer allocation

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-07-03 11:59:52 +02:00
Zbigniew Zdanowicz 21823af419 performance: add skeleton method to cmdlist immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-30 10:46:20 +02:00
Zbigniew Zdanowicz eb4e7fb2a6 performance: immediate flush add flushing mechanism to gpu 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-29 15:52:13 +02:00
Zbigniew Zdanowicz b3ebcfe811 performance: immediate flush add ending commands to command list buffer 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-28 08:22:29 +02:00
Igor Venevtsev feb605577c fix: start direct submission controller on first wddm csr flush 
Related-To: NEO-8072

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
 2023-06-27 17:30:45 +02:00
Zbigniew Zdanowicz bd15d067d5 performance: immediate flush add jump to batch buffer when preamble is present 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-23 09:28:15 +02:00
Zbigniew Zdanowicz c37dbc4cf0 performance: add one time context init ray tracing to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-21 18:27:31 +02:00
Zbigniew Zdanowicz 67b74e211d performance: add one time context init partition data to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-20 14:45:37 +02:00
Zbigniew Zdanowicz 7aff4e1bf4 performance: add one time context init system fence to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-20 07:25:09 +02:00
Lukasz Jobczyk c5f61cce85 fix: Ensure flat ring buffer disabled on regular cmd lists 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-06-19 16:27:57 +02:00
Zbigniew Zdanowicz 1146f42bcb performance: add scratch space handling to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-16 13:08:35 +02:00
Zbigniew Zdanowicz d276731757 fix: use stored value instead calling virtual method 
Related-To: NEO-7828

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-16 08:36:11 +02:00
Zbigniew Zdanowicz 305f24ec9d performance: add state base address dispatch to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-14 18:00:04 +02:00
Dominik Dabek 60d5e22f3b fix(ocl): reduce busy waiting in clFinish 
Use flushStamp=taskCount when passed flushStamp==0.
This will cause driver to busy wait for a short while before falling
back to use kmd notify.

Related-To: GSD-3612

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-06-14 13:56:40 +02:00
Mateusz Jablonski 4f72835b7d fix: create dedicated class for root device indices to store unique values 
remove method to removing duplicates from StackVec as the method
implicitly sorted the vector

Related-To: GSD-4692
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-06-12 22:24:06 +02:00
Dunajski, Bartosz 5fe9d70066 feature: new multitile post sync layout for immediate write [1/n] 
No functional changes in this commit. This is prework.

Related-To: NEO-7966

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-06-07 13:11:10 +02:00
Zbigniew Zdanowicz 8d983d3e7a performance: add new copy operations to state base address properties 
Adding properties to selectively copy properties for surface state,
dynamic state and binding table base addresses.

Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-07 11:34:28 +02:00
Zbigniew Zdanowicz 6036735840 fix: add option to select estimate size for binding table command 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-07 11:25:34 +02:00
Mateusz Hoppe 0844ca0ac8 refactor: cleanup getBindlessMode() usage 
- getGlobalBindlessHeapConfiguration() should be used to choose global
alloctor for SSH
- remove not needed and incorrect unit tests
- remove not needed branches
- bindless mode controls bindless compilation only

Related-To: NEO-7063

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-06-06 17:23:13 +02:00
Zbigniew Zdanowicz 831363e51b performance: add state compute mode dispatch to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-06 13:29:39 +02:00
Zbigniew Zdanowicz b66a2bf32c performance: add front end dispatch to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-05 13:04:57 +02:00
Zbigniew Zdanowicz cf5100c134 performance: add pipeline select dispatch to immediate flush task 
Related-To: NEO-7808

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-06-02 10:31:13 +02:00
Mateusz Hoppe 1c196b9f3d refactor: change ApiSpecificConfig functions names 
- better description of the meaning of functions

Related-To: NEO-7063

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-05-30 09:20:01 +02:00
Rafal Maziejuk d236bcbba9 feature: add isTranslationExceptionSupported method 
Related-To: NEO-7782

Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
 2023-05-17 15:12:46 +02:00
Kamil Kopryk 7f24a4ba25 refactor: Simplify SBA programming in flushTask 
Related-To: NEO-7621
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-05-16 12:27:34 +02:00
Kamil Kopryk e0d3db3d91 fix: improve release helper 
Related-To: NEO-7786
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-05-15 14:30:15 +02:00
Zbigniew Zdanowicz 01c20212c3 performance: limit number of copies of dirty flags and state values 
Related-To: NEO-7828

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-05-09 09:45:41 +02:00
Fabian Zwolinski cbce863dc2 refactor: Rename member variables to camelCase 3/n 
Additionally enable clang-tidy check for member variables

Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-04-28 16:01:14 +02:00
Fabian Zwolinski e351a90f81 refactor: Rename member variables to camelCase 2/n 
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-04-27 20:39:22 +02:00
Zbigniew Zdanowicz e695059152 [perf] reduce host overhead in command list reset call 
There is no need to reset all fields and load support flags every reset call.
Add dedicated calls that will reset values and dirty flags.
Call virtual methods only once at init time.

Related-To: NEO-7828

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-04-05 11:29:39 +02:00
Zbigniew Zdanowicz f211d97363 [perf] simplify state transition for size properties 
State base address size proprties are not used to track state changes, but
they are important to carry size values.
Simplify state base address tracking, so they can update the value of the
property, but not the dirty state.

Related-To: NEO-7828

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-04-04 10:41:36 +02:00
Zbigniew Zdanowicz 7731264fe3 [fix] update ray tracing commands programing 
- 3D btd command should be programed only once per context
- Add conditional pipe control command prior dispatching 3D btd command
- share 3D btd state between immediate and regular command lists
- add pipe control after ray tracing kernel to invalidate state cache

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-04-03 11:21:24 +02:00
Fabian Zwolinski c0603e0854 Allocate SipKernel per ctx for Offline dbg mode 
- Add debuggingEnabledMode getter in ExecutionEnvironment
- Add new overloaded function - BuiltIns::getSipKernel
- Add perContextSipKernels map to BuiltIns
- Add OsContext to PreemptionHelper::programStateSip arguments
- Add new overloaded function - SipKernel::getBindlessDebugSipKernel

Related-To: NEO-7630
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-03-30 16:40:41 +02:00
Zbigniew Zdanowicz 6437c1a91e Flush state caches after command list is destroyed 
When state base address tracking is enabled and command list use private heaps
then command list at destroy time must calls all compute CSRs that were using
that heap to invalidate state caches.
This allows new command list to reuse the same heap allocation for different
surface states, so before new use cached states are invalidated.

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-28 14:52:30 +02:00
Zhenjie Pan 820a189c52 fix: only increase fence/task count when submit task success 
Related-To: NEO-7812

Signed-off-by: Pan Zhenjie <zhenjie.pan@intel.com>
 2023-03-28 14:15:36 +02:00
Dunajski, Bartosz e49e245bec Revert "Disable RelaxedOrdering if UpdateTagFromWait is disabled" 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-27 11:47:10 +02:00
Zbigniew Zdanowicz ef12312672 [perf] add selective properties update for one-time and multi-time properties 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-23 15:59:50 +01:00
Dunajski, Bartosz 151aecc8bd Disable RelaxedOrdering if UpdateTagFromWait is disabled 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-22 18:15:39 +01:00
Cencelewska, Katarzyna a4a296d59f wa: enable wa to add additional dummy blits after blit copy 
- reduce number of dummy blits where are not needed
- track if dummy blit required in cmdlist

Related-To: NEO-7450
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-17 10:43:00 +01:00
Zbigniew Zdanowicz bc4e540c33 [fix] unify heaps size programing 
- share same code between csr and cmd container to get default heap size
- share handling of debug flag to change heap size
- share platform level surface heap size between csr and command list
- refactor heap size files
- put heap size constant and function into namespace
- command list surface heap size increased to 2MB for xehp+ to match csr
- command list increased surface heap size only for sba tracking
- sba tracking heap consumption increased due to different reset policy

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-17 08:34:06 +01:00
Dunajski, Bartosz 686790274d Disable OCL RelaxedOrdering if tag update is required 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-15 14:44:05 +01:00
Dunajski, Bartosz 477448c097 RelaxedOrdering dispatch for OCL 2/n 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-14 15:48:06 +01:00
Zbigniew Zdanowicz 86c91847cc [perf] change stream properties interfaces allowing fine grain selective update 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-14 13:46:49 +01:00
Dunajski, Bartosz 97a35debde RelaxedOrdering dispatch for OCL 1/n 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-13 17:37:12 +01:00
Zhenjie Pan 00b675643e fix: missed error handler of SubmissionStatus::FAILED 
Related-To: NEO-7802

Signed-off-by: Pan Zhenjie <zhenjie.pan@intel.com>
 2023-03-13 16:08:27 +01:00
Zbigniew Zdanowicz f3324964f6 [perf] initialize stream properties only once without further check 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-10 17:50:49 +01:00
Zbigniew Zdanowicz 24c8f089ed [perf] add state compute mode dirty flag to allow selective properties update 
- full properties update is time intesive task and must be done only once
- selective update can be done after initial update
- dirty flag will allow to distinguish initial update is done

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-10 17:27:08 +01:00
Cencelewska, Katarzyna 398c7b2d29 refactor, remove typo in struct name 
change name of EncodeSempahore to EncodeSemaphore
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-10 15:44:25 +01:00
Kamil Kopryk fa8579602f refactor: rename product helper files n/n 
Related-To: NEO-7703
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-03-10 13:24:38 +01:00
Dunajski, Bartosz d7aba6747c Move isRelaxedOrderingDispatchAllowed to common helper 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-09 17:11:53 +01:00
Cencelewska, Katarzyna c274309d7b wa: add dummy blits before command MI_FLUSH_DW 
to guarantee that all subblt got complete for previous copy
affect xe hpg

temporary changes under flag ForceDummyBlitWa

Related-To: NEO-7450

Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-09 10:40:35 +01:00
Zbigniew Zdanowicz f003666ad7 Add state base address transition for global stateless heap command lists 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-08 12:32:15 +01:00
Zbigniew Zdanowicz fd7a3c4096 Add creation of global stateless heap for the context 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-07 15:00:34 +01:00
Mateusz Jablonski 8194543ae5 refactor raytracing: unify RT programming logic 
reuse EncodeEnableRayTracing in CommandStreamReceiver
add method to determine need for 48b resource flag for RT allocations
Related-To: NEO-7606

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-03-07 11:51:58 +01:00
Cencelewska, Katarzyna 3e116ea378 refactor: use same paths when add command mi_semaphore_wait 
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-07 10:35:26 +01:00
Cencelewska, Katarzyna 50da32ffb1 wa: add dummy blits before command MI_ARB_CHECK 
to guarantee that all subblt got complete for previous copy
affect xe hpg

Related-To: NEO-7450

Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-07 10:21:05 +01:00
Maciej Plewka 52d322e738 Move barrier flush property from csr to cmdQueue 
Related-To: NEO-6982, HSD-15010621906

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-03-03 14:33:53 +01:00
Zbigniew Zdanowicz 42b8a536db Fix redundant state base address dispatch 
This fix handles scenario when regular command list uses context first,
then immediate command list is used for the first time.

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-03-01 10:08:55 +01:00
Lukasz Jobczyk 80c1e28947 Optimize ULLS init mutex 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-02-28 18:08:54 +01:00
Zbigniew Zdanowicz 34064811d2 Refactor state base address programing 4/n 
- This change gets level one cache policy from cached values instead
of calling virtual methods

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-27 17:30:36 +01:00
Zbigniew Zdanowicz 3cb064fe95 Refactor state base address programing 3/n 
This is small optimization to replace virtual call and retrieved struct with
cached value.

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-23 13:08:32 +01:00
Zbigniew Zdanowicz 43a49c4486 Refactor state base address programing 2/n 
This change allows to read sba data directly from sba properties

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-23 12:20:25 +01:00
Zbigniew Zdanowicz 2744501176 Inline base address transition function into flush task method 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-20 12:06:46 +01:00
Zbigniew Zdanowicz bf2072c3ea Add cross regular and intermediate command lists base address state transitions 
- updates coming from regular list are updated in csr last sent variables
- all per context and per kernel transitions kept in single place
- state updates from intermediate to regular are set in csr properties
- global atomics support duplicates removed

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-17 16:49:47 +01:00
Zbigniew Zdanowicz 2d6e5c2588 Fix issues in state base address properties tracking 
- add correct stateless mocs state update in immediate command lists
- disallow stateless mocs dirty sba command dispatch when sba tracking enabled
- checks support first, only then do the dirty state check in csr

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-17 13:38:47 +01:00
Warchulski, Jaroslaw b485c025d0 Cleanup includes 57 
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-17 11:19:59 +01:00
Warchulski, Jaroslaw 0556d543a3 Cleanup includes 56 
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-16 14:42:44 +01:00
Aravind Gopalakrishnan d75c4d3ec7 fix: Skip adding device to list if context creation fails 
Propogate error codes from ioctl failure properly up the layers
so that we skip exposing bad root devices.

Related-To: NEO-7709

Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
 2023-02-16 11:40:54 +01:00
Warchulski, Jaroslaw 8c17313c8b Cleanup includes 53 
Cleaned up files:
opencl/source/mem_obj/image.inl
shared/offline_compiler/source/decoder/zebin_manipulator.h
shared/source/aub_mem_dump/aub_alloc_dump.h
shared/source/compiler_interface/intermediate_representations.h
shared/source/helpers/blit_commands_helper_base.inl
shared/source/utilities/debug_file_reader.h
shared/source/utilities/software_tags.h
shared/source/xe_hpc_core/hw_cmds_pvc.h

Related-To: NEO-5548

Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-15 13:21:14 +01:00
Lukasz Jobczyk 275bed2a31 Register csr's client at first submit 
Related-To: NEO-7422, NEO-7458

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-02-15 11:31:59 +01:00
Zbigniew Zdanowicz 2b06aa1129 Drop support flags of always supported properties 
- stateless mocs is present in all state base address commands
- select GPGPU pipeline is present in all pipeline select commands

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-15 10:11:02 +01:00
Zbigniew Zdanowicz 6b1c5b7eb8 Update state properties only affected by kernel data 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-14 14:56:47 +01:00
Maciej Plewka b1e8ca5d59 fix make resident dependent multi root device tags 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-02-14 09:58:00 +01:00
Zbigniew Zdanowicz 98b60ba148 Change state tracking interfaces to split properties update 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-13 18:36:21 +01:00
Lukasz Jobczyk 7eb91e3b04 Split the L0 BCS split into D2H and H2D 
-use separate pair of engines for D2H and H2D transfers

Related-To: NEO-7716

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-02-13 14:17:39 +01:00
Warchulski, Jaroslaw 64f735481d Cleanup includes 48 
Cleaned up files:
shared/source/command_container/command_encoder.inl
shared/source/os_interface/hw_info_config.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-10 17:23:02 +01:00
Warchulski, Jaroslaw a2e6a8284b Cleanup includes 47 
Cleaned up files:
level_zero/tools/source/debug/windows/debug_session.h
level_zero/tools/source/sysman/memory/windows/os_memory_imp.h
level_zero/tools/source/sysman/windows/kmd_sys_manager.h
opencl/test/unit_test/aub_tests/command_stream/copy_engine_aub_tests_xehp_and
shared/source/command_container/command_encoder.inl
shared/source/command_stream/command_stream_receiver_hw_xehp_and_later.inl
shared/source/helpers/blit_commands_helper_base.inl
shared/test/unit_test/image/image_surface_state_fixture.h
shared/test/unit_test/os_interface/windows/os_interface_win_tests.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-10 17:07:30 +01:00
Zbigniew Zdanowicz 1740e1e747 Limit properties update for immediate command list to used in flush task 
Related-To: NEO-7701

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-09 17:45:43 +01:00
Dominik Dabek 0885379060 Fix typo 
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-02-07 17:59:37 +01:00
Lukasz Jobczyk 222992000a Handle barrier correctly in L0 split 
Resolves: NEO-7696

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-02-07 13:31:22 +01:00
Lukasz Jobczyk 9f574b6fba Introduce barrier tracking mechanism 
Related-To: NEO-7696

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-02-06 14:29:23 +01:00
Dunajski, Bartosz 6ebdc51fae Dynamic queue size limit in RelaxedOrdering mode 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-02-06 12:02:02 +01:00
Zbigniew Zdanowicz 7e0401d280 Add improvements to heap estimation in level zero command lists 
- add estimation parameter for interface descriptor data count
- add to the heap estimation alignment parameter for dynamic and surface heaps
- extend encode interface and implementations to allow child heaps

Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-02-03 20:26:27 +01:00
Kamil Kopryk 2484c7ceb2 refactor: rename hw_helper files to gfx_core_helper files 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-02-01 19:37:51 +01:00
Zbigniew Zdanowicz 34b8f08fc6 Add state base address properties tracking for command lists 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-01-31 12:47:17 +01:00
Lukasz Jobczyk 2abbd82195 Flush task at device init 
Resolves: NEO-7642

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-01-30 10:41:42 +01:00
Kamil Kopryk 004d3e3416 refactor: don't use global ProductHelper getter 18 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-30 08:15:39 +01:00
Kamil Kopryk 29f54be816 refactor: don't use global ProductHelper getter 17 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-27 19:28:45 +01:00
Kamil Kopryk b101f9f2f5 refactor: don't use global ProductHelper getter 12/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-27 12:29:18 +01:00
Compute-Runtime-Validation 44032a4386 Revert "Flush task at device init" 
This reverts commit 73bd55ad40.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-01-27 01:51:55 +01:00
Zbigniew Zdanowicz e9c18f8825 Add binding pool heap size parameter to state base address properties 
Related-To: NEO-5055

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-01-26 18:56:27 +01:00
Lukasz Jobczyk 73bd55ad40 Flush task at device init 
Resolves: NEO-7642

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-01-26 13:48:04 +01:00
Warchulski, Jaroslaw fe8a6d98ad Cleanup includes 45 
Cleaned up files:
opencl/source/api/api.h
shared/source/command_stream/csr_deps.h
shared/source/helpers/engine_node_helper.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-26 11:12:15 +01:00
Kamil Kopryk 27393c76ea refactor: don't use global ProductHelper getter 11/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-26 08:16:52 +01:00
Compute-Runtime-Validation e44e6e9a31 Revert "Flush task at device init" 
This reverts commit abb366e3c0.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-01-26 00:28:48 +01:00
Warchulski, Jaroslaw e21cf516d3 Cleanup includes 44 
Cleaned up files:
level_zero/tools/source/sysman/windows/os_sysman_imp.h
opencl/source/command_queue/command_queue.h
shared/source/command_container/cmdcontainer.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-25 16:05:22 +01:00
Warchulski, Jaroslaw c43233dabf Cleanup includes 42 
Cleaned up files:
level_zero/core/source/kernel/kernel_hw.h
shared/source/helpers/common_types.h
shared/test/common/libult/linux/drm_mock.h
shared/test/common/libult/ult_command_stream_receiver.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-25 09:16:39 +01:00
Lukasz Jobczyk abb366e3c0 Flush task at device init 
Resolves: NEO-7642

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-01-24 14:49:39 +01:00
Warchulski, Jaroslaw bc13db734d Cleanup includes 41 
Cleaned up files:
shared/source/command_stream/aub_command_stream_receiver_hw.h
shared/source/helpers/common_types.h
shared/source/os_interface/linux/drm_neo.h
shared/source/os_interface/windows/hw_device_id.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-24 14:37:36 +01:00
Compute-Runtime-Validation 747c159f24 Revert "Flush tag update at device init" 
This reverts commit 8ba950176d.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-01-23 23:27:49 +01:00
Kamil Kopryk 1758f55fe3 refactor: don't use global ProductHelper getter 7/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-23 16:37:47 +01:00
Lukasz Jobczyk 8ba950176d Flush tag update at device init 
Resolves: NEO-7642

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-01-23 12:18:58 +01:00
Warchulski, Jaroslaw 49837b7bb5 Cleanup includes 39 
Cleaned up files:
shared/source/command_container/command_encoder.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-23 11:56:42 +01:00
Maciej Plewka fa4830036a feature(ocl) use tags to synchronize multi root device events 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-01-23 10:28:01 +01:00
Kamil Kopryk a4eba996f7 refactor: don't use global ProductHelper getter 4/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-20 10:27:27 +01:00
Warchulski, Jaroslaw 76faad3398 Cleanup includes 36 
Cleaned up files:
shared/source/helpers/blit_commands_helper.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-20 10:10:40 +01:00
Kamil Kopryk bd6b7d75f0 refactor: don't use global ProductHelper getter 3/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-20 09:42:09 +01:00
Compute-Runtime-Validation 9bf2edcfbf Revert "Flush tag update on device init" 
This reverts commit 5f7541084d.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-01-20 03:06:44 +01:00