Media
/
compute-runtime
mirror of https://github.com/intel/compute-runtime.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,725 Commits 36 Branches 614 Tags 179 MiB
Commit Graph

748 Commits

Author SHA1 Message Date
Mateusz Jablonski b182917d9d refactor: correct naming of allocation types 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-11 16:23:37 +01:00
Mateusz Jablonski beafea9b39 refactor: correct naming of enum class constants 2/n 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-11 13:13:35 +01:00
Dunajski, Bartosz 58323bfb12 refactor: improve PostSync helper methods 
Related-To: NEO-8210

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-12-11 10:41:30 +01:00
Milczarek, Slawomir bec9874487 fix: Improved event profiling setup for bcs split enqueue 
Fixes OpenCL Khronos failures in test profiling with bcs split

Related-To: NEO-8927

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
 2023-12-07 21:29:55 +01:00
Dunajski, Bartosz aab3e7f7c5 refactor: improve getting postsync_data struct type 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-12-07 15:41:44 +01:00
Kamil Kopryk 7a14db7f9b refactor: add max front end threads in EncodeWalkerArgs 
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-12-07 11:38:46 +01:00
Lukasz Jobczyk c8c3f862f4 refactor: Add key to force zero copy without coherency 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-12-07 07:56:54 +01:00
Dunajski, Bartosz 9ce3713ace refactor: improve Walker args handling 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-12-06 16:10:26 +01:00
Mateusz Jablonski da957d1a37 refactor: correct naming of enum class constants 1/n 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-05 14:26:42 +01:00
Mateusz Jablonski c48e57e2de refactor: rename register offsets and constants 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-04 18:31:39 +01:00
Mateusz Jablonski 9486cd2a26 refactor: rename WALKER_TYPE to DefaultWalkerType 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-04 16:29:32 +01:00
Kamil Kopryk 933e5ab818 refactor: remove dead code 
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-12-04 14:31:00 +01:00
Mateusz Jablonski cdcd834712 refactor: correct naming of builtin types 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-01 14:08:21 +01:00
Mateusz Jablonski e57d372608 refactor: correct naming of enum class constants 
EngineGroupType
BlitDirection
PostBlitMode
WaitStatus

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-01 11:53:51 +01:00
Mateusz Jablonski c3ac7b78bd refactor: correct variable naming 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-12-01 02:18:46 +01:00
Mateusz Jablonski c9664e6bad refactor: rename global debug manager to debugManager 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-11-30 13:00:59 +01:00
Mateusz Jablonski aac8686095 fix: correct calculating submit cpu timestamp 
Related-To: NEO-9590, HSD-18035219634
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-11-29 17:42:41 +01:00
Kamil Kopryk ce7298d512 feature: Add heapless mode programming in ocl 
Related-To: NEO-7621
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-11-24 12:53:39 +01:00
Andrzej Koska 63aaa3b63f fix: Race removal between enqueueKernel and clFinish 
Related-To: NEO-8196
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
 2023-11-16 17:33:44 +01:00
Dominik Dabek 39cf653959 performance(ocl): cmd buffer prealloc per cmdqueue 
Add mechanism to preallocate cmd buffer allocations in command stream
receiver reusable allocations list per command queue initialized.

This should limit additional allocations during hot loop.

Needs to be enabled in subsequent commits by setting product helper
method.

Related-To: NEO-8152

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-10-27 16:56:29 +02:00
Zbigniew Zdanowicz 8a07380548 refactor: remove redundant method 
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
 2023-10-25 18:02:16 +02:00
Andrzej Koska c4a24d8f31 fix: Avoiding races when modifying queue and Tag data 
Related-To: NEO-8196
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
 2023-10-25 14:20:57 +02:00
Mateusz Jablonski 7e7eea9995 fix: calculate event timestamps based on submit time and host time diff 
Related-To: HSD-18034426016, HSD-18034426678
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-10-25 12:24:40 +02:00
Lukasz Jobczyk 2fdfc64053 refactor: add const to one time init variables 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-10-25 06:49:56 +02:00
Mateusz Jablonski 4dfa12c8eb fix: add mechanism to detect gpu timestamp overflows 
unify naming CpuGpu to GpuCpu

Related-To: NEO-8394
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-10-19 16:31:06 +02:00
Lukasz Jobczyk 750b5ba89a fix: flush necessary caches when dispatch pipe control 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-10-19 15:09:31 +02:00
Mateusz Jablonski c68f7c8fe2 fix: setup both cpu & gpu timestamp when setting timestamp in event 
Related-To: NEO-8394
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-10-17 08:51:05 +02:00
Mrozek, Michal 6f58ec9d2c fix: set walker params prior to adjusting interface descriptor 
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
 2023-10-04 16:37:54 +02:00
Mateusz Jablonski fc508212de refactor: pass big parameters as reference instead of by value 
Related-To: NEO-9038
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-10-04 14:53:13 +02:00
Mateusz Jablonski 6b3ad5b3e3 fix: add unrecoverable in case of nullptr 
Related-To: NEO-9038
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-10-04 14:38:05 +02:00
Mateusz Jablonski 895a586083 refactor: use reference in for-range loops 
Related-To: NEO-9038
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-10-03 18:56:53 +02:00
Dunajski, Bartosz e2387a450b fix: check for new bcs submission before releasing queue resources 
Related-To: NEO-9005

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-29 12:05:05 +02:00
Mateusz Jablonski a033df33ff fix: remove preferSmallWorkgroupSizeForKernel method 
Related-To: HSD-18033866078
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-09-29 11:55:09 +02:00
Dunajski, Bartosz 80d0c74605 fix: track registered CSR clients 2 
Related-To: NEO-8884

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-25 09:35:55 +02:00
Compute-Runtime-Validation ade538ce54 Revert "fix: track registered CSR clients" 
This reverts commit 53f635e392.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-09-24 10:07:26 +02:00
Dunajski, Bartosz 480c058cb2 feature: in-order patching for ComputeWalker 
Related-To: NEO-7966

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-22 15:00:44 +02:00
Dunajski, Bartosz 53f635e392 fix: track registered CSR clients 
In L0 its not possible to track objects relations. For example CmdList
may be removed before Event.
In such case, Event needs to safely skip unregister call, without
accessing CmdList/CmdQueue object.

Related-To: NEO-8884

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-22 09:42:55 +02:00
Dominik Dabek 0936fca8cd fix(ocl): set split barrier required correctly 
Fix bug introduced in neo 27314 - splitBarrierRequired was set for all
commands, should be only for cl_command_barrier.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-21 11:32:50 +02:00
Dominik Dabek 1b7e178b25 performance(ocl): program barrier pc in taskStream 
Program barrier to task stream, before next enqueue kernel.
This will reduce the number of batch buffer starts for sequences of
enqueue, barrier, enqueue, ... .

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-19 11:48:02 +02:00
Dominik Dabek ee767822b8 performance(ocl): add bcsEngineCount to cmdq 
Related-To: NEO-8155

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-15 15:49:56 +02:00
Mrozek, Michal 9bb64d0b15 refactor: remove not needed code 
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
 2023-09-13 11:43:09 +02:00
Mrozek, Michal d9f938f3db refactor: remove not needed code 
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
 2023-09-12 14:25:04 +02:00
Mrozek, Michal 15a0bf9d7b refactor: remove not needed code. 
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
 2023-09-12 13:52:47 +02:00
Dunajski, Bartosz 6648065703 feature: add indirect semaphore mode 
Related-To: NEO-8242

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-12 13:15:51 +02:00
Dunajski, Bartosz def3f2e9ad refactor: improve semaphore programming 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-12 11:24:11 +02:00
Mrozek, Michal cac547946a refactor: remove not needed code 
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
 2023-09-12 08:51:58 +02:00
Compute-Runtime-Validation b5e9c10f64 Revert "performance(ocl): program barrier pc in taskStream" 
This reverts commit 839c2d6737.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-09-12 01:32:28 +02:00
Dominik Dabek 839c2d6737 performance(ocl): program barrier pc in taskStream 
Program barrier immediately to task stream.
This will reduce the number of batch buffer starts.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-09-11 13:23:26 +02:00
Lukasz Jobczyk a38ac3557b performance: Disable blit enqueue on xe_lpg 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-09-11 13:10:23 +02:00
Compute-Runtime-Validation 7b5ef1b2f4 Revert "performance: Disable blit enqueue on xe_lpg" 
This reverts commit ac97b1c493.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-09-11 10:10:21 +02:00
Michal Mrozek 65188fc90b refactor: remove not needed code 
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
 2023-09-08 17:22:18 +02:00
Lukasz Jobczyk ac97b1c493 performance: Disable blit enqueue on xe_lpg 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-09-08 14:04:24 +02:00
Dunajski, Bartosz 269adbe43b refactor: add L0 dispatch params debug logs 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-09-08 05:35:32 +02:00
Dunajski, Bartosz f1fc273cfc fix: check for new submission before releasing TSP nodes in wait call. 
Related-To: NEO-8318

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-08-31 13:19:19 +02:00
Maciej Plewka 2e249d819e fix: submit marker for cpu transfer with event on IOQ queue 
Related-To: NEO-8081

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-08-21 15:07:37 +02:00
Dunajski, Bartosz 3cf1f5c462 fix: unregister CSR client on OCL sync points 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-08-16 13:35:07 +02:00
Dunajski, Bartosz a42e88d55b fix: stall RelaxedOrdering scheduler when programming OCL dependencies 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-08-14 10:47:35 +02:00
Fabian Zwolinski 6fca8ee195 refactor: Remove SourceLevelDebugger 
Removed:
- SourceLevelDebugger (with tests)
- DebuggerLibrary
- DebuggerLibraryRestore
- debuggerSupported field from hwInfo.capabilityTable
- HasSourceLevelDebuggerSupport matcher
- ExperimentalEnableSourceLevelDebugger debug var
- EnableMockSourceLevelDebugger debug var
- DebuggerOptDisable debug var
- lib_names.h.in file
- third_party/source_level_debugger/igfx_debug_interchange_types.h

Related-To: NEO-7213
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-08-10 11:14:02 +02:00
Mateusz Hoppe 997b599168 fix(debugger): pass correct sipAllocation to makeResident 
- sipAllocation for context must be resident in Offline mode

Related-To: NEO-7630

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2023-07-28 20:51:12 +02:00
Dunajski, Bartosz 6656e23b86 refactor: unify completion check methods 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-25 14:17:52 +02:00
Dunajski, Bartosz 2c50fd9486 fix: waiting for completion in TBX mode 
- use testTaskCountReady method to check TaskCount value
- download all allocations when TaskCount is ready

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-25 11:54:09 +02:00
Cencelewska, Katarzyna 6f45574ff9 fix: add proper bcs synchronization when marker 
Related-To: NEO-8105
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-07-24 10:57:41 +02:00
Dominik Dabek 0a4d0917d4 performance(ocl): skip dcFlush on no event 
Skip dcFlush on waitForBarrier without event by default.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-07-20 14:57:37 +02:00
Dominik Dabek 622a3ed89c performance(ocl): flag to not dcFlush on no event 
If waitForBarrier is not passed outEvent then do
dcFlush on the next synchronize call.

Related-To: NEO-8147

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-07-18 15:38:54 +02:00
Dunajski, Bartosz 815b37bf3a performance: allow waiting for OOQ timestamps in clEnqueueWaitForEvents 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-14 11:33:10 +02:00
Dunajski, Bartosz 712e059ace performance: check completion alloc only once when waiting for Event 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-14 08:32:50 +02:00
Dunajski, Bartosz 40c7b2842f fix: check engines completion before releasing deferred TSP nodes 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>

Related-To: NEO-8146
 2023-07-11 16:11:51 +02:00
Cencelewska, Katarzyna aa0beb8191 fix: Unify logic calculating threads per work group part 4 
- also use helper when checking that is simd1 to have same flow

Related-To: NEO-8087
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-07-07 15:34:59 +02:00
Dunajski, Bartosz 00bae2c827 fix: add missing nullptr check 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-07 11:34:49 +02:00
Dunajski, Bartosz d96cf5846a fix: dont allocate TSP for OOQ without Event 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-07-06 15:12:22 +02:00
Dunajski, Bartosz 2b5e475db9 refactor: use hex values to print TSP usage 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-06-23 11:22:10 +02:00
Dunajski, Bartosz b004a27e4e refactor: Debug flag to print TSP usage 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-06-22 14:47:39 +02:00
Dominik Dabek 60d5e22f3b fix(ocl): reduce busy waiting in clFinish 
Use flushStamp=taskCount when passed flushStamp==0.
This will cause driver to busy wait for a short while before falling
back to use kmd notify.

Related-To: GSD-3612

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-06-14 13:56:40 +02:00
Cencelewska, Katarzyna 7cb3278eb3 fix: add function to calculate number of threads per tg 
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-06-13 14:02:24 +02:00
Dunajski, Bartosz 0372b9410a fix: set correct number of active packets for IOQ barrier 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-05-30 16:02:23 +02:00
Lukasz Jobczyk 0e758e4bb5 performance: Add debug flag to set BCS split minimal size 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-05-17 08:07:43 +02:00
Lukasz Jobczyk 9f755b54ad performance: Bidirectional BCS split implementation for OCL 
Related-To: NEO-7877

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-05-16 13:34:18 +02:00
Fabian Zwolinski cbce863dc2 refactor: Rename member variables to camelCase 3/n 
Additionally enable clang-tidy check for member variables

Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-04-28 16:01:14 +02:00
Maciej Plewka 464c67789f fix: Deffer timestamp packet after failed submission 
Related-To: NEO-7835

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-04-28 12:25:32 +02:00
Maciej Plewka bac02071e7 refactor: Remove template param from enqueueNonBlocked 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-04-28 09:34:12 +02:00
Fabian Zwolinski e351a90f81 refactor: Rename member variables to camelCase 2/n 
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-04-27 20:39:22 +02:00
Fabian Zwolinski c441e9e971 refactor: Rename member variables to camelCase 
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
 2023-04-26 16:05:07 +02:00
Cencelewska, Katarzyna ac8ac62c92 fix: add bcs engine type only if engine exist 
- check bcs availability before insert to bcsEnginesTypes

Resolves: NEO-7886
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-04-20 09:02:38 +02:00
Milczarek, Slawomir 01d03aa5b6 Extended regkey to force prefetch of shared memory in enqueue commands 
Extended the regkey ForceMemoryPrefetchForKmdMigratedSharedAllocations
to force meory prefetch of kmd-migrated shared allocation
in clEnqueueNDRangeKernel(), clEnqueueMemFillINTEL, ...

Related-To: NEO-7841

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
 2023-04-11 11:23:48 +02:00
Mateusz Jablonski d014a731c5 fix multi device ocl: add missing tag update flush after blit 
when memory is migrated then we need to flush tag update

Related-To: NEO-7552
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-04-04 11:06:57 +02:00
Lukasz Jobczyk 18e5664c88 Set stalling command for split marker 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-03-29 15:34:45 +02:00
Dominik Dabek d7981e153e fix(ocl): tweak resolve deps with pipecontrols 
Keep resolving with semaphores if multiple (>2) queues are submitting to
the same CSR. In such case, semaphores allow concurrent execution while
pipecontrols would serialize it.

Related-To: NEO-7321

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-03-27 17:22:03 +02:00
Dunajski, Bartosz f522744886 OCL: Allow for RelaxedOrdering barriers in IOQ mode 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-27 12:25:01 +02:00
Dominik Dabek a634c6a7b1 fix:pass bool to get CS size instead of reevaluate 
Pass resolveDependenciesByPipecontrol bool value to get command stream
methods instead of reevaluating the condition.

Related-To: NEO-7321

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-03-24 15:24:10 +01:00
Dunajski, Bartosz b3c2fa41c5 OCL: Optimize IOQ barriers handling 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-24 12:52:47 +01:00
Dunajski, Bartosz 73213c961f Enable RelaxedOrdering for OCL on GPGPU engine 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-22 12:39:52 +01:00
Dunajski, Bartosz 43cc747843 Add Unrecoverable to RelaxedOrdering path 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-20 14:42:20 +01:00
Dunajski, Bartosz 686790274d Disable OCL RelaxedOrdering if tag update is required 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-15 14:44:05 +01:00
Lukasz Jobczyk 320deec53b Wait for barrier on every OCL split blitter 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-03-15 09:34:41 +01:00
Dunajski, Bartosz 477448c097 RelaxedOrdering dispatch for OCL 2/n 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-14 15:48:06 +01:00
Dunajski, Bartosz 15485fb1c8 Register CSR clients for OCL CommandQueues 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-13 18:29:14 +01:00
Dunajski, Bartosz 97a35debde RelaxedOrdering dispatch for OCL 1/n 
Related-To: NEO-7458

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-13 17:37:12 +01:00
Zhenjie Pan 00b675643e fix: missed error handler of SubmissionStatus::FAILED 
Related-To: NEO-7802

Signed-off-by: Pan Zhenjie <zhenjie.pan@intel.com>
 2023-03-13 16:08:27 +01:00
Cencelewska, Katarzyna 398c7b2d29 refactor, remove typo in struct name 
change name of EncodeSempahore to EncodeSemaphore
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-10 15:44:25 +01:00
Kamil Kopryk fa8579602f refactor: rename product helper files n/n 
Related-To: NEO-7703
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-03-10 13:24:38 +01:00
Maciej Plewka 6ab9037c35 Use FusedEu Dpas W/A only in ACM 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-03-08 14:14:58 +01:00
Cencelewska, Katarzyna 3e116ea378 refactor: use same paths when add command mi_semaphore_wait 
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-03-07 10:35:26 +01:00
Maciej Plewka 52d322e738 Move barrier flush property from csr to cmdQueue 
Related-To: NEO-6982, HSD-15010621906

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-03-03 14:33:53 +01:00
Dunajski, Bartosz 72ada8b41f Add missing pollForCompletion on clEnqueueVerifyMemoryINTEL 
Related-To: NEO-7618

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-03-03 10:55:33 +01:00
Dominik Dabek 22d7c2ea28 feat(ocl): move dependencies programming 
Move out of csr dependencies programming to queue stream.
Correct method fillCsrDependenciesForTimestampPacketContainer.

Related-To: NEO-7321

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2023-02-20 13:42:56 +01:00
Warchulski, Jaroslaw 0556d543a3 Cleanup includes 56 
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-16 14:42:44 +01:00
Maciej Plewka 75a3f99685 fix(ocl) use correct lws and groupCount to disable eu fusion check 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-02-15 14:43:36 +01:00
Mateusz Jablonski 51887af219 refactor OCL: cleanup after moving multi root device buffers to local mem 
remove debug flag AllocateBuffersInLocalMemoryForMultiRootDeviceContexts

Related-To: NEO-5735
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-02-15 09:41:20 +01:00
Mateusz Jablonski 5a89a761f5 Fix OCL: always signal usage when migrating memory 
multi storage memory migration needs to wait until memory is no longer used

Related-To: NEO-5735
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-02-14 15:10:02 +01:00
Maciej Plewka 429be6b4cb Disable EUFusion for odd work groups with DPAS on DG2 
Related-To: NEO-7495, HSD-14017007475

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-02-13 15:27:49 +01:00
Lukasz Jobczyk 7eb91e3b04 Split the L0 BCS split into D2H and H2D 
-use separate pair of engines for D2H and H2D transfers

Related-To: NEO-7716

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2023-02-13 14:17:39 +01:00
Warchulski, Jaroslaw d1b2311207 Cleanup includes 49 
Cleaned up files:
opencl/source/command_queue/command_queue_hw.h
opencl/source/gtpin/gtpin_defs.h
opencl/source/mem_obj/mem_obj_helper.h
opencl/source/memory_manager/mem_obj_surface.h
opencl/source/sharings/unified/unified_sharing.h
opencl/test/unit_test/api/cl_enqueue_migrate_mem_objects_tests.inl
opencl/test/unit_test/aub_tests/fixtures/unified_memory_fixture.h
opencl/test/unit_test/command_queue/command_queue_fixture.h

Related-To: NEO-5548

Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-10 17:26:49 +01:00
Warchulski, Jaroslaw 64f735481d Cleanup includes 48 
Cleaned up files:
shared/source/command_container/command_encoder.inl
shared/source/os_interface/hw_info_config.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-02-10 17:23:02 +01:00
Mateusz Jablonski 24c5352350 refactor: remove redundant including of compiler_cache.h 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-02-03 11:16:31 +01:00
Compute-Runtime-Validation 606a900080 Revert "Disable EUFusion for odd work groups with DPAS on DG2" 
This reverts commit 017d66a469.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2023-02-03 02:45:21 +01:00
Maciej Plewka 017d66a469 Disable EUFusion for odd work groups with DPAS on DG2 
Related-To: NEO-7495, HSD-14017007475

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-02-02 13:57:42 +01:00
Kamil Kopryk 2484c7ceb2 refactor: rename hw_helper files to gfx_core_helper files 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-02-01 19:37:51 +01:00
Kamil Kopryk 004d3e3416 refactor: don't use global ProductHelper getter 18 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-30 08:15:39 +01:00
Kamil Kopryk 5e059d4b30 refactor: don't use global ProductHelper getter 16 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-27 17:03:46 +01:00
Kamil Kopryk 445706361d refactor: don't use global ProductHelper 14/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-27 14:51:12 +01:00
Dunajski, Bartosz d42ec1ad8a Unify multi regular context selection 
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>

Related-To: NEO-7618
 2023-01-27 14:04:04 +01:00
Kamil Kopryk 026d50c7b9 refactor: don't use global ProductHelper getter 13/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-27 13:52:36 +01:00
Kamil Kopryk b101f9f2f5 refactor: don't use global ProductHelper getter 12/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-27 12:29:18 +01:00
Kamil Kopryk 27393c76ea refactor: don't use global ProductHelper getter 11/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-26 08:16:52 +01:00
Warchulski, Jaroslaw e21cf516d3 Cleanup includes 44 
Cleaned up files:
level_zero/tools/source/sysman/windows/os_sysman_imp.h
opencl/source/command_queue/command_queue.h
shared/source/command_container/cmdcontainer.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-25 16:05:22 +01:00
Warchulski, Jaroslaw 439aa6c87f Cleanup includes 43 
Cleaned up files:
level_zero/core/test/unit_tests/mocks/mock_kernel.h
opencl/source/mem_obj/mem_obj.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-25 11:33:39 +01:00
Kamil Kopryk 0499a72451 refactor: rename cl_gfx_core_helper files 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-24 11:16:03 +01:00
Warchulski, Jaroslaw 49837b7bb5 Cleanup includes 39 
Cleaned up files:
shared/source/command_container/command_encoder.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-23 11:56:42 +01:00
Maciej Plewka fa4830036a feature(ocl) use tags to synchronize multi root device events 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-01-23 10:28:01 +01:00
Warchulski, Jaroslaw 8cc4cc1612 Cleanup includes 38 
Cleaned up files:
opencl/source/cl_device/cl_device.h
opencl/source/command_queue/command_queue.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-20 14:55:17 +01:00
Dunajski, Bartosz 5a5596957a Capability to create multiple Regular BCS contexts per engine. 
Related-To: NEO-7618

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-01-20 13:43:48 +01:00
Kamil Kopryk a4eba996f7 refactor: don't use global ProductHelper getter 4/n 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-20 10:27:27 +01:00
Warchulski, Jaroslaw 77501d86ba Cleanup includes 35 
Cleaned up files:
shared/source/command_stream/command_stream_receiver.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-17 18:51:40 +01:00
Warchulski, Jaroslaw 16d5a323c7 Cleanup includes 34 
Cleaned up files:
opencl/source/command_queue/cl_local_work_size.h
opencl/test/unit_test/mocks/mock_buffer.h
shared/source/program/kernel_info.cpp

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-17 14:42:04 +01:00
Maciej Plewka 1421796541 Revert "feature(ocl) use tags to synchronize multi root device events" 
This reverts commit 353a7510b2bd2d774d0b7ee82ee48eae7f5dc1d3.

Signed-off-by: Maciej Plewka maciej.plewka@intel.com
 2023-01-17 11:29:58 +01:00
Warchulski, Jaroslaw c275008e51 Cleanup includes 32 
Cleaned up files:
level_zero/core/source/cmdlist/cmdlist_hw.h
level_zero/core/source/cmdqueue/cmdqueue.h
level_zero/core/source/event/event.h
opencl/source/helpers/get_info_status_mapper.h
opencl/source/helpers/hardware_commands_helper.h
shared/source/helpers/per_thread_data.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-16 20:41:37 +01:00
Dunajski, Bartosz 99e0493a39 Capability to create multiple Regular contexts per engine 
Ralated-To: NEO-7618

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
 2023-01-16 12:45:35 +01:00
Cencelewska, Katarzyna f94528097a fix: add set stateCacheInvalidationEnable to flush cache 
when blit operation and dcflush needed

resolves problem with corruptions visible when switch ccs with bcs
on platforms without engines coherency

Resolves: NEO-7577
Signed-off-by: Cencelewska, Katarzyna <katarzyna.cencelewska@intel.com>
 2023-01-13 10:35:54 +01:00
Maciej Plewka 16bc84e27d feature(ocl) use tags to synchronize multi root device events 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2023-01-13 08:09:32 +01:00
Warchulski, Jaroslaw fecb52ac49 Cleanup includes 29 
Cleaned up files:
opencl/source/helpers/cl_memory_properties_helpers.h
shared/source/memory_manager/surface.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-13 07:53:03 +01:00
Warchulski, Jaroslaw 191d4de033 Cleanup includes 28 
Cleaned up files:
opencl/source/command_queue/command_queue.h
opencl/source/command_queue/gpgpu_walker.h
shared/source/helpers/memory_properties_helpers.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-11 17:47:33 +01:00
Kamil Kopryk 200734892b refactor: don't use global gfxCoreHelper getter 7/7 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-11 16:19:32 +01:00
Warchulski, Jaroslaw 3d59dce80c Cleanup includes 27 
Cleaned up files:
opencl/source/command_queue/command_queue.h
shared/source/built_ins/registry/built_ins_registry.h
shared/source/kernel/kernel_descriptor.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-11 16:10:28 +01:00
Warchulski, Jaroslaw 4794648978 Cleanup includes 26 
Cleaned up files:
opencl/source/command_queue/csr_selection_args.h
opencl/source/event/event.h
shared/source/helpers/engine_control.h
shared/source/sku_info/definitions/sku_info.h

Related-To: NEO-5548

Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-11 09:10:45 +01:00
Warchulski, Jaroslaw 77b88f19a1 Cleanup includes 23 
Cleaned up files:
opencl/source/execution_environment/cl_execution_environment.h
opencl/source/helpers/cl_validators.h
opencl/test/unit_test/mocks/mock_cl_device.h
opencl/test/unit_test/mocks/mock_context.h
shared/source/helpers/cache_policy.h
shared/source/image/image_surface_state.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-09 12:30:30 +01:00
Mateusz Jablonski 43b790957d style: format code using clang-format 15.0.6 
Related-To: NEO-7500
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2023-01-05 10:33:47 +01:00
Kamil Kopryk 0dbf92d401 Refactor: reduce global productHelper getter usage 
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
 2023-01-04 16:35:20 +01:00
Warchulski, Jaroslaw b7ee3486d9 Cleanup includes 21 
Cleaned up files:
opencl/source/kernel/kernel.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-04 10:40:26 +01:00
Milczarek, Slawomir 1e8169ca3d Add bcs support for cross-device migrations of multi-graphics allocations 
This commit adds a support for cross-device migration to bcs enqueue path
exercised for CL enqueue rea/write, map, unmap calls, controlled with
the regkey AllocateBuffersInLocalMemoryForMultiRootDeviceContexts.

Related-To: NEO-7092

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
 2023-01-03 14:09:07 +01:00
Warchulski, Jaroslaw a2fe929f0c Cleanup includes 18 
Cleaned up files:
shared/source/command_stream/command_stream_receiver_hw.h
shared/source/compiler_interface/compiler_interface.h
shared/source/direct_submission/direct_submission_hw.h
shared/source/helpers/dirty_state_helpers.h

Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
 2023-01-02 13:28:29 +01:00