Commit Graph

298 Commits

Author SHA1 Message Date
Filip Hazubski 0fd685541d Add isDcFlushAllowed function to HwInfoConfig
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-21 18:29:43 +01:00
Filip Hazubski 6d439f88bb Explicitly set dcFlushEnable value
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-21 12:21:11 +01:00
Bartosz Dunajski b9132ef5f5 Remove not used file
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-17 12:18:44 +01:00
Bartosz Dunajski fe8cb190bc Remove deprecated code
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-14 11:36:10 +01:00
Bartosz Dunajski d07c76c237 unTypedDataPortCacheFlush pipe_control helper support
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-09 13:00:10 +01:00
Bartosz Dunajski 7c610ed5bb Add new Engine Group types
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-07 15:28:15 +01:00
Bartosz Dunajski 2b1aa8b331 Compilation fix: Add missing LrcaHelper types
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-07 13:19:36 +01:00
Lukasz Jobczyk 0c49fa8203 Add missing cache flush for blocked path
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-07 12:36:34 +01:00
Maciej Dziuban e3bb526067 Optimize timestamp packet dependencies
- Clear dependencies even if last engine changed
- Do no program semaphore waiting for blit when blit is submitted with gpgpu
- Track barrier timestamps to correctly synchronize blits in OOQ

Related-To: NEO-6444
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-12-07 11:47:50 +01:00
Bartosz Dunajski f20236c7f2 Initial PVC support
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>

Related-To: NEO-5542
2021-12-07 10:22:41 +01:00
Lukasz Jobczyk 09d2ffb9ed Add missing cache flush
Resolves: NEO-6505

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-06 17:28:12 +01:00
Bartosz Dunajski 68aea5bf62 Rename compression flags and helpers
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-03 18:09:02 +01:00
Bartosz Dunajski 6098290a0b Pass compression hints to memory properties
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-11-25 14:05:08 +01:00
Zbigniew Zdanowicz 61641bb70a Add implicit barriers capability to opencl
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-10 08:19:50 +01:00
Bartosz Dunajski 4bf4b170f1 Simplify WALKER_TYPE definition
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-11-04 17:09:06 +01:00
Zbigniew Zdanowicz 4fbb199790 Add platform parameter to configure pipe control dispatch
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-02 12:14:10 +01:00
Maciej Dziuban f1b6b733f0 Reuse graphics allocation from mapped buffers in OpenCL
Related-To: NEO-6352
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-27 15:53:10 +02:00
Sebastian Luzynski ce78bab177 Image compression checks
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
Related-To: NEO-6102
2021-10-27 13:36:41 +02:00
Bartosz Dunajski 1f2aa82c5b Remove UNUSED_VARIABLE macro
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-10-22 18:56:33 +02:00
Filip Hazubski 28b37aea72 Correct handling unique_ptr in functions
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-10-21 18:17:14 +02:00
Mateusz Jablonski b1df167632 Move enable_product.inl to shared
extract api agnostic validators to shared
remove not needed opencl includes from neo shared


Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-12 22:02:16 +02:00
Mateusz Jablonski 48f01f28f5 Move core part of MemoryPropertiesHelpers to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-07 23:14:38 +02:00
Mateusz Jablonski 973317e473 Move kmd notify properties to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-07 18:12:19 +02:00
Zbigniew Zdanowicz 0363749948 Disjoint local work size code from hw command generation
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-06 01:09:56 +02:00
Zbigniew Zdanowicz 96fef37834 Move shared local work size code to shared directory
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-04 14:04:28 +02:00
Zbigniew Zdanowicz 1028295a02 Move per thread data to shared directory
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-30 17:57:41 +02:00
Zbigniew Zdanowicz 25c71a6c13 Move kernel info to shared directory
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-29 23:49:49 +02:00
Maciej Dziuban c04f8e5e5b Pass copy engines to waitUntilComplete in OpenCL command queue
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-24 14:11:44 +02:00
Mateusz Jablonski bdd1a2be8f Move gmm callbacks to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 22:25:25 +02:00
Zbigniew Zdanowicz e295e74c0a Add preemption flags creation to shared code
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-23 15:20:13 +02:00
Mateusz Jablonski 34ad95ae12 Handle printf output when implicit args are required
Related-To: NEO-5081
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 13:49:40 +02:00
Mateusz Jablonski 8b36473a9a Move command stream receiver files to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 12:47:21 +02:00
Mateusz Jablonski 80b49e4a47 Create ClPreemptionHelper
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 10:15:58 +02:00
Mateusz Jablonski f8867e0b97 Move generic command stream receiver files to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-22 23:55:31 +02:00
Maciej Dziuban 04b6a604ec Refactor BCS in OpenCL CommandQueue
- use CopyEngineState class to hold task count and engine type
- pass engine type to updateBcsTaskCount

Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-22 10:39:46 +02:00
Maciej Dziuban a4b3dc29e4 Remove unnecessary method
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-21 11:34:27 +02:00
Bartosz Dunajski 9ff91defba Add API name to aub file name
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-16 14:50:25 +02:00
Zbigniew Zdanowicz b65d8909e4 Refactor and modularize walker partition code
Related-To: NEO-6244


Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-16 10:46:26 +02:00
Maciej Dziuban c7d86af500 Pass blitter CSR to event
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-15 12:49:22 +02:00
Kamil Kopryk 9ccf43e441 Correct branch_dir_suffix in cmake
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-6245
2021-09-14 16:00:20 +02:00
Mateusz Jablonski e193589582 Add implicit args support for OCL
Related-To: NEO-5081

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-13 10:54:19 +02:00
Filip Hazubski 3fafdf3f29 Correct check in getQueueFamilyName
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-09-10 15:14:31 +02:00
Kamil Kopryk a924b6a304 Code cleanup - avoid copy 5/n
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-09-08 08:59:55 +02:00
Maciej Dziuban 3e6b3cd780 Revert "Create single point for selecting engine for builtin ops"
This reverts commit 6513bd371a69cb821ea45c7c1964ea1f51dd75b2.

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-02 11:58:46 +02:00
Maciej Dziuban 33ac15dabe Pass blitter CSR in blocked queue scenarios
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-31 16:29:17 +02:00
Maciej Dziuban a03b5f8a95 Create single point for selecting engine for builtin ops
- selectCsrForBuiltinOperation selects proper CSR
- selected CSR is passed to dispatchBcsOrGpgpuEnqueue
- Notifications such as notifyEnqueueReadBuffer are now made on correct engine
- Temporary allocs for hostptrs are now created on gpgpuCsr

Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-31 13:29:17 +02:00
Bartosz Dunajski 856dee2b08 Improve Sampler programming
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-25 19:47:30 +02:00
Szymon Morek aa5e1780a2 Rename plus in filenames to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-17 11:26:27 +02:00
Konstanty Misiak ad19eda689 Fix event profiling for marker commands
Related-To: NEO-5799

Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-08-13 15:02:01 +02:00
Szymon Morek a85ae676e7 Rename plus in cmake macros to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-13 11:40:19 +02:00
Szymon Morek 217d067ad5 Refactor calculating maxMemAllocSize
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-12 14:37:42 +02:00
Bartosz Dunajski f8d04b1e66 Add method to adjust device bitfield
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-05 17:50:49 +02:00
Szymon Morek 3c15023871 Add AllowUnrestrictedSize debug flag
This debug flag allows to allocate memory with size greater than
CL_DEVICE_MAX_MEM_ALLOC_SIZE.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-05 15:35:26 +02:00
Milczarek, Slawomir e5237c2368 Enable stateless compression on xehp
Related-To: NEO-5107

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-03 16:01:44 +02:00
Bartosz Dunajski e880cf2ad6 Add xe_hp_sdv unit test target + minor test fixes
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-03 11:12:57 +02:00
Milczarek, Slawomir eb14d8458b Add helper function to enable stateless compression
Related-To: NEO-5107

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-02 14:34:33 +02:00
Compute-Runtime-Validation 1f4a835314 Revert "Add xe_hp_sdv unit test target + minor test fixes"
This reverts commit 6f75d67406.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-08-02 13:48:10 +02:00
Kamil Kopryk 4533595274 Rename constructPropertiesForCopyBuffer to constructPropertiesForCopy
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 11:31:56 +02:00
Bartosz Dunajski 6f75d67406 Add xe_hp_sdv unit test target + minor test fixes
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-30 10:23:08 +02:00
Kamil Kopryk af4b1afdbd Add support for copy images by blitter OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 09:29:45 +02:00
Kacper Nowak 64f86817f8 Fix get_work_dim() returning incorrect value
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-07-22 11:09:46 +02:00
Kamil Kopryk 30151a8f02 Cleanup images pitch programming OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-21 19:47:56 +02:00
Lukasz Jobczyk 9e50138829 Defer ULLS initialization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-21 15:55:16 +02:00
Szymon Morek c8b85bb5a9 Add method to check tile only context
Related-To: NEO-6043

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-21 12:22:42 +02:00
Mateusz Jablonski 6f3c89decb Add mechanism to migrate multi root device memory
invalidate TLB cache if kernel requires migration


Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-19 19:49:22 +02:00
Kamil Kopryk 8810547d3a Correct pitch programming for images BCS OCL
Related-To: NEO-4692
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-07-19 11:25:14 +02:00
Kacper Nowak 157bbbfb23 Enable generating & running Level Zero AUB tests
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-07-09 14:12:41 +02:00
Szymon Morek 399dc60bf8 Remove processing extra properties
Related-To: NEO-6024

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-08 16:18:06 +02:00
Rafal Maziejuk 457070c91b Move setGrfInfo function to inl file
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
2021-07-08 12:26:12 +02:00
Michal Mrozek ad3855ceb3 Revert "Fix event profiling for marker commands"
This reverts commit 5f0167b477993f3ebc804c53a110bc432638615b.

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-01 08:01:33 +02:00
Konstanty Misiak 1df1094465 Fix event profiling for marker commands
Related-To: NEO-5799

Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-06-30 14:56:39 +02:00
Kamil Kopryk dbe3ef21c1 Prefer unique_ptr instead of raw pointer nv12 ults
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-28 13:54:37 +02:00
Kamil Kopryk 76f7070917 Correct programming blitProperties for planar images
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-28 11:19:12 +02:00
Bartosz Dunajski 6b862b60ca Add implicit scaling tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-25 11:37:16 +02:00
Bartosz Dunajski 96d14967ac Partial support for XE_HP_SDV
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-24 18:35:54 +02:00
Bartosz Dunajski e1f42c2ae1 Remove TSP atomic dependency tracking
This reverts commit d17668f023bee409ee68e766bbc7d5f16ce8d52b.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-23 16:59:41 +02:00
Krystian Chmielewski 5e8e066541 Bindless support ocl
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-06-23 13:56:12 +02:00
Mateusz Jablonski 2ab961be49 Ensure that builtin kernel is patched and can't transform images
Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-22 16:20:07 +02:00
Bartosz Dunajski 82f1816aec Keep implicit TSP dependencies ownership after enqueue
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-22 13:37:20 +02:00
Compute-Runtime-Validation 9bc4f02a88 Revert "Ensure that builtin kernel is patched"
This reverts commit c9c752526e.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-06-21 12:59:27 +02:00
Bartosz Dunajski 2e97aeccfd Revert TSP changes
This commit reverts:
a1d2bdc76666059653c79fe39a26113ce47c632a,
71a115129c1698ff15305fd0ea3828cba861be47,
e1a9087a466bfba54d84a64247e6596092034a91.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-21 12:44:12 +02:00
Mateusz Jablonski e027178c37 Correct semaphore wait programming for cross device dependencies
when event is blocked by blocked user event then program semaphore wait during
unblocking user event

Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-18 09:06:53 +02:00
Mateusz Jablonski c9c752526e Ensure that builtin kernel is patched
Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-17 17:49:18 +02:00
Bartosz Dunajski 5af793ddc6 Remove TSP implicit dependency tracking logic
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-16 08:47:00 +02:00
Kamil Kopryk 0a9f653957 Fix cl_properties for image 2D array
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-14 13:34:20 +02:00
Kamil Kopryk d3c47ae831 Rename constructPropertiesForReadWriteBuffer function
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-09 16:39:06 +02:00
Kamil Kopryk b81ef7a5c6 Correct src/dst size for 1D,2D images
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-07 17:41:22 +02:00
Kamil Kopryk 0500f79753 Use size_t for src/dst size in blitProperties
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-07 15:20:03 +02:00
Piotr Zdunowski 7cac94b597 Fix profiling for marker commands.
Resolves: NEO-4867

Signed-off-by: Piotr Zdunowski <piotr.zdunowski@intel.com>
2021-05-27 12:15:07 +02:00
Piotr Obst 1dd552d473 Change D3DKMT_CLIENTHINT_OPENCL to _ONEAPI_LEVEL0 in L0
Signed-off-by: Piotr Obst <piotr.obst@intel.com>
2021-05-19 07:54:50 +02:00
lgotszal 3bd4bca911 Copyright header update
Dates corrected in copyright headers to reflect original publication date
(2018 for OpenCL, 2020 for Level Zero).

Signed-off-by: lgotszal <lukasz.gotszald@intel.com>
2021-05-17 20:38:19 +02:00
Bartosz Dunajski c6e81d3ed5 Simplify parsing affinity mask
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-05-05 21:17:53 +02:00
Milczarek, Slawomir b7883bf838 Add helper to check if non-AUX mode is required
Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-04-26 17:51:58 +02:00
Krystian Chmielewski ef71915c71 Remove KernelArgInfo and use KernelDescriptor's args instead
Related-To: NEO-4729
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-04-23 15:12:09 +02:00
Mateusz Jablonski 215051c48f Dont program semaphores for cross root device timestamp packets
Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-04-23 14:43:37 +02:00
Milczarek, Slawomir c99b223aed Implement cl_intel_device_attribute_query extension
Related-To: NEO-5759

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-04-22 11:19:32 +02:00
Krzysztof Gibala b01b8ba5ac Use MI_SEMAPHORE_WAIT command for event synchronization
Related-To: NEO-5508
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-04-19 11:34:52 +02:00
Katarzyna Cencelewska 43a032d764 Add info about supported thread arbitration policies
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-04-07 11:25:33 +02:00
Compute-Runtime-Validation 1c2dc70314 Revert "Add info about supported thread arbitration policies"
This reverts commit 3d13a9d855.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-04-05 08:46:58 +02:00
Katarzyna Cencelewska 3d13a9d855 Add info about supported thread arbitration policies
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-04-02 12:19:12 +02:00