Commit Graph

485 Commits

Author SHA1 Message Date
Zbigniew Zdanowicz 23a7ab7593 Refactor implicit scaling barriers to add more cache flush options
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-04 17:56:12 +01:00
Maciej Dziuban a582f34c04 Reuse graphics allocations in readBufferRect/writeBufferRect
Related-To: NEO-6352
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-11-03 14:58:51 +01:00
Zbigniew Zdanowicz b2124f43b8 Add implicit scaling barrier implementation
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-03 12:23:42 +01:00
Zbigniew Zdanowicz 4fbb199790 Add platform parameter to configure pipe control dispatch
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-02 12:14:10 +01:00
Mateusz Jablonski 3a2b018eb6 Enable blitterOperationsSupported on DG1
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-28 14:16:19 +02:00
Lukasz Jobczyk c7d5a96dfd Flush small task adjustments
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-10-28 11:39:55 +02:00
Kamil Diedrich 5fdcb14d57 WSL fallback to staging buffer on blocking reads
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-10-28 03:34:58 +02:00
Maciej Dziuban f1b6b733f0 Reuse graphics allocation from mapped buffers in OpenCL
Related-To: NEO-6352
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-27 15:53:10 +02:00
Maciej Dziuban 3f2536a6ba Move storage of mapped operations to OpenCL context
Relate-To: NEO-6352
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-26 11:52:13 +02:00
Mateusz Jablonski 58ebebeec6 Move drm_memory_manager_tests.h and related fixtures to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-21 20:46:58 +02:00
Mateusz Jablonski 3f94399dbb Cleanup builtins dependencies
move builtins builders to ClExecutionEnvironment

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-19 17:29:28 +02:00
Compute-Runtime-Validation 116dac90de Revert "Move storage of mapped operations to OpenCL context"
This reverts commit 8c9dd3085b.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-10-19 16:31:23 +02:00
Rafal Maziejuk 811d107ea9 Don't allow blit enqueue for images with 64KB tiling & 3D surface type
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-6142
2021-10-19 16:03:48 +02:00
Maciej Dziuban 8c9dd3085b Move storage of mapped operations to OpenCL context
Relate-To: NEO-6352
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-18 16:08:25 +02:00
Zbigniew Zdanowicz 24ff191e61 Verify completion on all tiles
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-15 15:43:28 +02:00
Mateusz Jablonski 7b57e87ad1 Move some mocks to shared
- MockAllocationProperties
- MockBuiltinsLib
- MockWddmMemoryManager
- MockAubCsr


Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-15 09:59:47 +02:00
Mateusz Jablonski 8f81f2ae8d Cleanup MockGmm
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-14 21:56:53 +02:00
Katarzyna Cencelewska 1c8a6d895a Use hwInfoConfig to check blitter support for image
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-10-13 17:51:00 +02:00
Maciej Dziuban 75b7adbe95 Skip transfer when CL_MAP_INVALIDATE_REGION is specified
Resolves: NEO-5490
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-13 17:13:33 +02:00
Michal Mrozek 4768be244b Cache post syncs.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-10-13 15:57:13 +02:00
Maciej Dziuban 19a6c9b1d3 Track separate task count for each BCS in OpenCL CommandQueue
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-13 12:06:27 +02:00
Mateusz Jablonski 52c75e92da Cleanup hw_parse.h
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-13 11:10:22 +02:00
Mateusz Jablonski bf25853799 Move some mocks to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-12 21:46:53 +02:00
Maciej Dziuban cdb7287816 Fix direct submission initialization
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-12 11:51:48 +02:00
Bartosz Dunajski 2441f0660d Add missing file to cmake
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-10-12 09:30:52 +02:00
Bartosz Dunajski 5856c283c5 Remove HardwareCapabilities struct
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-10-12 07:25:06 +02:00
Mateusz Jablonski 48f01f28f5 Move core part of MemoryPropertiesHelpers to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-07 23:14:38 +02:00
Maciej Dziuban c910a58aa0 Store bcsEngine in an std::vector in OpenCL CommandQUeue
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-10-07 21:55:21 +02:00
Konstanty Misiak e950ee5584 Add missing checks in unit tests
Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-10-06 19:19:18 +02:00
Bartosz Dunajski 5560663b01 Revert "Disabled forced cross engine synchronization on single queue"
This reverts commit 4b5432967eb9f484a491323b6766efe14929c5e9.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-10-06 17:49:48 +02:00
Mateusz Jablonski 7187769744 Move kernel binary helpers to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-06 13:41:34 +02:00
Zbigniew Zdanowicz 0363749948 Disjoint local work size code from hw command generation
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-06 01:09:56 +02:00
Artur Harasimiuk 9bea74a780 move mock_memory_manager to shared
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2021-10-05 16:22:38 +02:00
Zbigniew Zdanowicz 0b64ecba3f Pass active partitions from dispatched kernel to context
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-05 14:57:47 +02:00
Konstanty Misiak 684b9e5f51 Fix missing submit time calculation
Related-To: NEO-5799

Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-10-05 12:58:04 +02:00
Mateusz Jablonski 5e201f40be Prevent nullptr dereference in aub dump subcapture mode
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-10-04 14:23:19 +02:00
Zbigniew Zdanowicz 96fef37834 Move shared local work size code to shared directory
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-04 14:04:28 +02:00
Bartosz Dunajski 50bd8b5f19 Disabled forced cross engine synchronization on single queue
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-10-01 13:09:33 +02:00
Kamil Kopryk 1a34586dd4 Make sure sip kernel is initialized for aub tests
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-10-01 12:54:04 +02:00
Zbigniew Zdanowicz 317ef3776c Do not pass active partitions from dispatched kernel to context class
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-30 13:32:19 +02:00
Zbigniew Zdanowicz 25c71a6c13 Move kernel info to shared directory
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-29 23:49:49 +02:00
Bartosz Dunajski 4ba4c32766 Remove SBA->IOH programming on XE_HP_SDV
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-29 12:35:43 +02:00
Zbigniew Zdanowicz 6091861f3e Enable multi-tile task count post-sync writes
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-28 16:32:16 +02:00
Artur Harasimiuk a63b9b1273 move common files to shared/
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2021-09-27 11:10:20 +02:00
Maciej Dziuban c04f8e5e5b Pass copy engines to waitUntilComplete in OpenCL command queue
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-24 14:11:44 +02:00
Mateusz Jablonski 34ad95ae12 Handle printf output when implicit args are required
Related-To: NEO-5081
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 13:49:40 +02:00
Mateusz Hoppe d4a4c35759 Zero-initialize debug surface
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-09-22 14:36:36 +02:00
Bartosz Dunajski 4444eb8932 Fix engine group selection in unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-22 14:07:20 +02:00
Maciej Dziuban 04b6a604ec Refactor BCS in OpenCL CommandQueue
- use CopyEngineState class to hold task count and engine type
- pass engine type to updateBcsTaskCount

Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-22 10:39:46 +02:00
Maciej Dziuban 2707618fe3 Pass engine type to getBcsCommandStreamReceiver in OpenCL
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-21 16:27:07 +02:00
Maciej Dziuban a4b3dc29e4 Remove unnecessary method
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-21 11:34:27 +02:00
Pawel Cieslak 0a380f479a Fix typo in test name
Signed-off-by: Pawel Cieslak <pawel.cieslak@intel.com>
2021-09-21 09:29:16 +02:00
Mateusz Jablonski 4caa10f76e Don't use Platform class in shared tests
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-20 18:23:07 +02:00
Mateusz Jablonski 64b2fd5b19 Create printf handler if kernel has implicit args in OCL
Related-To: NEO-5081
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-20 10:58:41 +02:00
Zbigniew Zdanowicz eda3531729 Rename functions and variables in Implicit Scaling
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-16 17:58:35 +02:00
Maciej Dziuban eace896ec8 Change order of command queue groups
Resolves: NEO-6257
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-16 17:39:52 +02:00
Zbigniew Zdanowicz b65d8909e4 Refactor and modularize walker partition code
Related-To: NEO-6244


Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-16 10:46:26 +02:00
Rafal Maziejuk 05b161fffc Add Pipe Control WA test
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
2021-09-15 17:34:15 +02:00
Maciej Dziuban c7d86af500 Pass blitter CSR to event
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-15 12:49:22 +02:00
Rafal Maziejuk 09ac89339e Move local memory access mode getters from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-09-13 13:10:14 +02:00
Mateusz Jablonski e193589582 Add implicit args support for OCL
Related-To: NEO-5081

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-13 10:54:19 +02:00
Maciej Dziuban 858727010f Add selectCsrForBuiltinOperation method to OpenCL CommandQueue
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-6057
2021-09-10 12:26:47 +02:00
Kamil Kopryk a203cd2863 Add sip kernel as hexadecimal array header
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-5777
2021-09-03 17:16:58 +02:00
Filip Hazubski 3d6d4acda2 Update isCooperativeDispatchSupported
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-09-02 17:36:58 +02:00
Maciej Dziuban 3e6b3cd780 Revert "Create single point for selecting engine for builtin ops"
This reverts commit 6513bd371a69cb821ea45c7c1964ea1f51dd75b2.

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-02 11:58:46 +02:00
Compute-Runtime-Validation 94cd243360 Revert "Correct CSR used for hostptr allocations in builtins"
This reverts commit 69ae9dc9c2.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-09-02 04:45:06 +02:00
Bartosz Dunajski 0345d9f707 Improve queries with number of SubDevices
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-01 14:01:57 +02:00
Maciej Dziuban 69ae9dc9c2 Correct CSR used for hostptr allocations in builtins
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-01 13:19:49 +02:00
Maciej Dziuban 33ac15dabe Pass blitter CSR in blocked queue scenarios
Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-31 16:29:17 +02:00
Maciej Dziuban a03b5f8a95 Create single point for selecting engine for builtin ops
- selectCsrForBuiltinOperation selects proper CSR
- selected CSR is passed to dispatchBcsOrGpgpuEnqueue
- Notifications such as notifyEnqueueReadBuffer are now made on correct engine
- Temporary allocs for hostptrs are now created on gpgpuCsr

Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-31 13:29:17 +02:00
Szymon Morek 32c524c8ea Change macro in unit test
Resolves: NEO-6156

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-30 17:17:08 +02:00
Maciej Dziuban 42524b6bef Limit usage of getBcsCommandStreamReceiver()
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-27 12:15:30 +02:00
Bartosz Dunajski cb91474b1a Improve getDevice methods
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-26 14:45:00 +02:00
Filip Hazubski 63f8c9d98b Add new EngineUsage
Simplify verifying EngineUsage in tryGetEngine function.
Remove unused getGpgpuEnginesCount function.

Related-To: NEO-4940

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-23 17:41:13 +02:00
Bartosz Dunajski 4fb5ceeb89 Add helper engines to EngineInstanced Device
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-19 16:14:19 +02:00
Szymon Morek 274fe055e9 Rename Plus in source code to AndLater
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-19 15:06:45 +02:00
Filip Hazubski 84da4648cd Refactor engineGroups container
Use static array instead of the vector.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-19 13:49:32 +02:00
Rafal Maziejuk 63a578f5a4 Move obtainBlitterPreference function from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-17 17:51:06 +02:00
Szymon Morek aa5e1780a2 Rename plus in filenames to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-17 11:26:27 +02:00
Konstanty Misiak ad19eda689 Fix event profiling for marker commands
Related-To: NEO-5799

Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-08-13 15:02:01 +02:00
Szymon Morek a85ae676e7 Rename plus in cmake macros to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-13 11:40:19 +02:00
Bartosz Dunajski fb996a3d5b Add EngineDescriptor helper
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-12 15:19:46 +02:00
Bartosz Dunajski 14c93a6432 Add OCL xe_hp_core unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-10 14:25:12 +02:00
Kamil Kopryk 26e24fa872 Rename debug flag to EnableBlitterForEnqueueImageOperations
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 12:31:12 +02:00
Jaime Arteaga 4192fc7d86 Abort if SLM size larger than local mem size
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-07-30 10:31:37 +02:00
Kamil Kopryk cee37a43d2 Improve tests
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-07-30 09:46:36 +02:00
Kamil Kopryk af4b1afdbd Add support for copy images by blitter OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 09:29:45 +02:00
Kamil Kopryk 88c6c9def8 Enable support for half_float images on BCS OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-26 11:26:49 +02:00
Maciej Dziuban 9bca773b91 Remove command queue constructor
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-07-23 14:16:02 +02:00
Kamil Kopryk 30151a8f02 Cleanup images pitch programming OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-21 19:47:56 +02:00
Lukasz Jobczyk 9e50138829 Defer ULLS initialization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-21 15:55:16 +02:00
Compute-Runtime-Automation b9bd014a44
Add fixes to build with gcc11 (#5325)
* remove Fedora 31 and 32 builds

Signed-off-by: Jacek Danecki <jacek.danecki@intel.com>

* Add builds on Fedora 33 and 34

Signed-off-by: Jacek Danecki <jacek.danecki@intel.com>

* Fix build with gcc11

Signed-off-by: Jacek Danecki <jacek.danecki@intel.com>

* Remove info about EOL'd distributions

Signed-off-by: Jacek Danecki <jacek.danecki@intel.com>

* clean after build

Signed-off-by: Jacek Danecki <jacek.danecki@intel.com>

Co-authored-by: Jacek Danecki <jacek.danecki@intel.com>
2021-07-20 17:17:32 +02:00
Maciej Plewka dfe578754b Fix add pipe controll before marker profiling
Resolves: NEO-6065

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-07-20 16:23:57 +02:00
Mateusz Jablonski 2d6b8061a8 Split file with tests
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-20 15:51:53 +02:00
Mateusz Jablonski 6f3c89decb Add mechanism to migrate multi root device memory
invalidate TLB cache if kernel requires migration


Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-19 19:49:22 +02:00
Kamil Kopryk f06938c3d0 Enable support for 1Darray images on BCS OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-19 17:30:49 +02:00
Zbigniew Zdanowicz 37c0501f1c Add atomic move for native cleanup operations
Related-To: NEO-5848

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-15 15:49:22 +02:00
Zbigniew Zdanowicz a869921c2a Remove RMW from gfx allocations
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-15 11:28:03 +02:00
Lukasz Jobczyk 6255dbf03b Add test for batching optimization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-13 17:34:47 +02:00
Piotr Obst acf3e58a64 Move wddm_fixture.h and releted files from opencl to shared
Related-To: NEO-5894
Signed-off-by: Piotr Obst <piotr.obst@intel.com>
2021-07-07 12:30:12 +02:00