Commit Graph

1750 Commits

Author SHA1 Message Date
Lukasz Jobczyk a3d970ee24 Track new resource bound per VM
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-09-02 12:32:50 +02:00
Maciej Dziuban 3e6b3cd780 Revert "Create single point for selecting engine for builtin ops"
This reverts commit 6513bd371a69cb821ea45c7c1964ea1f51dd75b2.

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-09-02 11:58:46 +02:00
Rafal Maziejuk ea33fa5707 Add engine type remapping check
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-09-02 10:19:10 +02:00
Rafal Maziejuk 4862fee089 Move setAdditionalPipelineSelectFields to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-09-01 18:03:24 +02:00
Filip Hazubski 0606ef4095 Disable patching VfeState by default
By default VfeState will be programmed once per command lists execute.
Patching may be enabled with AllowPatchingVfeStateInCommandLists variable.

Related-To: NEO-4940

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-09-01 17:18:14 +02:00
Bartosz Dunajski 0345d9f707 Improve queries with number of SubDevices
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-01 14:01:57 +02:00
Milczarek, Slawomir 754d6e40e0 Fixed blitter path for printf with stateless compression in sba
Related-To: NEO-5107

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-09-01 11:45:34 +02:00
Jaroslaw Chodor 37af6a64c1 WDDM Linux - allocate 32bit through KMD
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-09-01 00:06:30 +02:00
Filip Hazubski c03620468b Update VFE state programming
Treat regular kernels scheduled as cooperative ones as cooperative kernels.
Add debug variable AllowMixingRegularAndCooperativeKernels.

Related-To: NEO-4940

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-31 19:49:25 +02:00
Bartosz Dunajski 92000bd75b Improve Device getter to support EngineInstanced Device with single Engine
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-31 15:50:23 +02:00
Filip Hazubski 7ed804a4bb Correct debugPauseStateAddress initialization
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-31 14:07:21 +02:00
Maciej Dziuban a03b5f8a95 Create single point for selecting engine for builtin ops
- selectCsrForBuiltinOperation selects proper CSR
- selected CSR is passed to dispatchBcsOrGpgpuEnqueue
- Notifications such as notifyEnqueueReadBuffer are now made on correct engine
- Temporary allocs for hostptrs are now created on gpgpuCsr

Related-To: NEO-6057
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-31 13:29:17 +02:00
Bartosz Dunajski 294859eacf Create single engine for EngineInstanced Devices
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-31 09:28:53 +02:00
Bartosz Dunajski 1bfe7d5839 Improve maxOsContextCount calculation
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-31 09:12:15 +02:00
Kamil Diedrich 03bfc2eaf9 Fix for hash counting
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-08-30 21:51:43 +02:00
Filip Hazubski 741fa13507 Store StreamProperties in CommandStreamReceiver
Move StreamProperties from CommandQueueHw.

Related-To: NEO-5995

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-30 15:52:47 +02:00
Rafal Maziejuk a651e30aa1 Move stepping getter functions from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-30 10:54:23 +02:00
Filip Hazubski de1e4e0074 Add adjustMaxWorkGroupCount helper
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-27 15:39:48 +02:00
Lukasz Jobczyk 8d60fb2a07 Refactor tag update for stop ring buffer
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-27 15:13:20 +02:00
Milczarek, Slawomir e7085fdafc Remove helper to get compression format for stateless compression in SBA
Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-27 11:28:53 +02:00
Compute-Runtime-Validation 946ae7cba3 Revert "Add HwHelper::getExtraExtensions"
This reverts commit a9226a9113.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-08-27 02:31:19 +02:00
Dominik Dabek 3ab3761172 Enable buffer compression debug flag
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-08-26 19:32:28 +02:00
Mateusz Hoppe e775dfa9a5 Add SysCall pwrite()
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-08-26 18:20:58 +02:00
Rafal Maziejuk f309cdff2f Delete unnecessary checks in isWorkaroundRequired function related tests
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
2021-08-26 17:06:41 +02:00
Filip Hazubski 4f77db267b Create cooperative engine once on engineInstanced device
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-26 16:46:35 +02:00
Bartosz Dunajski cb91474b1a Improve getDevice methods
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-26 14:45:00 +02:00
Filip Hazubski a9226a9113 Add HwHelper::getExtraExtensions
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-26 14:06:35 +02:00
Kamil Diedrich 4390590831 Add shareable allocation for Windows
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-08-26 13:43:55 +02:00
Rafal Maziejuk c7ff2bacd3 Move common implementation to os agnostic .inl files
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-26 12:07:00 +02:00
Michal Mrozek bf1180753d Improve private memory allocation.
-allocate from single bank when only one sub device passed

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-08-26 07:46:23 +02:00
Bartosz Dunajski 856dee2b08 Improve Sampler programming
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-25 19:47:30 +02:00
Milczarek, Slawomir 54cf561e09 Add helper to get compression format for stateless compression on XE_HP_SDV
Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-25 16:56:40 +02:00
Mateusz Hoppe d10eb1c04c Add thread log level
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-08-25 13:01:33 +02:00
Szymon Morek 60bf5f8cd2 Synchronize initializing direct submission
Related-To: NEO-5865

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-25 04:41:03 +02:00
Rafal Maziejuk c96bd1b35d Move getHwRevIdFromStepping function from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-24 15:45:19 +02:00
Mateusz Hoppe ac30102309 GPU Allocation created by KMD not mapped to cpuPtr
- do not map to locked cpuPtr on limited address space
platforms

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-08-24 15:18:31 +02:00
Krystian Chmielewski 0b9e87e35f Add support for data relocations using symbols
Support symbols for data relocations.
Remove unused symbolSegment field in RelocationInfo.

Related-To: NEO-5833
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-08-24 13:10:20 +02:00
Lukasz Jobczyk 4d2764eb0d Refactor direct submission per product files
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-23 19:13:30 +02:00
Filip Hazubski 63f8c9d98b Add new EngineUsage
Simplify verifying EngineUsage in tryGetEngine function.
Remove unused getGpgpuEnginesCount function.

Related-To: NEO-4940

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-23 17:41:13 +02:00
Krzysztof Gibala fccd22e3c7 Program additional pipe control before state compute mode command
Related-To: NEO-6056
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-08-23 14:22:21 +02:00
Lukasz Jobczyk 1638554a49 Add direct submission termination mechanism
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-20 13:57:28 +02:00
Jaroslaw Chodor 766d56e300 WSL - fixing allocation alignment
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-08-20 08:28:27 +02:00
Compute-Runtime-Validation f1264c19dc Revert "Improve private allocation storage."
This reverts commit be3ca800bb.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-08-20 02:54:09 +02:00
Zbigniew Zdanowicz 6d510240e6 Improve ioctl statistics
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-08-19 17:50:53 +02:00
Rafal Maziejuk c6ee7065db Move isPageTableManagerSupported function from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-19 17:35:08 +02:00
Maciej Dziuban 78fa40fac0 Add new parameter to functions
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-19 17:25:43 +02:00
Szymon Morek 8355194236 Correct uninitialized variables
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-19 16:30:51 +02:00
Bartosz Dunajski 4fb5ceeb89 Add helper engines to EngineInstanced Device
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-19 16:14:19 +02:00
Szymon Morek 274fe055e9 Rename Plus in source code to AndLater
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-19 15:06:45 +02:00
Jacek Danecki 4461fcdc2a Add 0x4690 device id
Signed-off-by: Jacek Danecki <jacek.danecki@intel.com>
2021-08-19 14:31:16 +02:00
Igor Venevtsev 43fdd90330 Add bindlessSip param to SIP queries
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-08-19 13:56:05 +02:00
Filip Hazubski 84da4648cd Refactor engineGroups container
Use static array instead of the vector.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-19 13:49:32 +02:00
Michal Mrozek be3ca800bb Improve private allocation storage.
- Do not allocate on multi tile if device limits scope.

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-08-18 15:02:14 +02:00
Filip Hazubski 29c64c3dd0 Disable implicit scaling for cooperative kernels
When implicit scaling is disabled use useSingleSubdeviceValue = true.

Resolves: NEO-5757

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-18 14:56:37 +02:00
Michal Mrozek b5d5784b81 Improve allocation type logging.
- allow to do this in release builds.
- allow to capture thise on stdout.

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-08-18 13:34:19 +02:00
Bartosz Dunajski d8a98acafd Set SingleSliceDispatchCcsMode for EngineInstanced OsContext
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-18 13:02:16 +02:00
Maciej Plewka 41fc2e8cce Revert Implement WA for 2d Images
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-08-18 12:35:35 +02:00
Jaime Arteaga 5c236a62fd Changes to SW tags
Add SW tags to synchronization points
Add ID sequence numbers
Add new allocation type

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-08-18 01:51:37 +02:00
Katarzyna Cencelewska 5f491ed22b Add support for adlp in opensource
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com
2021-08-18 00:03:17 +02:00
Lukasz Jobczyk 2cc11f2199 Ensure GEM_WAIT is not called while bind is available
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-17 19:37:49 +02:00
Dominik Dabek 65e00abea6 Enable new DriverProtection interface for MapGpuVa
Related-To: NEO-6096

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-08-17 18:02:26 +02:00
Rafal Maziejuk 63a578f5a4 Move obtainBlitterPreference function from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-17 17:51:06 +02:00
Szymon Morek aa5e1780a2 Rename plus in filenames to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-17 11:26:27 +02:00
Zbigniew Zdanowicz 7b697b72e3 Enable new KMD wait function in Linux
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-08-17 11:02:17 +02:00
Maciej Dziuban f838dc7644 Remove default parameter
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-08-16 17:38:46 +02:00
Szymon Morek 945a7cf905 Revert "Add method to set systolic mode"
This reverts commit 7ad007e.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-16 16:41:05 +02:00
Lukasz Jobczyk 49cf6f79f5 Validate host ptr on VM it will be used
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-16 08:15:53 +02:00
Spruit, Neil R d119494854 L0 Support for Dynamic Module Linking for undefined symbols
- Support for L0 apps to handle undefined symbols reported by IGC
- Removed duplication of symbol in exported symbol list and relocation
for properly resolving the symbol during dynamic link
- Add export module's exported function surface state to the import
module's residency container during dynamic linkage to allow import
kernels to execute exported functions.

Signed-off-by: Spruit, Neil R <neil.r.spruit@intel.com>
2021-08-13 19:26:41 +02:00
Konstanty Misiak ad19eda689 Fix event profiling for marker commands
Related-To: NEO-5799

Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-08-13 15:02:01 +02:00
Lukasz Jobczyk 816e95443f Add missing ioctl to kmd migrated resource
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-13 14:45:14 +02:00
Szymon Morek a85ae676e7 Rename plus in cmake macros to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-13 11:40:19 +02:00
Bartosz Dunajski 2661962ac3 Pass engine instanced parameter during OsContext creation
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-13 11:14:29 +02:00
Compute-Runtime-Validation 5d49dedf00 Revert "L0 Support for Dynamic Module Linking for undefined symbols"
This reverts commit e602f4829d.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-08-13 10:33:13 +02:00
Spruit, Neil R e602f4829d L0 Support for Dynamic Module Linking for undefined symbols
- Support for L0 apps to handle undefined symbols reported by IGC
- Removed duplication of symbol in exported symbol list and relocation
for properly resolving the symbol during dynamic link
- Add export module's exported function surface state to the import
module's residency container during dynamic linkage to allow import
kernels to execute exported functions.

Signed-off-by: Spruit, Neil R <neil.r.spruit@intel.com>
2021-08-12 21:30:13 +02:00
Zbigniew Zdanowicz 2125718091 Add missing inl to source file list
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-08-12 17:26:47 +02:00
Bartosz Dunajski fb996a3d5b Add EngineDescriptor helper
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-12 15:19:46 +02:00
Szymon Morek 217d067ad5 Refactor calculating maxMemAllocSize
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-12 14:37:42 +02:00
Kamil Diedrich be598fc692 Add AIL product enablers
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-08-11 22:19:33 +02:00
Kamil Kopryk 582a3620a2 Remove not needed hwHelper
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-08-11 17:04:31 +02:00
Dominik Dabek 2a7757651a Change percent of global memory returned
Related-To: NEO-5796

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-08-11 13:33:16 +02:00
Szymon Morek 7ad007ec92 Add method to set systolic mode
Resolves: NEO-6040

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-11 09:09:59 +02:00
Bartosz Dunajski 14c93a6432 Add OCL xe_hp_core unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-10 14:25:12 +02:00
Kamil Diedrich 2d5d071e66 Extended import device memory functionality
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-08-10 13:24:56 +02:00
Andrzej Koska 94c97fc14c Allowing the creation of overlapping buffers
Related-To: NEO-5871

Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2021-08-10 10:59:29 +02:00
John Falkowski da8ddc5907 Add offset to dispatchBlitMemoryFill
Signed-off-by: John Falkowski <john.falkowski@intel.com>
2021-08-10 06:32:23 +02:00
Lukasz Jobczyk 81609c7695 Use bind fence atomically
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-09 16:19:46 +02:00
Kamil Kopryk 0845a3b34b Revert "Remove not needed hwHelper"
This reverts commit 0d11b51c6b.

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-08-09 12:43:20 +02:00
Kamil Kopryk 82a5472422 Revert "Enable BCS for images on xe_hp_core OCL"
This reverts commit cc4048dcf68913dc60665b6e584c276d4664f439.
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-08-09 12:31:36 +02:00
Compute-Runtime-Validation d81c637b96 Revert "Use igc interface to get max param size"
This reverts commit a04d206fdd.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-08-07 08:50:27 +02:00
Michal Mrozek 8a506457d7 Add debug flag to skip freeing resources.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-08-06 14:46:17 +02:00
Kamil Kopryk 0d11b51c6b Remove not needed hwHelper
Related-To: NEO-6106

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-08-06 14:28:04 +02:00
Zbigniew Zdanowicz 0574e65fc1 Organize product configuration files
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-08-06 13:21:02 +02:00
Dominik Dabek a04d206fdd Use igc interface to get max param size
Related-To: NEO-4851

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-08-06 12:57:21 +02:00
Jaroslaw Chodor 2a4fa055b1 Fixing memleak during wddm init
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-08-05 19:35:58 +02:00
Bartosz Dunajski f8d04b1e66 Add method to adjust device bitfield
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-05 17:50:49 +02:00
Szymon Morek 3c15023871 Add AllowUnrestrictedSize debug flag
This debug flag allows to allocate memory with size greater than
CL_DEVICE_MAX_MEM_ALLOC_SIZE.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-05 15:35:26 +02:00
Krystian Chmielewski 34be220943 Enable relocation from instruction to data seg
Related-To: NEO-5833
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-08-05 14:24:29 +02:00
Jaroslaw Chodor c23a74e902 Zebin - optimizing yaml parser
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-08-05 14:05:53 +02:00
Bartosz Dunajski 5d2c6a2292 Return error code if BCS engine is not available
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-04 13:17:42 +02:00
Bartosz Dunajski 5c7955b1d0 Update getInternalEngine() implementation and remove unused method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-03 21:25:33 +02:00
Jaroslaw Chodor cfd3945b7e WSL - fixing missing GPU VA reservation
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-08-03 20:30:49 +02:00
Lukasz Jobczyk 1ddc83d0d5 Add flag to switch host ptr validation
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-03 16:45:21 +02:00
Milczarek, Slawomir e5237c2368 Enable stateless compression on xehp
Related-To: NEO-5107

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-03 16:01:44 +02:00
Filip Hazubski 2dd0e67e65 Disable overdispatch by default
When disable overdispatch is available:
- change default value of CFE_STATE::ComputeOverdispatchDisable to true.
- change default value of
INTERFACE_DESCRIPTOR_DATA::ThreadGroupDispatchSize to 3u.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-03 15:28:53 +02:00
Michal Mrozek d3fd5077e7 Do not allocate surface if not needed.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-08-03 12:43:12 +02:00
Zbigniew Zdanowicz b454bcbfe7 Make KMD wait function non default and available under debug key
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-08-03 11:24:43 +02:00
Bartosz Dunajski e880cf2ad6 Add xe_hp_sdv unit test target + minor test fixes
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-03 11:12:57 +02:00
Kacper Nowak 29580e53ec Revert WA for 2D Images for XE_HP_SDV
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-08-03 10:37:17 +02:00
Kamil Diedrich 2afb785bba Add AIL functionality
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-08-02 15:31:58 +02:00
Bartosz Dunajski ab73b61b77 Fix multitile ISA placement
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-02 15:16:13 +02:00
Milczarek, Slawomir eb14d8458b Add helper function to enable stateless compression
Related-To: NEO-5107

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-02 14:34:33 +02:00
Lukasz Jobczyk d99f20d400 Move semaphore buffer to system memory
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-02 14:24:12 +02:00
Compute-Runtime-Validation 1f4a835314 Revert "Add xe_hp_sdv unit test target + minor test fixes"
This reverts commit 6f75d67406.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-08-02 13:48:10 +02:00
Kamil Kopryk 0dc33b19e9 Enable BCS for images on xe_hp_core OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-08-02 13:26:59 +02:00
Lukasz Jobczyk 3c842575c1 Enable direct submission by default on XE HP
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-02 12:10:03 +02:00
Lukasz Jobczyk dbf9198186 Flush tlb on BCS direct submission
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-30 16:26:47 +02:00
Lukasz Jobczyk cb178f951e Wait for completion while evict unused resources
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-30 16:11:40 +02:00
Kacper Nowak 99caeaebf6 Fix allocation properties when allocating next command buffer
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-07-30 15:19:52 +02:00
Kamil Kopryk 26e24fa872 Rename debug flag to EnableBlitterForEnqueueImageOperations
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 12:31:12 +02:00
Kamil Kopryk 4533595274 Rename constructPropertiesForCopyBuffer to constructPropertiesForCopy
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 11:31:56 +02:00
Bartosz Dunajski 6f75d67406 Add xe_hp_sdv unit test target + minor test fixes
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-30 10:23:08 +02:00
Kamil Kopryk af4b1afdbd Add support for copy images by blitter OCL
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-07-30 09:29:45 +02:00
Jaime Arteaga b057935c7c Associate shared-allocations with device in multi-device systems
When a shared-allocation is created in a multi-device system and
no device is passed during the call, then the allocation needs to be
associated with all the devices. For now, that means we default to
creating the shared-allocation in the host, with no device-backing
memory, so all devices can access it.

However, if a device is passed, then the shared-allocation is
expected to be accessed only by that device, and there is no need
to allocate it solely in the host.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-07-29 20:28:27 +02:00
Filip Hazubski cb81078d40 Add disableOverdispatch to FrontEndProperties
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-07-29 17:05:47 +02:00
Szymon Morek e836f994f6 Correct maxMemAllocSize for multitile devices
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-29 14:32:42 +02:00
Bartosz Dunajski 65f02858ea Add support for multi tile blit transfers
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-29 13:21:09 +02:00
Szymon Morek 74e6c74071 Disable shareable allocs with huge size
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-28 15:52:27 +02:00
Mateusz Jablonski 113cef8977 Add missing includes
Signed-off-by: Florian Minnecker <florian.github@minnecker.com>
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-28 10:51:17 +02:00
Krystian Chmielewski 7dea397f22 Decode collection attributes in exec env
Add support for decoding required work group size and work gorup walk
order dimensions in zebin.

Related-To: NEO-6088
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-27 14:09:30 +02:00
Jaroslaw Chodor 7c6c45f5b5 Add option to allocate private mem per dispatch
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-27 13:34:12 +02:00
Bartosz Dunajski cf4972d90e Update abbreviation string.
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-27 11:49:32 +02:00
Rafal Maziejuk 78aeef801a Add additional pipe control arguments check
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
2021-07-26 15:33:33 +02:00
Kamil Kopryk aed1da7495 Code cleanup - avoid copy 3/n
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-07-26 12:25:38 +02:00
Maciej Plewka e87056fb4d Implement WA for 2d Images
Related-To: NEO-5659, NEO-5654, NEO-5653

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-07-26 10:26:28 +02:00
Compute-Runtime-Validation f6efba9a26 Revert "Use latest sent task count for Linux flush stamp"
This reverts commit 566415a1f5.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-07-24 10:02:26 +02:00
Bartosz Dunajski 9f5b3efa73 L0: Add xe_hp_core unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-23 17:57:10 +02:00
Zbigniew Zdanowicz 566415a1f5 Use latest sent task count for Linux flush stamp
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-23 17:35:00 +02:00
Mateusz Jablonski f5dca9e14c Prevent double-free in StackVec's move-assignment operator
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-23 11:52:05 +02:00
Szymon Morek 1a7c9e63fa Add method to set force non coherent
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-23 11:18:04 +02:00
Mateusz Hoppe 6486b3574d Set MaxEusPerSubslice from topology if not already set
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-07-22 19:29:08 +02:00
Mateusz Jablonski 575445dbb5 Minor code cleanup
prevent nullptr dereference

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-22 19:25:23 +02:00
Vilvaraj, T J Vivek c2ab7fcf70 add memType and Memory channel support to systemInfo
use the updated systemInfo to acquire Memory Type.


Signed-off-by: Vilvaraj, T J Vivek <t.j.vivek.vilvaraj@intel.com>
Signed-off-by: Mayank Raghuwanshi <mayank.raghuwanshi@intel.com>
2021-07-22 18:38:39 +02:00
Bartosz Dunajski 31250b343f TSP: Move packetsUsed member out of GraphicsAllocation
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-22 17:04:40 +02:00
Lukasz Jobczyk f22251f68a Add remaining external allocation types for local bank selector
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-22 16:57:37 +02:00
Kamil Kopryk aa70ad0aee Simplify code
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-07-22 14:58:37 +02:00
Lukasz Jobczyk 0f6484755a Chceck all BCS types in direct submission initialization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-22 09:31:31 +02:00
Jaime Arteaga 803d7cdd8a Add debug key to print UMD shared migrations
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-07-22 08:37:09 +02:00
Lukasz Jobczyk 890eec6105 Separate local memory usage tracking for internal and external
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-22 07:52:43 +02:00
Bartosz Dunajski c7aa5e0317 Update ftr flags
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-21 19:28:51 +02:00
Mateusz Jablonski 54b4b18fa0 Enable multi root device contexts by default
Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-21 16:16:57 +02:00
Lukasz Jobczyk 9e50138829 Defer ULLS initialization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-21 15:55:16 +02:00
Young Jin Yoon 4ba64d2530 Add ze-opt-level support
Related-To: LOCI-2315
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2021-07-20 20:34:57 +02:00
Krystian Chmielewski 78abc1c6fd Add work dimensions payload arg to zebin
Related-To: NEO-5833
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-20 16:30:27 +02:00
Spruit, Neil R 771722f3d7 L0 Support for hints to disable CPU Migration of USM memory
- Added support for disabling CPU migration of USM memory given
ZE_MEMORY_ADVICE_SET_READ_MOSTLY && ZE_MEMORY_ADVICE_SET_PREFERRED_LOCATION

Signed-off-by: Spruit, Neil R <neil.r.spruit@intel.com>
2021-07-20 04:34:16 +02:00
Jaime Arteaga fa26f2b075 Fix typo
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-07-19 22:10:38 +02:00
Mateusz Jablonski 6f3c89decb Add mechanism to migrate multi root device memory
invalidate TLB cache if kernel requires migration


Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-19 19:49:22 +02:00
Dominik Dabek b67fdb2ade Enable workgroup WA on different steppings
Related-To: NEO-6022

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-07-19 16:21:05 +02:00
Jaime Arteaga b28fd75ea1 Set ZE_ENABLE_PCI_ID_DEVICE_ORDER as false by default
This to avoid disruptions on performance data in multi-gpu
systems where each gpu may perform differently, when comparing
data before and after last refactor on ZE_ENABLE_PCI_ID_DEVICE_ORDER.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-07-18 06:03:44 +02:00
Bartosz Dunajski e939e97384 Dont replicate GPU_TIMESTAMP_DEVICE_BUFFER
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-16 15:23:50 +02:00
Krystian Chmielewski 9c7d8a183b Decode zebin reloc types
Change LinkerInput::RelocationInfo::Type to be compliant with zebin
relocation types.
Add support for setting relocation type if zebin relocation
type is set.
Continue supporting R_AMD64_64 and R_AMD64_32 relocation types for
backward compatibility

Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-16 12:33:51 +02:00
Bartosz Dunajski 3c88492229 Revert "Extended import device memory"
This reverts commit ea6555e788c98314160a11898212c2d664999705.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-16 09:56:52 +02:00
Jaroslaw Chodor 78499ca48d Mitigation for WDDM_LINUX allocation size limits
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-07-16 03:36:19 +02:00
Jaime Arteaga 058c30c9a8 Refactor ZE_ENABLE_PCI_ID_DEVICE_ORDER
- Make it avaialble also to OpenCL
- Use it before parsing affinity mask, so devices are masked also
following PCI order.


Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-07-16 01:27:49 +02:00
Szymon Morek 42c5f2235b Fix calculating maxMemAllocSize
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-15 22:10:05 +02:00
Bartosz Dunajski f293b409ff Set extra GMM memory flags
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-15 21:13:26 +02:00
Jaroslaw Chodor 6bac487e32 Accepting all debug section in zebin
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-07-15 18:11:07 +02:00
Zbigniew Zdanowicz 37c0501f1c Add atomic move for native cleanup operations
Related-To: NEO-5848

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-15 15:49:22 +02:00
Rafal Maziejuk 6453ab852a Rename state_base_address_skl_plus.inl -> state_base_address_skl.inl
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
2021-07-15 13:58:42 +02:00
Krystian Chmielewski a32c022202 Accept debugInfo section in zebin
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-15 12:50:48 +02:00
Krystian Chmielewski 1b2cfbbb1f Align per thread data size to GRF size
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-15 11:53:13 +02:00
Michal Mrozek d18172c00e Add debug flag to control tryFlushEvent
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-15 11:40:13 +02:00
Zbigniew Zdanowicz a869921c2a Remove RMW from gfx allocations
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-15 11:28:03 +02:00
Jaroslaw Chodor 080203b8fe Cleanup for LHDM flag
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-07-14 18:47:40 +02:00
Dominik Dabek bbe599aa95 Selectively enable getMaxThreadsForWorkgroup WA
Related-To: NEO-6022

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-07-14 17:29:43 +02:00
Jaroslaw Chodor fad4ee7e24 Enabling WDDM_LINUX by default
Based on libdxg headers, we're able
to support WDDM_LINUX (WSL2) in our
default build configuration

Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-07-14 12:42:29 +02:00
Bartosz Dunajski 75812634cf Add XE_HP_CORE OCL unit tests and waDefaultTile4 flag
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-14 12:30:42 +02:00
Krzysztof Gibala 0a41c42854 Add debug key for aub file generation per process id
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-07-14 08:59:26 +02:00
Michal Mrozek 65396fd2e5 optimize batching
- removes redundant MI_BATCH_BUFFER_START when target is within same command
buffer
- this way we do not have jump in command buffer

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-13 13:16:47 +02:00
Sebastian Luzynski c389db6f1c Add space calculation for SBA instruction
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2021-07-13 12:19:30 +02:00
Piotr Obst dc6a35286b Remove platform references from mock_aub_center_fixture.h
Related-To: NEO-5894
Signed-off-by: Piotr Obst <piotr.obst@intel.com>
2021-07-13 10:33:57 +02:00
Rafal Maziejuk dc41512fce Fix bindless surface/sampler MOCS programming
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-6045
2021-07-13 10:11:35 +02:00
Maciej Dziuban 7334920ed3 Add UsmInitialPlacement debug flag
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-07-12 15:57:59 +02:00
Kacper Nowak 157bbbfb23 Enable generating & running Level Zero AUB tests
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-07-09 14:12:41 +02:00
Krystian Chmielewski 7ee83db9d8 Add support for IntelGT note section
Add extraction of IntelGT note section in zebin decoder.
Add target validation based on intelGT notes in zebin decoder.
Add check in unpacking (unpackSingleDeviceBinary) for e_machine,
and validate target device accordingly.

Related-To: NEO-5658
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-07-09 11:17:14 +02:00
Bartosz Dunajski bec8cdd6f1 Update XE_HP_CORE files to enable unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-08 18:41:41 +02:00
Michal Mrozek 60df89976a remove not needed code.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-08 15:37:55 +02:00
Kamil Diedrich d5fdb949eb Extended import device memory
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-07-07 16:12:36 +02:00
Vinod Tipparaju fc4a1d608d Refactor immediate command list with kernel operations to use flushTask().
This is applicable for submissions with sync & async command queue modes.

Related-To: LOCI-1988

Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2021-07-07 15:31:38 +02:00
Mateusz Hoppe bbb27cdb8a L0 Device slice id mapping
Related-To: NEO-5640


Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-07-07 15:00:44 +02:00
Bartosz Dunajski 9166f9223a Device pool allocation in OsAgnosticMemoryManager
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-07 13:09:12 +02:00
Krzysztof Gibala 242e3c0f2a Add size estimation for additional command
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-07-07 12:40:02 +02:00
Piotr Obst acf3e58a64 Move wddm_fixture.h and releted files from opencl to shared
Related-To: NEO-5894
Signed-off-by: Piotr Obst <piotr.obst@intel.com>
2021-07-07 12:30:12 +02:00
Lukasz Jobczyk 9f592ec43d Disable direct submission
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-07 09:42:32 +02:00
Maciej Dziuban 6f6ee90aa5 Extend copy engine selector data
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-07-06 12:28:55 +02:00
Sebastian Luzynski d7a2a62ded Add additional StateBaseAddress cmd wa
Resolves: NEO-5982
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2021-07-06 11:53:47 +02:00
Lukasz Jobczyk ddcd2a578e Enable direct submission by default on XE HP
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-06 11:23:59 +02:00
Szymon Morek 5408366f62 Fix state_compute_mode on xehp
Related-To: NEO-5945

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-06 11:18:21 +02:00
Dominik Dabek 62f89b174a Add work_dim patching to l0 kernel
Related-To: NEO-5931

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-07-05 20:09:20 +02:00
Lukasz Jobczyk 449c0dc856 Do not register allocation on fail
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-05 19:23:58 +02:00
Bartosz Dunajski 83db85cf86 AubHelper: Local memory support
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-05 19:13:32 +02:00
Bartosz Dunajski c7a936d1f4 Add memory banks to Simulated CSR
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-05 12:19:58 +02:00
Katarzyna Cencelewska 2ce3a223f0 Change use of querySystemInfo
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-07-05 11:56:45 +02:00
Maciej Plewka bc121c09fa Use DSS count to callculate max work group size
This reverts commit 89b7a4c9cc0a69cfd2eb5a0bd138356f34c52f0d.

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-07-05 10:14:20 +02:00
Bartosz Dunajski 64eb82efac Add Kernel restrictions
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-02 17:41:03 +02:00
Maciej Plewka aed3fada28 Revert "Use Eu per dss to callculate max work group size"
This reverts commit 86b12dd23979db12e1898013c9162cb7106e40f1.

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-07-02 17:16:06 +02:00
Zbigniew Zdanowicz bcd9b2f982 Add debug flag to override command queue synchronous mode
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-02 13:03:02 +02:00
Mateusz Jablonski 294045071b Improve driverstore compatibility checker
make checker case-insensitive
handle HostDriverStore scenarios

Related-To: NEO-5182, NEO-6025
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-02 12:52:13 +02:00
Maciej Plewka bcf93a6aeb Use Eu per dss to callculate max work group size
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-07-02 12:30:18 +02:00
Bartosz Dunajski 8f21e46302 Disallow creating unsupported devices
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-02 12:08:13 +02:00
Jim Snow 2acc0fb3f6 Add memory backed buffer allocation for L0 ray tracing.
This allocates the buffer on a per-device basis and enables ray
tracing on devices that support it when given a kernel with ray
tracing calls.

Signed-off-by: Jim Snow <jim.m.snow@intel.com>
2021-07-02 11:56:18 +02:00
Zbigniew Zdanowicz 7ee9d279c8 Set correct allocation after reseting command container
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-01 16:46:35 +02:00
Bartosz Dunajski f06b36617d Update metrics header
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-01 14:36:40 +02:00
Katarzyna Cencelewska 89c84d5942 Move some xehp config files to definitions subdirectory
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-07-01 11:55:48 +02:00
Zbigniew Zdanowicz 95966711fe Reorganize sync commands in static partitioning
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-01 11:50:06 +02:00
Michal Mrozek ad3855ceb3 Revert "Fix event profiling for marker commands"
This reverts commit 5f0167b477993f3ebc804c53a110bc432638615b.

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-01 08:01:33 +02:00
Bartosz Dunajski b5d4732169 Add compression flags for Images
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-30 19:46:47 +02:00
Bartosz Dunajski a49b45a679 Initialize HwInfo in tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-30 17:59:46 +02:00
Lukasz Jobczyk 2fcf983a29 Update command buffer task count on BCS
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-30 16:57:38 +02:00
Konstanty Misiak 1df1094465 Fix event profiling for marker commands
Related-To: NEO-5799

Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2021-06-30 14:56:39 +02:00
Lukasz Jobczyk 850b38781d Move RING_BUFFER to system memory
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-29 16:24:43 +02:00
Jaroslaw Chodor 1fa74b9b3c Changing sysmem allocation logic for WSL
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-06-29 16:03:28 +02:00
Lukasz Jobczyk 73b0df3211 Disable gem close worker in CSR constructor
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-29 15:22:51 +02:00
Zbigniew Zdanowicz 8156d5c16e Reorganize new ioctl and ioctl param logging code
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-29 15:10:12 +02:00
Bartosz Dunajski 1a042af9c6 GmmClientContext cleanup
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-29 12:01:07 +02:00
Kamil Kopryk 9372360efd Rename getEnginesCount() -> getGpgpuEnginesCount()
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-06-28 17:19:28 +02:00
Jaroslaw Chodor 84653008b9 Fatbinary - settle for IR if devbin not available
Fixes problems with recompilation from IR when
fatbinary is being used.

Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-06-28 17:09:09 +02:00
Mateusz Hoppe 1d3d32cf39 Use sched_yield() instead pthread_yield()
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-28 15:55:03 +02:00
Bartosz Dunajski afd5f766c2 HwHelper: update getSubDevicesCount and getEnginesCount implementation
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-28 15:14:30 +02:00
Szymon Morek d74118c123 Change slash to branch variable
Related-To: NEO-5945

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-06-28 12:38:06 +02:00
Bartosz Dunajski fefd2d2429 Add CCS1-3 to EngineNodeHelper
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-28 11:48:21 +02:00
Kamil Kopryk 76f7070917 Correct programming blitProperties for planar images
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-28 11:19:12 +02:00
Bartosz Dunajski 00a94439f4 Add direct submission specialization for XE_HP_CORE
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-25 15:41:03 +02:00
Zbigniew Zdanowicz 94154145c0 Improve drm ioctl debug prints
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-25 14:18:54 +02:00
Maciej Dziuban 7979dcb757 Improve PrintDeviceAndEngineIdOnSubmission flag
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-06-24 20:14:27 +02:00
Bartosz Dunajski 96d14967ac Partial support for XE_HP_SDV
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-24 18:35:54 +02:00
Mateusz Jablonski 72d124e275 add function to append params for image from buffer
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-24 13:33:43 +02:00
Szymon Morek 8b48b33a0c Remove 4GB limit if shared allocations supported
Resolves: NEO-5984

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-06-24 13:28:59 +02:00
Bartosz Dunajski e1f42c2ae1 Remove TSP atomic dependency tracking
This reverts commit d17668f023bee409ee68e766bbc7d5f16ce8d52b.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-23 16:59:41 +02:00
Bartosz Dunajski c4a936d864 Track TSP OOQ ownership
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-23 15:59:47 +02:00
Krystian Chmielewski 8a2e8670a7 Update zeInfo decoder version
Related-To: NEO-3739
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-06-23 14:08:40 +02:00
Zbigniew Zdanowicz 9e6f84e01d Add debug flag to override notify enable parameter
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-22 18:34:59 +02:00
Zbigniew Zdanowicz 991fd3b358 Add flags parameter to user fence wait function
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-22 15:43:02 +02:00
Bartosz Dunajski 82f1816aec Keep implicit TSP dependencies ownership after enqueue
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-22 13:37:20 +02:00
Mateusz Hoppe 438611be09 Disable FusedEus when debugger is used
Related-To: NEO-5961

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-22 13:03:38 +02:00
Lukasz Jobczyk a30347cbc5 Update command buffer task count outside flush
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-22 10:47:47 +02:00
Krystian Chmielewski d62049035a printf support with ZEBinary
Resolves: NEO-5657

Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-06-21 20:53:58 +02:00
Zbigniew Zdanowicz ea214dd26b Select lowest subdevice when USM memory is allocated in not multicontext
Related-To: NEO-5498

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-21 18:45:11 +02:00
John Falkowski 48f4b34dee Mods for Level Zero Stateless Builtin Kernels
Signed-off-by: John Falkowski <john.falkowski@intel.com>
2021-06-21 17:16:02 +02:00
Bartosz Dunajski 2e97aeccfd Revert TSP changes
This commit reverts:
a1d2bdc76666059653c79fe39a26113ce47c632a,
71a115129c1698ff15305fd0ea3828cba861be47,
e1a9087a466bfba54d84a64247e6596092034a91.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-21 12:44:12 +02:00
Mateusz Hoppe 48feca4f44 Check Isa placement for every root device
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-21 11:53:19 +02:00
Mateusz Hoppe 3c1288de09 Add mmap and munmap to SysCalls
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-18 15:44:56 +02:00
Filip Hazubski 99c0f02e12 Update StateComputeModeProperties
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-18 12:25:16 +02:00
Zbigniew Zdanowicz f98b46e2cc Correct usage of user fence wait call
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-18 12:15:02 +02:00
Mateusz Jablonski e027178c37 Correct semaphore wait programming for cross device dependencies
when event is blocked by blocked user event then program semaphore wait during
unblocking user event

Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-18 09:06:53 +02:00
Mateusz Jablonski 7828a8ee6a Correct adapter detection
don't break when first adapter is incompatible

Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-18 05:50:25 +02:00
Zbigniew Zdanowicz 0e5ca243e2 Add notify enable parameter to post sync commands
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-17 19:22:51 +02:00
Young Jin Yoon a1036ecc75 Fix alignment to be based on starting address
Related-To: LOCI-2342
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2021-06-17 19:08:08 +02:00
Jaime Arteaga a481c28e55 Program GPU atomics on stateless kernels for L0
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-06-17 18:57:35 +02:00
Lukasz Jobczyk 2ecab0fdc7 Evict unused allocations when exec fails
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-17 16:38:25 +02:00
Mateusz Hoppe 8a037399d1 Immediate binding flag in BufferObject
Related-To: NEO-5985

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-17 14:16:13 +02:00
Compute-Runtime-Validation 3137e82fca Revert "Remove redundant DualSubSliceCount checks"
This reverts commit 5e85fe5042.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-06-17 13:47:49 +02:00
Zbigniew Zdanowicz ad18099ed8 Enable KMD fallback for User Fence wait call
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-17 12:12:43 +02:00
Mateusz Jablonski 6c7ccddae0 Respect 3 dimensions when calculating size for host surface
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-17 11:15:30 +02:00
Filip Hazubski 5e85fe5042 Remove redundant DualSubSliceCount checks
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-17 11:11:56 +02:00
Mateusz Hoppe ed649fae66 Destroy kernel and module in zello_world_jitc_ocloc
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-16 15:40:42 +02:00
Jaime Arteaga 2dbecfc354 Display error when printing ioctl entries
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-06-16 10:12:19 +02:00
Bartosz Dunajski 5af793ddc6 Remove TSP implicit dependency tracking logic
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-16 08:47:00 +02:00
Bartosz Dunajski 080b1e2f66 Remove redundant TSP completion tracking logic
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-15 17:29:19 +02:00
Jaroslaw Chodor d7cea99868 Changing source group for windows_inc.cpp
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-06-15 15:12:19 +02:00
Bartosz Dunajski 2d55916003 Disable atomic dependency tracking for TSP
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-15 15:03:57 +02:00
Mateusz Jablonski 67216047db Fix clang-tidy issues
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-11 09:33:11 +02:00
Jaime Arteaga 6c84c0407b Add debug variable to disable timestamp events
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-06-11 01:33:27 +02:00
Maciej Plewka e1bcad51f0 Fix makeNonResident for csr residency allocations
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-06-10 20:57:15 +02:00
Szymon Morek 3ed0f074af Add method to set compression flag
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-06-10 12:27:24 +02:00
Kamil Kopryk 8af9ca71d3 Improve Vec3
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-10 12:15:27 +02:00
Zbigniew Zdanowicz 4fa5041f27 Add inline directive to smallest functions
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-10 09:27:07 +02:00
Jaime Arteaga ddf75b8d23 Add IPC events support (2/N)
Fix shared allocation on multi DG1 systems

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-06-09 20:55:34 +02:00
Kamil Kopryk fdb67afded Correct hwInfo initializations in negative case
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-06-09 17:03:13 +02:00
Mateusz Jablonski db8798ed94 Defer BCS initialization in L0
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-09 16:57:03 +02:00
Kamil Kopryk d3c47ae831 Rename constructPropertiesForReadWriteBuffer function
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-09 16:39:06 +02:00
Mateusz Jablonski c2dfba5926 Add missing maybe_unused keywords
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-09 16:07:21 +02:00
Jaroslaw Chodor 53ce391eb8 Fixing gcc warnig in DECLARE_COMMAND_BUFFER
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-06-09 15:51:51 +02:00
Lukasz Jobczyk 13632ebbc9 Fix gpu address alignment for SVM CPU allocations
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-09 10:31:25 +02:00
Jaroslaw Chodor d1af8706c0 Changing default for WDDM_LINUX support
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-06-09 03:13:32 +02:00
Maciej Plewka 689ceacfe6 Fix set allocation adress in SS when offset is patched
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-06-08 13:05:38 +02:00
Zbigniew Zdanowicz d14c7e4ffb Add new DRM wait function
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-08 12:29:22 +02:00
Filip Hazubski 573d01f085 Update StreamProperties
Update ThreadArbitrationPolicy enum.
Remove adjustThreadArbitionPolicy from CommandStreamReceiverHw.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-08 10:05:05 +02:00
Filip Hazubski b25c0e4fc0 Update StreamProperties
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-08 08:57:55 +02:00
Jaime Arteaga 5e29dccddc Add IPC events support
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-06-08 08:11:15 +02:00
Kamil Kopryk 0500f79753 Use size_t for src/dst size in blitProperties
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-07 15:20:03 +02:00
Kamil Kopryk fafcc0b58c Correct naming of get/set transfer width/height functions for block copy
These functions set parameters x2/y2 for block copy.
When offset is not 0 then x2/y2 != transfer width/height,
so the new names are more correct.

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-07 15:01:13 +02:00
Bartosz Dunajski 8667f3eafa Remove incorrect check for Shared USM creation
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-07 14:48:33 +02:00
Jaroslaw Chodor b80a51e5bf Adding wsl_compute_helper
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-06-07 14:36:21 +02:00
Daria Hinz 9c34b7ef59 Add applyAppResource function
Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2021-06-07 12:57:44 +02:00
Kamil Kopryk 8ecdc7f4c5 Cleanup blitHelper 1/n
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2021-06-04 14:46:25 +02:00
Zbigniew Zdanowicz 8f91fcdd73 Add new atomic operation
Related-To: NEO-5244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-04 09:00:11 +02:00
Mateusz Jablonski 907dec5f11 Dont defer BCS context initialization
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-02 12:01:25 +02:00
Zbigniew Zdanowicz 2829226937 Improve query PCI info
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-01 19:26:22 +02:00
Mateusz Hoppe 9e677da83e Add pread SysCall
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-06-01 19:04:24 +02:00
Filip Hazubski b3283a4490 When initializing gtSystemInfo initialize DualSubSliceCount
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-01 14:52:19 +02:00