Commit Graph

296 Commits

Author SHA1 Message Date
Dominik Dabek 59a1adc41b Poll csr completion at CmdQueue
Related-To: NEO-6090

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2021-10-07 14:25:28 +02:00
Jaroslaw Chodor f1c24ddcbb WDDM - guard against duplicated host ptr allocs
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-10-06 22:33:40 +02:00
Katarzyna Cencelewska a157963e79 Fix problem with compression hang on gen12lp
add creating of pageTableManager for non regular engins

Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-10-06 17:02:08 +02:00
Zbigniew Zdanowicz 0b1c3d24f1 Remove unnecessary header include
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-10-05 16:34:14 +02:00
Krzysztof Gibala 9d69c70424 Program PIPE CONTROL before _3DSTATE_BTD
Related-To: NEO-6056

Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-10-05 16:12:49 +02:00
Krzysztof Gibala 6736454f85 Program PIPE CONTROL before STATE_SIP
Related-To: NEO-6056

Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-10-04 17:31:33 +02:00
Kamil Kopryk 1a34586dd4 Make sure sip kernel is initialized for aub tests
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2021-10-01 12:54:04 +02:00
Krzysztof Gibala 8482eb6a5f Program PIPE CONTROL before SBA
Related-To: NEO-6056

Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-10-01 12:44:23 +02:00
Katarzyna Cencelewska 30b3f5cdb0 Move PageTableManager from rootDeviceEnvironment to CommandStreamReceiver
Also add init of pageTable registers to blitter path

Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-09-30 12:59:11 +02:00
Szymon Morek 897420236a Add method to set systolic mode
Resolves: NEO-6040

Signed-off-by: Szymon Morek szymon.morek@intel.com
2021-09-30 10:39:56 +02:00
Bartosz Dunajski 4ba4c32766 Remove SBA->IOH programming on XE_HP_SDV
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-29 12:35:43 +02:00
Zbigniew Zdanowicz 6091861f3e Enable multi-tile task count post-sync writes
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-28 16:32:16 +02:00
Rafal Maziejuk 82f27e882d Refactor Gen12LP helpers
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-09-27 14:07:37 +02:00
Artur Harasimiuk a63b9b1273 move common files to shared/
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2021-09-27 11:10:20 +02:00
Mateusz Jablonski 5d0a13e37b Move opencl/command_stream to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 17:25:43 +02:00
Zbigniew Zdanowicz e295e74c0a Add preemption flags creation to shared code
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-23 15:20:13 +02:00
Zbigniew Zdanowicz 3b35ba504f Adapt command stream receiver to multiple active partitions
Related-To: NEO-6244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-23 14:32:20 +02:00
Krzysztof Gibala 9b3acc88fd Remove dependency on sharedHandles when program SCM
Related-To: NEO-6056
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-09-23 12:10:32 +02:00
Mateusz Jablonski 80b49e4a47 Create ClPreemptionHelper
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-23 10:15:58 +02:00
Mateusz Jablonski f8867e0b97 Move generic command stream receiver files to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-22 23:55:31 +02:00
Mateusz Jablonski d348526941 Simplify checkAndActivateAubSubCapture method
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-09-22 20:23:56 +02:00
Krzysztof Gibala 3b4a5c25da Move isPipeControlPriorToNonPipelinedStateCommandsWARequired to hwInfoConfig
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-09-21 16:03:49 +02:00
Bartosz Dunajski 603250a5f0 Fix aub name generation with PID
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-17 12:42:20 +02:00
Kamil Kopryk 9ccf43e441 Correct branch_dir_suffix in cmake
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-6245
2021-09-14 16:00:20 +02:00
Krzysztof Gibala 7c1ea18f74 Enable adding extra pipe control on specific platforms
Related-To: NEO-6056
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-09-10 16:22:47 +02:00
Zbigniew Zdanowicz cd4f3c221a Synchronize switching command buffers for all partitions
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-08 12:12:23 +02:00
Filip Hazubski 55723d0b18 Remove redundant functions
Remove EncodeStates::adjustStateComputeMode function.
Unify CommandStreamReceiverHw::programComputeMode functions.

Related-To: NEO-5995

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-09-07 16:13:50 +02:00
Rafal Maziejuk 824102dc6c Move isDisableOverdispatchAvailable function from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-09-07 14:12:48 +02:00
Filip Hazubski 23cea464fe Correct setting singleSliceDispatchCcsMode value
Don't set the value when appending kernels.

Related-To: NEO-5995

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-09-07 10:40:36 +02:00
Zbigniew Zdanowicz 6b299a3ab0 Make partitioned post sync operations for partitioned workloads
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-09-03 20:20:29 +02:00
Bartosz Dunajski 0345d9f707 Improve queries with number of SubDevices
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-09-01 14:01:57 +02:00
Filip Hazubski 7ed804a4bb Correct debugPauseStateAddress initialization
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-31 14:07:21 +02:00
Filip Hazubski 741fa13507 Store StreamProperties in CommandStreamReceiver
Move StreamProperties from CommandQueueHw.

Related-To: NEO-5995

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-30 15:52:47 +02:00
Rafal Maziejuk a651e30aa1 Move stepping getter functions from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-30 10:54:23 +02:00
Szymon Morek 60bf5f8cd2 Synchronize initializing direct submission
Related-To: NEO-5865

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-25 04:41:03 +02:00
Filip Hazubski 63f8c9d98b Add new EngineUsage
Simplify verifying EngineUsage in tryGetEngine function.
Remove unused getGpgpuEnginesCount function.

Related-To: NEO-4940

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-23 17:41:13 +02:00
Lukasz Jobczyk 1638554a49 Add direct submission termination mechanism
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-08-20 13:57:28 +02:00
Rafal Maziejuk c6ee7065db Move isPageTableManagerSupported function from HwHelper to HwInfoConfig
Signed-off-by: Rafal Maziejuk <rafal.maziejuk@intel.com>
Related-To: NEO-4541
2021-08-19 17:35:08 +02:00
Szymon Morek 8355194236 Correct uninitialized variables
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-19 16:30:51 +02:00
Szymon Morek 274fe055e9 Rename Plus in source code to AndLater
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-19 15:06:45 +02:00
Filip Hazubski 29c64c3dd0 Disable implicit scaling for cooperative kernels
When implicit scaling is disabled use useSingleSubdeviceValue = true.

Resolves: NEO-5757

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-18 14:56:37 +02:00
Bartosz Dunajski d8a98acafd Set SingleSliceDispatchCcsMode for EngineInstanced OsContext
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-08-18 13:02:16 +02:00
Szymon Morek aa5e1780a2 Rename plus in filenames to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-17 11:26:27 +02:00
Szymon Morek 945a7cf905 Revert "Add method to set systolic mode"
This reverts commit 7ad007e.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-16 16:41:05 +02:00
Szymon Morek a85ae676e7 Rename plus in cmake macros to and_later
Related-To: NEO-5920

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-13 11:40:19 +02:00
Szymon Morek 7ad007ec92 Add method to set systolic mode
Resolves: NEO-6040

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-08-11 09:09:59 +02:00
Filip Hazubski 2dd0e67e65 Disable overdispatch by default
When disable overdispatch is available:
- change default value of CFE_STATE::ComputeOverdispatchDisable to true.
- change default value of
INTERFACE_DESCRIPTOR_DATA::ThreadGroupDispatchSize to 3u.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-08-03 15:28:53 +02:00
Michal Mrozek d3fd5077e7 Do not allocate surface if not needed.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-08-03 12:43:12 +02:00
Milczarek, Slawomir eb14d8458b Add helper function to enable stateless compression
Related-To: NEO-5107

Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com>
2021-08-02 14:34:33 +02:00
Lukasz Jobczyk cb178f951e Wait for completion while evict unused resources
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-30 16:11:40 +02:00
Filip Hazubski cb81078d40 Add disableOverdispatch to FrontEndProperties
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-07-29 17:05:47 +02:00
Compute-Runtime-Validation f6efba9a26 Revert "Use latest sent task count for Linux flush stamp"
This reverts commit 566415a1f5.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-07-24 10:02:26 +02:00
Zbigniew Zdanowicz 566415a1f5 Use latest sent task count for Linux flush stamp
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-23 17:35:00 +02:00
Szymon Morek 1a7c9e63fa Add method to set force non coherent
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2021-07-23 11:18:04 +02:00
Lukasz Jobczyk 0f6484755a Chceck all BCS types in direct submission initialization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-22 09:31:31 +02:00
Lukasz Jobczyk 9e50138829 Defer ULLS initialization
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-07-21 15:55:16 +02:00
Mateusz Jablonski 6f3c89decb Add mechanism to migrate multi root device memory
invalidate TLB cache if kernel requires migration


Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-07-19 19:49:22 +02:00
Zbigniew Zdanowicz a869921c2a Remove RMW from gfx allocations
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-07-15 11:28:03 +02:00
Krzysztof Gibala 0a41c42854 Add debug key for aub file generation per process id
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-07-14 08:59:26 +02:00
Michal Mrozek 65396fd2e5 optimize batching
- removes redundant MI_BATCH_BUFFER_START when target is within same command
buffer
- this way we do not have jump in command buffer

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-13 13:16:47 +02:00
Sebastian Luzynski c389db6f1c Add space calculation for SBA instruction
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2021-07-13 12:19:30 +02:00
Bartosz Dunajski bec8cdd6f1 Update XE_HP_CORE files to enable unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-08 18:41:41 +02:00
Michal Mrozek 60df89976a remove not needed code.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-07-08 15:37:55 +02:00
Krzysztof Gibala 242e3c0f2a Add size estimation for additional command
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-07-07 12:40:02 +02:00
Piotr Obst acf3e58a64 Move wddm_fixture.h and releted files from opencl to shared
Related-To: NEO-5894
Signed-off-by: Piotr Obst <piotr.obst@intel.com>
2021-07-07 12:30:12 +02:00
Sebastian Luzynski d7a2a62ded Add additional StateBaseAddress cmd wa
Resolves: NEO-5982
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2021-07-06 11:53:47 +02:00
Bartosz Dunajski c7a936d1f4 Add memory banks to Simulated CSR
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-07-05 12:19:58 +02:00
Jim Snow 2acc0fb3f6 Add memory backed buffer allocation for L0 ray tracing.
This allocates the buffer on a per-device basis and enables ray
tracing on devices that support it when given a kernel with ray
tracing calls.

Signed-off-by: Jim Snow <jim.m.snow@intel.com>
2021-07-02 11:56:18 +02:00
Lukasz Jobczyk 2fcf983a29 Update command buffer task count on BCS
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-30 16:57:38 +02:00
Maciej Dziuban 7979dcb757 Improve PrintDeviceAndEngineIdOnSubmission flag
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-06-24 20:14:27 +02:00
Bartosz Dunajski 96d14967ac Partial support for XE_HP_SDV
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-24 18:35:54 +02:00
Bartosz Dunajski e1f42c2ae1 Remove TSP atomic dependency tracking
This reverts commit d17668f023bee409ee68e766bbc7d5f16ce8d52b.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-23 16:59:41 +02:00
Lukasz Jobczyk a30347cbc5 Update command buffer task count outside flush
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-06-22 10:47:47 +02:00
Bartosz Dunajski 2e97aeccfd Revert TSP changes
This commit reverts:
a1d2bdc76666059653c79fe39a26113ce47c632a,
71a115129c1698ff15305fd0ea3828cba861be47,
e1a9087a466bfba54d84a64247e6596092034a91.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-21 12:44:12 +02:00
Filip Hazubski 99c0f02e12 Update StateComputeModeProperties
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-18 12:25:16 +02:00
Mateusz Jablonski e027178c37 Correct semaphore wait programming for cross device dependencies
when event is blocked by blocked user event then program semaphore wait during
unblocking user event

Related-To: NEO-3691

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-06-18 09:06:53 +02:00
Zbigniew Zdanowicz 0e5ca243e2 Add notify enable parameter to post sync commands
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-17 19:22:51 +02:00
Zbigniew Zdanowicz ad18099ed8 Enable KMD fallback for User Fence wait call
Related-To: NEO-5845

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-06-17 12:12:43 +02:00
Bartosz Dunajski 5af793ddc6 Remove TSP implicit dependency tracking logic
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-06-16 08:47:00 +02:00
Maciej Plewka e1bcad51f0 Fix makeNonResident for csr residency allocations
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-06-10 20:57:15 +02:00
Filip Hazubski 573d01f085 Update StreamProperties
Update ThreadArbitrationPolicy enum.
Remove adjustThreadArbitionPolicy from CommandStreamReceiverHw.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-08 10:05:05 +02:00
Filip Hazubski b25c0e4fc0 Update StreamProperties
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-06-08 08:57:55 +02:00
Dominik Dabek 39f0387ecc Move tbx stream, tbx csr to shared
Related-To: NEO-5161

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>i
2021-05-31 14:35:32 +02:00
Jaroslaw Chodor 3b4ec5b3fa Refactor of global factories
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-05-28 19:09:24 +02:00
Filip Hazubski 7eb81e9d85 Unify StreamProperties structs
Introduce functions allowing to copy values from one struct to another,
while correctly setting values of isDirty field.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-05-27 15:37:14 +02:00
Lukasz Jobczyk 79903d6fce Ensure tag address will be null before freeing tag allocation
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-05-27 13:50:29 +02:00
Lukasz Jobczyk 341e6bbc3a Fix flush small task task counts
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-05-26 10:17:36 +02:00
Mateusz Hoppe 0f32231fc8 Use correct INTERNAL heap base address for ISA in system memory
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-05-25 10:22:28 +02:00
Filip Hazubski d693d24f27 Add StateComputeModeProperties to StreamProperties
Related-To: NEO-4940, NEO-4574


Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-05-21 16:39:39 +02:00
Zbigniew Zdanowicz a692f1ecc5 Move flag setup after initialization
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-05-20 13:39:18 +02:00
Maciej Plewka 159404f38e Revert "Program border color once per dsh"
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-05-18 12:26:58 +02:00
lgotszal 3bd4bca911 Copyright header update
Dates corrected in copyright headers to reflect original publication date
(2018 for OpenCL, 2020 for Level Zero).

Signed-off-by: lgotszal <lukasz.gotszald@intel.com>
2021-05-17 20:38:19 +02:00
Bartosz Dunajski 9c5dee54dc Fix root device residency for TagNode
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-05-17 14:51:23 +02:00
Bartosz Dunajski a6c6290c09 Move TSP creation to HwHelper
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-05-14 15:08:53 +02:00
Bartosz Dunajski e53202e96b TagAllocator to accept multiple root devices
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-05-14 09:27:16 +02:00
Vinod Tipparaju ed9290e650 Fix to make globalFenceAllocation resident before submission via flushSmallTask
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2021-05-13 18:47:37 +02:00
Lukasz Jobczyk 6b1d3e275a Null tag address before freeing multi tag allocation
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-05-12 09:08:16 +02:00
Zbigniew Zdanowicz 544890c066 Change default placement of preemption allocation
Related-To: NEO-5800

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-05-11 15:26:24 +02:00
Lukasz Jobczyk 8e1e213bcf Disable GEM_WAIT when new residency model available
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-05-10 14:59:21 +02:00
Vinod Tipparaju f879c05bda Fix to flush HW context during L0 non-kernel operation via flushTask
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2021-05-07 21:25:53 +02:00