Commit Graph

839 Commits

Author SHA1 Message Date
Katarzyna Cencelewska e060536a32 Add check in allocateGraphicsMemory64kb to not use cpuPtr
when isRenderCompressed

Related-To: NEO-4532
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2020-11-06 17:14:07 +01:00
Bartosz Dunajski 3ed2823d45 Revert "Always reserve 48 bit window on 57 bit CPU"
This reverts commit 8f10db0c7ff13a72526141269ad09142a5d74e5f.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-06 14:12:46 +01:00
Kamil Kopryk 60c9bbea22 Disable blitter support for images
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2020-11-06 13:09:24 +01:00
Kamil Kopryk 77a5443f90 Add isMediaBlockIOSupported helper
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4848
2020-11-05 15:14:28 +01:00
Krzysztof Gibala 3d9a180c12 Implement local memory path for all devices in buffer
Related-To: NEO-4589
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-11-05 15:01:58 +01:00
Michal Mrozek ad747a5cbf Make comment more verbose.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2020-11-05 13:03:41 +01:00
Maciej Plewka 4745b7d20b Add globalDsh and ssh for scratch in bindlessHeapHelper
Change-Id: Ieab07271425a2898d79854a3d0b3ade25bc37c51
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-11-04 10:22:50 +01:00
Bartosz Dunajski 7cf5f02433 Update blit parameters
Change-Id: Ib1d12d37d1bc43ac0cc377dbafef77331d26fd9a
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-03 14:21:35 +01:00
Vinod Tipparaju 8e6be83fcc Add cmdContainer ULTs - idOffset & numIdd reset, Gfx alloc failure
ULT required to cover IDOffset and numIdd values during reset.
ULT required to cover OUT_OF_MEM retrun during init.
Fix to check for valid gfx allocation inside heap helper & destructor

Change-Id: Ied9049b33dc0605d5f5f51c96114d5e96b26a4f7
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2020-11-03 13:22:44 +01:00
Slawomir Milczarek b7d5427f01 CPU access disallowed mode and blitter amendments
Related-To: NEO-4876

Change-Id: I7d6de1a0530e9c4f8bcf302824242033d3ca724a
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-11-03 13:04:28 +01:00
Mateusz Hoppe 4d2750161d Move OsAgnosticMemoryManager to shared
Resolves: NEO-5188
-move MockGraphicsAllocation to shared

Change-Id: I17e90af48183f003151fab075a46e40d7df3f160
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-11-02 21:02:53 +01:00
Lukasz Jobczyk 045632f355 Add new unified shared memory model
Related-To: NEO-3312

Change-Id: I640fb8d120729fa8bb2a23ff65c74c41ef27260d
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-11-02 19:23:40 +01:00
Maciej Plewka 44af85b492 Return correct maxFillSize property
Related-To: NEO-5205

Change-Id: I62b7fec89451c640f70028b8d3ecb81f7655225d
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-11-02 16:10:01 +01:00
Jaroslaw Chodor 0e9be40a7c zebin - fixing missing image metadata
Change-Id: Iae49aacb2fb7b38eea987a5fb283f12fc75718bf
2020-11-02 14:10:49 +01:00
Mateusz Hoppe 4df533f63a Use full path when loading SourceLevelDebugger library
Change-Id: I27f7ee2b8944b9890ab4b141c06e9c2f0a8dffb1
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-11-01 18:18:38 +01:00
Bartosz Dunajski d35806fdd8 Improve returning global and max alloc memory size
Change-Id: I2f22481412184f01652b7e49bc30a57c56e6204b
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-30 15:58:42 +01:00
Zbigniew Zdanowicz c678f3d9b0 Make DeviceBitfield argument constant
Related-To: NEO-5225

Change-Id: I14a5a4cc3394cd2b58a74bda183c734a0d17ac25
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-30 13:45:32 +01:00
Jaroslaw Chodor 345e56a151 Zebin improvements
* cleaning-up per-thread buffer size calculations
* fixing default slm alignment to 16
* adding scratch space slots
* renaming slm addressing mode
* adding support for zeinfo version

Change-Id: I0450353788b8488a685976d7f1dd26a44360383c
2020-10-29 16:33:21 +01:00
Mateusz Hoppe d539a7f8e4 Adjust AllocationProperties for SBA tracking buffer
Change-Id: I00d9d40c854c45775254b017997c53f17559daa4
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-29 15:48:25 +01:00
Mateusz Hoppe ac3b65ba82 Refactor isDebuggerActive
- use it for SourceLevelDebugger only

Change-Id: I130219a13d6baa1f72c5b35295afd6efa4bf37fa
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-29 12:21:18 +01:00
Kamil Kopryk 523887019b Rename debug flag to EnableBlitterForEnqueueOperations
Change-Id: I9ae8dfc1e86a837c600ee9099e936fc4a64c80b1
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2020-10-29 12:00:09 +01:00
Kamil Kopryk bc6ba0688e Limit usage of blitter for images
Change-Id: I15223ef4ebdbfef67b05647188bdd92d35a9dcad
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2020-10-29 11:53:21 +01:00
Maciej Plewka 6bb4112d1e Create heap helper for bindless
Related-To: NEO-4724

Change-Id: I62527a3ad06dce5d886b6ecfebd3c9abc46f6741
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-10-29 10:51:38 +01:00
Zbigniew Zdanowicz 30a67618f8 Add DeviceBitfield argument to CSR constructor
Related-To: NEO-5225

Change-Id: I8cf0aef3ec16314cfb1a787852b6c20ce0f65955
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-28 17:10:31 +01:00
Mateusz Hoppe 65690ccb21 Fix indirect dispatch programming
Related-To: NEO-5195

Change-Id: I82975abaa6323d27d3718ce1619748f7d83b55b4
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-28 01:06:08 +01:00
Mateusz Hoppe f3ab44da5a Remove classNames
Related-To: NEO-4964

Change-Id: Ib55626e811046eb66db0d9fe90697f9db7353afe
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-27 17:53:30 +01:00
Lukasz Jobczyk bec239211b Disable new residency model
Change-Id: I1b31296cfe3fff6b32cf6c6bc3cbcb1a7c1647d5
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-27 16:43:22 +01:00
Mateusz Hoppe d380f6898c Add isa cookie registration
Related-To: NEO-4552

Change-Id: I0a53deb92d19a2b6f2ce9385c17d82998d2a26d6
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-27 13:51:21 +01:00
Igor Venevtsev 67a31d0975 Check for supported CPU VA size in GfxPartition initialization
Resolves: NEO-5220

Change-Id: I081b0c693e9d7a468be81e12d7f816fada5da21d
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2020-10-27 13:19:56 +01:00
Sebastian Luzynski 5014861783 Minor code fix
Change-Id: I1e666b9032deb6aa7287c6d9e247cfef5ea35c7c
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2020-10-27 10:42:56 +01:00
Bartosz Dunajski b0e055ee3c Debug flag to print blit dispatch details
Change-Id: I1eb033449a49485b459249f634589e546492d99f
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-26 16:00:38 +01:00
Sebastian Luzynski 225e7f01b4 Add checks for correct engine for concurrent kernels.
Related-To: NEO-5135
Change-Id: Ib1c37ec8d5e468de331521ae4be1cd92902a2330
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2020-10-26 14:53:52 +01:00
Mateusz Hoppe f9a97cbb22 Set CAPTURE flag in fillExecObject
Resolves: NEO-5026

Change-Id: I132d5f1c02edf8e595d31e08029fb32ccbd6d307
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-26 13:09:40 +01:00
Andrzej Swierczynski e4adb7efbf Change RequirementsStatus from enum to enum class
Related-To: NEO-5167

Change-Id: Iecf6ac74b5f757e90c36ef84a0f65339bf58e3f9
Signed-off-by: Andrzej Swierczynski <andrzej.swierczynski@intel.com>
2020-10-26 12:56:41 +01:00
Plewka, Maciej 39a930e122 Revert "Enable copy engine in platforms which supports bcs"
This reverts commit b539b5a3ec.

Change-Id: I731b969cb82e4cfa6ec3f435c4b3178fc997c867
2020-10-23 17:11:00 +02:00
Filip Hazubski c3b8727e97 Remove opencl includes from HwHelper
Resolves: NEO-3964

Change-Id: Ie891ba6a205a89b41ca2cce0fa386dc4c93a0aaa
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-23 11:10:52 +02:00
Jaime Arteaga b863c90e7d Add 4-digit zero alignment of device id in device name (3)
Add missing header.

Related-To: NEO-4744

Change-Id: Ic61b864bc27a681e0a9b3804884455511d88346b
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-10-22 12:51:15 -07:00
Pranav Tendulkar 504dfe8a50 change TdDebugControl Register to enum
change TdDebugControl Register to enum for over-riding in another
platforms

Related-To: NEO-5203

Change-Id: I17b835a1d4cb43986cfd06741e6ec9a606feb5ae
Signed-off-by: Pranav Tendulkar <pranav.tendulkar@intel.com>
2020-10-22 19:42:15 +02:00
Mateusz Jablonski a5a5c94097 Correct clCreateProgramWithBuiltInKernels
create program for all provided devices
move OCL specific code from shared to opencl

Related-To: NEO-5001
Change-Id: Ic352b4e907ae75426634ae4b3c7048edecaf83e7
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-10-22 19:26:34 +02:00
Jaime Arteaga 31291b1cf0 Add 4-digit zero alignment of device id in device name (2)
Unify names for OpenCL and L0

Related-To: NEO-4744

Change-Id: I5094f228f447ecbd942c25d6244abee593f3ffbf
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-10-22 15:53:20 +02:00
Bartosz Dunajski e3e8f1ddf2 Fix private surface size calculation
Change-Id: Iebbbdf2bfa76173c6181d8a26838114fabf6cbe1
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-22 13:54:13 +02:00
Pranav Tendulkar 1d74871f85 increase the debug surface size to accomodate all threads
maximum number of threads have changed and the debug surface size
changed accordindly.

Related-To: NEO-5203

Change-Id: I53626f9fb1062f8dc4e0437db80a343b148b7701
Signed-off-by: Pranav Tendulkar <pranav.tendulkar@intel.com>
2020-10-22 13:19:57 +02:00
Filip Hazubski 0738ad5a82 Add ClHwHelper
Related-To: NEO-3964

Change-Id: Ib2660e8f7d92fc970172517b3e2ddfd607e09ec1
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-22 13:03:07 +02:00
Mateusz Hoppe 63d5c2b42a Assign INTERNAL_FRONT_WINDOW heap for DebugModuleArea allocation
Related-To: NEO-4550

Change-Id: Ic3209a5777245f0d1c6231cb0ce22d5327372a65
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-22 11:48:37 +02:00
Piotr Zdunowski 4c2d92890f Opensource ADLS.
Resolves: NEO-5092

Change-Id: I544247a057a667ce6423f2e59ba4ca769e866479
Signed-off-by: Piotr Zdunowski <piotr.zdunowski@intel.com>
2020-10-21 19:07:38 +02:00
Lukasz Jobczyk 5205d34894 Create multi graphics allocations with bo mmap
Change-Id: I97e3e3ddc8ae0f5a8ad9246befc9b2abc9c8c0f8
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-21 17:30:32 +02:00
Kamil Kopryk 914ace6165 Add blitter support for read/write images OpenCL
Change-Id: I5a74bcbdc5a5d7c20f55ee3c59839077649778c4
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2020-10-21 16:55:38 +02:00
Bartosz Dunajski 4d4f73580b Update max blit width
Change-Id: I94fcc325bc9838182458973afb411dece80f57f7
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-21 16:39:56 +02:00
Maciej Plewka b539b5a3ec Enable copy engine in platforms which supports bcs
Releated-To: NEO-4870

Change-Id: I3ef4c91c2bf210d5e6f59df0e8bd347aa867cbe5
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-10-21 15:27:15 +02:00
Bartosz Dunajski 1926ef8319 is_simt_thread token support
Change-Id: I8cee6ff26229f0f492ba0d1e5e61d6e46e0c2486
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-21 14:14:43 +02:00
Michal Mrozek a06369230c Add debug variable to control media vfe state dss settings.
Change-Id: I7668bd50c81cc9971315e6a635d64a838465b986
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2020-10-21 13:49:39 +02:00
Mateusz Hoppe 19d3fa73bd Rename flag to use32BitFrontWindow
Change-Id: I3ecffcce2586f7164577edd3ae4d473ac68a3185
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-21 12:38:33 +02:00
Zbigniew Zdanowicz 27c281a044 Fix start and dispatch blitter commands in direct mode
Related-To: NEO-5010

Change-Id: I3d03ef39325adb2beba26a989906381f5eccc4ff
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-20 14:12:22 +02:00
Slawomir Milczarek 5d9467b753 Make the EnableVaLibCalls debug key tri-state (-1/0/1)
Related-To: NEO-5110

Change-Id: I56b709e266a091fca68b55ff136690d673773734
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-10-20 13:58:46 +02:00
Michal Mrozek 7e45c396a2 Fix profiling in copy engine scenarios.
- We need to wait till completion prior to obtaining timestamps.

Change-Id: I1320c9d44e8c1a2c2125cbd332296de1df28491b
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2020-10-20 10:25:40 +02:00
Pawel Wilma 7f8b0c5b3f Global l3 invaldate for blitter engine
Related-To: NEO-5175

Change-Id: I88b3c9333398c91a7dd799f5e52cfd9182316960
Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-10-19 16:40:03 +02:00
Filip Hazubski ca5f34133b Move aub and tbx code to shared
Related-To: NEO-3964

Change-Id: Ice978e582721498d7496f989767ce7d6f5f4caf4
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-19 16:04:47 +02:00
Lukasz Jobczyk c2c2bc3f82 Reset tag allocators in CSR destructor
Change-Id: I178ece2b5d79c2bd38b8ba5b1c715bd3730b715e
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-19 11:57:25 +02:00
Mateusz Jablonski 7c086c9fb4 Use StackVec instead of std::vector in ClDeviceVector
Related-To: NEO-5001
Change-Id: Icab72b5be9f32abf10efd93614768b256aa2ac2c
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-10-16 17:51:40 +02:00
Kamil Kopryk 8e44038f9a Revert "Add blitter support for read/write image OpenCL"
This reverts commit cc6d6968dd.

Change-Id: I2696f05c5d1e3959f60239ca49483b00ad1b36ec
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2020-10-16 15:59:58 +02:00
Lukasz Jobczyk 3e762b25c0 Split buffer object validation and early pinning
Change-Id: If1b136807dc8593179ce743c8e0187ee80c3e95f
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-16 14:13:33 +02:00
Lukasz Jobczyk 6b0e12ed94 Return error code from BufferObject::bind
Change-Id: I12df63a651c8b0aa0a0b296ae0c8732ddf789a98
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-16 13:05:52 +02:00
Lukasz Jobczyk 574cd634b9 Refactor bo pinning
Change-Id: I451fa5225096829ea7131d159eb59f906817b2cd
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-16 12:55:57 +02:00
Filip Hazubski d27374b468 Move aub related files to aub directory
Additionally remove dependencies on opencl code from aub and tbx code.

Related-To: NEO-3964

Change-Id: Ie81b7d274e2f22b6090df0e07c45123618af5cae
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-16 12:05:58 +02:00
Kamil Kopryk cc6d6968dd Add blitter support for read/write image OpenCL
Change-Id: I5d8bf0590899751f1f562fd55e44b0ed36ca6110
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-4692
2020-10-16 11:59:03 +02:00
Mateusz Hoppe 4623cb3f85 Create module debug area allocation
Related-To: NEO-4550

Change-Id: I1aa151134cb51a7d4f578de3b08cdd51aefc58f2
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-16 11:21:39 +02:00
Filip Hazubski 60bfcbd69f Move populateFactoryTable() to shared
Related-To: NEO-3964

Change-Id: I9da0395265dc164deda219d5390dd9540e04f9aa
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-16 11:07:38 +02:00
Filip Hazubski 34176a8ea9 Correct formatting
Change-Id: I592986cb67099136a75d12ad3bc9729c7f85738b
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-16 10:46:26 +02:00
Jaime Arteaga 6614698997 Add multi-device support to events
Change-Id: I544d2409fa5ad7c2b64f7bfd081469e80d4f9c73
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-10-15 12:54:51 -07:00
Artur Harasimiuk 51c25adc85 fix single-sku builds
Change-Id: Ib1aef5f27148203b808ffb698878c89a410193c4
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2020-10-15 19:45:56 +02:00
Mateusz Hoppe 067ae67954 Introduce FRONT_WINDOW heaps inside INTERNAL heaps
Related-To: NEO-4550

Change-Id: I1979afb20881bcad7999af3ac5fd4f407b85ccc7
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-15 17:18:31 +02:00
Mateusz Jablonski 97154f7f98 Use ProgramInfo instead of Program in sip kernel
Related-To: NEO-5001
Change-Id: I58eda3ecc52fe1215ea8bbc35f97eea3a9d848e0
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-10-15 16:41:18 +02:00
Lukasz Jobczyk 2d781e5934 Add missing USM host allocation flag
Change-Id: I5658d5574fd522cff072adcc679f04805daabf12
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-15 12:12:55 +02:00
Mateusz Jablonski fd492f28b0 Correct useSystemMemoryPlacementForISA
Related-To: NEO-5156
Change-Id: Iee6df3e06eea5707b3b6cb45ac50e9880ee4dfb4
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-10-15 10:22:30 +02:00
Maciej Dziuban 21988a81e1 Enhance debug flag for post blit commands
Change-Id: Ia5dccd083d84ab1b7a1e772f7fd1d5344aa3c6b1
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-10-15 09:46:22 +02:00
Lukasz Jobczyk f825364770 Unprotect memory after migration to CPU
Change-Id: I280296422ec30583752a0b62c7c1c8777aa84c32
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-14 11:14:32 +02:00
Lukasz Jobczyk e34ba2a233 Create internal BOs with mmap by default
Change-Id: I34f79ae2e44cf087c3fe4ec6ab673e04db04e65e
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-14 10:37:36 +02:00
Lukasz Jobczyk d7df1ee5dd Rename createAllocWithAlignment parameter
Change-Id: If1b43f3fada0f85323d67ff6b43a6165d5b578ca
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-13 15:47:58 +02:00
Lukasz Jobczyk 8892ee3f1f Align mmaped bo address properly
Change-Id: I010f6619821ad715bb6f0e9640be19943a45abd8
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-13 14:11:08 +02:00
Slawomir Milczarek eb8f5fa301 Get CL Device Name with device ID appended at the end
Related-To: NEO-4744

Change-Id: I8a9a791a634f9c0c444695036d96e3c959c90de0
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-10-13 14:00:33 +02:00
Michal Mrozek 324150dd37 Do not track Kernel ISA as new resources.
Change-Id: Ib112952071b76ba471d046c13c556422c415ba96
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2020-10-13 13:34:35 +02:00
Pawel Wilma 0c3d430f50 W/A for disabling RCC RHWO for compressed media surfaces on gen12lp
Whenever media compressed surface is used, the RCC Read-Hit-Write optimization
disable bit (14) has to be set in Common Slice Chicken1 register (7010h).

Related-To: NEO-4982

Change-Id: I71b91b52692252459da05b737838eb4854575974
Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-10-13 11:52:15 +02:00
Zbigniew Zdanowicz ca023fa532 Fix L3 and Math programming
Change-Id: I4ffd729beeed95b0806dd284665c72fb424b0ffc
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-13 11:41:38 +02:00
Mateusz Jablonski b77f9bf8d1 Remove Program::setDevice
device should be passed to constructor

Related-To: NEO-5001
Change-Id: If4c64ec405bdd3beaccc7c09644e22fc98a02249
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-10-12 20:22:45 +02:00
Spruit, Neil R 976dad2e17 Updated BaseSurfaceStateAddressAlignment to PageSize to handle Block R/W in L0
- Block R/W in kernels requires a minimum of 16B alignment/OWORD
alignment to properly work without data corruption.
- Level Zero currently writes Base Surface State addresses alignment to
4B vs OpenCL writes Base Surface State addresses aligned to PageSize for
4KB.
- Added a function in encode buffer to verify that at a minimum the size
being encoded has the minumum alignment of 4B which is supported, but
will not support Block R/W

Change-Id: I6486c2cbbb0008834c779bf54918388d79c193bb
Signed-off-by: Spruit, Neil R <neil.r.spruit@intel.com>
2020-10-12 19:14:25 +02:00
Bartosz Dunajski 27f9a95af2 Refactor: Common helper for Blit and CPU memory transfers
Change-Id: Icc61f82517e75e3066e441494af3bf9a7ffbbeef
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-12 18:29:42 +02:00
Lukasz Jobczyk 99f0d2b1db Add debug flag for BO mmap creation
Change-Id: I1b0dc8b9328bf3aab64ceeaf9f1c5aeb4199eb08
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-12 12:36:28 +02:00
Kamil Diedrich 9e463ab45f Track all ssh in cmdList
Change-Id: Ibffb7b7b406e5e17d4ffb971fd0789557c879367
2020-10-12 12:12:12 +02:00
Maciej Dziuban 38ca6e9862 Disable L1 for Gen12lp
Change-Id: I3b0ec2a6ea9a3bb72507ff66d314bfb1ad7a6a81
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-10-12 11:18:55 +02:00
Mateusz Hoppe 0e935b0e10 Add allowCapture flag to BufferObject
Related-To: NEO-5026

Change-Id: I69a9f270272a13fccdd1d8dd8b13ad03ef93cb79
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-09 17:04:43 +02:00
Lukasz Jobczyk a939c89d91 Create internal BOs with map offset
Resolves: NEO-5097

Change-Id: I842f3d482420373cc630d5bfc034e229fa2cb30c
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-09 16:38:03 +02:00
Filip Hazubski da524fa03d Correct Intermediate Language related implementation
Change-Id: Ib2bdd21c255245767df787797bb5cfe05482e489
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-09 16:00:56 +02:00
Maciej Plewka 2ebee73e4b Unify bindless debug flags
Change-Id: I6a9313722eed01b935707e93cad532adddcc78af
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-10-09 14:49:50 +02:00
Zbigniew Zdanowicz bf32740f97 Move BTI programming to shared code
Change-Id: Ie9d67c1d883f24cfec13ea1618d834d746c0d5be
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-09 13:56:44 +02:00
Bartosz Dunajski fb0651521d Linker: Fix incremental patching for local memory allocations
Change-Id: Ib85e4a2abc8a62477003853aa0c35f8107444f4e
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-09 09:13:42 +02:00
Mateusz Jablonski fc090f74c6 Store device binary per root device in program
Related-To: NEO-5001
Change-Id: I9834f6894625031c734c68ebf210e6042c470ec7
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-10-08 19:05:04 +02:00
Zbigniew Zdanowicz 4e3679b8ae Move local ids generation code to shared directory
Change-Id: I5b0486ceae8d67d0c1d1be56a756c102226d7e2a
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-08 15:02:36 +02:00
Maciej Dziuban 8fcd51c2c8 Do not obtain command stream if it will not be needed
Change-Id: Id7fa1c6b78e71a085084f8fcb66a7b8e873ad2bc
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5120
2020-10-08 12:24:03 +02:00
Kamil Diedrich 960860e4cb Fix reservation size
Change-Id: I1cc3d4405b00365908c5915c9d2a1c512d572530
2020-10-08 10:57:08 +02:00
Bartosz Dunajski d07362c992 Use blitter to initialize Global surface if required
Change-Id: I53cc532a5b5edd16a32deaf987f85db4224b9945
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-07 17:11:48 +02:00
Bartosz Dunajski 595f374634 Dont use blitter for local memory transfer if not available
Change-Id: I5f43113498b59e3f1b8cb280c9feeccae8ff6140
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-07 15:55:22 +02:00
Kamil Diedrich 67e2853857 Add missing mockable_virtual in code
Change-Id: Ia8d041b68163a99cf4e9e399e825d39798425544
2020-10-07 14:25:04 +02:00
Mateusz Hoppe 5fd113dcb3 CommandContainer.reset() clears lastSentNumGrfRequired
RelatedTo: NEO-5137

Change-Id: Icaad8224ee24f8c927b75e2efb17585a8b79918a
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-07 12:24:04 +02:00
Kamil Diedrich ce7e293a99 Extend scratch implementation
Change-Id: I1bbc0c9be287b1411276b1e61a7ec1c8db238f3f
2020-10-07 11:39:04 +02:00
Igor Venevtsev bd9695a19a Get rid of UNRECOVERABLE_IF in MemoryManager constructor
Related-To: NEO-5053

Change-Id: Ibf955c760e61e34c4d38cbb5071ef712bae1c518
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2020-10-07 11:18:56 +02:00
Zbigniew Zdanowicz 47f5867e8f Move common code to shared directory
Change-Id: I5f604de01e06d35cc1e045fffdd4a26d88ffca8c
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-07 10:55:39 +02:00
Maciej Plewka 4dc3827b8e Prepare object lib for precompiled builtins in bindless mode
Releated-To: NEO-5138

Change-Id: I18e564a9e32041fba5e887bc18d2195a1c4ddda8
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-10-06 16:57:11 +02:00
Andrzej Swierczynski bdf8c5fc90 Extend UnifiedMemoryProperties constructor to take device bitfield
Related-To: NEO-4722

Change-Id: Ice185f1792635922e9bb89cd7329e6501bc585e0
Signed-off-by: Andrzej Swierczynski <andrzej.swierczynski@intel.com>
2020-10-06 16:35:08 +02:00
Zbigniew Zdanowicz 820efffdd0 Switch default CPU cache flush to disabled in direct submission
Change-Id: I1a5e5f67d3e6af129aeb611f203c243d892321bb
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-06 15:19:32 +02:00
Zbigniew Zdanowicz 28ef5fa709 Move pipecontrol w/a estimation to dedicated class
Change-Id: I8ceaa2dff94dd7148daf921568fd30f098e5dae4
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-06 15:02:37 +02:00
Zbigniew Zdanowicz ce1b669cda Use single class to program load register command
Change-Id: I90fe084409588cb32f0ac43a3db5082047d7a68b
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-06 13:45:35 +02:00
Maciej Dziuban 138f04bdcd Enable L1 cache for Tigerlake
Change-Id: I33513ed084f9d06ceca11315cac03f1b682db535
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-4832
2020-10-06 13:26:54 +02:00
Konstanty Misiak ec054a87da Fix builtin compiling with ZEBin
Related-To: NEO-5020

Change-Id: I2698db921e8b6c61ee592a0d6611dc38173a1688
Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2020-10-06 13:04:45 +02:00
Slawomir Milczarek 5f7b763ce5 Use kernel info to determine if AUX resolves required
This commit decouples the logic for AUX resolves from set kernel arg handlers.

Related-To: NEO-5107

Change-Id: I4c2912dc18633bcaefddb03cc6966e859d95262c
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-10-06 09:56:49 +02:00
Filip Hazubski 89be51cd94 Update CL_MEM_FORCE_HOST_MEMORY_INTEL flag
Rename CL_MEM_FORCE_SHARED_PHYSICAL_MEMORY_INTEL to
CL_MEM_FORCE_HOST_MEMORY_INTEL.
Rename MemoryFlags::forceSharedPhysicalMemory to MemoryFlags::forceHostMemory.

Change-Id: I48c0ae958ff55f2aef71cf99ed274d021a3c1f19
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-05 20:33:35 +02:00
Lukasz Jobczyk 447c3f5800 Add debug flag to disable gem close worker
Change-Id: If2453b2c168aa7086ad387f97ac2255291e08ae1
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-05 14:44:33 +02:00
Zbigniew Zdanowicz 2717fcae54 Unify programming of atomic command
Change-Id: I13afdb44fb83beaa8673eb6456d2a8edcb6ac047
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-05 13:37:52 +02:00
Filip Hazubski 60430d79ee Update OpenCL C features reporting to the compiler
Pass features also with -cl-ext option.

Change-Id: I1a1c68b655a2108be51c7d57be771591ee0b14e7
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-05 10:27:30 +02:00
Jaroslaw Chodor 746cf7fd33 Reuse old build options if new ones are NULL
Change-Id: I435e7ec8554b0429dcf4f6f8d9d4fd80e70b68c6
2020-10-04 16:54:02 +02:00
Lukasz Jobczyk 1fdd326ba0 Enhance bind log
Change-Id: I202d4f65b71aeda18b20312ef05c910c0c937d19
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-02 12:48:25 +02:00
Jaime Arteaga 9f9bf38d64 Copy user buffers when not accepted by Kernel
When performing copy operations to or from buffers allocated by the
user, it could happen that the buffer address is not accepted by
kernel, even though the buffer is valid. In those ocassions, then
allocate a new graphics allocation and copy the user buffer.

Change-Id: I6b1b6f2ef5fea0acf32c868bc87eafe8746f9a79
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-10-02 10:03:18 +02:00
Raiyan Latif 921e30802a Add L3_CONTROL cmd format for Gen12LP
Change-Id: Ibae6c3f10a54accb333aa1b21163024aac8cf93c
Signed-off-by: Raiyan Latif <raiyan.latif@intel.com>
2020-10-01 18:17:29 +02:00
Zbigniew Zdanowicz 18ccd448f2 Unify programming of semaphore command
Change-Id: Iae9060935554df366d9687e9f16c3b5dce9155ee
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-10-01 16:26:33 +02:00
Lukasz Jobczyk d1a9174204 Enable early pin on direct submission
Resolves: NEO-5112

Change-Id: I79398dda9de3584d327e9448dd57e9a3ed37b377
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-01 10:42:13 +02:00
Lukasz Jobczyk e7a1b53ec7 Use new residency model if supported
Related-To: NEO-5007

Change-Id: I74ee500c94d2fea0f8d99dd1b912aa10536b6cae
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-01 07:58:29 +02:00
Zbigniew Zdanowicz 5af3a46662 Add debug flag to disable cache flush
Related-To: NEO-5144

Change-Id: I29590d840a641dfcf3fc4d099ca84f196c8fdc1f
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-30 16:38:35 +02:00
Katarzyna Cencelewska ee63b7a840 Initialize storageInfo for new create allocation
in WddmMemoryManager::allocateGraphicsMemory64kb

Change-Id: Ie7ef14f2960c3923014941882c63f116ef265d74
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2020-09-30 13:07:50 +02:00
Lukasz Jobczyk 76501a2921 Adjust early BO pin to new residency model
Resolves: NEO-5112

Change-Id: Ia65b1d75f957669999f7de423716a1e3cffc4032
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-30 12:24:47 +02:00
Aravind Gopalakrishnan 9c84458b65 Move new fields in struct to group with other uint32_t
Change-Id: I2bf9a37a7147ece654e214b648fcbfaed6898e9e
Signed-off-by: Aravind Gopalakrishnan <Aravind.Gopalakrishnan@intel.com>
2020-09-30 10:43:30 +02:00
Bartosz Dunajski 44a6d70ced Dont use Packets without profiling data to calculate kernel duration
Change-Id: I710348835f8884a3b244502f53ff4e4980441654
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-29 17:09:01 +02:00
Maciej Plewka 52b785552b Fix memory fill using bliter
Change-Id: Idf2463361c19f80e11a920aebf7ad1194cd3c2bb
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-09-29 16:16:30 +02:00
Sebastian Luzynski 8093400baf Change default state of CSR.
Change-Id: I1124ff538de37736996d4cae3e827950b1022a8f
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2020-09-29 12:57:32 +02:00
Maciej Plewka e34c319ed7 Special address pool at External heap begining
Change-Id: I7da6e67010ff7a819aec25abea9213b6e43e348e
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-09-29 07:51:12 +02:00
Bartosz Dunajski 28acc2c8f6 Remove lowPriorityEngineType member
Change-Id: I39908addf1c3a12f7807479132d0a6d5a4398d7b
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-28 17:02:56 +02:00
Bartosz Dunajski 1b0983d7db Debug logs: print tag allocation address.
Change-Id: Ia5d8cf16fa42f7b1f567e4ac79fae61bbcb6f13a
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-28 16:38:46 +02:00
Andrzej Koska 0cc717b1b4 Adding support to packed formats
Related-To: NEO-4949
Change-Id: I5cbff44d6463fa6c7aa71f641e11b593a1dcf11e
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2020-09-28 14:49:54 +02:00
Bartosz Dunajski 55bd544402 Lazy evaluate arguments of printDebugStrings(...) function
Change-Id: Ie44e109fd9235c5df32fb90b9e6fc6058e558a99
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-25 18:38:58 +02:00
Sebastian Luzynski d24850cff3 Alter API with additional kernel exec info.
Related-To: NEO-4875
Change-Id: I10a5e3bfc32be520c3554c992dc36591fc1ff599
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2020-09-25 13:00:24 +02:00
Bartosz Dunajski f92f01e190 Enhance GPU breakpoint capabilities
Change-Id: Id28afb7ab584eeb5063c7311fed41d7a31edbec7
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-24 16:03:19 +02:00
Vinod Tipparaju 8d0df0c8a7 Reset cmdList - Fix to set genericMediaStateClear bit during programSBA
This resolves corruptions by flushing ID cache on HW

Change-Id: I56919360ac126cec67c5cbcf6380acfd72e0bcdb
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2020-09-24 13:42:04 +02:00
Lukasz Jobczyk c1b9580174 Disable binding by default
Change-Id: Ib90b7ef4eb196af7bd3c36b28cbcb2b6569452dd
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-24 10:24:57 +02:00
Bartosz Dunajski 2a69b1ed78 Select correct heap base address for ISA
Change-Id: I400f965faa4615519729756daa78350a46c46ff2
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-23 14:21:22 +02:00
Lukasz Jobczyk 1d4568e548 Set bb end pointer correctly in batched submission
Related-To: NEO-5112

Change-Id: Ideff314e4aee501a02f07142b99307b8d6c08fa1
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-23 10:43:00 +02:00
Michal Mrozek 76a9ccc095 Do not flush caches in ULLS submissions by default.
Change-Id: I4a1c96c597eef8b85e4e43e90cdc4779765eb72b
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2020-09-23 09:46:08 +02:00
Lukasz Jobczyk d20e3af187 Enable gem close worker on direct submission
Related-To: NEO-5112

Change-Id: I1b6950d0308d98cca09051d6fea46d51c10d2a6a
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-23 08:10:14 +02:00
Zbigniew Zdanowicz 3b6f9b7cb6 Add implicit flush for new resources and idling gpu
Related-To: NEO-5100

Change-Id: I57fdb8eecd88124c4c9171014950554c35dbecd1
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-22 21:50:02 +02:00
Bartosz Dunajski 8db8b09339 Use dedicated helper to detect ISA placement requirement
Change-Id: I701c64b52fddfef1e493f4adaef4edc28f5ffdf0
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-22 13:30:12 +02:00
Mateusz Hoppe 6ba7a3f6c1 Internal update
Change-Id: I84965fc114101683a63d7b2eae465a2f46e23603
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-22 09:03:27 +02:00
Aravind Gopalakrishnan 2e912aff52 Add device capability for timestamp valid bits
Change-Id: Ib4a0f4ce80f0fc3649f366ceb458e8f506a97e34
Signed-off-by: Aravind Gopalakrishnan <Aravind.Gopalakrishnan@intel.com>
2020-09-21 18:15:54 +02:00
Bartosz Dunajski 5b31b31734 Remove low priority and internal engine index variables
Change-Id: I984dbcedd5456cfdee284f4d2eda1371ba77f0d0
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-21 16:44:14 +02:00
Lukasz Jobczyk 9790c2991d Use new residency model by default
Related-To: NEO-5007

Change-Id: Id39ac53e00e126237200d80e493706e2eed53b30
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-21 08:09:11 +02:00
Mateusz Hoppe 2a18177ecb Minor fixes for compiler warnings
Change-Id: I25aa3a31d65e3055850c4731da77a83e3b7a41ab
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-19 10:59:52 +02:00
Mateusz Hoppe b7852303e8 Adding getter to BufferObject
Related-To: NEO-4964

Change-Id: I0bbac01cac9cf0468a78afba4ddc984ec8b55eb2
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-18 15:27:06 +02:00
Lukasz Jobczyk b81a78d0e9 Evict USM cpu allocation after migration
Related-To: NEO-5007

Change-Id: I3c91af3ca22cb6233d530b252cc0c75d8fc2f8b5
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-18 13:01:45 +02:00
Mateusz Hoppe 6ae58249a1 Change path in cmake
Related-To: NEO-4964

Change-Id: I21fd1568eee9bcecca583452917ebe7b17710bec
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-18 11:58:06 +02:00
Mateusz Hoppe eb287d87d7 Register Allocations
Related-To: NEO-4964

Change-Id: I792dd7f7d6d594f51701ec7a40b2c0d36531b02b
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-18 10:34:02 +02:00
Mateusz Jablonski 98c9e3f6ca Verify GL sharing based on luid from wglGetLuidINTEL function
Related-To: NEO-5016
Change-Id: I4409132ce000d6052c7f69a9b19c01389d51c2de
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-09-18 09:51:28 +02:00
Sebastian Luzynski 8260e7c5d9 Improve logging.
Change-Id: I4ca07fe6597fb72ffbd6c42d459415fe83658640
2020-09-18 09:29:47 +02:00
Lukasz Jobczyk a528908cbd Unbind unused resources when running out of memory
Resolves: NEO-5052

Change-Id: I3a07221b800317c79e65396443933d13d334a274
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-17 12:59:45 +02:00
Mateusz Hoppe d363448515 Interfaces to register resources
Change-Id: Ic587aaa5a41e4e7648211cfa730a0aa5bbc2985a
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-17 12:39:16 +02:00
Michal Mrozek 9981cdd9e2 Add new debug key for implicit flushes
Change-Id: Ifbf8903c383d16f62754655a5bc949f27d290c42
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2020-09-17 10:41:32 +02:00
Bartosz Dunajski c381f371cd Use BCS to copy ISA if required
Change-Id: I181e09d0356718c25162efdddede39b13399ed3b
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-17 10:34:06 +02:00
Vinod Tipparaju d2b218d82d Return ZE_RESULT_OUT_OF_MEMORY when alloc on device fails during cmdlist create
Change-Id: Ia03e7ac190598c56de044d3ad8216087b8da94f2
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2020-09-17 00:09:22 +05:30
Lukasz Jobczyk bf0ee40b69 Fix root device direct submission initialization
Related-To: NEO-5007

Change-Id: I4bac1a0a5e92982535f197c17d375050b484f8a2
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-16 13:49:42 +02:00
Zbigniew Zdanowicz 394e626db9 Refactor programming of surface states
Related-To: NEO-5069

Change-Id: Id7442fcdcc8c7df57f00e8dc383c11869bf1a677
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-16 11:54:00 +02:00
Lukasz Jobczyk 37c79dede8 Fix direct submission start on Linux
Related-To: NEO-5007

Change-Id: I60e6443d92ab1345d47c3438633a3bc41bf4ede6
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-15 15:33:55 +02:00
Maciej Dziuban 97ec64d22c Optimize first access to shared allocations
Change-Id: Ia3ce5f1e448128e7c9dfffb9ad49aaee15bdf948
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5059
2020-09-15 12:59:07 +02:00
Jaime Arteaga 57e462d8ee Remove legacy affinity mask format
Change-Id: I17e9ad131c888bdaceb7d14dd7b5aa9b5aec14d7
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-15 11:42:04 +02:00
Jaime Arteaga c5b214e554 Correct validation of error returned by mmap
mmap() on error returns MAP_FAILED, which is (void *)-1,
not nullptr

Change-Id: I7ed13fbf99b4a422e2586791a3a4d76234d7e3a6
Signed-off: Gengbin Zheng <gengbin.zheng@intel.com>
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-15 11:27:24 +02:00
Maciej Dziuban 7c7cfb1099 Delete unneeded memory transfer for USM
Change-Id: I7b11a132b621069febd5b851f9e29e7177d8d395
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5059
2020-09-14 16:13:58 +02:00
Pawel Wilma b54a5a795a Use appropriate DwordLength in MI_STORE_DATA_IMM command
Change-Id: I2d5a07e511f15e28acd6d0dfe7b84fac6dd8e9a3
Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-09-14 16:10:20 +02:00
Zbigniew Zdanowicz 7d506e3608 Add debug flag to enable compression in L0 USM allocations
Related-To: NEO-5069

Change-Id: Icbfeb8d72cd764bb3c90d5c699998455f81dd3ee
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-14 12:47:33 +02:00
Kamil Kopryk cbf838e5ab Remove unnecessary code
Change-Id: I7a38c1f2f65d650a566996bac1f8ff54c50d7bed
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2020-09-14 11:24:17 +02:00
Mateusz Hoppe 88ee48498b Use snprintf
Change-Id: Iece1320560e0f5a93f47cd67626435266de56ce9
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-10 09:21:01 -07:00
Kamil Diedrich 220ae46b8a Remove DEBUG_BREAK
Change-Id: Ibe1c152854d3c84b6cc0af50205ea730fcf4ad63
2020-09-10 14:57:31 +02:00
Mateusz Hoppe 0e7ec82577 UUIDs generation
Related-To: NEO-4964

Change-Id: I0ef5912fb744788f713803f539551c7b0b134208
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-10 13:57:05 +02:00
Lukasz Jobczyk b2ee148da9 Split residency task count and always resident flag
Related-To: NEO-5052

Change-Id: I1ae5f40a0e3ccc6fc269278f986709becccdaca6
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-10 12:28:18 +02:00
Jaime Arteaga 2527015bb8 Validate rootDeviceIndex before retrieving multiGraphicsAllocation
Change-Id: I4a5f6e8ae333e8daed13053fb2049fc5757736b5
Signed-off: Gengbin Zheng <gengbin.zheng@intel.com>
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-09 14:06:19 +02:00
Kamil Diedrich 5823450343 Refactor in queryKernelTimestamps
Change-Id: Icc0731c973fe797946eea06db29b0737ceef8778
2020-09-09 12:56:32 +02:00
Jim Snow 9f21418c4f Disable gemCloseWorker for internal DrmCommandStreamReceivers
Change-Id: I71abdcb417342110ddc64cc9b1dacecc24c78aac
Signed-off-by: Jim Snow <jim.m.snow@intel.com>
2020-09-09 12:31:24 +02:00
Kacper Nowak 5358f2cf9c Create a library with .spv kernels for L0 use
Change-Id: Ia319c5621e363f750159d58aaedd81e411d3babb
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2020-09-08 13:06:40 +02:00
Jaime Arteaga 9ceff528b5 Add toggle for enabling indirect access
Change-Id: I35d3e1580cd51fea5f6b139d524737e400f6e1bc
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-08 00:09:28 -07:00
Kamil Kopryk 145fd87f5d Revert "Add adjustPlatformCoreFamilyForIgc helper"
This reverts commit 8fffdcc111.

Change-Id: I0415b004ef0a1465bc2658cadc66f21a99302eca
2020-09-08 07:36:26 +02:00
Zbigniew Zdanowicz e910e28819 Add start override to Direct Submission debug flags
Related-To: NEO-5010

Change-Id: I6d690d3f1aef9ad377ad44db0f3be753ad831f63
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-07 21:21:31 +02:00
Jaroslaw Chodor a4ba92338a zebin - strip kernel name of quotes
Change-Id: If8054c01ea1992c0ba998e22b726b127c652beed
2020-09-07 18:25:36 +02:00
Jaroslaw Chodor 2d4468bb3b Ignore SHT_ZEBIN_GTPIN_INFO
Change-Id: I85c5bd52d96dce6603329bfe997a70dc5a432d3f
2020-09-07 18:04:37 +02:00
Jaroslaw Chodor 6c0da29670 Adding support for R_PER_THREAD_PAYLOAD_OFFSET_32
Change-Id: Iacd8d2f84b6f307b37dd09fe794357bf4fa44388
2020-09-07 17:51:42 +02:00
Maciej Dziuban abacd69def Optimize appendWriteGlobalTimestamp
Change-Id: Ia63a6324c3ce3dbdc18b790b3d9c2fbe4340e88c
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Resolves: NEO-5061
2020-09-07 17:25:59 +02:00
Jaime Arteaga 5c1e60208e Share USM host pointers among devices (2)
Dont pin and instantiate buffer objects associated with a USM
allocation for device >0 at allocation time, but instead, just
do a USERPTR ioctl, as with the allocation associated with
device 0.

Change-Id: Ib37f379df177d14e9d2781a3ed6335cd9550cc87
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-04 12:10:06 +02:00
Spruit, Neil R 3c44c6f942 Fix Windows Adapter Enumeration to ensure Render/Compute support
- On Windows, if one uses remote desktop to connect to their windows machine,
  then attempts to run compute workloads, a shadow intel graphics device
  is created and L0/OpenCL will report 2 devices for a single device.
- This second device is not valid and if used will cause workload failures.
- to ensure that only usable devices are reported by L0/OpenCL, we now check
  the Adapter for its Support in D3DKMT_ADAPTERTYPE which for our use must
  have RenderSupported. The Shadow devices only support display and not
  rendering/compute, so this check will avoid reporting a display only
  intel device for compute usage.

Change-Id: Ib619c454aea2deb91135e7958efbca1cee5a05eb
Signed-off-by: Spruit, Neil R <neil.r.spruit@intel.com>
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-09-04 12:00:47 +02:00
Lukasz Jobczyk 9ea9baf1ad Prepare to switch to new residency model
Related-To: NEO-5007

Change-Id: Ia9b43ca7fea0ef315af5caff5a53a84ffc363937
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-04 11:42:59 +02:00
Pawel Wilma 0e50c3f7bb WA for integer divide emulation on DG1
Resolves: NEO-5003

Change-Id: I2f0d6730cab53335f34ebd8e335a9517030d6441
Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-09-04 10:44:51 +02:00
Zbigniew Zdanowicz 8ad6a025fc Group debug keys to types used by keys
Change-Id: Idb13d8d6ff9692af8c34bf96bc23d16e0b58e9e2
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-04 10:28:16 +02:00
Lukasz Jobczyk 71f99f4174 Optimize mergeWithResidencyContainer method
Related-To: NEO-5007

Change-Id: I7145371c719ceeebf529fdf94a512a8398156591
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-04 09:04:09 +02:00
Kamil Diedrich 57269b97a3 Use global timestamps instead of local
Change-Id: Ie39b242915a55aef60fcf7164199647299c91a21
2020-09-03 16:39:36 +02:00
Koska 354720743b Enabling MTP on Gen12LP
Change-Id: I0ca08ea8dba3f34b5404ea598a16541d0128b37a
Signed-off-by: Koska <andrzej.koska@intel.com>
Related-To: NEO-4785
2020-09-03 13:47:34 +02:00
Vinod Tipparaju 083edd1a3e Thread safety violation fixes - Events & USM
Change-Id: I57de59f204d9fd4407be768d0b14bf579dae967d
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2020-09-03 08:54:34 +02:00
Piotr Zdunowski a568739061 Only use blitter on dg1 for allocations with no cpu pointer.
Change-Id: Id52df50f5630461ffc83097d7e74d402599bed56
Signed-off-by: Piotr Zdunowski <piotr.zdunowski@intel.com>
2020-09-02 17:43:52 +02:00
Mateusz Jablonski 442b6cfc47 Verify GL sharing based on primary display's luid
Resolves: NEO-5016
Change-Id: I244536fdd8acacfeb423ae09e13191df66c4f74a
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-09-02 17:14:13 +02:00
Piotr Zdunowski 48e7ca6102 Opensource RKL.
Resolves: NEO-5017

Change-Id: I29364aa331f802bd298bd08df440aa1e33dd3c4e
Signed-off-by: Piotr Zdunowski <piotr.zdunowski@intel.com>
2020-09-02 17:06:51 +02:00