Commit Graph

233 Commits

Author SHA1 Message Date
Dylan Baker 3689e49f4e run_project_tests: Fix it to actually work
This move the sorting logic into the TestDef class itself, which
simplifies sorting them.

Additionally it remove overcomplicated sort logic, because python
strings are compared character by character, we don't need to do the
split and cast to int, we know that realistically a maximum of 4
characters (the first 4 numbers) are going to be compared in most cases.
2020-02-07 09:29:02 -08:00
Daniel Mensinger 883262dbf6
tests: Added basic test matrix support for project tests 2020-02-05 12:11:32 +01:00
Jussi Pakkanen d8faf9b706
Merge pull request #6536 from jon-turney/cross-testing-refactor
Refactor CI cross-testing
2020-01-30 23:13:24 +02:00
Michael Hirsch, Ph.D 00f5dadd5b
Bugfix: sanitize_dir: use pathlib to handle case-insensitive filesystems (#6398) 2020-01-30 23:07:44 +02:00
Jon Turney ea805d4287
Make run_project_tests.py aware of --cross-file option 2020-01-28 21:42:06 +00:00
Daniel Mensinger 375a51712b
cmake: Some test improvements 2020-01-26 18:23:41 +01:00
Nirbheek Chauhan 2c8e676e2b tests: Fix some test failures on Ubuntun 16.04 CI
* xenial doesn't ship many dependencies, so make them all optional
  since we don't guarantee that everything will work
* cmake/{5,6}: needs stdlib.h for EXIT_SUCCESS on GCC 5
* common/222: needs C++11, and GCC 5 doesn't understand `auto`
  correctly unless we explicitly enable it.
* frameworks/1 boost: xenial doesn't ship boost_python3, so make it
  properly optional
* frameworks/6 gettext: gettext can be installed without xgettext,
  which doesn't cause the project to fail, but the installed files
  list is different which causes the test to fail.
* frameworks/7 gnome: gobject-introspection can't be enabled because
  the sanitizer unit test detects leaks in glib and fails
2020-01-24 02:53:34 +05:30
Daniel Mensinger 09b53c534f types: import typing as T (fixes #6333) 2020-01-08 15:28:17 +01:00
Michael Hirsch, Ph.D a910ba133a
doc: cuda windows comment 2019-12-23 17:25:14 -05:00
Jussi Pakkanen 17dd9e5bff
Merge pull request #6207 from dcbaker/linker-option
Add a way to select the dynamic linker meson uses
2019-12-11 23:29:33 +02:00
Michael Hirsch, Ph.D 8be7278855 run_project_tests: argparse(choices) for --only name check 2019-12-07 21:21:25 +02:00
Jussi Pakkanen 06cc98ab54
Merge pull request #6228 from scivision/scalapack
deps: add Scalapack
2019-12-07 21:17:53 +02:00
Daniel Mensinger 379d633ef2 lgtm: fix Unreachable code 2019-12-05 00:22:10 +02:00
Dylan Baker 39efd97714 run_project_tests: Fix skip rust
which expects an argument of backend, but isn't getting one.
2019-12-03 13:08:42 -08:00
Michael Hirsch, Ph.D 3120481d77
CI: scalapack not skippable since it's now in Docker image 2019-11-30 21:37:45 -05:00
Michael Hirsch, Ph.D 92b77cb321
deps: add scalapack
Scalapack uses a library stack that can be challenging to manage.
Not least of all since many Scalapacks ship with broken / incomplete
pkg-config files and CMake FindScalapack.cmake

This resolves those issues for typical Scalapack setups including:

* Linux: Intel MKL or OpenMPI + Netlib
* MacOS: Intel MKL or OpenMPI + Netlib
* Windows: Intel MKL (OpenMPI not available on Windows)
2019-11-30 21:29:49 -05:00
Daniel Mensinger 9435f11b17
ci: Add CI command to include text files in the CI log 2019-11-19 15:21:13 +01:00
Michael Hirsch, Ph.D 1baa1c9222 use '-Werror=unused-parameter' for gcc/clang on project tests and -fimplicit-none on fortran
Fortran: check for undeclared variables by forcing implicit none everywhere
C/C++: check for unused parameters and return types

removed unused variables from test cases

ci: do missing return and unused arg check with Github Actions
2019-11-17 13:24:42 +02:00
Daniel Mensinger 892c8ebe65
run_project_tests: Added print_tool_versions() 2019-10-20 12:04:15 +02:00
Dylan Baker 0c22798b1a compilers: replace CompilerType with MachineInfo
Now that the linkers are split out of the compilers this enum is
only used to know what platform we're compiling for. Which is
what the MachineInfo class is for
2019-10-07 12:08:20 -07:00
Patrick Griffis 1670fca36f Add blocks dependency
This allows easily enabling the blocks clang extension.
2019-09-23 21:10:00 +03:00
Michael Hirsch, Ph.D 3447767cac
PGI: windows PGI is sort of MSVC-like 2019-09-05 11:50:23 -04:00
Dylan Baker 25e32b56fb tests: add wasm to run_project_tests --only 2019-08-12 10:40:09 -07:00
Jussi Pakkanen f39600647d Condense test directory names. 2019-08-03 02:29:44 +03:00
Michael Hirsch, Ph.D b5e9ab8ed0
fortran tests: non-gfortran compilers on Windows are best static libs
collapsed get_relative_files_list_from_dir to a one-liner via pathlib.Path
2019-07-30 03:17:14 -04:00
Michael Hirsch, Ph.D 667cc80f72
run_tests: ifort / intel-cl must have ninja backend 2019-07-30 03:14:25 -04:00
Michael Hirsch, Ph.D 3d18da0de3
actually failfast, was not failing fast before 2019-07-30 03:14:24 -04:00
Daniel Mensinger 3b2126531a cmake: added test case for environment variables 2019-07-23 05:50:55 +00:00
Michael Hirsch, Ph.D cb7d236696 pythonic file checks 2019-07-11 22:37:25 +03:00
Jussi Pakkanen b1fbbde0b0 Use pytest parallelisation if available. 2019-07-09 22:38:30 +03:00
Jussi Pakkanen 4b1ab96795 Add command line argument to skip unit tests. 2019-07-09 22:03:58 +03:00
Michael Hirsch, Ph.D 5b109c9ad2 correct missing argument for IntelClFortranCompiler
ifort passes all tests

cleanup logic
2019-06-24 14:06:32 -04:00
Michael Hirsch, Ph.D 40a3a6c3d0 only --only option to run_project_tests, add type hints, improve variable name use 2019-06-23 18:22:43 +03:00
Michael Hirsch, Ph.D d61116efc1 windows project_test speedup by 2 2019-06-23 17:33:28 +03:00
Jussi Pakkanen 80856884cc Do not check for DOS line endings in log files. 2019-06-22 22:11:28 +03:00
Jussi Pakkanen 6d6acab6fe Detect broken Rust compiler setups. 2019-06-22 00:16:20 +03:00
John Ericson 07777e15d4 Purge `is_cross` and friends without changing user interfaces
In most cases instead pass `for_machine`, the name of the relevant
machines (what compilers target, what targets run on, etc). This allows
us to use the cross code path in the native case, deduplicating the
code.

As one can see, environment got bigger as more information is kept
structured there, while ninjabackend got a smaller. Overall a few amount
of lines were added, but the hope is what's added is a lot simpler than
what's removed.
2019-06-09 13:13:25 -04:00
John Ericson 32e827dcdc Use `env.machines.*` to avoid some `is_cross`
This is a small example of the `is_cross` removal the that abstraction
enables.
2019-06-09 13:13:20 -04:00
Daniel Mensinger 703054903b
cmake: disable the CMake tests for msvc2015 2019-06-06 18:27:05 +02:00
Daniel Mensinger 493e505d58
cmake: better logging 2019-06-06 18:27:04 +02:00
Daniel Mensinger cb57847c30
cmake: fixed installed_files.txt 2019-06-06 18:27:03 +02:00
Daniel Mensinger bf81aac465
cmake: Added project tests 2019-06-06 18:27:02 +02:00
Joel Rosdahl f13e65b93a Update to new ccache URL
ccache’s web site is now located at https://ccache.dev.

Bonus: Use the preferred capitalization “Ccache” instead of “CCache”.
2019-05-27 01:10:57 +03:00
Dylan Baker f5ea341319 compilers/clike: ICL needs msvc workarounds in has_function 2019-05-13 11:22:31 -07:00
Jussi Pakkanen b0f90a793f Better detection of tab indentation.
"But surely nobody would indent by having spaces first,
and tabs after that. Right? Right?"
2019-05-09 22:38:44 +03:00
Jussi Pakkanen 1f4023fa47
Merge pull request #5311 from mensinda/flake8Plugins
Added flake8 plugins and some code fixes
2019-05-02 23:30:29 +03:00
Michael Hirsch, Ph.D 06bfc2dab6 per-target manual specification of link_language 2019-05-02 23:26:51 +03:00
Daniel Mensinger 3581839f4c
Fix unused variables warnings 2019-04-29 12:22:50 +02:00
Daniel Mensinger bf98ffca9e
Fix blind exceptions 2019-04-29 12:16:06 +02:00
Jon Turney 744ca13ddb
Don't always skip objc/objc++ tests on Windows
These tests can run under MSYS2 using gcc or clang objc/objc++.
2019-04-15 12:07:17 +01:00
Jon Turney 1e9b753c95
Report detected compilers in run_project_tests
v2:
Use compilers.all_languages for the list of known languages
2019-04-15 12:06:58 +01:00
Ari Vuollet 5ee2fb6ede d: Fix linker errors with shared libraries on Windows 2019-04-03 19:59:24 +03:00
John Ericson f53f58f54e Always initialize compiler_options before sanity_check
This is because sanity checking wants to use CFLAGS and friends.
2019-03-27 10:54:56 -04:00
Jussi Pakkanen ed5992a10d
Merge pull request #5031 from bonzini/kconfig
Kconfig Module
2019-03-20 22:03:47 +02:00
Paolo Bonzini 7a02b76e70 interpreterbase: protect string division with FeatureNew
Meson is not warning if you join paths with / but you are requesting a
version older than 0.49.0; fix this before adding more features to the
division operator.

Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>
2019-03-18 10:51:44 -07:00
Mark Schulte 647bd2839e [modules] Add kconfig module
Add a kconfig module to allow meson to integrate with existing projects
that use kconfig.
2019-03-15 11:42:36 +01:00
Dylan Baker e7c4601fe3 tests: disable Dlang tests on windows
These don't work and no one has fixed them. When I've tried to
download dmd for windows I can't get a valid installer from their
website. Let's at least turn the CI green.
2019-03-13 23:18:09 +02:00
Michael Hirsch, Ph.D 71cffa67fa add NetCDF 2019-02-28 22:13:38 +02:00
Jussi Pakkanen a81207881b Disable D tests if dmd install is broken. 2019-02-26 01:26:54 +02:00
Dylan Baker 097faee83b run_project_tests: add support for loading cross files 2019-02-04 14:42:55 -08:00
Dylan Baker 30cf4f9c3a run_project_tests: Add support for loading a native file in tests
The file must be called nativefile.txt
2019-02-04 14:42:55 -08:00
Nirbheek Chauhan 042f5638bf project tests: qt is available on the macOS CI 2019-02-01 00:14:09 +05:30
Jussi Pakkanen 8eca221aac More tests and pic. 2019-01-21 23:35:38 +02:00
Dylan Baker 978e6fb88f tests: Add tests for the python module
This doesn't touch everything as it's just based on the python3 module
tests, ported to the python module. It's still better than the one very
basic test in the unit test module.
2018-12-12 12:23:37 -08:00
Jon Turney 94cdb68a3a
Deal with clang-cl generating empty implibs
Deal with clang-cl doing the sane (but different to MSVC) thing, of
generating an empty import library, rather than silently ignoring
/IMPLIB when there are no exports.
2018-11-06 13:19:44 +00:00
Jon Turney 5d51329d27
Extend test to when both name_{suf,pre}fix: are used 2018-11-06 13:17:21 +00:00
Jon Turney b17f6dae54
Add a test of installed library names when name_{suf,pre}fix: is used
Extend platform_fix_name() to handle this case

We avoid using library(version:), so we don't have to teach
platform_fix_name() all the platform details of versioned shared library
naming.  Hopefully that's exercised by platform-specific tests...
2018-11-06 13:17:12 +00:00
Jon Turney 3c38e46774
Use compiler detector in detect_system_compiler()
Use the compiler detector in detect_system_compiler(), rather than trying to
guess based on what it is the PATH (which could utterly fail e.g when CC env
var is set)

Note that this detection is only used by platform_fix_name() to interpret
installed_files.txt
2018-11-04 15:42:06 +00:00
Jussi Pakkanen 252bf6c52e
Merge pull request #4340 from jon-turney/azure-pipelines
Add Azure pipelines CI
2018-10-14 23:16:46 +03:00
Jon Turney 459b81de46
Use 'CI' environment variable to detect CI environment
Use the 'CI' environment variable to detect CI environment, rather than a
collection of CI-specific ones.
2018-10-14 16:01:36 +01:00
Niklas Claesson d964da79e7 tests: Merge backend guessing into one function 2018-10-10 21:32:02 +02:00
Niklas Claesson 4911a51aa2 Add option to fail fast in tests 2018-10-10 21:19:06 +02:00
Xavier Claessens 37067a53c4 Use a single ArgumentParser for all subcommands
This has the adventage that "meson --help" shows a list of all commands,
making them discoverable. This also reduce the manual parsing of
arguments to the strict minimum needed for backward compatibility.
2018-10-04 09:40:21 -04:00
Guillermo Ignacio Enriquez Gutierrez 5262aac977 Skip all dot files/directories when running tests 2018-09-25 01:14:48 +09:00
Guillermo Ignacio Enriquez Gutierrez b8581b7b67 Fix test script to be able to run in local macos 2018-09-22 22:45:34 +09:00
Marco Trevisan (Treviño) 0fc9a60189 run_proect_tests: add cygwin as platform fix name 2018-09-14 22:35:46 +02:00
Marco Trevisan (Treviño) 81e7a0981b run_project_tests: remove pdb workaround, just use filters
And ignore .dll.a files in non cygwin gcc instances
2018-09-14 20:19:35 +02:00
Marco Trevisan (Treviño) c677925dc1 run_projects_tests: Fail if we install extra files even if not in cl
As per commit 2340fd3, unexpected installed files are not reported anymore when
using compilers other than 'cl', this regression was introduced in the attempt
of not reporting extra .pdb files, but actually caused any non extra .pdb file
in other compilers to be ignored.

Fix boolean test, by reporting any extra file a part '.pdb' ones under non 'cl'
compiler, while anyone under 'cl'.
2018-09-12 21:31:26 -05:00
Jussi Pakkanen e8932adb14 Do not scan test logs. Closes #4046. 2018-08-19 14:00:40 +03:00
Jussi Pakkanen 11b520feda Scan markdown files for tabs. 2018-08-19 14:00:40 +03:00
Jussi Pakkanen 972535a6ac Condense test dirs. 2018-08-19 12:39:46 +03:00
Jussi Pakkanen b400cbe058 Kill tabs dead! For good! 2018-08-15 22:28:42 +03:00
Jussi Pakkanen 17bfbb99e5 Condense test dirs. 2018-07-31 19:22:24 +03:00
Jussi Pakkanen 2bc0f56b21 Write full directory name in files so script will change them. 2018-07-31 19:17:49 +03:00
Xavier Claessens f4d60acaa9 Remove had_argument_for() it is not used anymore
This also means we don't need to keep original command line arguments
anymore.
2018-06-06 20:02:37 +00:00
Filipe Brandenburger 862e1dd838 Add test case for 'install_mode'
This is a simple test case, checking for installed_files.txt, which just
makes sure the syntax is accepted.

Manual tests confirmed the permissions were set correctly.

A follow up commit adds a unit test based on this directory.
2018-06-02 04:50:32 +00:00
Nirbheek Chauhan 0a035dea6d Set the meson command to use when we know what it is
Instead of using fragile guessing to figure out how to invoke meson,
set the value when meson is run. Also rework how we pass of
meson_script_launcher to regenchecker.py -- it wasn't even being used

With this change, we only need to guess the meson path when running
the tests, and in that case:

1. If MESON_EXE is set in the env, we know how to run meson
   for project tests.
2. MESON_EXE is not set, which means we run the configure in-process
   for project tests and need to guess what meson to run, so either
   - meson.py is found next to run_tests.py, or
   - meson, meson.py, or meson.exe is in PATH

Otherwise, you can invoke meson in the following ways:

1. meson is installed, and mesonbuild is available in PYTHONPATH:
   - meson, meson.py, meson.exe from PATH
   - python3 -m mesonbuild.mesonmain
   - python3 /path/to/meson.py
   - meson is a shell wrapper to meson.real
2. meson is not installed, and is run from git:
   - Absolute path to meson.py
   - Relative path to meson.py
   - Symlink to meson.py

All these are tested in test_meson_commands.py, except meson.exe since
that involves building the meson msi and installing it.
2018-06-01 19:20:04 +00:00
Mathieu Duponchelle 14750b50ea configure_file: Add output_format kwarg (#3636)
* configure_file: Add output_format kwarg

* docs: Reference-manual.md output_format was added in 0.47 [skip ci]
2018-06-01 17:53:07 +00:00
Nirbheek Chauhan f56b402a5b Revert "mesonlib: handle meson exe wrappers"
This reverts commit 0627e9d616.

Breaks installation: https://github.com/mesonbuild/meson/issues/3647

Will be restored once that can be fixed.
2018-05-31 15:40:10 +05:30
Martin Kelly 0627e9d616 mesonlib: handle meson exe wrappers
There are cases when it is useful to wrap the main meson executable with
a script that sets up environment variables, passes --cross-file, etc.
For example, in a Yocto SDK, we need to point to the right meson.cross
so that everything "just works", and we need to alter CC, CXX, etc. In
such cases, it can happen that the "meson" found in the path is actually
a wrapper script that invokes the real meson, which may be in another
location (e.g. "meson.real" or similar).

Currently, in such a situation, meson gets confused because it tries to
invoke itself using the "meson" executable (which points to the wrapper
script) instead of the actual meson (which may be called "meson.real" or
similar). In fact, the wrapper script is not necessarily even Python, so
the whole thing fails.

Fix this by using Python imports to directly find mesonmain.py instead
of trying to detect it heuristically. In addition to fixing the wrapper
issue, this should make the detection logic much more robust.
2018-05-30 18:29:16 +00:00
Niklas Claesson ecbeae565b Enable running tests that fail at 'meson test' 2018-05-23 23:30:07 +03:00
Niklas Claesson ceeae58225 Prettifying some output with pathlib 2018-04-26 23:14:58 +03:00
Jussi Pakkanen 824650411e Final encoding fix.
I sincerely hope sufficient amounts of goats have now been sacrificed
at the altar of Debian Locales so things will actually work and I
can get to sleep.
2018-04-23 01:40:20 +03:00
Jussi Pakkanen c7e2549e59 If printing debug printing fails, try again in pure ASCII. 2018-04-23 00:02:17 +03:00
Jussi Pakkanen 166ed40097 Explicitly open log files in utf-8. 2018-04-22 21:53:22 +03:00
Elliott Sales de Andrade 8dd6b8c7ed Fix install checks when cross-compiling.
It checks the build machine for the correct extensions of resulting
binaries, but it should be checking the host machine.
2018-04-21 16:58:55 +03:00
Jukka Laurila 31df4ae164 Default run_project_tests backend to ninja instead of xcode on OS X.
The xcode backend is still incomplete and fails many tests.
2018-03-09 00:26:14 +02:00
Jon Turney 16f80b4c50 Enable 'test cases/frameworks/10 gtk-doc' for gtkdoc >= 1.26
Enable 'test cases/frameworks/10 gtk-doc' if gtkdoc version is 1.26 or
later.

Old versions of gtkdoc-scan also output the version to stdout rather than
stderr, so be sure to handle that...
2018-02-27 20:43:51 +02:00
Jussi Pakkanen 67f3f80362 Determining whether to run C# tests is so difficult it deserves its own function. 2018-02-25 12:15:59 +02:00
Thibault Saunier c48b9594ff Add support for Visual Studio csc c# compiler 2018-02-25 01:10:52 +02:00