c46c1e74ad
run_tests.py: Haiku has no nice().
2017-09-14 00:11:17 +03:00
192d0dd0a7
unit tests: Select test cases inside run_unittests.py
...
This allows people to directly run ./run_unittests.py without having
to worry about selecting the right test cases for the platform they
are on.
2017-08-13 21:16:22 +03:00
d94e06db21
Merged singleexe branch.
2017-08-06 17:00:51 +03:00
b5d829e5ac
Print system information to aid in debugging remote machines.
2017-08-06 13:07:34 +03:00
59a35c4c53
Print deprecation warnings on old style commands.
2017-08-02 22:01:13 +03:00
5eb64a6f3e
Revert "Merge pull request #1931 from centricular/use-patched-ninja"
...
This reverts commit aab7ada356e1b24765af
2017-07-18 00:30:52 +02:00
b5a79b491e
tests: Restore sleep for ninja on HFS+ (macOS)
...
QuLogic discovered that HFS+ only stores dates in uint32 seconds since
the epoch, so ninja cannot report sub-1s resolution timestamps there.
Sometime in the future Apple FS will become widely-available and we
will have to add a filesystem check at startup.
https://developer.apple.com/legacy/library/technotes/tn/tn1150.html#HFSPlusDates
2017-07-17 14:23:59 +05:30
6582cd28c8
CI: Use QuLogic's Ninja patches
...
This way we get some testing for the patches, and speed up our builds.
My server is hosted on a UK Linode, so it should have good uptimes.
However, we should likely move this into the Docker image at least
for Linux, and perhaps put it in a CI cache for the rest.
2017-07-17 14:23:59 +05:30
a681348b05
Add some colour to test output.
...
Bold the section names and colourize errors&skips.
2017-06-22 06:04:59 -04:00
3a33a8ef49
unit tests: Add class to generate failing tests
...
It is not feasible to test all failure modes by creating projects in
`test cases/failing` that would be an explosion of files, and that
mechanism is too coarse anyway. We have no way to ensure that the
expected error is being raised.
See FailureTests.test_dependency for an example.
2017-06-09 20:21:01 +05:30
0c83f8352d
dependencies: Add a new class ExternalDependency
...
This class now consolidates a lot of the logic that each external
dependency was duplicating in its class definition.
All external dependencies now set:
* self.version
* self.compile_args and self.link_args
* self.is_found (if found)
* self.sources
* etc
And the abstract ExternalDependency class defines the methods that
will fetch those properties. Some classes still override that for
various reasons, but those should also be migrated to properties as
far as possible.
Next step is to consolidate and standardize the way in which we call
'configuration binaries' such as sdl2-config, llvm-config, pkg-config,
etc. Currently each class has to duplicate code involved with that
even though the format is very similar.
Currently only pkg-config supports multiple version requirements, and
some classes don't even properly check the version requirement. That
will also become easier now.
2017-06-09 20:21:01 +05:30
17328e7019
Add coverage export for tests.
2017-05-21 16:11:31 -04:00
b595cda4ed
Fix cross environment pollution.
...
Environment variables like CFLAGS and LDFLAGS should not affect the
cross environment.
Fixes #1772
2017-05-21 23:04:19 +03:00
1570a90822
project tests: Also regen before building
...
This actually caught a cached-dependency related bug for me that the
test-time regen did not. I also increased the ninja wait time to
1 second because that's actually how long you need to sleep to be
guaranteed that a change will be detected.
Must poke upstream about https://github.com/ninja-build/ninja/issues/371
2017-05-09 14:23:15 +05:30
5791cb7c4b
unit tests: exe_suffix is '.exe' on Cygwin
2017-04-09 23:38:58 +05:30
4f0d42967e
tests: Move appveyor platform workaround to run_tests.py
...
This is also needed for the unit tests
2017-04-09 23:11:36 +05:30
f80d471345
unit tests: Fix running specific targets with MSBuild
...
/t:targetname syntax doesn't work, but running the vcxproj does work
Also use the Backend enum everywhere.
2017-04-09 23:11:36 +05:30
a331bf1162
unit tests: Run on all backends, not just Ninja
2017-04-09 23:11:05 +05:30
7e4a67c790
run_project_tests: Clean on backends that can't install
...
Also sets more groundwork for running unit tests with backends other
that Ninja.
Transferring global state to executors is totally broken in Python 3.4
so just serialize all the commands.
2017-04-09 23:11:05 +05:30
d755228afe
tests: Factor out common code to run_tests
...
And use generic build/clean/test/install commands in the unit tests,
just like project tests. This sets the groundwork for running the unit
tests with all backends.
2017-04-09 23:08:42 +05:30
4646958917
run_tests: Improve the backend detection
2017-04-09 23:07:49 +05:30
8df671b6f3
run_tests: Don't run unit tests when the VS backend is selected
2017-03-30 00:49:29 +05:30
98af711ca6
Merge pull request #1403 from centricular/compile_resources
...
Make configure_file() great again
2017-02-20 14:27:06 -05:00
2a64a2d00c
run_tests.py: Nice down when running on a dev machine
...
To avoid destroying productivity.
2017-02-20 23:32:04 +05:30
18bce47691
find_program: Correctly use scripts found in PATH
...
We also need to check whether the program found in PATH can be executed
directly by Windows or if we need to figure out what the interpreter is
and add it to the list.
Also add `msc` to the list of extensions that can be executed natively
Includes a project test and a unit test for this and all expected
behaviours on Windows.
2017-02-18 02:38:54 +05:30
82057ccd55
Add unit tests related to absolute prefixes
...
Also split the unit tests into those that are actually Linux-specific
and those that are not and can (and should) run on all platforms. This
will give us much better coverage since a lot of these test
platform-specific code in Meson that wraps features that we expose in
a platform-agnostic way.
Tests are for:
https://github.com/mesonbuild/meson/issues/1341
https://github.com/mesonbuild/meson/issues/1345
https://github.com/mesonbuild/meson/issues/1349
2017-02-18 02:37:32 +05:30
bbbc4e336b
Run some unit tests on all platforms
...
InternalTests can be run on all platforms since they have nothing
Linux-specific.
2017-01-30 03:19:41 +05:30
92f8e0ab31
Do not run arm cross compilation tests on arm.
2016-12-31 14:04:58 +02:00
7aa314368f
Some merge conflicts are logical. Such as this one was.
2016-12-21 00:28:57 +02:00
a2528a8816
Merge pull request #1233 from mesonbuild/wip/ignatenko/code-style
...
Trivial cleanups in code
2016-12-21 00:09:44 +02:00
2b65083463
Fix cross test and run them if a cross compiler is available.
2016-12-20 20:33:59 +02:00
8268eb4959
tree-wide: remove unused imports
...
./setup.py:17:1: F401 'os' imported but unused
import os
^
./setup.py:37:1: F401 'stat.ST_MODE' imported but unused
from stat import ST_MODE
^
./run_tests.py:17:1: F401 'os' imported but unused
import subprocess, sys, os
^
./run_tests.py:18:1: F401 'shutil' imported but unused
import shutil
^
./run_unittests.py:23:1: F401 'mesonbuild.dependencies.Qt5Dependency' imported but unused
from mesonbuild.dependencies import PkgConfigDependency, Qt5Dependency
^
./mesonbuild/build.py:15:1: F401 '.coredata' imported but unused
from . import coredata
^
./mesonbuild/interpreter.py:32:1: F401 'subprocess' imported but unused
import os, sys, subprocess, shutil, uuid, re
^
./mesonbuild/interpreter.py:32:1: F401 're' imported but unused
import os, sys, subprocess, shutil, uuid, re
^
./mesonbuild/dependencies.py:23:1: F401 'subprocess' imported but unused
import os, stat, glob, subprocess, shutil
^
./mesonbuild/mesonlib.py:17:1: F401 'sys' imported but unused
import platform, subprocess, operator, os, shutil, re, sys
^
./mesonbuild/modules/qt5.py:15:1: F401 'subprocess' imported but unused
import os, subprocess
^
./mesonbuild/modules/pkgconfig.py:15:1: F401 '..coredata' imported but unused
from .. import coredata, build
^
./mesonbuild/scripts/scanbuild.py:15:1: F401 'sys' imported but unused
import sys, os
^
./mesonbuild/scripts/meson_exe.py:20:1: F401 'subprocess' imported but unused
import subprocess
^
./mesonbuild/scripts/meson_exe.py:22:1: F401 '..mesonlib.MesonException' imported but unused
from ..mesonlib import MesonException, Popen_safe
^
./mesonbuild/scripts/symbolextractor.py:23:1: F401 'subprocess' imported but unused
import os, sys, subprocess
^
./mesonbuild/scripts/symbolextractor.py:25:1: F401 '..mesonlib.MesonException' imported but unused
from ..mesonlib import MesonException, Popen_safe
^
./mesonbuild/scripts/meson_install.py:19:1: F401 '..mesonlib.MesonException' imported but unused
from ..mesonlib import MesonException, Popen_safe
^
./mesonbuild/scripts/yelphelper.py:15:1: F401 'sys' imported but unused
import sys, os
^
./mesonbuild/scripts/yelphelper.py:20:1: F401 '..mesonlib.MesonException' imported but unused
from ..mesonlib import MesonException
^
./mesonbuild/backend/vs2010backend.py:17:1: F401 're' imported but unused
import re
^
./test cases/vala/8 generated sources/src/copy_file.py:3:1: F401 'os' imported but unused
import os
^
./test cases/common/107 postconf/postconf.py:3:1: F401 'sys' imported but unused
import sys, os
^
./test cases/common/129 object only target/obj_generator.py:5:1: F401 'shutil' imported but unused
import sys, shutil, subprocess
^
./test cases/common/57 custom target chain/usetarget/subcomp.py:3:1: F401 'os' imported but unused
import sys, os
^
./test cases/common/95 dep fallback/subprojects/boblib/genbob.py:3:1: F401 'os' imported but unused
import os
^
./test cases/common/98 gen extra/srcgen.py:4:1: F401 'os' imported but unused
import os
^
./test cases/common/113 generatorcustom/gen.py:3:1: F401 'os' imported but unused
import sys, os
^
./test cases/common/113 generatorcustom/catter.py:3:1: F401 'os' imported but unused
import sys, os
^
./test cases/common/59 object generator/obj_generator.py:5:1: F401 'shutil' imported but unused
import sys, shutil, subprocess
^
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2016-12-19 18:19:35 +01:00
afe00697fa
Run unittests only with default compiler.
2016-11-01 15:26:23 -07:00
8faf0414ce
Some fixes to unittest running.
2016-10-12 21:11:56 +03:00
f90bfa5245
Review fixes.
2016-10-09 14:41:47 -04:00
3a002709f4
Pass cmd line args onwards.
2016-10-08 08:06:59 -04:00
b11a5b93cb
Store all invocation output. Not shown to users yet.
2016-10-08 07:54:37 -04:00
c7936f6819
Run unittests.
2016-10-08 07:44:19 -04:00
81423270f5
run_tests: Print stdo and stde in failing test logs
...
This is a superset of the mlog output, and also contains the ninja
output and the test output.
2016-10-07 11:53:24 +05:30
c334eeda76
Merge pull request #684 from mesonbuild/pdb
...
Create pdb files with MSVC
2016-09-11 13:04:55 +03:00
91c5f07a8e
run_tests.py: Ignore .pdb files while validating install
...
Their presence depends on build options and compiler, and we don't
currently have the test infrastructure to deal with this.
2016-09-11 10:10:48 +05:30
aec1e88c21
Use context manager in test cases.
2016-08-30 04:17:46 -04:00
56823272ab
Implement D support
...
This patch adds support for the D programming language[1] to Meson.
The following compilers are supported:
* LDC
* GDC
* DMD
[1]: http://dlang.org/
2016-08-19 03:02:51 +02:00
f3c793b9c1
Added test for a prebuilt static library and a declare_dependency that uses it.
2016-07-25 22:00:38 +03:00
88aafd363e
Normalize the path of a configured file to avoid dupes ( #640 )
2016-07-19 20:10:57 +03:00
cc4826b85f
run_tests.py: Make 'no-installed-files' stricter
...
When the file 'no-installed-files' is installed, require that the test
not install any other files. A test for this is pending.
2016-07-13 01:17:46 +05:30
45c8557dc6
Fix tests for the new library/executable naming scheme
...
Also add new tests for the platform-specific and compiler-specific
versioning scheme.
A rough summary is:
1. A bug in how run_tests.py:validate_install checked for files has been
fixed. Earlier it wasn't checking the install directory properly.
2. Shared libraries are no longer installed in common tests, and the
library name/path testing is now done in platform-specific tests.
3. Executables are now always called something?exe in the
installed_files.txt file, and the suffix automatically corrected
depending on the platform.
4. If a test installs a file called 'no-installed-files', the installed
files for that test are not validated. This is required to implement
compiler-specific tests for library names/paths such as MSVC vs MinGW
5. The platform-specific file renaming in run_tests.py has been mostly
removed since it is broken for shared libraries and isn't needed for
static libraries.
6. run_tests.py now reports all missing and extra files. The logic for
finding these has been reworked.
2016-07-01 20:50:47 +05:30
d61656d43c
Fix typo argument order to TestRunner ( #615 )
2016-06-24 13:44:07 +03:00
436eab9b85
Print full mesonlog on failed tests when run under CI.
2016-06-23 00:03:59 +03:00
15ab984d8e
Finish appveyor integration by moving static library in a subdir to avoid clashes.
2016-06-13 22:50:47 +03:00
1e9e91f25a
Print full log when failures happen under Appveyor.
2016-06-13 22:27:12 +03:00
0bc0056064
Merge pull request #577 from nioncode/vs2015
...
Implement vs2015 backend
2016-06-05 13:00:57 +03:00
3bedca0257
add vs2015 backend
2016-05-30 21:49:35 +02:00
37c5d45d07
Print all of the things when CI fails.
2016-05-30 22:29:27 +03:00
4a102fd445
cancel all pending test cases when interrupted by signals
2016-05-25 23:38:15 +02:00
1d2b4ed8e9
simplify unit test output ( #506 )
...
Print status on single line
only print a single line for succeeded tests and two lines for failed
tests. This makes it easier to scan the output for failed tests.
2016-04-07 20:26:53 +03:00
435700aeb0
add exponential backoff for deleting temp directories
2016-04-06 21:39:51 +02:00
5decddf09f
fix off by one, since range() does not include the end of the range
2016-04-06 21:35:51 +02:00
32e0973ef1
fix randomly failing test execution on Windows
...
shutil.rmtree, which is used by tempfile.TemporaryDirectory, randomly fails
on Windows, because the directory is not empty although it should be,
because all files were deleted by shutil.rmtree internals before trying to
remove the directory.
A simple retry approach fixes the issue.
2016-04-06 12:38:39 +02:00
42e6b78351
do not print anything during tests
...
Otherwise, output from parallel tests might interleave. Let the main loop
handle printing of additional info.
2016-04-05 23:05:09 +02:00
ff9d879eea
properly fix Windows parallel tests by not using global variables
...
The _run_test method uses several global variables (unity_flags,
backend_flags, compile_commands, install_commands) which are
not set when the method is run by the executor (at least on Windows).
To resolve this, pass the variables as method parameters.
2016-04-05 23:02:15 +02:00
eb69b268d4
Revert "Fix Windows. Again."
...
This reverts commit e522a9f268
2016-04-05 22:03:57 +02:00
e522a9f268
Fix Windows. Again.
2016-04-01 23:27:50 +03:00
a7e9301215
Output is all pretty again.
2016-04-01 23:06:58 +03:00
81e37e1220
Run tests in parallel.
2016-04-01 23:06:19 +03:00
9587715585
Fix Windows.
2016-04-01 22:51:36 +03:00
ea092fefc2
Use individual tempdirs for building and installing in unit tests.
2016-04-01 20:20:48 +03:00
5b3c9e262b
Check option files too.
2016-03-20 22:52:46 +02:00
5482a23936
enhance test framework to read meson arguments from a file per test
...
A 'test_args.txt' file in the same directory as the test case will be
parsed by the test framework and the content will be passed as arguments
to meson during configuration. The arguments are put before any
'extra_args' to make them overwritable from the command line.
2016-03-12 17:41:42 +01:00
455e55f8e5
Back to .py suffix in files. Closes #394 .
2016-03-02 21:49:29 +02:00
ea60a22cd5
Merge Python 3 module support.
2016-02-26 21:21:53 +02:00
681a14a695
use sys.stdout.encoding when parsing subprocess output
2016-02-22 22:58:17 +01:00
a8120eb519
Added plain Python sample project.
2016-02-21 14:52:36 +02:00
23b98cd6e6
Renamed meson package to mesonbuild so that we can have a script named meson in the same toplevel dir.
2016-01-16 17:35:29 +02:00
4c31e7774d
Finalize moduleification so that full test suite runs.
2016-01-16 00:04:57 +02:00
a5508d3fd3
Can run most of test suite (with hacks).
2016-01-15 21:43:15 +02:00
8b1039fa30
Organise files into a module structure.
2016-01-15 21:22:09 +02:00
c86ee8158a
Make vs dependency detector work on non-english locales.
2015-12-18 17:30:30 +02:00
d92504797f
Can build simple Swift executables.
2015-12-07 21:12:23 +02:00
26873801bc
Can define benchmarks and run them.
2015-11-25 23:29:06 +02:00
067935ce76
Added conf option for build tree layout.
2015-09-17 19:21:26 +03:00
9d559b2b39
More robust windows detection and more logs.
2015-08-25 23:09:54 +03:00
f15eb466fb
Merge pull request #162 from mesonbuild/lint_errors
...
Fix some bugs when linting code
2015-06-19 13:10:07 +03:00
4dc8dbb7c1
run_tests: Bad first argument 'Exception' given to super()
...
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2015-06-19 10:37:54 +03:00
816013ef0d
run_tests: fix bad-continuation
...
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2015-06-19 10:17:25 +03:00
cf0bd77ddd
Do not invoke linker via cmd /c on Windows.
2015-05-17 15:23:33 +03:00
ff7c8b1647
Run unit tests in-process too for extra speed.
2015-04-23 17:34:31 +03:00
144b2314ce
Run Meson test invocations in-process because spawning a new Python process for each is too slow.
2015-04-23 17:08:08 +03:00
324cca808d
Print test time breakdown.
2015-04-23 12:51:41 +03:00
edda2f6888
Store time taken to configure, build and test individual cases.
2015-04-23 12:40:51 +03:00
a92fcb711b
Fix windows tests when using newer MinGW.
2015-04-20 22:04:58 +03:00
f19fd50702
Encoding of result file is always utf-8.
2015-04-13 23:45:10 +03:00
2c8c6fbf20
tests: add all platform tests and skip needed tests
...
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2015-03-25 23:15:23 +03:00
e0ba9ba2b9
tests: add skipped tests
...
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2015-03-25 22:44:01 +03:00
dccb6a170e
tests: add time property
...
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2015-03-25 20:39:11 +03:00
9287d7e2c5
Write out padding zeroes to numbers because Jenkins is too stupid to do logical order sorting.
2015-03-25 18:38:24 +02:00
7249ff9b00
tests: use name as class name
...
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2015-03-25 19:22:13 +03:00
99a955491d
Minor fixes.
2015-03-25 18:11:34 +02:00
3a1a3404ba
Fix empty java case.
2015-03-25 17:52:12 +02:00
fd30a81fa9
Made run_tests.py output test results in junit xml to allow better integration with CI tools.
2015-03-25 17:32:58 +02:00
Jérôme Duval