Commit Graph

53 Commits

Author SHA1 Message Date
Jussi Pakkanen 4a08841331 Merge pull request #1335 from tp-m/test-custom-target-used-in-test-cmd
tests: check custom target output is created before being used in a t…
2017-01-28 19:05:54 +02:00
Hemmo Nieminen 85304bd8cf [mesontest] Implement a quiet option.
Implement a quiet option that can be used to hide OK messages for
successful tests to better highlight the failing ones.
2017-01-28 18:27:58 +02:00
Nirbheek Chauhan 2e30912447 vs: Fix running of tests to use mesontest.py
Back in November when this broke, we didn't notice because our tests
are run in-process, so we don't check that `msbuild RUN_TESTS.vcxproj`
and `ninja test` actually work.

Now we do.
2017-01-28 01:05:21 +05:30
Nirbheek Chauhan 6778d0e2da mesontest: Don't add '.' at the end of some prints
Makes it difficult to copy the filename/datetime by double-clicking
since that includes the '.' at the end.
2017-01-26 21:56:51 +02:00
Nirbheek Chauhan d9a4b367b4 mesontest: Don't overwrite test status on timeout
Earlier it would mark tests as "FAIL" even if it skipped.
2017-01-26 21:56:51 +02:00
Mike Sinkovsky 550761d97b cleanup: @staticmethod 2017-01-18 21:22:47 +02:00
Mike Sinkovsky c9423cc3a8 cleanup: Replace assignment with augmented assignment 2017-01-18 21:22:47 +02:00
Mike Sinkovsky 969be1f679 cleanup: Remove redundant parentheses 2017-01-18 21:22:47 +02:00
Jussi Pakkanen 7a28f387e2 More readable total statistics. 2017-01-15 21:27:32 +02:00
Hemmo Nieminen b90956c2f2 mesontest: Improve test suite selection.
Suite option can now be given to specify in more detail which tests should
be run.
2017-01-12 22:17:12 +02:00
Mike Sinkovsky 5b626ab4cb style: [E1**] Indentation 2017-01-11 12:33:27 -05:00
Hemmo Nieminen ebea1e3bd9 mesontest: Print test stats even if in verbose mode. 2017-01-03 09:51:31 +02:00
Hemmo Nieminen 01be50fdd9 mesontest: Unify testing behaviour between the test target and mesontest.
Also add a test summary to the end of the test output.
2017-01-03 09:51:31 +02:00
Hemmo Nieminen fc17e3b9cc mesontest: Show the test command in truncated test logs. 2017-01-03 09:39:55 +02:00
Hemmo Nieminen bf281fd4c4 mesontest: Remove excess newline and whitespace from test logs. 2017-01-03 09:39:55 +02:00
Jussi Pakkanen b3d51abff2 Can put external programs to test suite exe wrappers directly. 2017-01-02 23:52:50 +02:00
Jussi Pakkanen 74f15263b6 Can set envvars in test setups. 2017-01-02 23:52:50 +02:00
Jussi Pakkanen ee8a6e6fc5 Can specify test setups and run them with mesontest. 2017-01-02 23:52:50 +02:00
Igor Gnatenko 969dc7e995 style: fix E124 violations
E124: closing bracket does not match visual indentation

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2017-01-01 12:02:05 -05:00
Igor Gnatenko 116da33cdd style: fix E128 violations
E128: continuation line under-indented for visual indent

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2017-01-01 12:02:05 -05:00
Igor Gnatenko ef608f217d style: fix E222 violations
E222: multiple spaces after operator

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2017-01-01 12:02:05 -05:00
Igor Gnatenko 2017d8578a style: fix E226 violations
E226: missing whitespace around arithmetic operator

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2017-01-01 12:02:05 -05:00
Igor Gnatenko f0b30baa39 style: fix E225 violations
E225: missing whitespace around operator

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2017-01-01 12:02:05 -05:00
Jussi Pakkanen b55235dfbd Fix space before :. 2016-12-31 16:28:15 +02:00
Jussi Pakkanen 3fc67f4951 Minimal fixes to make tests pass when cross compiling. 2016-12-20 20:33:59 +02:00
Jussi Pakkanen 2b65083463 Fix cross test and run them if a cross compiler is available. 2016-12-20 20:33:59 +02:00
Jussi Pakkanen f2b3ab826b If/elif fix so running just mesontest actually runs the tests after doing a rebuild. 2016-12-11 14:20:39 +02:00
Jussi Pakkanen 22aedda6d0 Use a big timeout when running gdb interactively and a typo fix. 2016-12-11 14:20:39 +02:00
Patrick Griffis 4c74b47cfd mesontest: Fix exception 2016-12-07 21:54:30 +02:00
Thibault Saunier 10e2b9bca0 mesontest: Rebuild all before running tests
Only supporting ninja backend for now.
2016-12-03 22:41:31 +02:00
Jussi Pakkanen 8be0df1443 Typo fix. 2016-12-03 20:58:29 +02:00
Jussi Pakkanen 57b7a98e02 Merge pull request #1128 from thiblahute/mesontest_misc_fixes
mesontest misc fixes
2016-12-03 20:54:42 +02:00
Jussi Pakkanen c1efaafec4 Stray debug print removal. 2016-12-03 16:19:02 +02:00
Thibault Saunier 16bdc044e4 mesontest: Properly let user know when a test timeout out in verbose mode 2016-12-02 20:04:33 -03:00
Thibault Saunier e2782f7864 tests: Allow user to change timeout time
For example if we know the tests takes more time because, for example
we are tracing it, or running with very high debug log level we might
not want the test to timeout.
2016-12-02 20:04:33 -03:00
Thibault Saunier 56a6f86827 mesontest: Do not timeout when running inside GDB 2016-12-02 20:04:33 -03:00
Thibault Saunier 6203e3ae34 mesontest: Let user work with gdb when not running in a loop
In the normal case the user probably wants to set break point or
anything when running an app in gdb, we should let him a chance to
do so.

In the case he is running in a loop, it probably means he want to
reproduce a crash or a race inside gdb so we should just go and
run in gdb.

We probably miss a few options to give him more control.
2016-12-02 20:04:33 -03:00
Thibault Saunier 3d05b91e37 mesontest: Respect repeat argument even when running testsuites 2016-12-02 20:04:31 -03:00
Thibault Saunier 7afb4c6552 mesontest: Error out even in verbose mode when running repeatidly 2016-12-01 23:38:54 +02:00
Daniel Stone 1cb9d2bc0d Support skipped tests
Knowing whether a test failed to run as its prerequisites were not
available, or whether those prerequisites were available and produced
unexpected/incorrect results, is a useful differentiation.

Add support for skipped tests by testing for exit code 77, used through
autotools/piglit/etc to denote a test which detected this and decided to
skip.
2016-11-29 13:13:29 -05:00
Thibault Saunier 5d866bb4f3 mesontest: Add a 'verbose' mode which does not capture stdout/err
And reuse that mode when running inside gdb instead of reimplementing
running test for that particular use case.
2016-11-23 09:14:09 -03:00
Thibault Saunier 2584a9f27d mesontest: Fix usage of test.env as it can be a build.EnvironmentVariables 2016-11-22 15:52:17 -03:00
Thibault Saunier 3f6e06c930 mesontest: Fix the --wd option and rename it to -C to be coherent with ninja 2016-11-22 14:18:21 -03:00
Thibault Saunier 9644e8b8de mesontest: Fix --list option
The listing code path could not be hit when running mesontest --list
2016-11-22 14:13:20 -03:00
Jussi Pakkanen 1ebc5c1ea0 Can run special tests with the new tool. 2016-11-18 22:10:22 +02:00
Jussi Pakkanen c7ddce163f All testing is now in mesontest.py, which simplifies a lot of stuff. 2016-11-18 22:10:22 +02:00
Jussi Pakkanen 39df22bf53 Made Meson test into a class rather than abusing global variables and as preparation for moving it elsewhere. 2016-11-18 22:08:07 +02:00
Jussi Pakkanen e24229eae7 Can run benchmarks. 2016-11-18 22:04:29 +02:00
Jussi Pakkanen 077741097a Run all tests if none are specified. 2016-11-18 22:04:29 +02:00
Jussi Pakkanen 951262d759 Removed Valgrind from core. 2016-11-18 22:04:29 +02:00