Gammu Testsuite

Gammu comes with quite big test suite. It covers some basic low level functions, handling replies from the phone and also does testing of command line utilities and SMSD.

Running the tests

You can run the test suite this using make test. CMake build system uses for testing CTest, which also includes option to connect to dashboard and submit test results there, so that they can be reviewed and fixed by others. To participate in this testing, you need just to run make Experimental which also does submission to the dashboard.

There are some more options for testing:

make test

Runs testsuite with no uploading of results.

make Experimental

Runs testsuite and uploads results to the dashboard.

make ExperimentalMemCheck

This checks memory accesses using valgrind during tests and submits report. You need to do this after make Experimental and you can submit results using make ExperimentalSubmit.

Coverage reports

To get test coverage reports, you need to configure project using cmake -DCOVERAGE=ON

Nightly testing

Currently several machines do compile and test Gammu every night. If you want to tak part of this, just ensure that your machine executes test suite every night (preferably after 3:00 CET). You can select either make Nightly to do regular testing or make NightlyMemoryCheck to test with valgrind. Also you can enable coverage tests as described above.

Running single test

You can run single test by directly calling ctest:
ctest -R test-name
Adding -V runs it in verbose mode with all test output:
ctest -V -R test-name

Collecting results

The tests are ran daily on several platforms and you can find the results on Travis.

The coverage reports are at Coveralls.

Testing of SMSD

SMSD tests are performed using Dummy Driver and uses file backend and sqlite database by default. For this you nee Gammu compiled with libdbi, have installed sqlite driver for libdbi and have sqlite3 binary available on the system.

Testing of additional database backends must be enabled separately:

MYSQL_TESTING:: you need to have setup MySQL server with database where SMSD can play.
PSQL_TESTING: you need to have setup PostgreSQL server with database where SMSD can play.

Testing of command line utility

Gammu command line tests are performed using Dummy Driver where required. It covers most of command line interface, but some parts need to be explicitly enabled:

ONLINE_TESTING:: enable testing of features which require internet access

Testing of Python interface

Python module tests are performed using Dummy Driver where required. It does also cover testing of SMSD interface, which is done using libdbi(sqlite) driver.

Testing of reply functions

The tests directory contains various tests which do inject data into reply functions and check their response.

Testing of data parsing

The tests directory contains various tests which just try to parse various file formats supported by libGammu.

Configuration of the test suite

You can pass various parameters to configure the test suite:

Programs used for testing

SH_BIN: Path to the sh program
BASH_BIN: Path to the bash program
SQLITE_BIN: Path to the sqlite3 program
SED_BIN: Path to the sed program
MYSQL_BIN: Path to the mysql program
PSQL_BIN: Path to the psql program

Limiting testsuite

ONLINE_TESTING: Enable testing of parts which use remote servers, requires connection to interned
PSQL_TESTING: Enable testing of PostgreSQL SMSD backend, requires configured PostgreSQL database
MYSQL_TESTING: Enable testing of MySQL SMSD backend, requires configured MySQL database

Database backends configuration

PSQL_HOST: Host to use for PostgreSQL tests (default: 127.0.0.1)
PSQL_DATABASE: Database to use for PostgreSQL tests (default: smsd)
PSQL_USER: User to use for PostgreSQL tests (default: smsd)
PSQL_PASSWORD: Password to use for PostgreSQL tests (default: smsd)
MYSQL_HOST: Host to use for MySQL tests (default: 127.0.0.1)
MYSQL_DATABASE: Database to use for MySQL tests (default: smsd)
MYSQL_USER: User to use for MySQL tests (default: smsd)
MYSQL_PASSWORD: Password to use for MySQL tests (default: smsd)
ODBC_DSN`: ODBC DSN to use for ODBC tests (default: smsd). Currently needs to point to MySQL database.