A local copy of OpenSSL from GitHub
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Pauli 8c63532002 test: fix coverity 1473609 & 1473610: unchecked return values 1 year ago
..
certs test/x509: Test for issuer being overwritten when printing. 1 year ago
ct Use .cnf for config files, not .conf 2 years ago
d2i-tests add test for CVE-2016-7053 6 years ago
helpers Add internal X509_add_certs_new(), which simplifies matters 1 year ago
ocsp-tests Fix OCSP_basic_verify() cert chain construction in case bs->certs is NULL 5 years ago
ossl_shim Update copyright year 1 year ago
recipes Add a test for CVE-2021-3449 1 year ago
smime-certs Update copyright year 1 year ago
ssl-tests Fix the check for suitable groups and TLSv1.3 1 year ago
testutil Update copyright year 1 year ago
CAtsa.cnf Remove RANDFILE settings from configuration files 3 years ago
README-dev.md Rename NOTES*, README*, VERSION, HACKING, LICENSE to .md or .txt 2 years ago
README-external.md Fix many MarkDown issues in {NOTES*,README*,HACKING,LICENSE}.md files 2 years ago
README.md test: document the random test ordering env variable 1 year ago
README.ssltest.md Fix issues reported by markdownlint 2 years ago
aborttest.c Following the license change, modify the boilerplates in test/ 4 years ago
acvp_test.c Remove TODO in test/acvp_test.c related to setting AES-GCM iv. 1 year ago
acvp_test.inc Drop OPENSSL_NO_RSA everywhere 1 year ago
aesgcmtest.c Update copyright year 1 year ago
afalgtest.c Update copyright year 2 years ago
algorithmid_test.c test: support params arguments to init functions 1 year ago
asn1_decode_test.c Add a test for encoding/decoding using an invalid ASN.1 Template 1 year ago
asn1_dsa_internal_test.c Update copyright year 2 years ago
asn1_encode_test.c Add a test for encoding/decoding using an invalid ASN.1 Template 1 year ago
asn1_internal_test.c Add tests for the limited Unicode code point range 1 year ago
asn1_string_table_test.c typo ANS1 -> ASN1 4 years ago
asn1_time_test.c Update copyright year 2 years ago
asynciotest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
asynctest.c Rename OPENSSL_CTX prefix to OSSL_LIB_CTX 2 years ago
bad_dtls_test.c test: fix coverity 1451550: unchecked return value 1 year ago
bftest.c Update copyright year 2 years ago
bio_callback_test.c Following the license change, modify the boilerplates in test/ 4 years ago
bio_enc_test.c Following the license change, modify the boilerplates in test/ 4 years ago
bio_memleak_test.c Update copyright year 2 years ago
bio_prefix_text.c TEST: Add test recipe and help program to test BIO_f_prefix() 2 years ago
bio_readbuffer_test.c Fix DER reading from stdin for BIO_f_readbuffer 1 year ago
bioprinttest.c TEST: Adjust test/bioprinttest.c to behave like the testutil routines 2 years ago
bn_internal_test.c Update copyright year 1 year ago
bn_rand_range.h Test of uniformity of BN_rand_range output. 3 years ago
bntest.c Update copyright year 2 years ago
bntests.pl Following the license change, modify the boilerplates in test/ 4 years ago
build.info Fix DER reading from stdin for BIO_f_readbuffer 1 year ago
ca-and-certs.cnf Cleanup cert config files for tests 2 years ago
casttest.c Update copyright year 2 years ago
chacha_internal_test.c Reorganize private crypto header files 3 years ago
cipher_overhead_test.c Update copyright year 1 year ago
cipherbytes_test.c Fix safestack issues in ssl.h 2 years ago
cipherlist_test.c test: fix Coverity 1454818: use after free 1 year ago
ciphername_test.c Fix safestack issues in ssl.h 2 years ago
clienthellotest.c test: fix coverity 1454812: improper use of negative value 1 year ago
cmactest.c Add a CMAC test 2 years ago
cmp_asn_test.c test: fix coverity 1454040: resource leak 1 year ago
cmp_client_test.c Update copyright year 1 year ago
cmp_ctx_test.c Update copyright year 1 year ago
cmp_hdr_test.c test: fix coverity 1455330, 1455332, 1455334, 1455342, 1455344 : resource leak 1 year ago
cmp_msg_test.c Update copyright year 1 year ago
cmp_protect_test.c Update copyright year 1 year ago
cmp_server_test.c Use adapted test_get_libctx() for simpler test setup and better error reporting 1 year ago
cmp_status_test.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
cmp_vfy_test.c Update copyright year 1 year ago
cms-examples.pl Following the license change, modify the boilerplates in test/ 4 years ago
cmsapitest.c Update copyright year 1 year ago
conf_include_test.c Remove RANDFILE settings from configuration files 3 years ago
confdump.c Fix safestack issues in conf.h 2 years ago
constant_time_test.c Reorganize local header files 3 years ago
context_internal_test.c Update copyright year 2 years ago
crltest.c Fix safestack issues in x509.h 2 years ago
ct_test.c Fix safestack issues in ct.h 2 years ago
ctype_internal_test.c Reorganize private crypto header files 3 years ago
curve448_internal_test.c Add ossl_provider symbols 1 year ago
d2i_test.c Update copyright year 2 years ago
danetest.c Update copyright year 1 year ago
danetest.in Following the license change, modify the boilerplates in test/ 4 years ago
danetest.pem DANE support for X509_verify_cert() 6 years ago
data.bin TEST: Make our test data binary 2 years ago
data2.bin TEST: Make our test data binary 2 years ago
default-and-fips.cnf Update some nits around the FIPS module 2 years ago
default-and-legacy.cnf test/recipes/30-test_evp.t: Modify to test with different providers 3 years ago
default.cnf test/recipes/30-test_evp.t: Modify to test with different providers 3 years ago
defltfips_test.c Test that EVP_default_properties_is_fips_enabled() works early 2 years ago
destest.c Update copyright year 2 years ago
dhtest.c Update copyright year 2 years ago
drbgtest.c test: update tests to allow for params argument for the instantiate call on EVP_RAND_CTXs 1 year ago
dsa_no_digest_size_test.c Update copyright year 2 years ago
dsatest.c Fix DSA EVP_PKEY_param_check() when defaults are used for param generation. 1 year ago
dtls_mtu_test.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
dtlstest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
dtlsv1listentest.c Following the license change, modify the boilerplates in test/ 4 years ago
ec_internal_test.c Fix external symbols related to ec & sm2 keys 1 year ago
ecdsatest.c Update copyright year 1 year ago
ecdsatest.h Fix header file include guard names 3 years ago
ecstresstest.c Remove tab characters from C source files. 3 years ago
ectest.c Simplify the EVP_PKEY_XXX_fromdata_XX methods. 1 year ago
endecode_test.c EVP_PKCS82PKEY: Create provided keys if possible 1 year ago
endecoder_legacy_test.c test: fix coverity 1469427: impropery use of negative value 1 year ago
enginetest.c EVP: deprecate the EVP_X_meth_ functions. 2 years ago
errtest.c TEST: Adapt test/errtest for the 'no-err' configuration 2 years ago
evp_extra_test.c Add testing for non-default library context into evp_extra_test 1 year ago
evp_extra_test2.c Update copyright year 1 year ago
evp_fetch_prov_test.c Rename OPENSSL_CTX prefix to OSSL_LIB_CTX 2 years ago
evp_kdf_test.c test: adjust tests to include extra argument to KDF derive call 1 year ago
evp_libctx_test.c test: support params arguments to init functions 1 year ago
evp_pkey_dparams_test.c Add necessary checks of OPENSSL_NO_DH, OPENSSL_NO_DSA and OPENSSL_NO_EC 1 year ago
evp_pkey_provided_test.c Make EVP_PKEY_missing_parameters work properly on provided RSA keys 1 year ago
evp_test.c test: coverity 1455749 - dereference after null check 1 year ago
exdatatest.c test: fix coverity 1414445: resource leak 1 year ago
exptest.c test: fix coverity 1414451: unchecked return value 1 year ago
fatalerrtest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
ffc_internal_test.c Update copyright year 1 year ago
filterprov.c provider: add an unquery function to allow providers to clean up. 1 year ago
filterprov.h provider: add an unquery function to allow providers to clean up. 1 year ago
fips-and-base.cnf Add CLI tests in FIPS configuration 2 years ago
fips.cnf Test that EVP_default_properties_is_fips_enabled() works early 2 years ago
generate_buildtest.pl Following the license change, modify the boilerplates in test/ 4 years ago
generate_ssl_tests.pl Update copyright year 2 years ago
gmdifftest.c test: fix coverity 1338157: unchecked return value 1 year ago
gosttest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
hexstr_test.c Fix misc external ossl_ symbols. 1 year ago
hmactest.c Update copyright year 2 years ago
http_test.c http_test.c: Fix minor Coverity issue CID 1473608 1 year ago
ideatest.c Update copyright year 2 years ago
igetest.c Deprecate the AES_ige_*() functions 3 years ago
insta.priv.pem Chunk 11 of CMP contribution to OpenSSL: CMP command-line interface 2 years ago
insta_ca.cert.pem Chunk 11 of CMP contribution to OpenSSL: CMP command-line interface 2 years ago
keymgmt_internal_test.c Remove TODO in rsa_ameth.c 1 year ago
legacy.cnf test/recipes/30-test_evp.t: Modify to test with different providers 3 years ago
lhash_test.c Update copyright year 2 years ago
mdc2_internal_test.c Update copyright year 2 years ago
mdc2test.c Update copyright year 2 years ago
memleaktest.c test/memleaktest.c: Modify for use with address/leak sanitizer 3 years ago
modes_internal_test.c test: fix coverity 1429210: unchecked return value 1 year ago
moduleloadtest.c test: fix coverity 1470559: resource leak 1 year ago
namemap_internal_test.c Always check CRYPTO_LOCK_{read,write}_lock 1 year ago
ocspapitest.c Fix safestack issues in x509.h 2 years ago
ossl_store_test.c Update copyright year 1 year ago
p_test.c Update copyright year 1 year ago
packettest.c Make the PACKET/WPACKET code available to both libcrypto and libssl 3 years ago
param_build_test.c params: add OSSL_PARAM helpers for time_t. 2 years ago
params_api_test.c test: fix coverity 1451553: resource leak 1 year ago
params_conversion_test.c Update copyright year 2 years ago
params_test.c OSSL_PARAM: Correct the assumptions on the UTF8 string length 1 year ago
pbelutest.c Following the license change, modify the boilerplates in test/ 4 years ago
pem_read_depr_test.c Test various deprecated PEM_read_bio_* APIs 2 years ago
pemtest.c Following the license change, modify the boilerplates in test/ 4 years ago
pkcs7-1.pem Import of old SSLeay release: SSLeay 0.8.1b 24 years ago
pkcs7.pem Import of old SSLeay release: SSLeay 0.8.1b 24 years ago
pkcs12_format_test.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
pkey_meth_kdf_test.c Update copyright year 2 years ago
pkey_meth_test.c Update copyright year 2 years ago
pkits-test.pl Following the license change, modify the boilerplates in test/ 4 years ago
poly1305_internal_test.c Add ChaCha related ciphers to default provider 3 years ago
property_test.c property_test: use property values that are not used elsewhere 1 year ago
provider_fallback_test.c Rename OPENSSL_CTX prefix to OSSL_LIB_CTX 2 years ago
provider_internal_test.c Update copyright year 1 year ago
provider_internal_test.cnf.in Use .cnf for config files, not .conf 2 years ago
provider_status_test.c Rename OPENSSL_CTX prefix to OSSL_LIB_CTX 2 years ago
provider_test.c Update copyright year 1 year ago
proxy.cnf Cleanup cert config files for tests 2 years ago
rand_status_test.c rand: instantiate the DRBGs upon first use. 2 years ago
rc2test.c Update copyright year 2 years ago
rc4test.c Update copyright year 2 years ago
rc5test.c Update copyright year 2 years ago
rdrand_sanitytest.c Remove extern declarations of OPENSSL_ia32cap_P 3 years ago
recordlentest.c Update copyright year 1 year ago
rsa_complex.c Following the license change, modify the boilerplates in test/ 4 years ago
rsa_mp_test.c Drop OPENSSL_NO_RSA everywhere 1 year ago
rsa_sp800_56b_test.c Drop OPENSSL_NO_RSA everywhere 1 year ago
rsa_test.c Remove RSA SSLv23 padding mode 1 year ago
run_tests.pl Update copyright year 1 year ago
sanitytest.c Following the license change, modify the boilerplates in test/ 4 years ago
secmemtest.c Update copyright year 2 years ago
serverinfo.pem Require ServerInfo PEMs to be named "BEGIN SERVERINFO FOR"... 9 years ago
serverinfo2.pem Add a SERVERINFOV2 format test file 5 years ago
servername_test.c test: fix coverity 1451534: improper use of negative value 1 year ago
session.pem Don't store the ticket nonce in the session 4 years ago
shibboleth.pfx Add PKCS#12 UTF-8 interoperability test. 6 years ago
shlibloadtest.c test: fix coverity 1414449 & 1414471: resource leak 1 year ago
simpledynamic.c Fix simpledynamic.c - a typo and missed a header 2 years ago
simpledynamic.h Update copyright year 1 year ago
siphash_internal_test.c Fix a TODO(3.0) in the siphash code 1 year ago
sm2_internal_test.c Update copyright year 1 year ago
sm4_internal_test.c Add ossl_ symbols for sm3 and sm4 1 year ago
smcont.txt test/smcont.txt: trigger assertion in bio_enc.c. 6 years ago
smcont_zero.txt Tests for processing zero-length content in SMIME format 2 years ago
sparse_array_test.c Reorganize private crypto header files 3 years ago
srptest.c Update copyright year 1 year ago
ssl_cert_table_internal_test.c test: fix coverity 1416888: unchecked return value 1 year ago
ssl_ctx_test.c Update copyright year 2 years ago
ssl_old_test.c Stop disabling TLSv1.3 if ec and dh are disabled 1 year ago
ssl_test.c Update copyright year 1 year ago
ssl_test.tmpl test/ssl_test.tmpl: make it work with elderly perl. 6 years ago
ssl_test_ctx_test.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
ssl_test_ctx_test.cnf Use .cnf for config files, not .conf 2 years ago
sslapitest.c test: fix coverity 1451574: improper use of negative value 1 year ago
sslbuffertest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
sslcorrupttest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
stack_test.c Update copyright year 1 year ago
sysdefault.cnf Apply system_default configuration on SSL_CTX_new(). 4 years ago
sysdefaulttest.c Following the license change, modify the boilerplates in test/ 4 years ago
test.cnf Add -section option to 'req' command 2 years ago
test_test.c Fix --strict-warnings build 3 years ago
testcrl.pem Import of old SSLeay release: SSLeay 0.8.1b 24 years ago
testdsa.pem Add private/public key conversion tests 7 years ago
testdsapub.pem Add private/public key conversion tests 7 years ago
testec-p256.pem Add private/public key conversion tests 7 years ago
testecpub-p256.pem Add private/public key conversion tests 7 years ago
tested448.pem More testing for CLI usage of Ed25519 and Ed448 keys 2 years ago
tested448pub.pem More testing for CLI usage of Ed25519 and Ed448 keys 2 years ago
tested25519.pem More testing for CLI usage of Ed25519 and Ed448 keys 2 years ago
tested25519pub.pem More testing for CLI usage of Ed25519 and Ed448 keys 2 years ago
testp7.pem Change PKCS#7 test data to take account of removal of 22 years ago
testreq2.pem Import of old SSLeay release: SSLeay 0.8.1b 24 years ago
testrsa.pem Support writing RSA keys using the traditional format again 2 years ago
testrsa2048.pem Add fips checks for rsa encryption 2 years ago
testrsapss.pem rsa_kmgmt: Return OSSL_PKEY_PARAM_DEFAULT_DIGEST for unrestricted PSS keys 1 year ago
testrsapssmandatory.pem RSA: properly generate algorithm identifier for RSA-PSS signatures 1 year ago
testrsapub.pem Add private/public key conversion tests 7 years ago
testsid.pem Remove SSLv2 support 8 years ago
testutil.h test: add utility function to set the fake random callback on both the public and private instances 1 year ago
testx509.pem Extend X509 cert checks and error reporting in v3_{purp,crld}.c and x509_{set,vfy}.c 2 years ago
threadstest.c test: fix coverity 1473609 & 1473610: unchecked return values 1 year ago
time_offset_test.c Following the license change, modify the boilerplates in test/ 4 years ago
tls-provider.c test: support params arguments to init functions 1 year ago
tls13ccstest.c test cleanup: move helper .c and .h files to test/helpers/ 2 years ago
tls13encryptiontest.c Move MAC removal responsibility to the various protocol "enc" functions 2 years ago
tls13secretstest.c Update copyright year 1 year ago
uitest.c Update copyright year 2 years ago
v3-cert1.pem Import of old SSLeay release: SSLeay 0.8.1b 24 years ago
v3-cert2.pem Import of old SSLeay release: SSLeay 0.8.1b 24 years ago
v3_ca_exts.cnf make various test CA certs RFC 5280 compliant w.r.t. X509 extensions 1 year ago
v3ext.c Update copyright year 2 years ago
v3nametest.c v3nametest: Make the gennames structure static 1 year ago
verify_extra_test.c Update copyright year 1 year ago
versions.c Following the license change, modify the boilerplates in test/ 4 years ago
wpackettest.c WPACKET: don't write DER length when we don't want to 2 years ago
x509_check_cert_pkey_test.c Update copyright year 2 years ago
x509_dup_cert_test.c Update copyright year 2 years ago
x509_internal_test.c Join the x509 and x509v3 directories 3 years ago
x509_time_test.c Update copyright year 2 years ago
x509aux.c Update copyright year 1 year ago

README.md

Using OpenSSL Tests

After a successful build, and before installing, the libraries should be tested. Run:

$ make test                                      # Unix
$ mms test                                       ! OpenVMS
$ nmake test                                     # Windows

Warning: you MUST run the tests from an unprivileged account (or disable your privileges temporarily if your platform allows it).

If some tests fail, take a look at the section Test Failures below.

Test Failures

If some tests fail, look at the output. There may be reasons for the failure that isn't a problem in OpenSSL itself (like an OS malfunction or a Perl issue). You may want increased verbosity, that can be accomplished like this:

Full verbosity, showing full output of all successful and failed test cases (make macro VERBOSE or V):

$ make V=1 test                                  # Unix
$ mms /macro=(V=1) test                          ! OpenVMS
$ nmake V=1 test                                 # Windows

Verbosity on failed (sub-)tests only (VERBOSE_FAILURE or VF or REPORT_FAILURES):

$ make test VF=1

Verbosity on failed (sub-)tests, in addition progress on succeeded (sub-)tests (VERBOSE_FAILURE_PROGRESS or VFP or REPORT_FAILURES_PROGRESS):

$ make test VFP=1

If you want to run just one or a few specific tests, you can use the make variable TESTS to specify them, like this:

$ make TESTS='test_rsa test_dsa' test            # Unix
$ mms/macro="TESTS=test_rsa test_dsa" test       ! OpenVMS
$ nmake TESTS='test_rsa test_dsa' test           # Windows

And of course, you can combine (Unix examples shown):

$ make test TESTS='test_rsa test_dsa' VF=1
$ make test TESTS="test_cmp_*" VFP=1

You can find the list of available tests like this:

$ make list-tests                                # Unix
$ mms list-tests                                 ! OpenVMS
$ nmake list-tests                               # Windows

Have a look at the manual for the perl module Test::Harness to see what other HARNESS_* variables there are.

To report a bug please open an issue on GitHub, at https://github.com/openssl/openssl/issues.

For more details on how the make variables TESTS can be used, see section Running Selected Tests below.

Running Selected Tests

The make variable TESTS supports a versatile set of space separated tokens with which you can specify a set of tests to be performed. With a "current set of tests" in mind, initially being empty, here are the possible tokens:

 alltests      The current set of tests becomes the whole set of available
               tests (as listed when you do 'make list-tests' or similar).

 xxx           Adds the test 'xxx' to the current set of tests.

-xxx           Removes 'xxx' from the current set of tests.  If this is the
               first token in the list, the current set of tests is first
               assigned the whole set of available tests, effectively making
               this token equivalent to TESTS="alltests -xxx".

 nn            Adds the test group 'nn' (which is a number) to the current
               set of tests.

-nn            Removes the test group 'nn' from the current set of tests.
               If this is the first token in the list, the current set of
               tests is first assigned the whole set of available tests,
               effectively making this token equivalent to
               TESTS="alltests -xxx".

Also, all tokens except for "alltests" may have wildcards, such as *. (on Unix and Windows, BSD style wildcards are supported, while on VMS, it's VMS style wildcards)

Examples

Run all tests except for the fuzz tests:

$ make TESTS='-test_fuzz*' test

or, if you want to be explicit:

$ make TESTS='alltests -test_fuzz*' test

Run all tests that have a name starting with "test_ssl" but not those starting with "test_ssl_":

$ make TESTS='test_ssl* -test_ssl_*' test

Run only test group 10:

$ make TESTS='10' test

Run all tests except the slow group (group 99):

$ make TESTS='-99' test

Run all tests in test groups 80 to 99 except for tests in group 90:

$ make TESTS='[89]? -90' test

To run specific fuzz tests you can use for instance:

$ make test TESTS='test_fuzz_cmp test_fuzz_cms'

To stochastically verify that the algorithm that produces uniformly distributed random numbers is operating correctly (with a false positive rate of 0.01%):

$ ./util/wrap.sh test/bntest -stochastic

Running Tests in Parallel

By default the test harness will execute the selected tests sequentially. Depending on the platform characteristics, running more than one test job in parallel may speed up test execution. This can be requested by setting the HARNESS_JOBS environment variable to a positive integer value. This specifies the maximum number of test jobs to run in parallel.

Depending on the Perl version different strategies could be adopted to select which test recipes can be run in parallel. In recent versions of Perl, unless specified otherwise, any task can be run in parallel. Consult the documentation for TAP::Harness to know more.

To run up to four tests in parallel at any given time:

$ make HARNESS_JOBS=4 test

Randomisation of Test Ordering

By default, the test harness will execute tests in the order they were added. By setting the OPENSSL_TEST_RAND_ORDER environment variable to zero, the test ordering will be randomised. If a randomly ordered test fails, the seed value used will be reported. Setting the OPENSSL_TEST_RAND_ORDER environment variable to this value will rerun the tests in the same order. This assures repeatability of randomly ordered test runs. This repeatability is independent of the operating system, processor or platform used.

To randomise the test ordering:

$ make OPENSSL_TEST_RAND_ORDER=0 test

To run the tests using the order defined by the random seed 42:

$ make OPENSSL_TEST_RAND_ORDER=42 test