Distributed System Tests for Nim-Codex
Go to file
benbierens f38f7861a0
Log comparing test
2024-04-27 18:08:54 +02:00
.github/workflows Use just folder as a path for digests upload (#99) 2024-03-23 21:13:25 +02:00
Framework Test for disc speeds 2024-04-23 09:10:10 +02:00
ProjectPlugins sets up parser for codex log lines 2024-04-27 14:20:31 +02:00
Tests Log comparing test 2024-04-27 18:08:54 +02:00
Tools Bump k8s operation timeout for long timeset 2024-04-14 09:29:13 +02:00
docker Update Runners Jobs nodeSelector (#86) 2023-11-27 19:22:28 +02:00
docs Update Continuous-Tests documentation (#67) 2023-09-25 20:04:06 +03:00
.gitignore ADD Parallel download Tests 2023-04-19 12:34:46 +02:00
CONTRIBUTINGPLUGINS.MD Overdue readme updates 2024-03-27 15:01:32 +01:00
CONTRIBUTINGTESTS.MD fix Continous typo 2023-10-26 20:27:44 +08:00
README.md Overdue readme updates 2024-03-27 15:01:32 +01:00
codexnode-manifest.yml Use codexstorage/nim-codex Docker images 2023-05-30 22:45:41 +03:00
cs-codex-dist-testing.sln Overdue readme updates 2024-03-27 15:01:32 +01:00

README.md

Distributed System Tests

This project allows you to write tools and tests that control and interact with container-based applications to form a distributed system in a controlled, reproducible environment.

Dotnet: v7.0
Kubernetes: v1.25.4
Dotnet-kubernetes SDK: v10.1.4 https://github.com/kubernetes-client/csharp
Nethereum: v4.14.0

Currently, this project is mainly used for distributed testing of Nim-Codex. However, its plugin-structure allows for other projects to be on-boarded (relatively) easily. (See 'contribute a plugin`.)

Tests/DistTestCore

Library with generic distributed-testing functionality. Uses NUnit3. Reference this project to build unit-test style scenarios: setup, run test, teardown. The DistTestCore responds to the following env-vars:

  • LOGPATH = Path where log files will be written.
  • DATAFILEPATH = Path where (temporary) data files will be stored.
  • ALWAYS_LOGS = When set, DistTestCore will always download all container logs at the end of a test run. By default, logs are only downloaded on test failure.

Tests/CodexTests and Tests/CodexLongTests

These are test assemblies that use DistTestCore to perform tests against transient Codex nodes. Read more HERE

Tests/ContinuousTests

A console application that runs tests in an endless loop against a persistent deployment of Codex nodes. Read more HERE

Tools/CodexNetDeployer

A console application that can deploy Codex nodes. Read more HERE

Framework architecture

The framework is designed to be extended by project-specific plugins. These plugins contribute functionality and abstractions to the framework. Users of the framework use these to perform tasks such as testing and deploying. Architecture

How to contribute a plugin

If you want to add support for your project to the testing framework, follow the steps HERE

How to contribute tests

If you want to contribute tests, please follow the steps HERE.

Run the tests on your machine

Creating tests is much easier when you can debug them on your local system. This is possible, but requires some set-up. If you want to be able to run the tests on your local system, follow the steps HERE. Please note that tests which require explicit node locations cannot be executed locally. (Well, you could comment out the location statements and then it would probably work. But that might impact the validity/usefulness of the test.)

Missing functionality

Surely the test-infra doesn't do everything we'll need it to do. If you're running into a limitation and would like to request a new feature for the test-infra, please create an issue.