EvoSpikeNet integrated test system

[!NOTE] For the latest implementation status, please refer to Functional Implementation Status (Remaining Functionality).

overview

EvoSpikeNet's integrated testing system provides a comprehensive menu system that allows you to run all your test suites in an integrated manner. This system allows developers to easily test the entire system and analyze the results in detail.

function

🎯 Test execution by category: Select and execute from 8 test categories
📊 Detailed report generation: Automatically generate comprehensive reports of execution results
🚀 Interactive Menu: Easy-to-use menu-driven navigation
📈 Performance Monitoring: Track test execution time and success rate
💾 Save report: Test results can be saved to a file

Test category

1. 🚀 Performance Optimization

Batch Processing Optimization: Dynamic batch processing and optimization
Model Compression: Model compression and quantization
Load Balancing: AI-based load balancing
Communication Compression: Intelligent compression algorithm
Async Pipeline: Asynchronous processing pipeline

2. 🧠 AI/ML Core

Core Models: SpikingEvo, Transformer model
Evolution System: Neuroevolution and fitness evaluation
Attention & Plasticity: Attention and synaptic plasticity
Encoding & Control: Neural encoding, control systems, parallel plan execution

3. 🌐 Distributed Systems

Zenoh Communication: Zenoh-based distributed communication
Distributed Brain: Distributed brain node communication
Federated Learning: Federated learning system
Node Discovery: Distributed node discovery

4. 🔒 Security & Safety

Security Framework: Security and Authentication
Safety Watchdog: Safety monitoring and watchdog

5. 🔗 Integration & E2E

Full Integration: Full system integration testing
E2E Workflows: End-to-end workflows
PFC Integration: Prefrontal cortex integration test

6. 🔌API & Services

API Endpoints: REST API endpoints
SDK Integration: SDK integration testing

7. 📊 Data Processing

Text Processing: Text processing and analysis
Vision Processing: Computer vision processing
Audio Processing: Audio processing and analysis
RAG System: Search extension generation

8. 👁️ Visualization & UI

3D Visualization: 3D brain visualization
Full Brain UI: Full brain user interface

9. 🎯 Run All

Run entire test suite

How to use

cd /path/to/EvoSpikeNet
python3 test_menu.py

Menu display: Displays a list of test categories
Select: Enter the number of the category you want to execute (1-9)
Run: Tests in the selected categories will be executed sequentially
Display results: A detailed report of the execution results will be displayed.
Save Report: Save the report to a file if necessary
Continue: Choose to run another test or exit

Quick test run

For testing basic functionality:

python3 test_menu_quick_test.py

Interpretation of test results

Success rate display

Test Suite: Success/Failure of each test suite
Total number of tests: Number of all tests executed
Success rate: Success rate in percentage

Report contents

📅 Creation date and time
⏱️ Total execution time
📈 Summary statistics
📋 Results by category
📝 Detailed results (execution time, number of tests, status for each test suite)

Notes on test execution

Environmental requirements

-Python 3.8+ -pytest - Necessary dependent libraries (torch, numpy, fastapi, etc.)

Runtime considerations

Some tests may require GPU
Distributed system tests are performed only when Zenoh is available
Test execution may take some time

troubleshooting

If the test fails

Check dependencies: pip install -r requirements.txt
Set environment variables: Set environment variables as necessary
Individual test execution: pytest tests/test_specific.py -v

NumPy/PyTorch compatibility error```bash

pip install --upgrade numpy pip install --upgrade torch

## Extension method

### Adding a new test category

Add new category to `_initialize_test_suites` method in `test_menu.py`:

```python
TestSuite(
    name="New Test Suite",
    category=TestCategory.NEW_CATEGORY,
    test_files=["test_new_feature.py"],
    description="New feature tests",
    priority=1
)

Custom report generation

Extended the generate_report method to add custom report formats.

Information for developers

Architecture

IntegratedTestMenu: Main test management class
TestSuite: Individual test suite settings
TestResult: Test execution result
TestCategory: Enumeration of test categories

Main methods

run_interactive_menu(): Run interactive menu
run_category_tests(): Run tests by category
run_test_suite(): Run individual test suite
generate_report(): Generate report

support

If you have any issues or questions regarding the test system, please contact our development team.

Auth: Masahiro Aoki