Code

Fides Module#1073

Code

Open

d-strat wants to merge 202 commits intostratosphereips:developstratosphereips/StratosphereLinuxIPS:developfrom d-strat:developd-strat/Slips:developCopy head branch name to clipboard

+6,528-83

Commits

Commits on Oct 3, 2024

• Merge modules/FidesModule from David-enhance-fides-module branch to keep progress and have a fresh start

  d-strat

  committed
  f440c84

• Let go, PyCharm knows

  d-strat

  committed
  422e43f

• Trust Databases are now running.

  d-strat

  committed
  550c453

Commits on Oct 4, 2024

• Add all Fides' channels and save progress before implementing new knowledge of pubsub.

  d-strat

  committed
  2ccc87e

Commits on Oct 6, 2024

• Fix Hardcoded path and update gitignore.

  d-strat

  committed
  79e6ceb

• Import Changes made during Alya/David meeting.

  d-strat

  committed
  cd47da7

Commits on Oct 8, 2024

• Fix messaging queues or leave them out wherever possible

  d-strat

  committed
  8be78bc

• Cleanup channels and test prints

  d-strat

  committed
  05bebf7

• Delete outdated codestück

  d-strat

  committed
  a0878cf

• Fix and update fides module logger to fit current slips.

  d-strat

  committed
  c93f218

• Fix typo in original redis wrapper.

  d-strat

  committed
  e9820c2

Commits on Oct 9, 2024

• Create files and prepare for database implementation.

  d-strat

  committed
  35eafc0

Commits on Oct 10, 2024

• Implement SlipsThreatIntelligenceDatabase, class to get Fides' TI by target.

  d-strat

  committed
  134ef64

• Update peer to make it possible to use json.dump on it

  d-strat

  committed
  57d20c6

• Implement storing and retrieving connected P2P peers.

  d-strat

  committed
  dcf4666

Commits on Oct 11, 2024

• Delete obsolete messaging interface code

  d-strat

  committed
  472a027

• Implement storing and retrieving trust data to and from redis database.

  d-strat

  committed
  8fc2a6a

• Implement caching of threat intelligence.

  d-strat

  committed
  69aecb2

Commits on Oct 15, 2024

• Implement base for SQLite database.

  d-strat

  committed
  8fb0228

• Implement dictionary conversions.

  d-strat

  committed
  b9d3c45

• Fix time

  d-strat

  committed
  f365ab0

• Add dictionary conversions to recommendation_history.py.

  d-strat

  committed
  f3bf240

• Add sqldatabase to trust.py

  d-strat

  committed
  40d230f

• Write table creation to p2p SQL database.

  d-strat

  committed
  5325a61

Commits on Oct 17, 2024

• Add PeerTrustData table to store corresponding datatype, finish database design.

  d-strat

  committed
  5bfd291

• Fix database design, PeerTrustData 1 to many RecommendationHistory, 1 to many ServiceHistory.

  d-strat

  committed
  2748678

• Add missing function to template

  d-strat

  committed
  e902d80

• Improve storage of PeerInfo list with different use cases in mind. Organize code.

  d-strat

  committed
  a8d55a8

• Implement connected peers backing up in a SQLite database as well as recovery (after losing Redis data)

  d-strat

  committed
  7b1bd94

Commits on Oct 18, 2024

• Implement get_peers_with_organisations, functions that gets list of peers that are members of organisations specified on input.

  d-strat

  committed
  06dc8df

• Merge branch 'stratosphereips:master' into david-feature-fides-module-rewrite

  d-strat

  authored
  d43d4b6

Commits on Oct 21, 2024

• Protect query execution from race condition.

  d-strat

  committed
  5fff215

• Update database design to be able to stere truly everything.

  d-strat

  committed
  1265d32

Commits on Oct 22, 2024

• Adds a function that gives all peers in form of PeerInfo that have recommendation trust above given trash-hold.

  d-strat

  committed
  436748a

• Add SQLite fallback for get_peer_trust_data()

  d-strat

  committed
  7939771

• Add thread safe function that stores data into the SQLite database, to sqlite_db.py

  d-strat

  committed
  5a16061

• Enrobust get_peer_trust_data() function

  d-strat

  committed
  56ed053

• Add SQLite-equivalent to Redis function to store_peer_trust_data()

  d-strat

  committed
  ed9c192

• Resolve caching TODOs

  d-strat

  committed
  2ffe451

• Implement get peers with organisation using Slips' DatabaseManager.

  d-strat

  committed
  5c3f9fe

• Merge remote-tracking branch 'origin/david-feature-fides-module-rewrite' into david-feature-fides-module-rewrite

  d-strat

  committed
  d1b0161

• Implement creator for testing database.

  d-strat

  committed
  95a4440

Commits on Oct 23, 2024

• Get TIEvaluation from file using the original configuration-reading methods.

  d-strat

  committed
  211f41a

• Add save() to Slips' Redis database and accommodate get_for() to the changes.

  d-strat

  committed
  eea662d

• Add save() to Slips' Redis database and accommodate get_for() to the changes.

  d-strat

  committed
  486e144

• Add backup of SLipsThreatIntelligence from threat_intelligence.py into sqlite_db.py - SQLiteDB.

  d-strat

  committed
  877413f

• Add comments

  d-strat

  committed
  28bb6fd

• Merge branch 'trust_database_sql_queries' into david-feature-fides-module-rewrite

  Show description for a6a53e6
  d-strat

  committed
  a6a53e6

Commits on Oct 24, 2024

• Add base class for SQlite DB tests

  d-strat

  committed
  6781468

• Fix __dict__ -> dict

  d-strat

  committed
  0d3f680

• Fix __dict__ -> dict

  d-strat

  committed
  50d018a

• Fix __dict__ -> dict

  d-strat

  committed
  9fe34d5

• Fix __dict__ -> dict

  d-strat

  committed
  54560be

• Fix table-creation-query for PeerTrustData.

  d-strat

  committed
  10ea5d3

• Fix slips threat intelligence test and table

  d-strat

  committed
  75d335a

• Fix test_store_slips_threat_intelligence

  d-strat

  committed
  a2595b5

• Fix test_get_slips_threat_intelligence_by_target

  d-strat

  committed
  06c1786

• Make database lock reentrant - atomicity of multi-table-altering queries

  d-strat

  committed
  abf6c3f

• Fix sample values test_get_peer_trust_data

  d-strat

  committed
  20e806a

• Fix test values.

  d-strat

  committed
  923e61b

• Fix peer info storage

  d-strat

  committed
  a3263be

Commits on Oct 25, 2024

• Merge branch 'write-sqlite-db-tests' into david-feature-fides-module-rewrite

  d-strat

  committed
  90a6bbe

• Merge remote-tracking branch 'upstream/develop' into david-feature-fides-module-rewrite

  d-strat

  committed
  fcbb524

Commits on Oct 27, 2024

• Cleanup and fixes: id access in store_peer_trust_data and Redis call in cache_network_opinion was missing time argument

  d-strat

  committed
  5d0c742

Commits on Oct 31, 2024

• Merge pull request stratosphereips#1055 from stratosphereips/develop

  Show description for 6e6bc6f
  AlyaGomaa

  authored
  6e6bc6f

• Make database imports point to the correct database, plus minor fixes

  d-strat

  committed
  492c4c3

Commits on Nov 12, 2024

• Merge remote-tracking branch 'upstream/develop' into develop

  d-strat

  committed
  8a7ba6a

• Merge remote-tracking branch 'upstream/develop' into david-feature-fides-module-rewrite

  d-strat

  committed
  ab34ff7

Commits on Nov 15, 2024

• Create a base for fides module testing

  d-strat

  committed
  0e40c00

• Fix Fides sqlite database' logging

  d-strat

  committed
  1490570

Commits on Nov 18, 2024

• Add pre main test with database cleanup

  d-strat

  committed
  8d4d2c0

Commits on Nov 19, 2024

• Add descriptions to tests and fidesModule.py

  d-strat

  committed
  77f02ec

• Create a base for fides documentation

  d-strat

  committed
  ebe5f36

• Merge branch 'test-messaging' into develop

  d-strat

  committed
  085aa98

• Write Fides Module documentation.

  d-strat

  committed
  9743063

• Fix fide module documentation

  d-strat

  committed
  b4ed358

• Add Fides' Module database to .gitignore

  d-strat

  committed
  319f77f

• Merge modules/FidesModule from David-enhance-fides-module branch to keep progress and have a fresh start

  d-strat

  committed
  86b2c60

• Let go, PyCharm knows

  d-strat

  committed
  5f80700

• Trust Databases are now running.

  d-strat

  committed
  4c49c28

• Add all Fides' channels and save progress before implementing new knowledge of pubsub.

  d-strat

  committed
  7999152

• Fix Hardcoded path and update gitignore.

  d-strat

  committed
  68b013a

• Import Changes made during Alya/David meeting.

  d-strat

  committed
  83ea0c6

• Fix messaging queues or leave them out wherever possible

  d-strat

  committed
  3d955f0

• Cleanup channels and test prints

  d-strat

  committed
  900b373

• Delete outdated codestück

  d-strat

  committed
  0a07431

• Fix and update fides module logger to fit current slips.

  d-strat

  committed
  0f9fc2f

• Fix typo in original redis wrapper.

  d-strat

  committed
  d7e932d

• Create files and prepare for database implementation.

  d-strat

  committed
  e560bc1

• Implement SlipsThreatIntelligenceDatabase, class to get Fides' TI by target.

  d-strat

  committed
  b8f7651

• Update peer to make it possible to use json.dump on it

  d-strat

  committed
  7f7a349

• Implement storing and retrieving connected P2P peers.

  d-strat

  committed
  a0cf1e3

• Delete obsolete messaging interface code

  d-strat

  committed
  4503911

• Implement storing and retrieving trust data to and from redis database.

  d-strat

  committed
  c9cad72

• Implement caching of threat intelligence.

  d-strat

  committed
  95ca713

• Implement base for SQLite database.

  d-strat

  committed
  91ebcc1

• Implement dictionary conversions.

  d-strat

  committed
  281ac6d

• Fix time

  d-strat

  committed
  17b69e3

• Add dictionary conversions to recommendation_history.py.

  d-strat

  committed
  ddad024

• Add sqldatabase to trust.py

  d-strat

  committed
  90e567f

• Write table creation to p2p SQL database.

  d-strat

  committed
  65a17e2

• Add PeerTrustData table to store corresponding datatype, finish database design.

  d-strat

  committed
  ab974da

• Fix database design, PeerTrustData 1 to many RecommendationHistory, 1 to many ServiceHistory.

  d-strat

  committed
  737a6b8

• Add missing function to template

  d-strat

  committed
  9b0a0fc

• Improve storage of PeerInfo list with different use cases in mind. Organize code.

  d-strat

  committed
  da5b332

• Implement connected peers backing up in a SQLite database as well as recovery (after losing Redis data)

  d-strat

  committed
  5b37262

• Implement get peers with organisation using Slips' DatabaseManager.

  d-strat

  committed
  bcedebe

• Get TIEvaluation from file using the original configuration-reading methods.

  d-strat

  committed
  d25dec5

• Add save() to Slips' Redis database and accommodate get_for() to the changes.

  d-strat

  committed
  cdc1881

• Implement get_peers_with_organisations, functions that gets list of peers that are members of organisations specified on input.

  d-strat

  committed
  0c44d22

• Protect query execution from race condition.

  d-strat

  committed
  0449dcf

• Update database design to be able to stere truly everything.

  d-strat

  committed
  fd62123

• Adds a function that gives all peers in form of PeerInfo that have recommendation trust above given trash-hold.

  d-strat

  committed
  15617e0

• Add SQLite fallback for get_peer_trust_data()

  d-strat

  committed
  aed65ff

• Add thread safe function that stores data into the SQLite database, to sqlite_db.py

  d-strat

  committed
  0ec7150

• Enrobust get_peer_trust_data() function

  d-strat

  committed
  b4fbf23

• Add SQLite-equivalent to Redis function to store_peer_trust_data()

  d-strat

  committed
  3acaa9b

• Resolve caching TODOs

  d-strat

  committed
  89b6aa9

• Implement creator for testing database.

  d-strat

  committed
  aad1545

• Add backup of SLipsThreatIntelligence from threat_intelligence.py into sqlite_db.py - SQLiteDB.

  d-strat

  committed
  5f38d15

• Add comments

  d-strat

  committed
  193d35c

• Fix __dict__ -> dict

  d-strat

  committed
  0ef55cd

• Add base class for SQlite DB tests

  d-strat

  committed
  77f47cf

• Fix __dict__ -> dict

  d-strat

  committed
  95fab9d

• Fix __dict__ -> dict

  d-strat

  committed
  af72a89

• Fix table-creation-query for PeerTrustData.

  d-strat

  committed
  81e0d7b

• Fix slips threat intelligence test and table

  d-strat

  committed
  9d6e44a

• Fix test_store_slips_threat_intelligence

  d-strat

  committed
  134bfef

• Fix test_get_slips_threat_intelligence_by_target

  d-strat

  committed
  5fad83a

• Make database lock reentrant - atomicity of multi-table-altering queries

  d-strat

  committed
  4b70607

• Fix sample values test_get_peer_trust_data

  d-strat

  committed
  ad63e96

• Fix test values.

  d-strat

  committed
  65a5e01

• Fix peer info storage

  d-strat

  committed
  2664757

• Cleanup and fixes: id access in store_peer_trust_data and Redis call in cache_network_opinion was missing time argument

  d-strat

  committed
  92acabd

• Make database imports point to the correct database, plus minor fixes

  d-strat

  committed
  db3419a

• Create a base for fides module testing

  d-strat

  committed
  71b673f

• Fix Fides sqlite database' logging

  d-strat

  committed
  35bbb27

• Add pre main test with database cleanup

  d-strat

  committed
  e5eedd8

• Add descriptions to tests and fidesModule.py

  d-strat

  committed
  2e84540

• Create a base for fides documentation

  d-strat

  committed
  d352246

• Write Fides Module documentation.

  d-strat

  committed
  9ade8c8

• Fix fide module documentation

  d-strat

  committed
  82844d8

• Add Fides' Module database to .gitignore

  d-strat

  committed
  a635c49

• Merge remote-tracking branch 'origin/develop' into develop

  Show description for a20aa10
  d-strat

  committed
  a20aa10

• Fix trust.py after merge

  d-strat

  committed
  76d9610

• Clean the Slips output from network_bridge.py logger

  d-strat

  committed
  5fd111f

Commits on Nov 21, 2024

• Addressed PR comments: Fix link in docs

  d-strat

  committed
  ec35135

• Addressed PR comments: Add description

  d-strat

  committed
  2407943

• Addressed PR comments: Shorten the description for better readability and understandability

  d-strat

  committed
  b5d696f

Commits on Nov 22, 2024

• fides: remove error handling from module's main, use the IModule's try except instead

  AlyaGomaa

  committed
  1fde730

• fides: only run on interface and when use_p2p is enabled in slips.yaml

  AlyaGomaa

  committed
  8397fb4

• move fides sqlite db tests to the tests/ dir and run them using CI

  AlyaGomaa

  committed
  0ce6337

• Make fides_module.md visible in the docs

  AlyaGomaa

  committed
  7f143ef

Commits on Nov 25, 2024

• pre-commit: exclude sqlite_db.py from ruff

  AlyaGomaa

  committed
  e44e9a9

• Fides: cleanup opened threads on temrination

  AlyaGomaa

  committed
  8bcad6f

• Fides: split long lines

  AlyaGomaa

  committed
  c99e893

• p2ptrust: remove pigeon warnings when the pigeon is shutdown gracefully (ret_code = 0)

  AlyaGomaa

  committed
  afa54f2

• Cleanup of obsolete files

  d-strat

  committed
  94f72e2

Commits on Nov 26, 2024

• Cleanup of obsolete files

  d-strat

  committed
  8e59860

• Cleanup of obsolete files

  d-strat

  committed
  50ae758

• Adding the correct channels to fidesModule.py

  d-strat

  committed
  466562c

• Rename queueF.py to redis_simplex_queue.py in modules/fidesModule/messaging

  d-strat

  committed
  aab6284

• Resurrecting files that were in use

  d-strat

  committed
  e7647bd

• Clean up obsolete files from persistence with an E, move the useful ones to persistance with an A, rename files that had to be renamed, give more descriptive names and rename imports in many parts …

  Show description for d2d473a
  d-strat

  committed
  d2d473a

• Rename persistAnce -> persistEnce

  d-strat

  committed
  2af1afa

Commits on Nov 27, 2024

• fides: fix err connecting to new_ip channel

  AlyaGomaa

  committed
  62f7c54

• add an option in the config to enable fides instead of enabling it with the local p2p

  AlyaGomaa

  committed
  b7e676a

• fides: validate IPs before sending to other peers

  AlyaGomaa

  committed
  fb18284

• update PR with the latest develop

  AlyaGomaa

  committed
  db85834

Commits on Nov 29, 2024

• Merge remote-tracking branch 'upstream/develop' into develop

  Show description for 78c2dce
  d-strat

  committed
  78c2dce

• Add finished high level docks for Fides Module.

  d-strat

  committed
  7d1bc63

Commits on Dec 1, 2024

• Add messaging - NetworkBridge, Queue - tests

  d-strat

  committed
  b7fecfb

Commits on Dec 4, 2024

• Merge remote-tracking branch 'upstream/develop' into develop

  d-strat

  committed
  6ad67ce

• run fides on growing zeek dir

  AlyaGomaa

  committed
  298c3d7

• add an integration test for fides

  AlyaGomaa

  committed
  21b21ad

• Merge remote-tracking branch 'origin/develop' into develop

  d-strat

  committed
  f27db24

• add fides config file for testing

  AlyaGomaa

  committed
  84c2f52

• Merge remote-tracking branch 'origin/develop' into develop

  d-strat

  committed
  b25ae7a

• Merge remote-tracking branch 'origin/develop' into fork/d-strat/develop

  AlyaGomaa

  committed
  77e0c77

• fides: change verbose lvl of fides logs

  AlyaGomaa

  committed
  17cebcb

• test_fides: countdown until sigterm

  AlyaGomaa

  committed
  84aeb29

• rename p2p_db.sqlite and change its location

  AlyaGomaa

  committed
  f61fd1d

• update fides test

  AlyaGomaa

  committed
  ad9a31d

• Merge remote-tracking branch 'origin/develop' into develop

  d-strat

  committed
  a960ee1

Commits on Dec 5, 2024

• Add cwd to integration/e2e test for Fides Module

  d-strat

  committed
  5a11178

• Add temporary receive in fidesModule.py to pass test

  d-strat

  committed
  bb0cebe

• Ignore tmp directory

  d-strat

  committed
  36864fe

• Ignore tmp directory fix

  d-strat

  committed
  f84c440

• Fix possible cause of crashing

  d-strat

  committed
  94dc981

• .pre-commit-config.yaml: fix exclude regex

  AlyaGomaa

  committed
  642f5b2

• rm output dir after the fides test is done

  AlyaGomaa

  committed
  f1b7fba

• Merge remote-tracking branch 'd-strat/develop' into fork/d-strat/develop

  AlyaGomaa

  committed
  680ddbe

Commits on Dec 6, 2024

• Add Optional to data handling classes

  d-strat

  committed
  cde4baa

• Disable sqlite's thread safety feature, own thread safety is implemented

  d-strat

  committed
  3bc3ce0

• Fix id extraction

  d-strat

  committed
  a8ee278

Commits on Dec 9, 2024

• fides: move fides_p2p_db.sqlite to the main slips dir instead of the output dir

  AlyaGomaa

  committed
  00d8598

Commits on Dec 23, 2024

• Merge remote-tracking branch 'origin/develop' into develop

  d-strat

  committed
  fda083b

Commits on Dec 26, 2024

• Create proper integration test for Fides module (currently partial asserts)

  d-strat

  committed
  557b164

• Updating gitignore and docks (minor)

  d-strat

  committed
  5d73aa3

Commits on Dec 29, 2024

• Fix fides module (manual integration testing using debugging)

  d-strat

  committed
  185b396

• Fixing fides module second test

  d-strat

  committed
  3481344

• Update Fides documentation, add messaging support to programmers notes

  d-strat

  committed
  efd594a