Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fides Module #1073

Open
wants to merge 202 commits into
base: develop
Choose a base branch
from
Open

Fides Module #1073

wants to merge 202 commits into from

Conversation

d-strat
Copy link

@d-strat d-strat commented Nov 19, 2024

Fixes Issue

Changes proposed

Adding Fides Module, based on previous work of LukasForst. Updating, rewriting and enriching the base code.

Steps you followed to test the changes purposed in this PR:

  • Running Slips on test file with Fides Module in place
  • Tests for Fides Modules part
  • Tests for whole Fides Module

Check List (Check all the applicable boxes)

  • My code follows the code style of this project.
  • My change requires changes to the documentation.
  • I have updated the documentation accordingly.
  • All new and existing tests passed.
  • This PR does not contain plagiarized content.
  • The title of my pull request is a short description of the requested changes.

Screenshots

Screenshot from 2024-11-19 21-22-07
Screenshot from 2024-11-19 21-21-38

Note to reviewers

Last update from stratosphereips (around Nov 15) passed the CI/CD pipelines.

d-strat added 30 commits October 3, 2024 11:26
@d-strat
Merge modules/FidesModule from David-enhance-fides-module branch to k…
f440c84 
…eep progress and have a fresh start
@d-strat
Let go, PyCharm knows
422e43f
@d-strat
Trust Databases are now running.
550c453
@d-strat
Add all Fides' channels and save progress before implementing new kno…
2ccc87e 
…wledge of pubsub.
@d-strat
Fix Hardcoded path and update gitignore.
79e6ceb
@d-strat
Import Changes made during Alya/David meeting.
cd47da7
@d-strat
Fix messaging queues or leave them out wherever possible
8be78bc
@d-strat
Cleanup channels and test prints
05bebf7
@d-strat
Delete outdated codestück
a0878cf
@d-strat
Fix and update fides module logger to fit current slips.
c93f218
@d-strat
Fix typo in original redis wrapper.
e9820c2
@d-strat
Create files and prepare for database implementation.
35eafc0
@d-strat
Implement SlipsThreatIntelligenceDatabase, class to get Fides' TI by …
134ef64 
…target.
@d-strat
Update peer to make it possible to use json.dump on it
57d20c6
@d-strat
Implement storing and retrieving connected P2P peers.
dcf4666
@d-strat
Delete obsolete messaging interface code
472a027
@d-strat
Implement storing and retrieving trust data to and from redis database.
8fc2a6a
@d-strat
Implement caching of threat intelligence.
69aecb2
@d-strat
Implement base for SQLite database.
8fb0228
@d-strat
Implement dictionary conversions.
b9d3c45
@d-strat
Fix time
f365ab0
@d-strat
Add dictionary conversions to recommendation_history.py.
f3bf240
@d-strat
Add sqldatabase to trust.py
40d230f
@d-strat
Write table creation to p2p SQL database.
5325a61
@d-strat
Add PeerTrustData table to store corresponding datatype, finish datab…
5bfd291 
…ase design.
@d-strat
Fix database design, PeerTrustData 1 to many RecommendationHistory, 1…
2748678 
… to many ServiceHistory.
@d-strat
Add missing function to template
e902d80
@d-strat
Improve storage of PeerInfo list with different use cases in mind. Or…
a8d55a8 
…ganize code.
@d-strat
Implement connected peers backing up in a SQLite database as well as …
7b1bd94 
…recovery (after losing Redis data)
@d-strat
Implement get_peers_with_organisations, functions that gets list of p…
06dc8df 
…eers that are members of organisations specified on input.
d-strat and others added 30 commits December 4, 2024 13:34
@d-strat
Merge remote-tracking branch 'upstream/develop' into develop
6ad67ce
@AlyaGomaa
run fides on growing zeek dir
298c3d7
@AlyaGomaa
add an integration test for fides
21b21ad
@d-strat
Merge remote-tracking branch 'origin/develop' into develop
f27db24
@AlyaGomaa
add fides config file for testing
84c2f52
@d-strat
Merge remote-tracking branch 'origin/develop' into develop
b25ae7a
@AlyaGomaa
Merge remote-tracking branch 'origin/develop' into fork/d-strat/develop
77e0c77
@AlyaGomaa
fides: change verbose lvl of fides logs
17cebcb
@AlyaGomaa
test_fides: countdown until sigterm
84aeb29
@AlyaGomaa
rename p2p_db.sqlite and change its location
f61fd1d
@AlyaGomaa
update fides test
ad9a31d
@d-strat
Merge remote-tracking branch 'origin/develop' into develop
a960ee1
@d-strat
Add cwd to integration/e2e test for Fides Module
5a11178
@d-strat
Add temporary receive in fidesModule.py to pass test
bb0cebe
@d-strat
Ignore tmp directory
36864fe
@d-strat
Ignore tmp directory fix
f84c440
@d-strat
Fix possible cause of crashing
94dc981
@AlyaGomaa
.pre-commit-config.yaml: fix exclude regex
642f5b2
@AlyaGomaa
rm output dir after the fides test is done
f1b7fba
@AlyaGomaa
Merge remote-tracking branch 'd-strat/develop' into fork/d-strat/develop
680ddbe
@d-strat
Add Optional to data handling classes
cde4baa
@d-strat
Disable sqlite's thread safety feature, own thread safety is implemented
3bc3ce0
@d-strat
Fix id extraction
a8ee278
@AlyaGomaa
fides: move fides_p2p_db.sqlite to the main slips dir instead of the …
00d8598 
…output dir
@d-strat
Merge remote-tracking branch 'origin/develop' into develop
fda083b
@d-strat
Create proper integration test for Fides module (currently partial as…
557b164 
…serts)
@d-strat
Updating gitignore and docks (minor)
5d73aa3
@d-strat
Fix fides module (manual integration testing using debugging)
185b396
@d-strat
Fixing fides module second test
3481344
@d-strat
Update Fides documentation, add messaging support to programmers notes
efd594a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AlyaGomaa AlyaGomaa AlyaGomaa left review comments

Assignees
No one assigned
Labels
None yet
Projects
Slips
Status: Todo
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@d-strat @AlyaGomaa