Commit Graph

400 Commits

Author SHA1 Message Date
26bcb10409 Merge pull request #177 from pemontto/feature-nessus-json-latest
Beta 2.0 initial commit

A number of changes in this PR. Many fixes and cleanups, some bug fixes, and the first steps towards a vulnerability standard.
- Nessus and Tenable output as JSON
- Start of vulnerability standard (mapping and transform methods for all modules)
- Removed ELK5
- Overhauled Logstash configs
- Support for alternative Qualys WAS CSV headers
- More unicode fixes
- Mock tests for Qualys WAS and OpenVAS

Todo:
- Continue standardising modules, bring nessus/tenable inline with others
- Write better end-to-end tests and include Qualys WAS and OpenVAS
2019-05-02 11:10:17 +02:00
74dd2d7ae7 remove from root 2019-05-02 08:32:04 +01:00
9c27f5d4a2 kibana object updates 2019-05-01 20:51:49 +01:00
98a84af5d0 use web_application_name as asset 2019-05-01 20:50:41 +01:00
e2c2b47d4d update kibana API objects 2019-05-01 19:39:48 +01:00
5b6a51f02c add unique document id 2019-05-01 17:51:46 +01:00
ea864d09ac write output to .tmp then rename 2019-05-01 10:33:37 +01:00
be06f4811a fix whitespace 2019-04-30 08:34:33 +01:00
762734d6a6 cleanups 2019-04-29 22:39:44 +01:00
e752655990 add nessus API key support 2019-04-29 17:26:14 +01:00
eb9695605b more flexible config support 2019-04-29 17:00:27 +01:00
47409ba0b9 more Qualys WAS mappings and transforms 2019-04-29 16:22:02 +01:00
1a0406fdb2 Fix indents 2019-04-29 16:20:07 +01:00
b31d1b8098 Support tenable API keys 2019-04-29 16:18:07 +01:00
b49dfbde89 Update docker test for new doc count 2019-04-27 17:14:11 +01:00
92cad06b2b Update Qualys WAS mapping and transforms 2019-04-27 07:26:35 +01:00
e8340e6b67 Support alternate Qualys WAS CSV header 2019-04-27 07:23:37 +01:00
f922e396de Add mock tests for qualys web 2019-04-25 14:14:03 +01:00
7919d3e569 Remove counter for nessus download 2019-04-25 14:13:31 +01:00
5264aea802 Fix qualys web unicode issues 2019-04-25 11:31:04 +01:00
c320fc8c63 Specify master branch 2019-04-25 11:05:06 +01:00
afffef306a Update submodule to latest commit 2019-04-25 10:59:18 +01:00
5539dd4ed8 Fix docker tests output 2019-04-24 11:43:29 +10:00
97ed4c7838 Update cvss extraction regex 2019-04-24 09:31:21 +10:00
ac364f149d Update docker test output 2019-04-24 09:25:22 +10:00
abf6b9f048 Remove debug output from logstash 2019-04-24 09:25:02 +10:00
d41011a5ed refactor qualys cvss extraction 2019-04-24 09:20:27 +10:00
24cf2ca623 Add OpenVAS mock endpoints 2019-04-24 09:06:05 +10:00
73ae99f054 reorganise imports 2019-04-24 09:03:14 +10:00
51fa81cb05 restructure and write openvas to db 2019-04-23 16:59:55 +10:00
7999810d28 fix qualys logstash conditionals 2019-04-22 13:48:25 +10:00
50f4d76fec move setup.py install to install 2019-04-22 12:34:21 +10:00
85cca87e58 move fields from logstash into vulnwhisperer 2019-04-22 11:41:51 +10:00
0c3200567e remove unnecessary groks 2019-04-22 11:38:41 +10:00
8d59831855 don't use reserved _timestamp 2019-04-22 11:18:49 +10:00
7c2aa54156 refactor cvss normalisation 2019-04-22 10:56:01 +10:00
2b6afe31c2 minor updates 2019-04-18 16:12:54 +10:00
e6c397397b Update mappings and transforms 2019-04-18 11:34:01 +10:00
a2e27d816b Ensure empty fields are output as nulls 2019-04-18 11:33:25 +10:00
e3907940bc remove unnecessary conditional 2019-04-17 19:27:04 +10:00
08334973be bring inline with master 2019-04-17 19:10:21 +10:00
50f6c43a2f Remove ELK5 resources 2019-04-17 19:05:10 +10:00
60c56b778e Update README.md
Fixed link references
1.8.0
2019-04-17 10:52:13 +02:00
093f963adf Merge pull request #170 from HASecuritySolutions/beta-1.8
VulnWhisperer Release 1.8
2019-04-17 10:36:35 +02:00
3464cfed68 Merge pull request #174 from pemontto/docker-fixes
Docker fixes
2019-04-17 10:29:32 +02:00
9c7600b264 Updates for normalised fields and json output 2019-04-17 16:31:37 +10:00
eea417a0d9 fix cvss info severity 2019-04-17 16:31:23 +10:00
e8d0c71bfb Merge branch 'docker-fixes' into feature-nessus-json-latest
* docker-fixes: (33 commits)
  fix test output
  set default path and fix restore
  Set limit to bail out on
  increase timeout for ES sync
  restore deleted files
  Test updates
  Move vulnwhisperer tests to a script
  standardise /tmp to /opt
  Update test
  Add docker test script
  Expose Logstash API port
  sudo chown
  fix
  Fix permissions for ES
  Fix build command
  Test travis docker
  update kibana objects to match template
  update index template
  Retry template installation a few times
  Add initial ELK6 index template
  ...

# Conflicts:
#	.travis.yml
#	configs/test.ini
#	docker-compose-test.yml
#	docker-compose.v6.yml
#	resources/elk5-old_compatibility/logstash/1000_nessus_process_file.conf
#	resources/elk6/init_kibana.sh
#	resources/elk6/pipeline/1000_nessus_process_file.conf
#	resources/elk6/pipeline/2000_qualys_web_scans.conf
#	resources/elk6/pipeline/3000_openvas.conf
2019-04-17 15:40:19 +10:00
c78f22ed88 Merge pull request #12 from pemontto/travis-docker-latest 2019-04-17 15:09:37 +10:00
c3167bd76b fix test output 2019-04-17 14:52:03 +10:00