Commit Graph

72 Commits

Author SHA1 Message Date
b31d1b8098 Support tenable API keys 2019-04-29 16:18:07 +01:00
92cad06b2b Update Qualys WAS mapping and transforms 2019-04-27 07:26:35 +01:00
e8340e6b67 Support alternate Qualys WAS CSV header 2019-04-27 07:23:37 +01:00
7919d3e569 Remove counter for nessus download 2019-04-25 14:13:31 +01:00
5264aea802 Fix qualys web unicode issues 2019-04-25 11:31:04 +01:00
97ed4c7838 Update cvss extraction regex 2019-04-24 09:31:21 +10:00
d41011a5ed refactor qualys cvss extraction 2019-04-24 09:20:27 +10:00
73ae99f054 reorganise imports 2019-04-24 09:03:14 +10:00
2b6afe31c2 minor updates 2019-04-18 16:12:54 +10:00
e6c397397b Update mappings and transforms 2019-04-18 11:34:01 +10:00
ee327874e5 Move to a common normalisation function 2019-04-15 21:12:07 +10:00
29a91cbfb2 Simplify pandas operations, update transforms 2019-04-15 17:05:21 +10:00
275b89c94d Create cvss score from base and temporal 2019-04-15 13:32:31 +10:00
5b45da69a8 Add @timestamps to findings, map more fields 2019-04-12 01:49:15 +10:00
ad184689f8 map more qualys_vuln fields 2019-04-11 23:18:42 +10:00
8f9932e56b minor updates 2019-04-11 21:17:24 +10:00
5671b70bdd Add normalisation for qualys_vuln 2019-04-11 20:13:17 +10:00
d6980d8229 Add normalisation, mapping and transform stubs 2019-04-11 20:11:08 +10:00
76d54abdc6 Nessus JSON output with normalisation 2019-04-11 20:09:21 +10:00
74db06b17a Merge pull request #168 from HASecuritySolutions/qualys_was_fix
Qualys was fix
2019-04-10 11:35:37 +02:00
45e23985d3 added comment 2019-04-10 11:25:28 +02:00
cde2fe2dd8 final commit for qualys web 2019-04-10 11:19:44 +02:00
c8d906c05f Fix tenable downloads 2019-04-08 19:30:48 +10:00
1ef7289b8d reduntant replace, formatting 2019-04-08 18:44:30 +10:00
a12e9f70a1 Remove redundant param 2019-04-08 18:38:03 +10:00
873066a419 reorder imports 2019-04-08 17:43:50 +10:00
ec5d6cd388 Iterate through nessus download data 2019-04-08 12:25:50 +10:00
33f2a5a3d1 Use a session and don't overwrite imports 2019-04-08 12:24:22 +10:00
5edde8760a Fix missing sys import 2019-04-06 11:02:42 +11:00
7370f5b608 Merge branch 'beta-1.8' of https://github.com/HASecuritySolutions/VulnWhisperer into beta-1.8 2019-04-05 23:37:41 +02:00
1ef67d48be Feature error codes (#165)
* Use error codes for failed scans

* Fix indentations

* Fix more indentation

* Continue after failed download

* Add tests for failed scans

* Add more tests

* move definition

* Update nessus.py

This function was used by function `print_scans` which at the same time was an unused one that had been deleted in the PR itself.
2019-04-05 11:36:13 +02:00
27412d31b4 Merge branch 'beta-1.8' of https://github.com/HASecuritySolutions/VulnWhisperer into beta-1.8 2019-04-05 11:04:29 +02:00
71352aee57 Add external API mocking and travis tests (#164)
* Fix closing logging handlers

* Fix *some* unicode issues for nessus and qualys

* Prevent multiple requests to nessus scans endpoint

* More unicode fixes

* Remove unnecessary call

* Fix whitespace

* Add mock module and argument

* Add test config and data

* Fix whitespace again

* Disable qualys_web until data is available

* Use logging module

* Delete report_tracker.db

* Cleanup mock calls

* Add httpretty to requirements

* Refactor into a class

* Updates travis tests

* Fix exit codes

* Remove print statements

* Remove test

* Add test directory as submodule
2019-04-05 10:57:39 +02:00
eae64a745d cleanup of unused code and fixes, still breaks 2019-04-04 11:24:01 +02:00
03f7a4cedb fixed line 2019-04-04 11:05:39 +02:00
a30a22ab98 fix wrong parenthesis on qualys was 2019-04-03 15:15:31 +02:00
e32c9bf55d Fix *some* unicode issues for nessus and qualys (#160)
* Fix *some* unicode issues for nessus and qualys

* More unicode fixes
2019-04-01 10:06:16 +02:00
9619a47d7a Fix Tenable and Nessus scan listing (#162)
* Prevent multiple requests to nessus scans endpoint

* Remove unnecessary call
2019-04-01 10:04:12 +02:00
9d52596be9 fix xml encoding issue #156 2019-03-20 08:49:36 +01:00
70e1d7703f fix missing section specification on qualys was connector #156 2019-03-20 08:35:03 +01:00
0ea144bf87 Qualysapi fix (#146)
* moved qualysapi to branch master-update

* fixing bug of qualys scan without vulnerabilities: vulnWhispererQualysVuln[1361] ERROR Could not process scan/1549159480.84792: 'severity'

* change to fixed qualysapi branch

* fix bug and changed to qualysapi fork master branch

* updated submodule to master branch
2019-02-06 17:00:43 +01:00
8bd3c5cab9 Jira extras (#120)
* changing config template paths for qualys

* Update frameworks_example.ini

Will leave for now qualys local folder as "qualys" instead of changing to one for each module, as like this it will still be compatible with the current logstash and we will be able to update master to drop the qualysapi fork once the new version is uploaded to PyPI repository.
PR from qualysapi repo has already been merged, so the only missing is the upload to PyPI.

* initialize variable fullpath to avoid break

* fix get latest scan entry from db and ignore 'potential' not verified vulns

* added host resolv + cache to speed already resolved, jira logging

* make sure that vulnerability criticality appears as a label on ticket + automatic actions

* jira bulk report of scans, fix on nessus logging, jira time resolution and list all ticket reported assets

* added jira ticket data download + change default time window from 6 to 12 months

* small fixes

* jira logstash files

* fix variable confusion (thx Travis :)
2018-11-08 09:24:24 +01:00
cf879b4731 merge with testing 2018-11-05 15:16:22 +01:00
e3e416fe44 Rework logging using the stdlib machinery (#116)
* Rework logging using the stdlib machinery
Use the verbose or debug flag to enable/disable logging.DEBUG
Remove the vprint function from all classes
Remove bcolors from all code
Cleanup [INFO], [ERROR], {success} and similar

* fix some errors my local linter missed but travis catched

* add coloredlogs and --fancy command line flag
2018-11-04 05:39:27 -06:00
4422db586d Jira module fully working (#104)
* clean OS X .DS_Store files

* fix nessus end of line carriage, added JIRA args

* JIRA module fully working

* jira module working with nessus

* added check on already existing jira config, update README

* qualys_vm<->jira working, qualys_vm database entries with qualys_vm, improved checks

* JIRA module updates ticket's assets and comments update

* added JIRA auto-close function for resolved vulnerabitilies

* fix if components variable empty issue

* fix creation of new ticket after updating existing one

* final fixes, added extra line in template

* added vulnerability criticality as label in order to be able to filter
2018-10-12 09:30:14 -05:00
8336b72314 Docker-compose fully working with vulnwhisperer integrated (#90)
* ignore nessus requests warnings

* docker-compose fully working with vulnwhisperer integrated

* remove comments docker-compose

* documenting docker-compose

* Readme corrections

* fix after recheck everything works out of the box

* fix exits that break the no specified section execution mode

* fix docker qualysapi issue, updated README

* revert change on deps/qualysapi/qualysapi/util.py (no effect)

* temporarily changed Dockerfile link to the working one
2018-08-17 08:51:28 -04:00
5b879e13c7 Silence requests warnings 2018-08-14 06:23:18 -04:00
7f2c59f531 Qualys Vulnerability Management integration (#74)
* Add Qualys vulnerability scans

* Use non-zero exit codes for failures

* Convert to strings for Logstash

* Update logstash config for vulnerability scans

* Update README

* Grab all scans statuses

* Add Qualys vulnerability scans

* Use non-zero exit codes for failures

* Convert to strings for Logstash

* Update logstash config for vulnerability scans

* Update README

* Grab all scans statuses

* Fix error: "Cannot convert non-finite values (NA or inf) to integer"

When trying to download the results of Qualys Vulnerability Management scans, the following error pops up:

[FAIL] - Could not process scan/xxxxxxxxxx.xxxxx - Cannot convert non-finite values (NA or inf) to integer

This error is due to pandas operating with the scan results json file, as the last element from the json doesn't fir with the rest of the response's scheme: that element is "target_distribution_across_scanner_appliances", which contains the scanners used and the IP ranges that each scanner went through.

Taking out the last line solves the issue.

Also adding the qualys_vuln scheme to the frameworks_example.ini
2018-07-05 10:34:02 -07:00
38d2eec065 Tenable.io support (#70)
* Basic tenable.io support

* Add tenable config section

* Use existing variable

* Fix indent

* Fix paren

* Use ternary syntax

* Update Logstash config for tenable.io
2018-06-26 13:03:08 -04:00
9b10711d34 Nessus bugfixes (#68)
* Handle cases where no scans are present

* Prevent infinite login loop with incorrect creds

* Print actual config file path

* Don't overwrite Nessus Synopsis with Description
2018-06-13 02:56:06 -04:00