Commit Graph

432 Commits

Author SHA1 Message Date
39c2f8df2d Merge pull request #180 from pemontto/feature-filter-scans
This PR adds two CLI flags to filter which scans get imported/requested and one to list the scans:

    -f, --filter: allows supplying a regex pattern to match a scan name (this can also be specified in the config file)
    --days: the number of days to look back from the current date for scans (not supported on OpenVAS yet)
    --list: lists scans matching the filters and shows their imported/processed status

Other changes:

    combined all Logstash config into a single file
    create cvss and cvss_severity field which will always be populated from either cvss3 or cvss2
    renamed qualys_web -> qualys_was
    renamed qualys_vuln -> qualys_vm
    renamed plugin -> signature in field mappings
    added a helper script to pull Kibana API objects
    updated ES index template
2019-05-27 18:22:38 +02:00
393ec25003 fix cvssX_severity and qualys_vm dns 2019-05-13 13:20:02 +01:00
dfc4403779 update cvss_severity calculation 2019-05-13 10:01:51 +01:00
bf2d2f86cd better help messages 2019-05-11 09:08:35 +01:00
d05296f516 update scan filtering and listing 2019-05-11 09:07:56 +01:00
fe3b5b272c remove debugging 2019-05-10 19:22:48 +01:00
a3a35502ec allow partial matches for nessus and tenable 2019-05-10 19:21:58 +01:00
e19dfd000c observe days argument for tenable history 2019-05-10 18:40:16 +01:00
927bbe618f don't try to process empty scans 2019-05-10 18:00:28 +01:00
4386001111 allow specifying 0 days 2019-05-10 16:29:07 +01:00
ba3cef409d show by date descending 2019-05-10 16:23:33 +01:00
3f129f8c76 fix output formatting 2019-05-10 16:20:25 +01:00
969c4ae8e5 fix missing paramters 2019-05-10 16:10:20 +01:00
32b54391e5 add option to list available scans 2019-05-10 15:57:39 +01:00
aa9fa5b652 add filter for scan name and days to look back 2019-05-10 12:19:53 +01:00
a432491e7e don't fail if no scans are found 2019-05-10 11:31:38 +01:00
3ce6065b38 simplify pandas operations 2019-05-09 11:30:45 +01:00
6b8e699eb6 make scan_name easily searchable 2019-05-08 17:52:12 +01:00
a8ca4153fc increase file chunk size to 256KB 2019-05-08 17:52:01 +01:00
5ebe05e584 add vendors 2019-05-08 17:51:18 +01:00
f600d0b88c Only set IP if it's an IP 2019-05-08 17:51:05 +01:00
488bd09dad unified logstash config 2019-05-07 17:20:14 +01:00
836515f6d1 update kibana objects 2019-05-07 17:19:31 +01:00
155c3ba163 create unified cvss field 2019-05-07 17:17:53 +01:00
c350ec73c2 map openvas and make risk mapping common 2019-05-07 17:14:42 +01:00
44d75c397f rename qualys modules to be more accurate 2019-05-03 16:39:57 +01:00
fb76b0a1ce rename plugin to signature and cvss_x to cvss2_x 2019-05-03 16:25:29 +01:00
a1671a953f don't overwrite the whole dataframe 😬 2019-05-03 15:25:52 +01:00
ff6fec3a38 logging updates 2019-05-03 15:11:59 +01:00
f441f4f992 fix logging and remove username/password 2019-05-02 18:04:06 +01:00
5df4d127ca remove redunant logic 2019-05-02 11:48:32 +01:00
1597ad13e8 add utility to extract kibana objects 2019-05-02 11:42:41 +01:00
26bcb10409 Merge pull request #177 from pemontto/feature-nessus-json-latest
Beta 2.0 initial commit

A number of changes in this PR. Many fixes and cleanups, some bug fixes, and the first steps towards a vulnerability standard.
- Nessus and Tenable output as JSON
- Start of vulnerability standard (mapping and transform methods for all modules)
- Removed ELK5
- Overhauled Logstash configs
- Support for alternative Qualys WAS CSV headers
- More unicode fixes
- Mock tests for Qualys WAS and OpenVAS

Todo:
- Continue standardising modules, bring nessus/tenable inline with others
- Write better end-to-end tests and include Qualys WAS and OpenVAS
2019-05-02 11:10:17 +02:00
74dd2d7ae7 remove from root 2019-05-02 08:32:04 +01:00
9c27f5d4a2 kibana object updates 2019-05-01 20:51:49 +01:00
98a84af5d0 use web_application_name as asset 2019-05-01 20:50:41 +01:00
e2c2b47d4d update kibana API objects 2019-05-01 19:39:48 +01:00
5b6a51f02c add unique document id 2019-05-01 17:51:46 +01:00
ea864d09ac write output to .tmp then rename 2019-05-01 10:33:37 +01:00
be06f4811a fix whitespace 2019-04-30 08:34:33 +01:00
762734d6a6 cleanups 2019-04-29 22:39:44 +01:00
e752655990 add nessus API key support 2019-04-29 17:26:14 +01:00
eb9695605b more flexible config support 2019-04-29 17:00:27 +01:00
47409ba0b9 more Qualys WAS mappings and transforms 2019-04-29 16:22:02 +01:00
1a0406fdb2 Fix indents 2019-04-29 16:20:07 +01:00
b31d1b8098 Support tenable API keys 2019-04-29 16:18:07 +01:00
b49dfbde89 Update docker test for new doc count 2019-04-27 17:14:11 +01:00
92cad06b2b Update Qualys WAS mapping and transforms 2019-04-27 07:26:35 +01:00
e8340e6b67 Support alternate Qualys WAS CSV header 2019-04-27 07:23:37 +01:00
f922e396de Add mock tests for qualys web 2019-04-25 14:14:03 +01:00