Project

General

Profile

Actions

Story #6597

open

Task #4772: tracking: parity between fields logged and fields available for detection

rules: improve rules keyword/output parity

Added by Juliana Fajardini Reichow over 1 year ago. Updated 6 months ago.

Status:
New
Priority:
Normal
Assignee:
Target version:

Description

For each application layer protocol, the overall process should be:

i. document the output of running
src/suricata --list-keyword | grep <app-proto>
ii. document the output of the complete EVE log for said protocol
iii. compare that to the schema.json for the app-proto
iv. complete the schema, if needed
v. group the documented outputs from steps i. and ii. by type (e.g. integers)
vi. list candidates for implementation (either as keywords or missing output fields), and share the list on the adequate ticket, request feedback for that on ticket
vii. implement keywords or missing output fields as agreed upon
viii. create or update SV tests to cover new fields/keywords
ix. document new fields/keywords

Deliverables:
iv, vii, viii, ix


Related issues 20 (16 open4 closed)

Related to Suricata - Documentation #6478: schema: add missing fieldsNewCommunity TicketActions
Related to Suricata - Feature #7095: rdp: keywords additionsNewOISF DevActions
Related to Suricata - Feature #7100: smb: additional keywordsNewOISF DevActions
Related to Suricata - Feature #6198: smtp: add keywords for use in rulesNewOISF DevActions
Blocked by Suricata - Feature #5642: DNS: parity between log fields and detectionAssignedJason IshActions
Blocked by Suricata - Feature #4153: app-layer: rust derive style macros to generate common codeAssignedJason IshActions
Blocked by Suricata - Task #6476: ftp: parity of logging and detection buffersIn ProgressJeff LucovskyActions
Blocked by Suricata - Task #6473: detect: smtp keyword coverageAssignedVictor JulienActions
Blocked by Suricata - Task #6463: eve/output: investigate how to track coverage / parityIn ProgressJason IshActions
Blocked by Suricata - Task #7452: ldap: add keywords to match outputIn ProgressAlice da Silva AkakiActions
Blocked by Suricata - Feature #7586: mime: expose 'headers' as a keywordNewOISF DevActions
Blocked by Suricata - Feature #7587: mime: add email.body_md5 keywordNewOISF DevActions
Blocked by Suricata - Feature #7588: mime: add email.cc keywordClosedAlice da Silva AkakiActions
Blocked by Suricata - Task #7591: mime: add email.date keywordIn ReviewAlice da Silva AkakiActions
Blocked by Suricata - Feature #7592: mime: add email.from keywordClosedAlice da Silva AkakiActions
Blocked by Suricata - Feature #7593: mime: add email.message_id keywordNewOISF DevActions
Blocked by Suricata - Task #7594: mime: add email.status keywordNewOISF DevActions
Blocked by Suricata - Feature #7595: mime: add email.subject keywordClosedAlice da Silva AkakiActions
Blocked by Suricata - Feature #7596: mime: add email.to keywordClosedAlice da Silva AkakiActions
Blocked by Suricata - Feature #7600: mime: add rule keywordsNewOISF DevActions
Actions #1

Updated by Juliana Fajardini Reichow over 1 year ago

Actions #2

Updated by Juliana Fajardini Reichow over 1 year ago

  • Subtask #5642 added
Actions #3

Updated by Juliana Fajardini Reichow over 1 year ago

  • Description updated (diff)
Actions #4

Updated by Juliana Fajardini Reichow over 1 year ago

  • Related to Task #4772: tracking: parity between fields logged and fields available for detection added
Actions #5

Updated by Philippe Antoine over 1 year ago

My understanding is that the first step is to complete the json schema for DNS.
like tc boolean field is missing (just reviewing the code in rust/src/dns/log.rs and look for js.set_ calls

Actions #6

Updated by Hadiqa Alamdar Bukhari over 1 year ago

  • Status changed from New to In Progress
Actions #7

Updated by Juliana Fajardini Reichow 10 months ago

  • Assignee changed from Hadiqa Alamdar Bukhari to OISF Dev

I'll assign this to OISF Dev, as this is the parent ticket. Thanks for the work you've done, Hadiqa! :)

Actions #8

Updated by Jason Ish 9 months ago

Actions #9

Updated by Lukas Sismis 9 months ago

Actions #10

Updated by Victor Julien 9 months ago

  • Subject changed from rules keyword/output parity: improve to tracking: impove rules keyword/output parity
  • Status changed from In Progress to New
  • Assignee changed from OISF Dev to Victor Julien
  • Target version changed from 8.0.0-beta1 to 8.0.0
Actions #11

Updated by Victor Julien 9 months ago

  • Parent task set to #4772
Actions #12

Updated by Victor Julien 9 months ago

  • Subtask deleted (#5642)
Actions #13

Updated by Victor Julien 9 months ago

  • Blocked by Feature #5642: DNS: parity between log fields and detection added
Actions #14

Updated by Victor Julien 9 months ago

  • Blocked by Feature #4153: app-layer: rust derive style macros to generate common code added
Actions #15

Updated by Victor Julien 9 months ago

  • Tracker changed from Task to Story
  • Subject changed from tracking: impove rules keyword/output parity to rules: impove rules keyword/output parity
Actions #16

Updated by Juliana Fajardini Reichow 7 months ago

  • Related to Feature #6198: smtp: add keywords for use in rules added
Actions #17

Updated by Juliana Fajardini Reichow 6 months ago

  • Subject changed from rules: impove rules keyword/output parity to rules: improve rules keyword/output parity

edit: fix type in issue subject

Actions #18

Updated by Philippe Antoine 6 months ago

  • Related to Task #6476: ftp: parity of logging and detection buffers added
Actions #19

Updated by Victor Julien 6 months ago

  • Related to deleted (Task #6476: ftp: parity of logging and detection buffers)
Actions #20

Updated by Victor Julien 6 months ago

  • Blocked by Task #6476: ftp: parity of logging and detection buffers added
Actions #21

Updated by Victor Julien 6 months ago

  • Blocked by Task #6473: detect: smtp keyword coverage added
Actions #22

Updated by Juliana Fajardini Reichow 6 months ago

  • Blocked by Task #6463: eve/output: investigate how to track coverage / parity added
Actions #23

Updated by Philippe Antoine 4 months ago

  • Blocked by Task #7452: ldap: add keywords to match output added
Actions #24

Updated by Juliana Fajardini Reichow 21 days ago

  • Blocked by Feature #7586: mime: expose 'headers' as a keyword added
Actions #25

Updated by Juliana Fajardini Reichow 21 days ago

  • Blocked by Feature #7587: mime: add email.body_md5 keyword added
Actions #26

Updated by Juliana Fajardini Reichow 21 days ago

Actions #27

Updated by Juliana Fajardini Reichow 21 days ago

  • Blocked by Task #7591: mime: add email.date keyword added
Actions #28

Updated by Juliana Fajardini Reichow 21 days ago

Actions #29

Updated by Juliana Fajardini Reichow 21 days ago

  • Blocked by Feature #7593: mime: add email.message_id keyword added
Actions #30

Updated by Juliana Fajardini Reichow 21 days ago

  • Blocked by Task #7594: mime: add email.status keyword added
Actions #31

Updated by Juliana Fajardini Reichow 21 days ago

  • Blocked by Feature #7595: mime: add email.subject keyword added
Actions #32

Updated by Juliana Fajardini Reichow 21 days ago

Actions #33

Updated by Juliana Fajardini Reichow 21 days ago

Actions

Also available in: Atom PDF