Project

General

Profile

Actions

Bug #715

closed
PM

packet_stats.csv makes odd CPU usage

Bug #715: packet_stats.csv makes odd CPU usage

Added by Peter Manev over 13 years ago. Updated about 10 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Target version:
-
Affected Versions:
Effort:
Difficulty:
Label:

Description

With -- This is Suricata version 1.4dev (rev 5f4c528)

when packet_stats.csv is enabled in suricata.yaml - it appears to work:

root@suricata:/var/data/regit/log/suricata# ls -lh
-rw-r-----  1 root root 146M Jan 12 17:00 fast.log
drwxr-xr-x  2 root root    6 Aug 26 20:17 files
-rw-r-----  1 root root  51M Jan 12 16:53 files-json.log
-rw-r-----  1 root root 111M Jan 12 16:53 http.log
-rw-r--r--  1 root root 129M Jan 12 17:00 packet_stats.csv

root@suricata:/var/data/regit/log/suricata# ls -lh
-rw-r-----  1 root root 146M Jan 12 17:00 fast.log
drwxr-xr-x  2 root root    6 Aug 26 20:17 files
-rw-r-----  1 root root  51M Jan 12 16:53 files-json.log
-rw-r-----  1 root root 111M Jan 12 16:53 http.log
-rw-r--r--  1 root root 183M Jan 12 17:00 packet_stats.csv

root@suricata:/var/data/regit/log/suricata# ls -lh
-rw-r-----  1 root root 146M Jan 12 17:00 fast.log
drwxr-xr-x  2 root root    6 Aug 26 20:17 files
-rw-r-----  1 root root  51M Jan 12 16:53 files-json.log
-rw-r-----  1 root root 111M Jan 12 16:53 http.log
-rw-r--r--  1 root root 237M Jan 12 17:00 packet_stats.csv
root@suricata:/var/data/regit/log/suricata#

however - when that is enabled the CPUs (16 count) are 30% busy.
If packet_stats.csv output is not enabled - the CPUs are back to normal 90% usage.

It is understandable that there is a (higher) performance impact when packet_stats.csv is enabled
(and --enable-profiling configured)
but the impact seems a bit odd in this case -
lower actually.

VJ Updated by Victor Julien over 13 years ago Actions #1

  • Description updated (diff)

VJ Updated by Victor Julien over 13 years ago Actions #2

I think it uses a big lock, so it won't scale. It's not meant to be used in live conditions, more to be used with pcap files and single mode.

PM Updated by Peter Manev over 13 years ago Actions #3

Maybe we can make use of a socket?

VJ Updated by Victor Julien almost 13 years ago Actions #4

  • Target version set to TBD

AH Updated by Andreas Herz about 10 years ago Actions #5

  • Status changed from New to Closed

AH Updated by Andreas Herz about 10 years ago Actions #6

  • Target version deleted (TBD)

not relevant anymore

Actions

Also available in: PDF Atom