Inputs.sysstat /tmp/sysstat-1547164850 failed with exit status 2


#1

I installed telegraf 1.9 on centos 6.8.
telegraf.conf to use inputs.sysstat

The following error occurred:
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -P ALL /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -u /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -v /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -n ALL /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -S /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -w /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -W /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -r /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -R /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -d /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -v /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -q /tmp/sysstat-1547164840 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -W /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -r /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -d /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -u /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -q /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -w /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -S /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -R /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -n ALL /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -P ALL /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -B /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -u /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -v /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -C /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -q /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -P ALL /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -R /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -r /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -n ALL /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -S /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -B /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -b /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -d /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -w /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -W /tmp/sysstat-1547164850 failed with exit status 2
2019-01-11T00:01:00Z E! [inputs.sysstat]: Error in plugin: failed to run command /usr/lib64/sa/sadc -S DISK 9 2 /tmp/sysstat-1547164860: exit status 3 - Invalid system activity file: /tmp/sysstat-1547164860

Help me


#2

Can you paste the relevant section of your config file please?


#3

did you find a solution? I have encountered the same issue.
If not I am highjacking this post :slight_smile: If that is not okay let me know I will create a new post.
Server OS: Ubuntu 18.04
Version of telegraf: 1.9.3-1
Version of sysstat: 11.6.1-1

After setting up telegraf on on Ubuntu 18.04 with telegraf and sysstat i am getting this error in syslog ever 10 sec.:
telegraf[48965]: 2019-01-28T11:03:39Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -R /tmp/sysstat-1548673410 failed with exit status 1

When i run a trace of the command i the log i get the following:
$ strace /usr/bin/sadf -p – -p -R /tmp/sysstat*
execve("/usr/bin/sadf", ["/usr/bin/sadf", “-p”, “–”, “-p”, “-R”, “/tmp/sysstat-1548673190”], 0x7ffe28ee25d8 /* 23 vars */) = 0
brk(NULL) = 0x5563b7255000
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/etc/ld.so.cache”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54107, …}) = 0
mmap(NULL, 54107, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fcff6d8d000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libc.so.6”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260\34\2\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=2030544, …}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fcff6d8b000
mmap(NULL, 4131552, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fcff6783000
mprotect(0x7fcff696a000, 2097152, PROT_NONE) = 0
mmap(0x7fcff6b6a000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1e7000) = 0x7fcff6b6a000
mmap(0x7fcff6b70000, 15072, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fcff6b70000
close(3) = 0
arch_prctl(ARCH_SET_FS, 0x7fcff6d8c540) = 0
mprotect(0x7fcff6b6a000, 16384, PROT_READ) = 0
mprotect(0x5563b65ad000, 4096, PROT_READ) = 0
mprotect(0x7fcff6d9b000, 4096, PROT_READ) = 0
munmap(0x7fcff6d8d000, 54107) = 0
brk(NULL) = 0x5563b7255000
brk(0x5563b7276000) = 0x5563b7276000
openat(AT_FDCWD, “/usr/lib/locale/locale-archive”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=8490000, …}) = 0
mmap(NULL, 8490000, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fcff5f6a000
close(3) = 0
openat(AT_FDCWD, “/usr/share/locale/locale.alias”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=2995, …}) = 0
read(3, “# Locale name alias data base.\n#”…, 4096) = 2995
read(3, “”, 4096) = 0
close(3) = 0
openat(AT_FDCWD, “/usr/share/locale/en_US/LC_MESSAGES/sysstat.mo”, O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/share/locale/en/LC_MESSAGES/sysstat.mo”, O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/share/locale-langpack/en_US/LC_MESSAGES/sysstat.mo”, O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/share/locale-langpack/en/LC_MESSAGES/sysstat.mo”, O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, “Usage: /usr/bin/sadf [ options ]”…, 85Usage: /usr/bin/sadf [ options ] [ [ ] ] [ | -[0-9]+ ]
) = 85
write(2, "Options are:\n[ -C ] [ -c | -d | "…, 215Options are:
[ -C ] [ -c | -d | -g | -j | -p | -r | -x ] [ -H ] [ -h ] [ -T | -t | -U ] [ -V ]
[ -O [,…] ] [ -P { [,…] | ALL } ]
[ -s [ <hh:mm[:ss]> ] ] [ -e [ <hh:mm[:ss]> ] ]
[ – <sar_options> ]
) = 215
exit_group(1) = ?
+++ exited with 1 +++

I have this running on Ubuntu 16.04 where it works, no error log in syslog and the command sadf -p – -p -R /tmp/sysstat… terminates correctly.

When i do an strace of the 16.04 command i get the following:
$ strace /usr/bin/sadf -p – -p -R /tmp/sysstat*
execve("/usr/bin/sadf", ["/usr/bin/sadf", “-p”, “–”, “-p”, “-R”, “/tmp/sysstat-1537179020”], [/* 18 vars /]) = 0
brk(NULL) = 0x5562fe71c000
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=24630, …}) = 0
mmap(NULL, 24630, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fc5e0005000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\t\2\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=1868984, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc5e0004000
mmap(NULL, 3971488, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc5dfa1d000
mprotect(0x7fc5dfbdd000, 2097152, PROT_NONE) = 0
mmap(0x7fc5dfddd000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1c0000) = 0x7fc5dfddd000
mmap(0x7fc5dfde3000, 14752, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc5dfde3000
close(3) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc5e0003000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc5e0002000
arch_prctl(ARCH_SET_FS, 0x7fc5e0003700) = 0
mprotect(0x7fc5dfddd000, 16384, PROT_READ) = 0
mprotect(0x5562fccb1000, 4096, PROT_READ) = 0
mprotect(0x7fc5e000c000, 4096, PROT_READ) = 0
munmap(0x7fc5e0005000, 24630) = 0
brk(NULL) = 0x5562fe71c000
brk(0x5562fe73d000) = 0x5562fe73d000
open("/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=2981280, …}) = 0
mmap(NULL, 2981280, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fc5df745000
close(3) = 0
stat("/tmp/sysstat-1537179020", {st_mode=S_IFREG|0644, st_size=27368, …}) = 0
open("/proc/devices", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=0, …}) = 0
read(3, “Character devices:\n 1 mem\n 4 /”…, 1024) = 509
read(3, “”, 1024) = 0
close(3) = 0
open("/tmp/sysstat-1537179020", O_RDONLY) = 3
read(3, “\226\325s!\v\2\0\0 \1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 76) = 76
read(3, “\214}\237[\0\0\0\0)\0\0\0\20\0\0\0\1\0\0\0\21\10v\10Linux\0\0\0”…, 288) = 288
read(3, “\1\0\0\0\212\0\0\0)\0\0\0\1\0\0\0\240\0\0\0”, 20) = 20
read(3, “\2\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0 \0\0\0”, 20) = 20
read(3, “\3\0\0\0\212\0\0\0\1\4\0\0\1\0\0\0\20\0\0\0”, 20) = 20
read(3, “\4\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0\20\0\0\0”, 20) = 20
read(3, “\5\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0@\0\0\0”, 20) = 20
read(3, “\6\0\0\0\213\0\0\0\1\0\0\0\1\0\0\0000\0\0\0”, 20) = 20
read(3, “\7\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0\200\0\0\0”, 20) = 20
read(3, “”\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0\200\0\0\0", 20) = 20
read(3, “\10\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0\20\0\0\0”, 20) = 20
read(3, “\t\0\0\0\213\0\0\0\1\0\0\0\1\0\0\0 \0\0\0”, 20) = 20
read(3, “\v\0\0\0\213\0\0\0\31\0\0\0\1\0\0\0@\0\0\0”, 20) = 20
read(3, “\f\0\0\0\214\0\0\0\5\0\0\0\1\0\0\0\220\0\0\0”, 20) = 20
read(3, “\r\0\0\0\213\0\0\0\5\0\0\0\1\0\0\0\240\0\0\0”, 20) = 20
read(3, “\16\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0\30\0\0\0”, 20) = 20
read(3, “\17\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0,\0\0\0”, 20) = 20
read(3, “\20\0\0\0\212\0\0\0\1\0\0\0\1\0\0\0\30\0\0\0”, 20) = 20
read(3, “Cx7Z\1\0\0\0\0\0\0\0\0\0\0\0\332G\250\10\0\0\0\0\0\0\0\0\0\0\0\0”…, 48) = 48
read(3, “\26559\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 6560) = 6560
read(3, “mL(”\1\0\0\0\0\0\0\0\0\0\0\0\300\332t\0\0\0\0\0\0\0\0\0\0\0\0\0", 32) = 32
read(3, “\365&\331\244\0\0\0\0\0\0\0\0\0\0\0\0;\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 16400) = 16400
read(3, “\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”, 16) = 16
read(3, “{\325\310\1\0\0\0\0\251c\260\f\0\0\0\0V\244\335C\0\0\0\0002\4\0\0\0\0\0\0”…, 64) = 64
read(3, “\360Q<\0\0\0\0\0 \f\4\0\0\0\0\0\320E8\0\0\0\0\0\367\252\221\3\0\0\0\0”…, 48) = 48
read(3, “\274’\31\v\0\0\0\0@I\3\0\0\0\0\0xZE\0\0\0\0\0\354#\271\v\0\0\0\0”…, 128) = 128
read(3, “\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 128) = 128
read(3, “\0\31\0\0\2~\1\0Z\310\v\0\1\0\0\0”, 16) = 16
read(3, “\2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\n\0\0\0\4\0\0\0\1\0\0\0\206\7\0\0”, 32) = 32
read(3, "\374\344\2\0\0\0\0\0\0\0\0\0\0\0\0\0
\322B\0\0\0\0\0AV?\1\0\0\0\0"…, 1600) = 1600
read(3, “SQ\302\0\0\0\0\0\0\0\0\0\0\0\0\0SQ\302\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 720) = 720
read(3, “\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 800) = 800
read(3, “\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”, 24) = 24
read(3, “\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0”…, 44) = 44
read(3, “=\r\0\0g\7\0\0\f\0\0\0\7\0\0\0\0\0\0\0\0\0\0\0”, 24) = 24
open("/etc/localtime", O_RDONLY|O_CLOEXEC) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=2160, …}) = 0
fstat(4, {st_mode=S_IFREG|0644, st_size=2160, …}) = 0
read(4, “TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\7\0\0\0\7\0\0\0\0”…, 4096) = 2160
lseek(4, -1377, SEEK_CUR) = 783
read(4, “TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\10\0\0\0\0”…, 4096) = 1377
close(4) = 0
lseek(3, 0, SEEK_CUR) = 27368
lseek(3, 27368, SEEK_SET) = 27368
read(3, “”, 48) = 0
close(3) = 0
exit_group(0) = ?
+++ exited with 0 +++
Telegraf.conf https://git.its.aau.dk/mb/documentation/wiki/Home


#4

Bump. Any one that can help me with the issue?


#5

This error shows that your config is requesting options that your sadf command doesn’t accept.

Can you try this with a smaller config?

   [inputs.sysstat.options]
     -C = "cpu"
     -d = "disk"             # requires DISK activity
     "-P ALL" = "per_cpu"
     -r = "mem_util"
     -H = "hugepages"        # only available for newer linux distributions

Are the versions of sysstat the same across both Ubuntu installations?


#6

Hi Rawkode.
Thank you for the suggestions. I did try the simple config, and the bug disappeared. I tried to comment in until the bug reappeared. the

“2019-01-11T00:00:59Z E! [inputs.sysstat]: Error in plugin: command /usr/bin/sadf -p – -p -S /tmp/sysstat-1547164840 failed with exit status 2”

appears when i add this options:
-R = "mem"
versions are:
Old server: Ubuntu 16.04.5
telegraf = 1.7.4–1
sysstat = 11.2.0

New server: Ubuntu 18.04.1
telegraf: 1.9.3-1
sysstat: 11.6.1-1


#7

This flag was removed in 2017:

2017/01/11: Version 11.5.4 - Sebastien Godard (sysstat <at> orange.fr)
	* sar: Remove memory statistics (option -R).

#8

Thank you for the reply. That i have overlooked :-S