Re: [PATCH RFC V9 2/3] perf,tools: per-event callgraph support

From: Jiri Olsa
Date: Sat Aug 08 2015 - 12:45:48 EST


On Fri, Aug 07, 2015 at 12:49:38PM -0300, Arnaldo Carvalho de Melo wrote:
> Em Fri, Aug 07, 2015 at 12:38:43PM -0300, Arnaldo Carvalho de Melo escreveu:
> > Em Thu, Aug 06, 2015 at 03:44:53PM -0400, kan.liang@xxxxxxxxx escreveu:
> > > From: Kan Liang <kan.liang@xxxxxxxxx>
> > > Here are some examples and test results.
> > >
> > > 1. Comparing the elapsed time and perf.data size from "kernbench -M -H".
> > >
> > > The test command for FULL callgraph and time support.
> > > "perf record -e
> > > '{cpu/cpu-cycles,period=100000/,cpu/instructions,period=20000/p}'
> > > --call-graph fp --time"
>
> Some other oddity I noticed while testing:
>

SNIP

> This is in the 'perf report' TUI, why, for an event with 'callgraph=no', we
> get callchains? How come?
>
> If I try it with the --stdio, well, its there as well:
>
> # Samples: 2K of event 'cpu/instructions,call-graph=no,time=0,period=20000/p'
> # Event count (approx.): 46956518
> #
> # Children Self Command Shared Object Symbol
> # ........ ........ ............... .......................... ..............................................
> #
> 67.56% 0.00% qemu-system-x86 [unknown] [.] 0xad5e258d4c544155
> |
> ---0xad5e258d4c544155
>
> 67.56% 0.00% qemu-system-x86 libc-2.20.so [.] __libc_start_main
> |
> ---__libc_start_main
> 0xad5e258d4c544155
>
> 67.56% 0.00% qemu-system-x86 perf [.] main
> |
> ---main
> __libc_start_main
> 0xad5e258d4c544155
>
> 67.56% 0.00% qemu-system-x86 perf [.] run_builtin
> |
> ---run_builtin
> main
> __libc_start_main
> 0xad5e258d4c544155
>
> Can you take a look? What I have, i.e. the patches from Jiri and Kan
> moving stuff out of the way of the python binding and this patch is at
> the tmp.perf/core branch in my git tree:
>
> git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux.git

hum, tried this branch and got proper behaviour for both stdio and TUI,
attaching stdio output

the record command was:
$ ./perf record -e 'cpu/cpu-cycles,call-graph=fp,time,period=10000/pp,cpu/instructions,call-graph=no,time=0,period=20000/p' ls

got the events strings from your report output.. what was different in your record command?

jirka
# To display the perf.data header info, please use --header/--header-only options.
#
#
# Total Lost Samples: 4
#
# Samples: 95 of event 'cpu/cpu-cycles,call-graph=fp,time,period=10000/pp'
# Event count (approx.): 7487606
#
# Children Self Command Shared Object Symbol
# ........ ........ ....... .................. .....................................
#
61.66% 0.00% ls [kernel.vmlinux] [k] entry_SYSCALL_64_fastpath
|
---entry_SYSCALL_64_fastpath
|
|--55.19%-- open64
| 0x686361632e6f732e
|
|--21.81%-- __GI___libc_write
| |
| |--24.74%-- 0x6e69746c69756220
| |
| |--19.20%-- 0x909632e66666964
| |
| |--18.35%-- 0x657461746f6e6e61
| |
| |--16.05%-- 0x1dbdc70
| |
| |--11.32%-- 0
| |
| --10.34%-- 0x9096f2e61746164
|
|--6.18%-- __getdents64
|
|--5.00%-- mmap64
| |
| |--50.39%-- _dl_check_all_versions
| |
| --49.61%-- _dl_map_object
| 0x213988
| 0
|
|--2.72%-- mprotect
| dl_main
| _dl_sysdep_start
|
|--1.26%-- _exit
| __run_exit_handlers
| 0
|
|--0.92%-- __GI___munmap
--6.92%-- [...]

34.03% 0.00% ls [unknown] [.] 0x686361632e6f732e
|
---0x686361632e6f732e

34.03% 0.00% ls ld-2.18.so [.] open64
|
---open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] sys_open
|
---sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] do_sys_open
|
---do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] do_filp_open
|
---do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] path_openat
|
---path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] link_path_walk
|
---link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] inode_permission
|
---inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

34.03% 0.00% ls [kernel.vmlinux] [k] __inode_permission
|
---__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] irq_work_interrupt
|
---irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] smp_irq_work_interrupt
|
---smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] irq_work_run
|
---irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] irq_work_run_list
|
---irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] perf_duration_warn
|
---perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] printk
|
---printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] vprintk_default
|
---vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] vprintk_emit
|
---vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.75% 0.00% ls [kernel.vmlinux] [k] console_unlock
|
---console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.43% 0.00% ls [kernel.vmlinux] [k] call_console_drivers.constprop.27
|
---call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.43% 0.00% ls [kernel.vmlinux] [k] univ8250_console_write
|
---univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.43% 0.00% ls [kernel.vmlinux] [k] uart_console_write
|
---uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

33.43% 0.00% ls [kernel.vmlinux] [k] serial8250_console_putchar
|
---serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

28.96% 0.00% ls [kernel.vmlinux] [k] wait_for_xmitr
|
---wait_for_xmitr
serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

17.71% 0.00% ls libc-2.18.so [.] __GI___libc_write
|
---__GI___libc_write
|
|--16.81%-- 0x657461746f6e6e61
|
|--10.79%-- 0x6e69746c69756220
|
|--8.37%-- 0x909632e66666964
|
|--7.00%-- 0x1dbdc70
|
|--6.67%-- 0x96f2e68636e6562
|
|--5.30%-- 0x2d6469646c697562
|
|--4.93%-- 0
|
|--4.51%-- 0x9096f2e61746164
|
|--3.30%-- 0x6f2e7473696c7665
--32.32%-- [...]

14.14% 0.41% ls [kernel.vmlinux] [k] __const_udelay
|
---__const_udelay
|
|--97.12%-- wait_for_xmitr
| serial8250_console_putchar
| uart_console_write
| univ8250_console_write
| call_console_drivers.constprop.27
| console_unlock
| vprintk_emit
| vprintk_default
| printk
| perf_duration_warn
| irq_work_run_list
| irq_work_run
| smp_irq_work_interrupt
| irq_work_interrupt
| __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
--2.88%-- serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

13.75% 13.75% ls [kernel.vmlinux] [k] io_serial_in
|
---io_serial_in
wait_for_xmitr
serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

13.45% 0.00% ls [kernel.vmlinux] [k] sys_write
|
---sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--14.21%-- 0x6e69746c69756220
|
|--11.03%-- 0x909632e66666964
|
|--10.54%-- 0x657461746f6e6e61
|
|--9.22%-- 0x1dbdc70
|
|--6.50%-- 0
|
|--5.94%-- 0x9096f2e61746164
--42.57%-- [...]

13.45% 0.00% ls [kernel.vmlinux] [k] vfs_write
|
---vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--14.21%-- 0x6e69746c69756220
|
|--11.03%-- 0x909632e66666964
|
|--10.54%-- 0x657461746f6e6e61
|
|--9.22%-- 0x1dbdc70
|
|--6.50%-- 0
|
|--5.94%-- 0x9096f2e61746164
--42.57%-- [...]

13.45% 0.00% ls [kernel.vmlinux] [k] __vfs_write
|
---__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--14.21%-- 0x6e69746c69756220
|
|--11.03%-- 0x909632e66666964
|
|--10.54%-- 0x657461746f6e6e61
|
|--9.22%-- 0x1dbdc70
|
|--6.50%-- 0
|
|--5.94%-- 0x9096f2e61746164
--42.57%-- [...]

13.45% 0.00% ls [kernel.vmlinux] [k] tty_write
|
---tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--14.21%-- 0x6e69746c69756220
|
|--11.03%-- 0x909632e66666964
|
|--10.54%-- 0x657461746f6e6e61
|
|--9.22%-- 0x1dbdc70
|
|--6.50%-- 0
|
|--5.94%-- 0x9096f2e61746164
--42.57%-- [...]

13.45% 0.00% ls [kernel.vmlinux] [k] n_tty_write
|
---n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--14.21%-- 0x6e69746c69756220
|
|--11.03%-- 0x909632e66666964
|
|--10.54%-- 0x657461746f6e6e61
|
|--9.22%-- 0x1dbdc70
|
|--6.50%-- 0
|
|--5.94%-- 0x9096f2e61746164
--42.57%-- [...]

12.39% 12.39% ls [kernel.vmlinux] [k] delay_tsc
|
---delay_tsc
|
|--88.16%-- __const_udelay
| wait_for_xmitr
| serial8250_console_putchar
| uart_console_write
| univ8250_console_write
| call_console_drivers.constprop.27
| console_unlock
| vprintk_emit
| vprintk_default
| printk
| perf_duration_warn
| irq_work_run_list
| irq_work_run
| smp_irq_work_interrupt
| irq_work_interrupt
| __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
--11.84%-- wait_for_xmitr
serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

9.88% 0.00% ls [unknown] [.] 0x0000000000841f0f
|
---0x841f0f

9.16% 0.00% ls [kernel.vmlinux] [k] pty_write
|
---pty_write
|
|--45.92%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--31.59%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--69.57%-- 0x657461746f6e6e61
| |
| --30.43%-- 0x1dbdc70
|
--22.49%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

9.16% 0.00% ls [kernel.vmlinux] [k] tty_flip_buffer_push
|
---tty_flip_buffer_push
pty_write
|
|--45.92%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--31.59%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--69.57%-- 0x657461746f6e6e61
| |
| --30.43%-- 0x1dbdc70
|
--22.49%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

9.16% 0.00% ls [kernel.vmlinux] [k] tty_schedule_flip
|
---tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--45.92%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--31.59%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--69.57%-- 0x657461746f6e6e61
| |
| --30.43%-- 0x1dbdc70
|
--22.49%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

9.16% 0.00% ls [kernel.vmlinux] [k] queue_work_on
|
---queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--45.92%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--31.59%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--69.57%-- 0x657461746f6e6e61
| |
| --30.43%-- 0x1dbdc70
|
--22.49%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

9.16% 0.00% ls [kernel.vmlinux] [k] __queue_work
|
---__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--45.92%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--31.59%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--69.57%-- 0x657461746f6e6e61
| |
| --30.43%-- 0x1dbdc70
|
--22.49%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

9.16% 1.30% ls [kernel.vmlinux] [k] insert_work
|
---insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--45.92%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--31.59%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--69.57%-- 0x657461746f6e6e61
| |
| --30.43%-- 0x1dbdc70
|
--22.49%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

8.41% 0.00% ls [unknown] [.] 0000000000000000
|
---0
|
|--15.30%-- 0x632e74617473
|
|--12.88%-- 0
|
|--12.01%-- 0x72616863656d6974
--59.81%-- [...]

7.92% 0.00% ls ls [.] 0xffffffffffc0e1cf
|
---0xe1cf
0x841f0f

6.97% 0.00% ls [kernel.vmlinux] [k] wake_up_worker
|
---wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--37.80%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--32.63%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| --100.00%-- 0x657461746f6e6e61
|
--29.57%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

6.97% 0.00% ls [kernel.vmlinux] [k] wake_up_process
|
---wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--37.80%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--32.63%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| --100.00%-- 0x657461746f6e6e61
|
--29.57%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

6.97% 0.00% ls [kernel.vmlinux] [k] try_to_wake_up
|
---try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--37.80%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--32.63%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| --100.00%-- 0x657461746f6e6e61
|
--29.57%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

6.97% 0.00% ls [kernel.vmlinux] [k] ttwu_do_activate.constprop.92
|
---ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--37.80%-- n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--72.50%-- 0x6e69746c69756220
| |
| --27.50%-- 0x909632e66666964
|
|--32.63%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| --100.00%-- 0x657461746f6e6e61
|
--29.57%-- tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

5.94% 5.94% ls libc-2.18.so [.] get_next_seq
|
---get_next_seq
0xe1cf
0x841f0f

5.80% 0.00% ls [kernel.vmlinux] [k] __schedule
|
---__schedule
|
|--73.77%-- preempt_schedule_common
| _cond_resched
| mutex_lock
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--28.65%-- 0
| |
| |--26.18%-- 0x9096f2e61746164
| |
| |--24.86%-- 0x909632e66666964
| |
| --20.31%-- 0x1dbdc70
|
--26.23%-- schedule
prepare_exit_to_usermode
syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
|
|--61.62%-- 0x2d6469646c697562
|
--38.38%-- 0x6f2e7473696c7665

5.75% 1.94% ls libc-2.18.so [.] __getdents64
|
---__getdents64
|
|--33.68%-- 0x616863656d69742d
--66.32%-- [...]

5.04% 0.00% ls [kernel.vmlinux] [k] 0x000000007f47cb44
|
---0x27cb44
entry_SYSCALL_64_fastpath
|
|--15.40%-- _exit
| __run_exit_handlers
| 0
--84.60%-- [...]

5.04% 0.00% ls [kernel.vmlinux] [k] do_group_exit
|
---do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath
|
|--15.40%-- _exit
| __run_exit_handlers
| 0
--84.60%-- [...]

5.04% 0.78% ls [kernel.vmlinux] [k] do_exit
|
---do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath
|
|--15.40%-- _exit
| __run_exit_handlers
| 0
--84.60%-- [...]

4.96% 0.00% ls [kernel.vmlinux] [k] do_output_char
|
---do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--28.59%-- 0x657461746f6e6e61
|
|--12.51%-- 0x1dbdc70
--58.90%-- [...]

4.79% 4.79% ls [kernel.vmlinux] [k] native_write_msr_safe
|
---native_write_msr_safe
|
|--37.79%-- __intel_pmu_disable_all
| intel_pmu_disable_all
| x86_pmu_disable
| perf_pmu_disable
| ctx_sched_out
| __perf_event_task_sched_out
| __schedule
| |
| |--51.77%-- schedule
| | prepare_exit_to_usermode
| | syscall_return_slowpath
| | int_ret_from_sys_call
| | __GI___libc_write
| | 0x2d6469646c697562
| |
| --48.23%-- preempt_schedule_common
| _cond_resched
| mutex_lock
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| 0
|
|--32.55%-- __GI___libc_write
| 0x657461746f6e6e61
|
|--29.58%-- __intel_pmu_enable_all.isra.9
| intel_pmu_enable_all
| x86_pmu_enable
| perf_pmu_enable
| |
| |--56.32%-- perf_event_context_sched_in
| | |
| | |--100.00%-- __perf_event_task_sched_in
| | | finish_task_switch
| | | __schedule
| | | preempt_schedule_common
| | | _cond_resched
| | | mutex_lock
| | | n_tty_write
| | | tty_write
| | | __vfs_write
| | | vfs_write
| | | sys_write
| | | entry_SYSCALL_64_fastpath
| | | __GI___libc_write
| | | 0x9096f2e61746164
| | --0.00%-- [...]
| |
| --43.68%-- perf_pmu_sched_task
| __perf_event_task_sched_out
| __schedule
| preempt_schedule_common
| _cond_resched
| mutex_lock
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| 0x1dbdc70
--0.08%-- [...]

4.28% 0.00% ls [kernel.vmlinux] [k] mutex_lock
|
---mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--20.42%-- 0
|
|--18.66%-- 0x9096f2e61746164
|
|--17.71%-- 0x909632e66666964
|
|--14.47%-- 0x1dbdc70
--28.74%-- [...]

4.28% 0.00% ls [kernel.vmlinux] [k] _cond_resched
|
---_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--20.42%-- 0
|
|--18.66%-- 0x9096f2e61746164
|
|--17.71%-- 0x909632e66666964
|
|--14.47%-- 0x1dbdc70
--28.74%-- [...]

4.28% 0.00% ls [kernel.vmlinux] [k] preempt_schedule_common
|
---preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--20.42%-- 0
|
|--18.66%-- 0x9096f2e61746164
|
|--17.71%-- 0x909632e66666964
|
|--14.47%-- 0x1dbdc70
--28.74%-- [...]

4.06% 4.06% ls [kernel.vmlinux] [k] io_serial_out
|
---io_serial_out
serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

4.04% 4.04% ls ls [.] 0x0000000000006686
|
---0x6686

4.04% 0.00% ls ls [.] 0xffffffffffc06686
|
---0x6686

3.81% 0.00% ls [kernel.vmlinux] [k] sys_getdents
|
---sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

3.81% 0.00% ls [kernel.vmlinux] [k] iterate_dir
|
---iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

3.81% 0.00% ls [ext4] [k] ext4_readdir
|
---ext4_readdir
iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

3.81% 0.00% ls [ext4] [k] ext4_htree_fill_tree
|
---ext4_htree_fill_tree
ext4_readdir
iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

3.81% 0.00% ls [ext4] [k] htree_dirblock_to_tree
|
---htree_dirblock_to_tree
ext4_htree_fill_tree
ext4_readdir
iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

3.64% 0.00% ls [kernel.vmlinux] [k] activate_task
|
---activate_task
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--56.57%-- tty_put_char
| do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
|--23.55%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
--19.88%-- n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x909632e66666964

3.64% 0.00% ls [kernel.vmlinux] [k] enqueue_task
|
---enqueue_task
activate_task
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--56.57%-- tty_put_char
| do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
|--23.55%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
--19.88%-- n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x909632e66666964

3.64% 0.00% ls [kernel.vmlinux] [k] enqueue_task_fair
|
---enqueue_task_fair
enqueue_task
activate_task
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--56.57%-- tty_put_char
| do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
|--23.55%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
--19.88%-- n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x909632e66666964

3.38% 0.00% ls ld-2.18.so [.] _dl_map_object
|
---_dl_map_object
|
|--45.27%-- 0x21eb10
| 0
|
|--45.27%-- 0x213988
| 0
|
--9.45%-- 0x21e640
0

3.27% 0.00% ls ld-2.18.so [.] _dl_sysdep_start
|
---_dl_sysdep_start

3.27% 0.00% ls ld-2.18.so [.] dl_main
|
---dl_main
_dl_sysdep_start

3.08% 0.00% ls ld-2.18.so [.] mmap64
|
---mmap64
|
|--50.39%-- _dl_check_all_versions
|
--49.61%-- _dl_map_object
0x213988
0

3.08% 0.00% ls [kernel.vmlinux] [k] sys_mmap
|
---sys_mmap
entry_SYSCALL_64_fastpath
mmap64
|
|--50.39%-- _dl_check_all_versions
|
--49.61%-- _dl_map_object
0x213988
0

3.08% 0.00% ls [kernel.vmlinux] [k] sys_mmap_pgoff
|
---sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
|
|--50.39%-- _dl_check_all_versions
|
--49.61%-- _dl_map_object
0x213988
0

3.08% 0.00% ls [kernel.vmlinux] [k] vm_mmap_pgoff
|
---vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
|
|--50.39%-- _dl_check_all_versions
|
--49.61%-- _dl_map_object
0x213988
0

3.08% 0.00% ls [kernel.vmlinux] [k] do_mmap_pgoff
|
---do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
|
|--50.39%-- _dl_check_all_versions
|
--49.61%-- _dl_map_object
0x213988
0

3.08% 0.00% ls [kernel.vmlinux] [k] mmap_region
|
---mmap_region
do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
|
|--50.39%-- _dl_check_all_versions
|
--49.61%-- _dl_map_object
0x213988
0

3.03% 0.00% ls [kernel.vmlinux] [k] mmput
|
---mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

3.03% 0.00% ls [kernel.vmlinux] [k] exit_mmap
|
---exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

2.98% 0.00% ls [unknown] [.] 0x657461746f6e6e61
|
---0x657461746f6e6e61

2.79% 0.64% ls [kernel.vmlinux] [k] finish_task_switch
|
---finish_task_switch
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--28.65%-- 0x9096f2e61746164
|
|--27.20%-- 0x909632e66666964
--44.14%-- [...]

2.70% 0.00% ls [kernel.vmlinux] [k] int_ret_from_sys_call
|
---int_ret_from_sys_call
__GI___libc_write
|
|--43.71%-- 0x96f2e68636e6562
|
|--34.69%-- 0x2d6469646c697562
|
--21.61%-- 0x6f2e7473696c7665

2.70% 0.00% ls [kernel.vmlinux] [k] syscall_return_slowpath
|
---syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
|
|--43.71%-- 0x96f2e68636e6562
|
|--34.69%-- 0x2d6469646c697562
|
--21.61%-- 0x6f2e7473696c7665

2.70% 1.18% ls [kernel.vmlinux] [k] prepare_exit_to_usermode
|
---prepare_exit_to_usermode
syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
|
|--43.71%-- 0x96f2e68636e6562
|
|--34.69%-- 0x2d6469646c697562
|
--21.61%-- 0x6f2e7473696c7665

2.43% 0.00% ls [kernel.vmlinux] [k] __perf_event_task_sched_out
|
---__perf_event_task_sched_out
__schedule
|
|--61.42%-- preempt_schedule_common
| _cond_resched
| mutex_lock
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| |--58.52%-- 0
| |
| --41.48%-- 0x1dbdc70
|
--38.58%-- schedule
prepare_exit_to_usermode
syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
0x2d6469646c697562

2.30% 0.00% ls ls [.] 0xffffffffffc06dcb
|
---0x6dcb
0
|
|--56.03%-- 0x632e74617473
|
--43.97%-- 0x72616863656d6974

2.26% 1.63% ls ld-2.18.so [.] do_lookup_x
|
---do_lookup_x

2.16% 1.54% ls [kernel.vmlinux] [k] nmi
|
---nmi
|
|--63.15%-- __const_udelay
| wait_for_xmitr
| serial8250_console_putchar
| uart_console_write
| univ8250_console_write
| call_console_drivers.constprop.27
| console_unlock
| vprintk_emit
| vprintk_default
| printk
| perf_duration_warn
| irq_work_run_list
| irq_work_run
| smp_irq_work_interrupt
| irq_work_interrupt
| __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
|--29.07%-- do_lookup_x
|
|--5.52%-- end_repeat_nmi
| scheduler_tick
| update_process_times
| tick_sched_handle.isra.17
| tick_sched_timer
| __hrtimer_run_queues
| hrtimer_interrupt
| local_apic_timer_interrupt
| smp_apic_timer_interrupt
| apic_timer_interrupt
| setup_new_exec
| load_elf_binary
| search_binary_handler
| do_execveat_common.isra.32
| sys_execve
| return_from_execve
| 0x7f9abb498a77
|
|--1.10%-- nmi_handle
| default_do_nmi
| do_nmi
| end_repeat_nmi
| scheduler_tick
| update_process_times
| tick_sched_handle.isra.17
| tick_sched_timer
| __hrtimer_run_queues
| hrtimer_interrupt
| local_apic_timer_interrupt
| smp_apic_timer_interrupt
| apic_timer_interrupt
| setup_new_exec
| load_elf_binary
| search_binary_handler
| do_execveat_common.isra.32
| sys_execve
| return_from_execve
| 0x7f9abb498a77
|
|--0.63%-- perf_event_nmi_handler
| nmi_handle
| default_do_nmi
| do_nmi
| end_repeat_nmi
| scheduler_tick
| update_process_times
| tick_sched_handle.isra.17
| tick_sched_timer
| __hrtimer_run_queues
| hrtimer_interrupt
| local_apic_timer_interrupt
| smp_apic_timer_interrupt
| apic_timer_interrupt
| setup_new_exec
| load_elf_binary
| search_binary_handler
| do_execveat_common.isra.32
| sys_execve
| return_from_execve
| 0x7f9abb498a77
|
--0.52%-- scheduler_tick
update_process_times
tick_sched_handle.isra.17
tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

2.15% 0.00% ls [kernel.vmlinux] [k] __perf_event_task_sched_in
|
---__perf_event_task_sched_in
finish_task_switch
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
|
|--37.19%-- 0x9096f2e61746164
|
|--35.31%-- 0x909632e66666964
--27.50%-- [...]

2.06% 0.00% ls [kernel.vmlinux] [k] tty_put_char
|
---tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

2.06% 2.06% ls [kernel.vmlinux] [k] update_rq_runnable_avg
|
---update_rq_runnable_avg
enqueue_task_fair
enqueue_task
activate_task
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
tty_put_char
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

1.98% 1.98% ls libc-2.18.so [.] __strcoll_l
|
---__strcoll_l
0xe1cf
0x841f0f

1.97% 1.35% ls [kernel.vmlinux] [k] perf_pmu_sched_task
|
---perf_pmu_sched_task
|
|--68.52%-- __perf_event_task_sched_in
| finish_task_switch
| __schedule
| preempt_schedule_common
| _cond_resched
| mutex_lock
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| |
| --100.00%-- 0x909632e66666964
|
--31.48%-- __perf_event_task_sched_out
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x1dbdc70

1.95% 1.95% ls ls [.] 0x000000000000e270
|
---0xe270
0x841f0f

1.95% 0.00% ls ls [.] 0xffffffffffc0e270
|
---0xe270
0x841f0f

1.94% 0.00% ls [unknown] [.] 0x616863656d69742d
|
---0x616863656d69742d

1.93% 0.00% ls [kernel.vmlinux] [k] unmap_vmas
|
---unmap_vmas
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.93% 0.93% ls [kernel.vmlinux] [k] unmap_single_vma
|
---unmap_single_vma
unmap_vmas
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.93% 0.00% ls [ext4] [k] ext4fs_dirhash
|
---ext4fs_dirhash
htree_dirblock_to_tree
ext4_htree_fill_tree
ext4_readdir
iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

1.93% 1.93% ls [ext4] [k] str2hashbuf_signed
|
---str2hashbuf_signed
ext4fs_dirhash
htree_dirblock_to_tree
ext4_htree_fill_tree
ext4_readdir
iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

1.91% 0.00% ls [unknown] [.] 0x6e69746c69756220
|
---0x6e69746c69756220

1.91% 0.00% ls [kernel.vmlinux] [k] ttwu_do_wakeup
|
---ttwu_do_wakeup
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x6e69746c69756220

1.91% 0.00% ls [kernel.vmlinux] [k] check_preempt_curr
|
---check_preempt_curr
ttwu_do_wakeup
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x6e69746c69756220

1.91% 0.00% ls [kernel.vmlinux] [k] check_preempt_wakeup
|
---check_preempt_wakeup
check_preempt_curr
ttwu_do_wakeup
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x6e69746c69756220

1.91% 1.91% ls [kernel.vmlinux] [k] set_next_buddy
|
---set_next_buddy
check_preempt_wakeup
check_preempt_curr
ttwu_do_wakeup
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x6e69746c69756220

1.89% 1.89% ls [ext4] [k] ext4_htree_store_dirent
|
---ext4_htree_store_dirent
htree_dirblock_to_tree
ext4_htree_fill_tree
ext4_readdir
iterate_dir
sys_getdents
entry_SYSCALL_64_fastpath
__getdents64

1.85% 1.85% ls libc-2.18.so [.] __strcmp_sse2
|
---__strcmp_sse2

1.82% 0.00% ls [unknown] [.] 0x6f74207367756220
|
---0x6f74207367756220

1.82% 1.82% ls libc-2.18.so [.] strlen
|
---strlen
0x6f74207367756220

1.81% 0.00% ls [kernel.vmlinux] [k] ctx_sched_out
|
---ctx_sched_out
__perf_event_task_sched_out
__schedule
|
|--51.77%-- schedule
| prepare_exit_to_usermode
| syscall_return_slowpath
| int_ret_from_sys_call
| __GI___libc_write
| 0x2d6469646c697562
|
--48.23%-- preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0

1.81% 0.00% ls [kernel.vmlinux] [k] perf_pmu_disable
|
---perf_pmu_disable
ctx_sched_out
__perf_event_task_sched_out
__schedule
|
|--51.77%-- schedule
| prepare_exit_to_usermode
| syscall_return_slowpath
| int_ret_from_sys_call
| __GI___libc_write
| 0x2d6469646c697562
|
--48.23%-- preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0

1.81% 0.00% ls [kernel.vmlinux] [k] x86_pmu_disable
|
---x86_pmu_disable
perf_pmu_disable
ctx_sched_out
__perf_event_task_sched_out
__schedule
|
|--51.77%-- schedule
| prepare_exit_to_usermode
| syscall_return_slowpath
| int_ret_from_sys_call
| __GI___libc_write
| 0x2d6469646c697562
|
--48.23%-- preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0

1.81% 0.00% ls [kernel.vmlinux] [k] intel_pmu_disable_all
|
---intel_pmu_disable_all
x86_pmu_disable
perf_pmu_disable
ctx_sched_out
__perf_event_task_sched_out
__schedule
|
|--51.77%-- schedule
| prepare_exit_to_usermode
| syscall_return_slowpath
| int_ret_from_sys_call
| __GI___libc_write
| 0x2d6469646c697562
|
--48.23%-- preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0

1.81% 0.00% ls [kernel.vmlinux] [k] __intel_pmu_disable_all
|
---__intel_pmu_disable_all
intel_pmu_disable_all
x86_pmu_disable
perf_pmu_disable
ctx_sched_out
__perf_event_task_sched_out
__schedule
|
|--51.77%-- schedule
| prepare_exit_to_usermode
| syscall_return_slowpath
| int_ret_from_sys_call
| __GI___libc_write
| 0x2d6469646c697562
|
--48.23%-- preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0

1.76% 0.00% ls [unknown] [.] 0x00401f0fc3f30678
|
---0x401f0fc3f30678

1.76% 1.76% ls libc-2.18.so [.] _dl_addr
|
---_dl_addr
0x401f0fc3f30678

1.72% 0.00% ls ls [.] 0xffffffffffc06438
|
---0x6438

1.72% 1.72% ls ls [.] 0x0000000000005b4d
|
---0x5b4d
0x6438

1.72% 0.00% ls ls [.] 0xffffffffffc05b4d
|
---0x5b4d
0x6438

1.70% 1.70% ls libpthread-2.18.so [.] frame_dummy
|
---frame_dummy

1.68% 0.00% ls ld-2.18.so [.] mprotect
|
---mprotect
dl_main
_dl_sysdep_start

1.68% 0.00% ls [kernel.vmlinux] [k] sys_mprotect
|
---sys_mprotect
entry_SYSCALL_64_fastpath
mprotect
dl_main
_dl_sysdep_start

1.68% 0.00% ls [kernel.vmlinux] [k] mprotect_fixup
|
---mprotect_fixup
sys_mprotect
entry_SYSCALL_64_fastpath
mprotect
dl_main
_dl_sysdep_start

1.68% 0.00% ls [kernel.vmlinux] [k] split_vma
|
---split_vma
mprotect_fixup
sys_mprotect
entry_SYSCALL_64_fastpath
mprotect
dl_main
_dl_sysdep_start

1.68% 0.00% ls [kernel.vmlinux] [k] __split_vma.isra.34
|
---__split_vma.isra.34
split_vma
mprotect_fixup
sys_mprotect
entry_SYSCALL_64_fastpath
mprotect
dl_main
_dl_sysdep_start

1.68% 1.68% ls [kernel.vmlinux] [k] vma_interval_tree_remove
|
---vma_interval_tree_remove
__split_vma.isra.34
split_vma
mprotect_fixup
sys_mprotect
entry_SYSCALL_64_fastpath
mprotect
dl_main
_dl_sysdep_start

1.59% 1.59% ls ld-2.18.so [.] _dl_relocate_object
|
---_dl_relocate_object
dl_main
_dl_sysdep_start

1.58% 0.86% ls [kernel.vmlinux] [k] enqueue_entity
|
---enqueue_entity
enqueue_task_fair
enqueue_task
activate_task
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
|
|--54.22%-- do_output_char
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
|
--45.78%-- n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x909632e66666964

1.55% 0.00% ls ld-2.18.so [.] _dl_check_all_versions
|
---_dl_check_all_versions

1.55% 0.00% ls [kernel.vmlinux] [k] perf_event_mmap
|
---perf_event_mmap
mmap_region
do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
_dl_check_all_versions

1.55% 0.00% ls [kernel.vmlinux] [k] perf_event_aux
|
---perf_event_aux
perf_event_mmap
mmap_region
do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
_dl_check_all_versions

1.55% 1.55% ls [kernel.vmlinux] [k] perf_event_aux_ctx
|
---perf_event_aux_ctx
perf_event_aux
perf_event_mmap
mmap_region
do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
_dl_check_all_versions

1.53% 0.00% ls ld-2.18.so [.] 0xffff804cabb57988
|
---0x213988
0

1.53% 0.00% ls ld-2.18.so [.] 0xffff804cabb62b10
|
---0x21eb10
0

1.53% 0.00% ls ld-2.18.so [.] memset
|
---memset
_dl_map_object
0x21eb10
0

1.53% 0.00% ls [kernel.vmlinux] [k] page_fault
|
---page_fault
memset
_dl_map_object
0x21eb10
0

1.53% 0.00% ls [kernel.vmlinux] [k] do_page_fault
|
---do_page_fault
page_fault
memset
_dl_map_object
0x21eb10
0

1.53% 0.00% ls [kernel.vmlinux] [k] __do_page_fault
|
---__do_page_fault
do_page_fault
page_fault
memset
_dl_map_object
0x21eb10
0

1.53% 0.00% ls [kernel.vmlinux] [k] handle_mm_fault
|
---handle_mm_fault
__do_page_fault
do_page_fault
page_fault
memset
_dl_map_object
0x21eb10
0

1.53% 1.53% ls [kernel.vmlinux] [k] put_page
|
---put_page
handle_mm_fault
__do_page_fault
do_page_fault
page_fault
memset
_dl_map_object
0x21eb10
0

1.53% 0.00% ls [kernel.vmlinux] [k] vma_link
|
---vma_link
mmap_region
do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
_dl_map_object
0x213988
0

1.53% 1.53% ls [kernel.vmlinux] [k] vma_interval_tree_insert
|
---vma_interval_tree_insert
vma_link
mmap_region
do_mmap_pgoff
vm_mmap_pgoff
sys_mmap_pgoff
sys_mmap
entry_SYSCALL_64_fastpath
mmap64
_dl_map_object
0x213988
0

1.52% 0.00% ls [kernel.vmlinux] [k] schedule
|
---schedule
prepare_exit_to_usermode
syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
|
|--61.62%-- 0x2d6469646c697562
|
--38.38%-- 0x6f2e7473696c7665

1.48% 0.00% ls [unknown] [.] 0x0909632e66666964
|
---0x909632e66666964

1.44% 1.44% ls [kernel.vmlinux] [k] paranoid_entry
|
---paranoid_entry
__const_udelay
wait_for_xmitr
serial8250_console_putchar
uart_console_write
univ8250_console_write
call_console_drivers.constprop.27
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

1.42% 0.00% ls [kernel.vmlinux] [k] perf_pmu_enable
|
---perf_pmu_enable
|
|--56.32%-- perf_event_context_sched_in
| |
| |--100.00%-- __perf_event_task_sched_in
| | finish_task_switch
| | __schedule
| | preempt_schedule_common
| | _cond_resched
| | mutex_lock
| | n_tty_write
| | tty_write
| | __vfs_write
| | vfs_write
| | sys_write
| | entry_SYSCALL_64_fastpath
| | __GI___libc_write
| | 0x9096f2e61746164
| --0.00%-- [...]
|
--43.68%-- perf_pmu_sched_task
__perf_event_task_sched_out
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x1dbdc70

1.42% 0.00% ls [kernel.vmlinux] [k] x86_pmu_enable
|
---x86_pmu_enable
perf_pmu_enable
|
|--56.32%-- perf_event_context_sched_in
| |
| |--100.00%-- __perf_event_task_sched_in
| | finish_task_switch
| | __schedule
| | preempt_schedule_common
| | _cond_resched
| | mutex_lock
| | n_tty_write
| | tty_write
| | __vfs_write
| | vfs_write
| | sys_write
| | entry_SYSCALL_64_fastpath
| | __GI___libc_write
| | 0x9096f2e61746164
| --0.00%-- [...]
|
--43.68%-- perf_pmu_sched_task
__perf_event_task_sched_out
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x1dbdc70

1.42% 0.00% ls [kernel.vmlinux] [k] intel_pmu_enable_all
|
---intel_pmu_enable_all
x86_pmu_enable
perf_pmu_enable
|
|--56.32%-- perf_event_context_sched_in
| |
| |--100.00%-- __perf_event_task_sched_in
| | finish_task_switch
| | __schedule
| | preempt_schedule_common
| | _cond_resched
| | mutex_lock
| | n_tty_write
| | tty_write
| | __vfs_write
| | vfs_write
| | sys_write
| | entry_SYSCALL_64_fastpath
| | __GI___libc_write
| | 0x9096f2e61746164
| --0.00%-- [...]
|
--43.68%-- perf_pmu_sched_task
__perf_event_task_sched_out
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x1dbdc70

1.42% 0.00% ls [kernel.vmlinux] [k] __intel_pmu_enable_all.isra.9
|
---__intel_pmu_enable_all.isra.9
intel_pmu_enable_all
x86_pmu_enable
perf_pmu_enable
|
|--56.32%-- perf_event_context_sched_in
| |
| |--100.00%-- __perf_event_task_sched_in
| | finish_task_switch
| | __schedule
| | preempt_schedule_common
| | _cond_resched
| | mutex_lock
| | n_tty_write
| | tty_write
| | __vfs_write
| | vfs_write
| | sys_write
| | entry_SYSCALL_64_fastpath
| | __GI___libc_write
| | 0x9096f2e61746164
| --0.00%-- [...]
|
--43.68%-- perf_pmu_sched_task
__perf_event_task_sched_out
__schedule
preempt_schedule_common
_cond_resched
mutex_lock
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x1dbdc70

1.42% 0.00% ls [kernel.vmlinux] [k] wq_worker_waking_up
|
---wq_worker_waking_up
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x657461746f6e6e61

1.42% 1.42% ls [kernel.vmlinux] [k] kthread_data
|
---kthread_data
wq_worker_waking_up
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
do_output_char
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x657461746f6e6e61

1.31% 0.04% ls [kernel.vmlinux] [k] do_nmi
|
---do_nmi
|
|--52.08%-- end_repeat_nmi
| |
| |--46.71%-- vsnprintf
| | sprintf
| | print_time.part.12
| | print_prefix
| | msg_print_text
| | console_unlock
| | vprintk_emit
| | vprintk_default
| | printk
| | perf_duration_warn
| | irq_work_run_list
| | irq_work_run
| | smp_irq_work_interrupt
| | irq_work_interrupt
| | __inode_permission
| | inode_permission
| | link_path_walk
| | path_openat
| | do_filp_open
| | do_sys_open
| | sys_open
| | entry_SYSCALL_64_fastpath
| | open64
| | 0x686361632e6f732e
| |
| |--41.63%-- __inode_permission
| | inode_permission
| | link_path_walk
| | path_openat
| | do_filp_open
| | do_sys_open
| | sys_open
| | entry_SYSCALL_64_fastpath
| | open64
| | 0x686361632e6f732e
| |
| --11.66%-- scheduler_tick
| update_process_times
| tick_sched_handle.isra.17
| tick_sched_timer
| __hrtimer_run_queues
| hrtimer_interrupt
| local_apic_timer_interrupt
| smp_apic_timer_interrupt
| apic_timer_interrupt
| setup_new_exec
| load_elf_binary
| search_binary_handler
| do_execveat_common.isra.32
| sys_execve
| return_from_execve
| 0x7f9abb498a77
|
--47.92%-- nmi
do_lookup_x

1.29% 0.00% ls [unknown] [.] 0x0000632e74617473
|
---0x632e74617473

1.29% 1.29% ls ls [.] 0x0000000000005a40
|
---0x5a40
0x6dcb
0
0x632e74617473

1.29% 0.00% ls ls [.] 0xffffffffffc05a40
|
---0x5a40
0x6dcb
0
0x632e74617473

1.27% 0.00% ls [kernel.vmlinux] [k] default_do_nmi
|
---default_do_nmi
do_nmi
|
|--50.48%-- end_repeat_nmi
| |
| |--49.78%-- vsnprintf
| | sprintf
| | print_time.part.12
| | print_prefix
| | msg_print_text
| | console_unlock
| | vprintk_emit
| | vprintk_default
| | printk
| | perf_duration_warn
| | irq_work_run_list
| | irq_work_run
| | smp_irq_work_interrupt
| | irq_work_interrupt
| | __inode_permission
| | inode_permission
| | link_path_walk
| | path_openat
| | do_filp_open
| | do_sys_open
| | sys_open
| | entry_SYSCALL_64_fastpath
| | open64
| | 0x686361632e6f732e
| |
| |--44.37%-- __inode_permission
| | inode_permission
| | link_path_walk
| | path_openat
| | do_filp_open
| | do_sys_open
| | sys_open
| | entry_SYSCALL_64_fastpath
| | open64
| | 0x686361632e6f732e
| |
| --5.85%-- scheduler_tick
| update_process_times
| tick_sched_handle.isra.17
| tick_sched_timer
| __hrtimer_run_queues
| hrtimer_interrupt
| local_apic_timer_interrupt
| smp_apic_timer_interrupt
| apic_timer_interrupt
| setup_new_exec
| load_elf_binary
| search_binary_handler
| do_execveat_common.isra.32
| sys_execve
| return_from_execve
| 0x7f9abb498a77
|
--49.52%-- nmi
do_lookup_x

1.27% 0.63% ls [kernel.vmlinux] [k] nmi_handle
|
---nmi_handle
default_do_nmi
do_nmi
|
|--50.48%-- end_repeat_nmi
| |
| |--49.78%-- vsnprintf
| | sprintf
| | print_time.part.12
| | print_prefix
| | msg_print_text
| | console_unlock
| | vprintk_emit
| | vprintk_default
| | printk
| | perf_duration_warn
| | irq_work_run_list
| | irq_work_run
| | smp_irq_work_interrupt
| | irq_work_interrupt
| | __inode_permission
| | inode_permission
| | link_path_walk
| | path_openat
| | do_filp_open
| | do_sys_open
| | sys_open
| | entry_SYSCALL_64_fastpath
| | open64
| | 0x686361632e6f732e
| |
| |--44.37%-- __inode_permission
| | inode_permission
| | link_path_walk
| | path_openat
| | do_filp_open
| | do_sys_open
| | sys_open
| | entry_SYSCALL_64_fastpath
| | open64
| | 0x686361632e6f732e
| |
| --5.85%-- scheduler_tick
| update_process_times
| tick_sched_handle.isra.17
| tick_sched_timer
| __hrtimer_run_queues
| hrtimer_interrupt
| local_apic_timer_interrupt
| smp_apic_timer_interrupt
| apic_timer_interrupt
| setup_new_exec
| load_elf_binary
| search_binary_handler
| do_execveat_common.isra.32
| sys_execve
| return_from_execve
| 0x7f9abb498a77
|
--49.52%-- nmi
do_lookup_x

1.24% 0.00% ls [unknown] [.] 0x0000000001dbdc70
|
---0x1dbdc70

1.23% 0.00% ls [kernel.vmlinux] [k] task_work_run
|
---task_work_run
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.23% 0.00% ls [kernel.vmlinux] [k] ____fput
|
---____fput
task_work_run
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.23% 0.00% ls [kernel.vmlinux] [k] __fput
|
---__fput
____fput
task_work_run
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.23% 1.23% ls [kernel.vmlinux] [k] locks_remove_file
|
---locks_remove_file
__fput
____fput
task_work_run
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.18% 0.00% ls [unknown] [.] 0x096f2e68636e6562
|
---0x96f2e68636e6562

1.10% 0.00% ls [kernel.vmlinux] [k] tlb_finish_mmu
|
---tlb_finish_mmu
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.10% 0.00% ls [kernel.vmlinux] [k] tlb_flush_mmu_free
|
---tlb_flush_mmu_free
tlb_finish_mmu
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.10% 0.00% ls [kernel.vmlinux] [k] free_pages_and_swap_cache
|
---free_pages_and_swap_cache
tlb_flush_mmu_free
tlb_finish_mmu
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.10% 1.10% ls [kernel.vmlinux] [k] release_pages
|
---release_pages
free_pages_and_swap_cache
tlb_flush_mmu_free
tlb_finish_mmu
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

1.08% 1.08% ls ls [.] 0x0000000000006b20
|
---0x6b20
0
0

1.08% 0.00% ls ls [.] 0xffffffffffc06b20
|
---0x6b20
0
0

1.01% 0.00% ls [unknown] [.] 0x72616863656d6974
|
---0x72616863656d6974

1.01% 1.01% ls ls [.] __ctype_get_mb_cur_max@plt
|
---__ctype_get_mb_cur_max@plt
0x6dcb
0
0x72616863656d6974

1.01% 1.01% ls [kernel.vmlinux] [k] unmap_page_range
|
---unmap_page_range
unmap_single_vma
unmap_vmas
exit_mmap
mmput
do_exit
do_group_exit
0x27cb44
entry_SYSCALL_64_fastpath

0.94% 0.00% ls [unknown] [.] 0x2d6469646c697562
|
---0x2d6469646c697562

0.89% 0.89% ls [kernel.vmlinux] [k] get_pwq.isra.18
|
---get_pwq.isra.18
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write

0.80% 0.00% ls [kernel.vmlinux] [k] end_repeat_nmi
|
---end_repeat_nmi
|
|--39.76%-- vsnprintf
| sprintf
| print_time.part.12
| print_prefix
| msg_print_text
| console_unlock
| vprintk_emit
| vprintk_default
| printk
| perf_duration_warn
| irq_work_run_list
| irq_work_run
| smp_irq_work_interrupt
| irq_work_interrupt
| __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
|--35.44%-- __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
--24.80%-- scheduler_tick
update_process_times
tick_sched_handle.isra.17
tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.80% 0.00% ls [kernel.vmlinux] [k] perf_event_context_sched_in
|
---perf_event_context_sched_in
|
|--100.00%-- __perf_event_task_sched_in
| finish_task_switch
| __schedule
| preempt_schedule_common
| _cond_resched
| mutex_lock
| n_tty_write
| tty_write
| __vfs_write
| vfs_write
| sys_write
| entry_SYSCALL_64_fastpath
| __GI___libc_write
| 0x9096f2e61746164
--0.00%-- [...]

0.80% 0.00% ls [unknown] [.] 0x09096f2e61746164
|
---0x9096f2e61746164

0.78% 0.00% ls libc-2.18.so [.] __run_exit_handlers
|
---__run_exit_handlers
0

0.78% 0.00% ls libc-2.18.so [.] _exit
|
---_exit
__run_exit_handlers
0

0.72% 0.72% ls [kernel.vmlinux] [k] account_entity_enqueue
|
---account_entity_enqueue
enqueue_entity
enqueue_task_fair
enqueue_task
activate_task
ttwu_do_activate.constprop.92
try_to_wake_up
wake_up_process
wake_up_worker
insert_work
__queue_work
queue_work_on
tty_schedule_flip
tty_flip_buffer_push
pty_write
n_tty_write
tty_write
__vfs_write
vfs_write
sys_write
entry_SYSCALL_64_fastpath
__GI___libc_write
0x909632e66666964

0.62% 0.00% ls [kernel.vmlinux] [k] perf_event_nmi_handler
|
---perf_event_nmi_handler
nmi_handle
default_do_nmi
do_nmi
end_repeat_nmi
|
|--51.70%-- vsnprintf
| sprintf
| print_time.part.12
| print_prefix
| msg_print_text
| console_unlock
| vprintk_emit
| vprintk_default
| printk
| perf_duration_warn
| irq_work_run_list
| irq_work_run
| smp_irq_work_interrupt
| irq_work_interrupt
| __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
|--46.08%-- __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
--2.22%-- scheduler_tick
update_process_times
tick_sched_handle.isra.17
tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.60% 0.60% ls [kernel.vmlinux] [k] perf_sample_event_took
|
---perf_sample_event_took
perf_event_nmi_handler
nmi_handle
default_do_nmi
do_nmi
end_repeat_nmi
|
|--52.87%-- vsnprintf
| sprintf
| print_time.part.12
| print_prefix
| msg_print_text
| console_unlock
| vprintk_emit
| vprintk_default
| printk
| perf_duration_warn
| irq_work_run_list
| irq_work_run
| smp_irq_work_interrupt
| irq_work_interrupt
| __inode_permission
| inode_permission
| link_path_walk
| path_openat
| do_filp_open
| do_sys_open
| sys_open
| entry_SYSCALL_64_fastpath
| open64
| 0x686361632e6f732e
|
--47.13%-- __inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

0.58% 0.00% ls [unknown] [.] 0x6f2e7473696c7665
|
---0x6f2e7473696c7665

0.58% 0.00% ls [kernel.vmlinux] [k] pick_next_task_fair
|
---pick_next_task_fair
__schedule
schedule
prepare_exit_to_usermode
syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
0x6f2e7473696c7665

0.58% 0.58% ls [kernel.vmlinux] [k] __enqueue_entity
|
---__enqueue_entity
pick_next_task_fair
__schedule
schedule
prepare_exit_to_usermode
syscall_return_slowpath
int_ret_from_sys_call
__GI___libc_write
0x6f2e7473696c7665

0.57% 0.00% ls libc-2.18.so [.] __GI___munmap
|
---__GI___munmap

0.57% 0.00% ls [kernel.vmlinux] [k] sys_munmap
|
---sys_munmap
entry_SYSCALL_64_fastpath
__GI___munmap

0.57% 0.00% ls [kernel.vmlinux] [k] vm_munmap
|
---vm_munmap
sys_munmap
entry_SYSCALL_64_fastpath
__GI___munmap

0.57% 0.00% ls [kernel.vmlinux] [k] do_munmap
|
---do_munmap
vm_munmap
sys_munmap
entry_SYSCALL_64_fastpath
__GI___munmap

0.57% 0.00% ls [kernel.vmlinux] [k] remove_vma
|
---remove_vma
do_munmap
vm_munmap
sys_munmap
entry_SYSCALL_64_fastpath
__GI___munmap

0.57% 0.57% ls [kernel.vmlinux] [k] kmem_cache_free
|
---kmem_cache_free
remove_vma
do_munmap
vm_munmap
sys_munmap
entry_SYSCALL_64_fastpath
__GI___munmap

0.32% 0.00% ls [kernel.vmlinux] [k] msg_print_text
|
---msg_print_text
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

0.32% 0.00% ls [kernel.vmlinux] [k] print_prefix
|
---print_prefix
msg_print_text
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

0.32% 0.00% ls [kernel.vmlinux] [k] print_time.part.12
|
---print_time.part.12
print_prefix
msg_print_text
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

0.32% 0.00% ls [kernel.vmlinux] [k] sprintf
|
---sprintf
print_time.part.12
print_prefix
msg_print_text
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

0.32% 0.00% ls [kernel.vmlinux] [k] vsnprintf
|
---vsnprintf
sprintf
print_time.part.12
print_prefix
msg_print_text
console_unlock
vprintk_emit
vprintk_default
printk
perf_duration_warn
irq_work_run_list
irq_work_run
smp_irq_work_interrupt
irq_work_interrupt
__inode_permission
inode_permission
link_path_walk
path_openat
do_filp_open
do_sys_open
sys_open
entry_SYSCALL_64_fastpath
open64
0x686361632e6f732e

0.32% 0.00% ls ld-2.18.so [.] 0xffff804cabb62640
|
---0x21e640
0

0.32% 0.32% ls ld-2.18.so [.] _dl_setup_hash
|
---_dl_setup_hash
_dl_map_object
0x21e640
0

0.29% 0.00% ls [unknown] [k] 0x00007f9abb498a77
|
---0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] return_from_execve
|
---return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] sys_execve
|
---sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] do_execveat_common.isra.32
|
---do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] search_binary_handler
|
---search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] load_elf_binary
|
---load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] setup_new_exec
|
---setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] apic_timer_interrupt
|
---apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] smp_apic_timer_interrupt
|
---smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] local_apic_timer_interrupt
|
---local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] hrtimer_interrupt
|
---hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] __hrtimer_run_queues
|
---__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] tick_sched_timer
|
---tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] tick_sched_handle.isra.17
|
---tick_sched_handle.isra.17
tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] update_process_times
|
---update_process_times
tick_sched_handle.isra.17
tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.21% 0.00% ls [kernel.vmlinux] [k] scheduler_tick
|
---scheduler_tick
update_process_times
tick_sched_handle.isra.17
tick_sched_timer
__hrtimer_run_queues
hrtimer_interrupt
local_apic_timer_interrupt
smp_apic_timer_interrupt
apic_timer_interrupt
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77

0.08% 0.08% ls [kernel.vmlinux] [k] native_sched_clock
|
---native_sched_clock
0x7f9abb498a77

0.00% 0.00% ls [kernel.vmlinux] [k] perf_event_exec
|
---perf_event_exec
setup_new_exec
load_elf_binary
search_binary_handler
do_execveat_common.isra.32
sys_execve
return_from_execve
0x7f9abb498a77



# Samples: 158 of event 'cpu/instructions,call-graph=no,time=0,period=20000/p'
# Event count (approx.): 3762761
#
# Children Self Command Shared Object Symbol
# ........ ........ ....... ................ ..................................
#
5.87% 5.87% ls [unknown] [.] 0x00007fb353d5cf7e

4.84% 4.84% ls [kernel.vmlinux] [k] delay_tsc

3.77% 3.77% ls [kernel.vmlinux] [k] pick_next_task_fair

3.11% 3.11% ls [kernel.vmlinux] [k] unmap_page_range

2.94% 2.94% ls [kernel.vmlinux] [k] n_tty_write

2.48% 2.48% ls [unknown] [.] 0x000000000040669a

2.40% 2.40% ls [unknown] [.] 0x00007fb353d5cd1a

2.37% 2.37% ls [unknown] [.] 0x00007fb353d5cca4

2.37% 2.37% ls [unknown] [.] 0x00000000004066ca

2.25% 2.25% ls [unknown] [.] 0x00007fb353d5db87

2.03% 2.03% ls [unknown] [.] 0x00007fb353d5ccaa

1.98% 1.98% ls [unknown] [.] 0x00007fb353d5cc9c

1.97% 1.97% ls [unknown] [.] 0x0000000000405b2a

1.89% 1.89% ls [unknown] [.] 0x00007fb3546d43e0

1.83% 1.83% ls [unknown] [.] 0x00007fb353d5cef6

1.75% 1.75% ls [kernel.vmlinux] [k] ring_buffer_record_is_on

1.69% 1.69% ls [unknown] [.] 0x00007fb353d5cc3a

1.63% 1.63% ls [unknown] [.] 0x0000000000405611

1.47% 1.47% ls [kernel.vmlinux] [k] __fput

1.44% 1.44% ls [kernel.vmlinux] [k] release_pages

1.37% 1.37% ls [kernel.vmlinux] [k] perf_pmu_sched_task

1.34% 1.34% ls [unknown] [.] 0x00007fb353d54fed

1.33% 1.33% ls [kernel.vmlinux] [k] __memcpy

1.33% 1.33% ls [unknown] [.] 0x00007fb353d5df34

1.31% 1.31% ls [unknown] [.] 0x00007fb353d5ccdf

1.29% 1.29% ls [unknown] [.] 0x0000000000406a19

1.29% 1.29% ls [kernel.vmlinux] [k] page_remove_rmap

1.29% 1.29% ls [kernel.vmlinux] [k] do_set_pte

1.28% 1.28% ls [kernel.vmlinux] [k] __audit_syscall_exit

1.28% 1.28% ls [kernel.vmlinux] [k] enqueue_entity

1.28% 1.28% ls [ext4] [k] ext4fs_dirhash

1.26% 1.26% ls [kernel.vmlinux] [k] cpuacct_charge

1.24% 1.24% ls [kernel.vmlinux] [k] sched_clock

1.24% 1.24% ls [unknown] [.] 0x00007fb353d4bca5

1.22% 1.22% ls [unknown] [.] 0x00007fb353dfb6ac

1.21% 1.21% ls [ext4] [k] str2hashbuf_signed

1.21% 1.21% ls [unknown] [.] 0x00007fb3546c766a

1.20% 1.20% ls [ext4] [k] __ext4_check_dir_entry

1.13% 1.13% ls [kernel.vmlinux] [k] x86_pmu_disable

1.12% 1.12% ls [unknown] [.] 0x00007fb3546c5571

1.11% 1.11% ls [kernel.vmlinux] [k] vm_normal_page

1.09% 1.09% ls [unknown] [.] 0x00007fb3546cc246

1.06% 1.06% ls [unknown] [.] 0x00007fb3546cc21e

1.03% 1.03% ls [unknown] [.] 0x000000000040e6a0

1.01% 1.01% ls [unknown] [.] 0x00007fb3546c5ce3

0.88% 0.88% ls [unknown] [.] 0x00007fb3546c7814

0.88% 0.88% ls [kernel.vmlinux] [k] mark_page_accessed

0.87% 0.87% ls [unknown] [.] 0x00007fb3546c7960

0.78% 0.78% ls [unknown] [.] 0x000000000040e7ea

0.77% 0.77% ls [kernel.vmlinux] [k] security_mmap_file

0.66% 0.66% ls [unknown] [.] 0x000000000040f3c5

0.65% 0.65% ls [kernel.vmlinux] [k] enqueue_task_fair

0.63% 0.63% ls [kernel.vmlinux] [k] unlock_page

0.61% 0.61% ls [kernel.vmlinux] [k] place_entity

0.57% 0.57% ls [unknown] [.] 0x000000000040e808

0.56% 0.56% ls [kernel.vmlinux] [k] perf_event_aux_ctx

0.54% 0.54% ls [kernel.vmlinux] [k] __rb_insert_augmented

0.54% 0.54% ls [kernel.vmlinux] [k] update_min_vruntime

0.50% 0.50% ls [kernel.vmlinux] [k] update_curr

0.47% 0.47% ls [kernel.vmlinux] [k] vma_interval_tree_insert

0.47% 0.47% ls [kernel.vmlinux] [k] io_serial_in

0.47% 0.47% ls [kernel.vmlinux] [k] check_cfs_rq_runtime

0.46% 0.46% ls [kernel.vmlinux] [k] tracing_record_cmdline

0.46% 0.46% ls [kernel.vmlinux] [k] __dec_zone_page_state

0.42% 0.42% ls [kernel.vmlinux] [k] try_to_wake_up

0.40% 0.40% ls [kernel.vmlinux] [k] insert_work

0.40% 0.40% ls [kernel.vmlinux] [k] put_prev_entity

0.40% 0.40% ls [kernel.vmlinux] [k] avc_has_perm_noaudit

0.38% 0.38% ls [kernel.vmlinux] [k] __list_del_entry

0.38% 0.38% ls [unknown] [.] 0x0000000000405852

0.36% 0.36% ls [kernel.vmlinux] [k] __intel_pmu_disable_all

0.35% 0.35% ls [kernel.vmlinux] [k] ttwu_do_activate.constprop.92

0.35% 0.35% ls [kernel.vmlinux] [k] mem_cgroup_begin_page_stat

0.34% 0.34% ls [kernel.vmlinux] [k] perf_ctx_unlock

0.32% 0.32% ls [unknown] [.] 0x0000000000405b46

0.32% 0.32% ls [unknown] [.] 0x0000000000405811

0.31% 0.31% ls [unknown] [.] 0x00007fb3546c54fa

0.31% 0.31% ls [kernel.vmlinux] [k] rb_next

0.31% 0.31% ls [kernel.vmlinux] [k] tracing_is_on

0.30% 0.30% ls [unknown] [.] 0x00007fb3546c553d

0.29% 0.29% ls [unknown] [.] 0x00007fb3546cb597

0.20% 0.20% ls [kernel.vmlinux] [k] format_decode

0.18% 0.18% ls [kernel.vmlinux] [k] __audit_syscall_entry

0.16% 0.16% ls [kernel.vmlinux] [k] arch_get_unmapped_area_topdown

0.16% 0.16% ls [kernel.vmlinux] [k] fsnotify

0.16% 0.16% ls [kernel.vmlinux] [k] intel_bts_enable_local

0.15% 0.15% ls [kernel.vmlinux] [k] selinux_inode_permission

0.14% 0.14% ls [kernel.vmlinux] [k] wait_for_xmitr

0.14% 0.14% ls [kernel.vmlinux] [k] __const_udelay

0.11% 0.11% ls [kernel.vmlinux] [k] find_vma

0.11% 0.11% ls [unknown] [.] 0x00007fb3546d18ae

0.10% 0.10% ls [unknown] [.] 0x00007fb3546cb18e

0.03% 0.03% ls [kernel.vmlinux] [k] native_sched_clock

0.01% 0.01% ls [kernel.vmlinux] [k] trigger_load_balance

0.01% 0.01% ls [kernel.vmlinux] [k] do_nmi

0.00% 0.00% ls [kernel.vmlinux] [k] perf_event_nmi_handler

0.00% 0.00% ls [kernel.vmlinux] [k] perf_sample_event_took

0.00% 0.00% ls [kernel.vmlinux] [k] nmi



#
# (For a higher level overview, try: perf report --sort comm,dso)
#