Re: [PATCH 00/37] perf/core improvements and fixes

[Ingo Molnar]

* Arnaldo Carvalho de Melo <acme@xxxxxxxxxx> wrote:

> Hi Ingo,
> 
> 	Please consider pulling,
> 
> - Arnaldo
> 
> Test results at the end of this message, as usual.
> 
> The following changes since commit ce6c9da1113ad681bff27a3e376d2017f7f8a59c:
> 
>   Merge remote-tracking branch 'tip/perf/urgent' into perf/core (2018-10-18 11:13:01 -0300)
> 
> are available in the Git repository at:
> 
>   git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux.git tags/perf-core-for-mingo-4.20-20181025
> 
> for you to fetch changes up to fe57120e18a1f9124ca758c89cc54f91333d1847:
> 
>   perf script: Support total cycles count (2018-10-24 15:29:56 -0300)
> 
> ----------------------------------------------------------------
> perf/core improvements and fixes:
> 
> - Introduce 'perf trace --max-events' for stopping 'perf trace' when
>   that many syscalls (enter+exit), tracepoints or other events such as
>   page faults take place.
> 
>   Support that as well on a per-event basis, e.g.:
> 
>    perf trace -e sched:*switch/nr=2/,block:*_plug/nr=4/,block:*_unplug/nr=1/,net:*dev_queue/nr=3,max-stack=16/
> 
>   Will stop when 2 context switches, 4 block plugs, 1 block unplug and
>   3 net_dev_queue tracepoints take place. (Arnaldo Carvalho de Melo)
> 
> - Poll for monitored tasks being alive in 'perf stat -p/-t', exiting when
>   those tasks all terminate (Jiri Olsa)
> 
> - Encode -k clockid frequency into perf.data to enable timestamps derived
>   metrics conversion into wall clock time on reporting stage. (Alexey Budankov)
> 
> - Improve Intel PT call graph from SQL database and GUI python scripts,
>   including adopting the Qt MDI interface to allow for multiple subwindows
>   for all the tables, helping in better visualizing the data in the SQL
>   tables, also uses, when available, the Intel XED disassembler libraries
>   to present the Intel PT data as x86 asm mnemonics. This last feature
>   is not currently working in some cases, fix is being discussed (Adrian Hunter)
> 
> - Implement a ftrace function_graph view in 'perf script' when processing
>   hardware trace data such as Intel PT (Andi Kleen)
> 
> - Better integration with the Intel XED disassembler, when available, in
>   'perf script' (Andi Kleen)
> 
> - Some 'perf trace' drop refcount fixes (Arnaldo Carvalho de Melo)
> 
> - Add Sparc support to 'perf annotate', jitdump (David Miller)
> 
> - Fix PLT symbols entry/header sizes properly on Sparc (David Miller)
> 
> - Fix generation of system call table failure with /tmp mounted with 'noexec'
>   in arm64 (Hongxu Jia)
> 
> - Allow extended console debug output in 'perf script' (Milian Wolff)
> 
> - Flush output stream after events in 'perf script' verbose mode (Milian Wolff)
> 
> Signed-off-by: Arnaldo Carvalho de Melo <acme@xxxxxxxxxx>
> 
> ----------------------------------------------------------------
> Adrian Hunter (17):
>       perf scripts python: call-graph-from-sql.py: Use SPDX license identifier
>       perf scripts python: call-graph-from-sql.py: Provide better default column sizes
>       perf scripts python: call-graph-from-sql.py: Set a minimum window size
>       perf scripts python: call-graph-from-sql.py: Change icon
>       perf scripts python: call-graph-from-sql.py: Make a "Main" function
>       perf scripts python: call-graph-from-sql.py: Separate the database details into a class
>       perf scripts python: call-graph-from-sql.py: Add a class for global data
>       perf scripts python: call-graph-from-sql.py: Remove use of setObjectName()
>       perf scripts python: call-graph-from-sql.py: Factor out CallGraphModel from TreeModel
>       perf scripts python: call-graph-from-sql.py: Add data helper functions
>       perf scripts python: call-graph-from-sql.py: Refactor TreeItem class
>       perf scripts python: call-graph-from-sql.py: Rename to exported-sql-viewer.py
>       perf scripts python: exported-sql-viewer.py: Add support for multiple sub-windows
>       perf scripts python: exported-sql-viewer.py: Add ability to find symbols in the call-graph
>       perf scripts python: exported-sql-viewer.py: Add ability to shrink / enlarge font
>       perf scripts python: exported-sql-viewer.py: Add ability to display all the database tables
>       perf scripts python: exported-sql-viewer.py: Add All branches report
> 
> Alexey Budankov (1):
>       perf record: Encode -k clockid frequency into Perf trace
> 
> Andi Kleen (5):
>       perf script: Add --insn-trace for instruction decoding
>       perf script: Make itrace script default to all calls
>       tools script: Add --call-trace and --call-ret-trace
>       perf script: Implement --graph-function
>       perf script: Support total cycles count
> 
> Arnaldo Carvalho de Melo (7):
>       tools lib subcmd: Introduce OPTION_ULONG
>       perf trace: Introduce --max-events
>       perf evsel: Introduce per event max_events property
>       perf evsel: Mark a evsel as disabled when asking the kernel do disable it
>       perf trace: Drop addr_location refcounts
>       perf trace: Drop thread refcount in trace__event_handler()
>       perf trace: Introduce per-event maximum number of events property
> 
> David Miller (3):
>       perf annotate: Add Sparc support
>       perf jitdump: Add Sparc support.
>       perf symbols: Set PLT entry/header sizes properly on Sparc
> 
> Hongxu Jia (1):
>       perf arm64: Fix generate system call table failed with /tmp mounted with noexec
> 
> Jiri Olsa (1):
>       perf stat: Poll for monitored tasks being alive
> 
> Milian Wolff (2):
>       perf script: Allow extended console debug output
>       perf script: Flush output stream after events in verbose mode
> 
>  tools/lib/subcmd/parse-options.c                  |   19 +
>  tools/lib/subcmd/parse-options.h                  |    2 +
>  tools/perf/Documentation/build-xed.txt            |   19 +
>  tools/perf/Documentation/intel-pt.txt             |    2 +-
>  tools/perf/Documentation/itrace.txt               |    7 +-
>  tools/perf/Documentation/perf-script.txt          |   18 +
>  tools/perf/Documentation/perf-trace.txt           |   67 +
>  tools/perf/arch/arm64/entry/syscalls/mksyscalltbl |    2 +-
>  tools/perf/arch/sparc/Makefile                    |    2 +
>  tools/perf/arch/sparc/annotate/instructions.c     |  169 ++
>  tools/perf/builtin-record.c                       |   24 +-
>  tools/perf/builtin-script.c                       |  166 +-
>  tools/perf/builtin-stat.c                         |   24 +
>  tools/perf/builtin-trace.c                        |   50 +-
>  tools/perf/perf.h                                 |    1 +
>  tools/perf/scripts/python/call-graph-from-sql.py  |  339 ----
>  tools/perf/scripts/python/export-to-postgresql.py |    2 +-
>  tools/perf/scripts/python/export-to-sqlite.py     |    2 +-
>  tools/perf/scripts/python/exported-sql-viewer.py  | 2128 +++++++++++++++++++++
>  tools/perf/util/annotate.c                        |    8 +
>  tools/perf/util/auxtrace.c                        |   17 +-
>  tools/perf/util/auxtrace.h                        |    5 +-
>  tools/perf/util/cs-etm.c                          |    3 +-
>  tools/perf/util/env.h                             |    1 +
>  tools/perf/util/evlist.c                          |    2 +-
>  tools/perf/util/evsel.c                           |   27 +-
>  tools/perf/util/evsel.h                           |    5 +
>  tools/perf/util/genelf.h                          |    6 +
>  tools/perf/util/header.c                          |   23 +
>  tools/perf/util/header.h                          |    1 +
>  tools/perf/util/intel-bts.c                       |    3 +-
>  tools/perf/util/intel-pt.c                        |    3 +-
>  tools/perf/util/parse-events.c                    |    8 +
>  tools/perf/util/parse-events.h                    |    1 +
>  tools/perf/util/parse-events.l                    |    1 +
>  tools/perf/util/symbol-elf.c                      |   12 +-
>  tools/perf/util/symbol.h                          |    3 +-
>  tools/perf/util/thread.h                          |    2 +
>  38 files changed, 2778 insertions(+), 396 deletions(-)
>  create mode 100644 tools/perf/Documentation/build-xed.txt
>  create mode 100644 tools/perf/arch/sparc/annotate/instructions.c
>  delete mode 100644 tools/perf/scripts/python/call-graph-from-sql.py
>  create mode 100755 tools/perf/scripts/python/exported-sql-viewer.py

Pulled, thanks a lot Arnaldo!

	Ingo