Re: [PATCH v8 00/10] Enable VAS

[Michael Neuling]

So this is upstream now but it will cause a crash on boot with older skiboots
with: 

powernv-cpufreq: cpufreq pstate min 101 nominal 50 max 0
powernv-cpufreq: Workload Optimized Frequency is enabled in the platform
Disabling lock debugging due to kernel taint
Severe Machine check interrupt [Not recovered]
 NIP [c000000000098530]: reset_window_regs+0x20/0x220
 Initiator: CPU
 Error type: Unknown
opal: Machine check interrupt unrecoverable: MSR(RI=0)
opal: Hardware platform error: Unrecoverable Machine Check exception
CPU: 1 PID: 1 Comm: swapper/0 Tainted: GÂÂÂMÂÂÂÂÂÂÂÂÂÂÂÂ4.13.0-rc7-00708-g8b680911e774-dirty #10
task: c000000f22680000 task.stack: c000000f22700000
NIP:ÂÂc000000000098530 LR: c000000000098758 CTR: 0000000000000000
REGS: c00000003ffebd80 TRAP: 0200ÂÂÂTainted: GÂÂÂMÂÂÂÂÂÂÂÂÂÂÂÂÂ(4.13.0-rc7-00708-g8b680911e774-dirty)
MSR:ÂÂ9000000008349031 <SF,HV,EE,ME,IR,DR,LE>ÂÂCR: 24000224ÂÂXER: 00000000
CFAR: c000000000098754 DAR: 00000000100bef30 DSISR: 40000000 SOFTE: 0Â
GPR00: c000000000098f44 c000000f22703a00 c000000000eff200 c000000f1cf861e0Â
GPR04: c000000f22703a50 0000000000000001 0000000000000fff 0000000000000003Â
GPR08: c00c0000842f0000 0000000000000001 0000000000000000 0000000000000000Â
GPR12: 0000000000000000 c00000000fd40580 c000000000c03590 c000000000c1f428Â
GPR16: c000000000c4a640 c000000000c31360 c000000000c92738 c000000000c92690Â
GPR20: c000000000c926a0 c000000000c926f0 c000000f1d672940 0000000000000000Â
GPR24: c000000000c92638 0000000000000000 c000000000e888b0 c000000000dce428Â
GPR28: 0000000000000002 c000000f0e800000 c000000f22703a50 c000000f1cf861e0Â
NIP [c000000000098530] reset_window_regs+0x20/0x220
LR [c000000000098758] init_winctx_regs+0x28/0x6c0
Call Trace:
[c000000f22703a00] [0000000000000002] 0x2 (unreliable)
[c000000f22703a30] [c000000000098f44] vas_rx_win_open.part.11+0x154/0x210
[c000000f22703ae0] [c000000000d668e8] nx842_powernv_init+0x6b4/0x824
[c000000f22703c[ÂÂÂ38.412765557,0] OPAL: Reboot requested due to Platform error.
[ÂÂÂ38.412828287,3] OPAL: Reboot requested due to Platform error.40] [c00000000000ca60] do_one_initcall+0x60/0x1c0

If you see this you need a new skiboot with at least these two patches:

    b503dcf16d vas: Set mmio enable bits in DD2
    a5c124072f vas: Set FIRs according to workbook

This is a community announcement brought to you by OzLabs.Â
  OzLabs: Making Linux better since 1999

Mikey


On Mon, 2017-08-28 at 23:23 -0700, Sukadev Bhattiprolu wrote:
> Power9 introduces a hardware subsystem referred to as the Virtual
> Accelerator Switchboard (VAS). VAS allows kernel subsystems and user
> space processes to directly access the Nest Accelerator (NX) engines
> which implement compression and encryption algorithms in the hardware.
> 
> NX has been in Power processors since Power7+, but access to the NX
> engines was through the 'icswx' instruction which is only available
> to the kernel/hypervisor. Starting with Power9, access to the NX
> engines is provided to both kernel and user space processes through
> VAS.
> 
> The switchboard (i.e VAS) multiplexes accesses between "receivers" and
> "senders", where the "receivers" are typically the NX engines and
> "senders" are the kernel subsystems and user processors that wish to
> access the receivers (NX engines).ÂÂOnce a sender is "connected" to
> a receiver through the switchboard, the senders can submit compression/
> encryption requests to the hardware using the new (PowerISA 3.0)
> "copy" and "paste" instructions.
> 
> In the initial OPAL and PowerNV kernel patchsets, the "senders" can
> only be kernel subsystems (eg NX-842 driver) and receivers can only
> be the NX-842 engine. Follow-on patch sets will allow senders/receivers
> to be user-space processes and receivers to be NX-GZIP engines.
> 
> Provides:
> 
> 	This kernel patch set configures the VAS subsystems and provides
> 	kernel interfaces to drivers like NX-842 to open receive and send
> 	windows in VAS and to submit compression requests to the NX engine.
> 
> Requires:
> 
> 	This patch set needs corresponding VAS/NX skiboot patches which
> 	were merged into skiboot tree. i.e skiboot must include:
> 	commit b503dcf ("vas: Set mmio enable bits in DD2")
> 
> Tests:
> ÂÂÂÂÂÂÂÂIn-kernel compression requests were tested on DD1 and DD2 POWER9
> 	hardware using compression self-test module and the following
> 	NX-842 patch set from Haren Myneni:
> 
> ÂÂÂÂÂÂÂÂhttps://lists.ozlabs.org/pipermail/linuxppc-dev/2017-July/160620.html
> 
> 	and by dropping the last parameters to both vas_copy_crb() and
> 	vas_paste_crb() calls in drivers/crypto/nx/nx-842-powernv.c.
> 	See also PATCH 10/10.
> 
> Git Tree:
> 
> ÂÂÂÂÂÂÂÂhttps://github.com/sukadev/linux/Â;
> 	Branch: vas-kern-v8
> 
> Thanks to input from Ben Herrenschmidt, Michael Neuling, Michael Ellerman
> and Haren Myneni.
> 
> Changelog[v8]:
> 	- [Michael Ellerman] Use kernel int types (u64, u32 etc); make VAS
> 	ÂÂa built-in rather than a module; drop unnecessary fields from
> 	ÂÂstruct vas_instance; Update ISA references; use 0 or 1 with
> 	ÂÂSET_FIELD macros instead of bool; skip writing to SPARE registers;
> 	ÂÂminor cleanup of debug/error messages; retry if ida_get_new()
> 	ÂÂfails with EAGAIN; fix couple of leaks in ids in error handling;
> 	ÂÂdrop vas_initialized() check; drop vas_win_id() and vas_paste_addr()
> 	ÂÂinterfaces as they are not yet used; Set task_state() and fix
> 	ÂÂparameter to schedule_timeout(); Reuse existing copy/paste macros
> 	ÂÂdrop unnecessary parameters and add cr0 to clobbers list
> 
> Changelog[v7]:
> 	- Drop support for user space send/receive FTW windows (will be
> 	ÂÂposted separately) Simplifies the rx-win-open interface a bit.
> 	- [Michael Ellerman] Move GET_FIELD/SET_FIELD macros fromÂ
> 	ÂÂuapi/asm/vas.h to asm/vas.h.
> 
> Changelog[v6]
> 	- Add support for user space send/receive FTW windows
> 	- Add a new, NX-FTW driver which provides the FTW user interface
> 
> Changelog[v5]
> 	- [Ben Herrenschmidt] Make VAS a platform device in the device tree
> 	ÂÂand use the core platform functions to parse the VAS properties.
> 	ÂÂMap the VAS MMIO regions as non-cachable and paste regions as
> 	ÂÂcachable. Use CONFIG_PPC_VAS rather than CONFIG_VAS; Don't assume
> 	ÂÂVAS ids are sequential.
> 	- Copy the FIFO address as is into LFIFO_BAR (don't shift it).
> 
> Changelog[v4]
> 	Comments from Michael Neuling:
> 	- Move VAS code from drivers/misc/vas to arch/powerpc/platforms/powernv
> 	ÂÂsince VAS only provides interfaces to other drivers like NX-842.
> 	- Drop vas-internal.h and use vas.h in separate dirs for VAS
> 	ÂÂinternal, kernel API and user API
> 	- Rather than create 6 separate device tree properties windows
> 	ÂÂand window context, combine them into 6 "reg" properties.
> 	- Drop vas_window_reset() since windows are reset/cleared before
> 	ÂÂbeing assigned to kernel/users.
> 	- Use ilog2() and radix_enabled() helpers
> 
> Changelog[v3]
> 	- Rebase to v4.11-rc1
> 	- Add interfaces to initialize send/receive window attributes to
> 	ÂÂdefaults that drivers can use (see arch/powerpc/include/asm/vas.h)
> 	- Modify interface vas_paste() to return 0 or error code
> 	- Fix a bug in setting Translation Control Mode (0b11 not 0x11)
> 	- Enable send-window-credit checkingÂ
> 	- Reorg codeÂÂin vas_win_close()
> 	- Minor reorgs and tweaks to register field settings to make it
> 	ÂÂeasier to add support for user space windows.
> 	- Skip writing to read-only registers
> 	- Start window indexing from 0 rather than 1
> 
> Changelog[v2]
> 	- Use vas-id, HVWC, UWC and paste address, entries from device tree
> 	ÂÂrather than defining/computing them in kernel and reorg code.
> 
> 
> Sukadev Bhattiprolu (10):
> Â powerpc/vas: Define macros, register fields and structures
> Â Move GET_FIELD/SET_FIELD to vas.h
> Â powerpc/vas: Define vas_init() and vas_exit()
> Â powerpc/vas: Define helpers to access MMIO regions
> Â powerpc/vas: Define helpers to init window context
> Â powerpc/vas: Define helpers to alloc/free windows
> Â powerpc/vas: Define vas_rx_win_open() interface
> Â powerpc/vas: Define vas_win_close() interface
> Â powerpc/vas: Define vas_tx_win_open()
> Â powerpc/vas: Define copy/paste interfaces
> 
> Â.../devicetree/bindings/powerpc/ibm,vas.txtÂÂÂÂÂÂÂÂ|ÂÂÂ23 +
> ÂMAINTAINERSÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂÂÂ9 +
> Âarch/powerpc/include/asm/ppc-opcode.hÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂÂÂ2 +
> Âarch/powerpc/include/asm/vas.hÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂ160 +++
> Âarch/powerpc/platforms/powernv/KconfigÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂÂ14 +
> Âarch/powerpc/platforms/powernv/MakefileÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂÂÂ1 +
> Âarch/powerpc/platforms/powernv/copy-paste.hÂÂÂÂÂÂÂÂ|ÂÂÂ46 +
> Âarch/powerpc/platforms/powernv/vas-window.cÂÂÂÂÂÂÂÂ| 1134
> ++++++++++++++++++++
> Âarch/powerpc/platforms/powernv/vas.cÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂ151 +++
> Âarch/powerpc/platforms/powernv/vas.hÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂ467 ++++++++
> Âdrivers/crypto/nx/nx-842-powernv.cÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂÂÂ7 +-
> Âdrivers/crypto/nx/nx-842.hÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ|ÂÂÂÂ5 -
> Â12 files changed, 2011 insertions(+), 8 deletions(-)
> Âcreate mode 100644 Documentation/devicetree/bindings/powerpc/ibm,vas.txt
> Âcreate mode 100644 arch/powerpc/include/asm/vas.h
> Âcreate mode 100644 arch/powerpc/platforms/powernv/copy-paste.h
> Âcreate mode 100644 arch/powerpc/platforms/powernv/vas-window.c
> Âcreate mode 100644 arch/powerpc/platforms/powernv/vas.c
> Âcreate mode 100644 arch/powerpc/platforms/powernv/vas.h
>