[PATCH v3 0/3] Enable JPEG Encoder on RK3566/RK3568

From: Nicolas Frattaroli
Date: Wed May 11 2022 - 11:53:36 EST


Hello,

the following series adds support for and enables one of the hardware
video encoders on the RK3566 and RK3568 line of SoCs by Rockchip,
initially just for the JPEG format in line with what the kernel supports.

The encoder block is separate from the Hantro decoder instance, as they
are in different power domains and have wildly different memory addresses
as well.

The encoder hardware seemingly also supports VP8 and H.264 in addition
to just JPEG, as is evident from both the downstream vendor stack and the
register listing in the TRM. The hantro driver in Linux, however, does
not yet support encoding these formats.

The first patch modifies the bindings with a new compatible, and adds
the ability to just have a vepu interrupt without a vdpu interrupt.

The second patch makes the actual driver changes to support this variant.

The third and final patch makes the necessary device tree changes for
the rk356x device tree file to add both the node for the encoder and
its MMU.

The series has been tested on a PINE64 Quartz64 Model A with an RK3566
SoC using GStreamer.

Below you'll also find an interdiff against V2.

Regards,
Nicolas Frattaroli

Changes in v3:
- bindings: change consts to an enum
- bindings: add check to make sure devices with a -vepu compatible only
have the vepu interrupt

Changes in v2:
- rename compatible as it's not JPEG only
- rename device tree nodes as it's not JPEG only
- reword commits as it's not JPEG only
- get rid of a whole bunch of redundant struct definitions, as, you
guessed it, it's not JPEG only

Nicolas Frattaroli (3):
dt-bindings: media: rockchip-vpu: Add RK3568 VEPU compatible
media: hantro: Add support for RK356x encoder
arm64: dts: rockchip: Add Hantro encoder node to rk356x

.../bindings/media/rockchip-vpu.yaml | 17 ++++++++++++-
arch/arm64/boot/dts/rockchip/rk356x.dtsi | 21 ++++++++++++++++
drivers/staging/media/hantro/hantro_drv.c | 1 +
drivers/staging/media/hantro/hantro_hw.h | 1 +
.../staging/media/hantro/rockchip_vpu_hw.c | 25 +++++++++++++++++++
5 files changed, 64 insertions(+), 1 deletion(-)

Interdiff against v2:
diff --git a/Documentation/devicetree/bindings/media/rockchip-vpu.yaml b/Documentation/devicetree/bindings/media/rockchip-vpu.yaml
index 4045f107ca4e..965ca80b5cea 100644
--- a/Documentation/devicetree/bindings/media/rockchip-vpu.yaml
+++ b/Documentation/devicetree/bindings/media/rockchip-vpu.yaml
@@ -40,8 +40,9 @@ properties:

interrupt-names:
oneOf:
- - const: vdpu
- - const: vepu
+ - enum:
+ - vdpu
+ - vepu
- items:
- const: vepu
- const: vdpu
@@ -78,6 +79,18 @@ required:

additionalProperties: false

+allOf:
+ # compatibles that end in -vepu should only have the vepu interrupt
+ - if:
+ properties:
+ compatible:
+ contains:
+ pattern: "^[a-zA-Z0-9\\-,_.]+\\-vepu$"
+ then:
+ properties:
+ interrupt-names:
+ const: vepu
+
examples:
- |
#include <dt-bindings/clock/rk3288-cru.h>
--
2.36.1