Re: [RFC PATCH 2/6] crypto: benchmark - add a crypto benchmark tool

From: Greg KH
Date: Tue Sep 20 2022 - 03:30:39 EST


On Mon, Sep 19, 2022 at 08:05:33PM +0800, Yang Shen wrote:
> Provide a crypto benchmark to help the developer quickly get the
> performance of a algorithm registered in crypto.
>
> Due to the crypto algorithms have multifarious parameters, the tool
> cannot support all test scenes. In order to provide users with simple
> and easy-to-use tools and support as many test scenarios as possible,
> benchmark refers to the crypto method to provide a unified struct
> 'crypto_bm_ops'. And the algorithm registers its own callbacks to parse
> the user's input. In crypto, a algorithm class has multiple algorithms,
> but all of them uses the same API. So in the benchmark, a algorithm
> class uses the same 'ops' and distinguish specific algorithm by name.
>
> First, consider the performance calculation model. Considering the
> crypto subsystem model, a reasonable process code based on crypto api
> should create a numa node based 'crypto_tfm' in advance and apply for
> a certain amount of 'crypto_req' according to their own business.
> In the real business processing stage, the thread send tasks based on
> 'crypto_req' and wait for completion.
>
> Therefore, the benchmark will create 'crypto_tfm' and 'crypto_req' at
> first, and then count all requests time to calculate performance.
> So the result is the pure algorithm performance. When each algorithm
> class implements its own 'ops', it needs to pay attention to the content
> completed in the callback. Before the 'ops.perf', the tool had better
> prepare the request data set. And in order to avoid the false high
> performance of the algorithm caused by the false cache and TLB hit rate,
> the size of data set should be larger than 'crypto_req' number.
> The 'crypto_bm_ops' has following api:
> - init & uninit
> The initialize related functions. Algorithm can do some private setting.
> - create_tfm & release_tfm
> The 'crypto_tfm' related functions. Algorithm has different tfm name in
> crypto. But they both has a member named tfm, so use tfm to stand for
> algorithm handle. The benchmark has provides the tfm array.
> - create_req & release_req
> The 'crypto_req' related functions. The callbacks should create a 'reqnum'
> 'crypto_req' group in struct 'crypto_bm_base'. And the also suggest
> prepare the request data in this function. In order to avoid the false
> high performance of the algorithm caused by the false cache and TLB hit
> rate, the size of data set should be larger than 'crypto_req' number.
> - perf
> The request sending functions. The registrant should use parameter 'loop'
> to send requests repeatly. And update the count in struct
> 'crypto_bm_thread_data'.
>
> Then consider the parameters that user can configure. Generally speaking,
> the following parameters will affect the performance of the algorithm:
> tfm number, request number, block size, numa node. And some parameters
> will affect the stability of performance: testing time and requests sent
> number. To sum up, the benchmark has following parameters:
> - algorithm
> The testing algorithm name. Showed in /proc/crypto.
> - algtype
> The testing algorithm class. Can get the algorithm class by echo 'algtype'
> to /sys/module/crypto_benchmark/parameters/help.
> - inputsize
> The testing length that can greatly impact performance. Such as data size
> for compress or key length for encryption.
> - loop
> The testing loop times. Avoid performance fluctuations caused by
> environment.
> - numamask
> The testing bind numamask. Used for allocate memory, create threads and
> create 'crypto_tfm'.
> - optype
> The testing algorithm operation type. Can get the algorithm available
> operation types by cat /sys/module/crypto_benchmark/parameters/help
> with specified 'algtype'.
> - reqnum
> The testing request number for per tfm. Used for test asynchrony api
> performance.
> - threadnum
> The testing thread number. To simplify model, create a 'crypto_tfm' per
> thread.
> - time
> The testing time. Used for stop the test thread.
> - run
> Start or stop the test.
>
> Users can configure parameters under
> /sys/modules/crypto_benchmark/parameters/.

Please don't use module parameters for stuff like this, use configfs
which was designed for this type of interactions.

thanks,

greg k-h