Re: [PATCH v2 1/1] lib: Optimise hex_dump_to_buffer()

[Andy Shevchenko]

On Sat, Mar 08, 2025 at 09:34:21AM +0000, David Laight wrote:
> Fastpath the normal case of single byte output that fits in the buffer.
> Output byte groups (byteswapped on little-endian) without calling snprintf().
> Remove the restriction that rowsize must be 16 or 32.
> (All callers currently pass 16 or 32.)
> Remove the restriction that groupsize must be 8 or less.
> If groupsize isn't a power of 2 or doesn't divide into both len and
>   rowsize it is set to 1 (otherwise byteswapping is hard).
> Change the types of the rowsize and groupsize parameters to be unsigned types.
> 
> Fix the return value (should be zero) when both len and linebuflen are zero.
> 
> All the updated tests in lib/test_hexdump.c pass.
> Code size (x86-64) approximately halved.

...

> -extern int hex_dump_to_buffer(const void *buf, size_t len, int rowsize,
> -			      int groupsize, char *linebuf, size_t linebuflen,
> -			      bool ascii);
> +extern size_t hex_dump_to_buffer(const void *buf, size_t len, size_t rowsize,

Why is extern still here?

> +				 size_t groupsize, char *linebuf,
> +				 size_t linebuflen, bool ascii);

int - > size_t in the returned value is incorrect change.
This is explained in the comments to the test cases patch series.

-- 
With Best Regards,
Andy Shevchenko