XISP : Creating new IPA for AMD/Xilinx HLS-based ISP

[Mario Bergeron]

I have a preliminary "pipeline handler" working for my use case, with
integration to a petalinux 2024.1 project with yocto recipes, pulling
libcamera v0.4.0, and applying my modifications as patches.
I have documented my progress here :
https://avnet.me/tria-rpicam-fun-2024.1-part4


This is still using the HLS-based AWB algorithm, which is very very fast
and stable, but not producing as good image quality as the raspberry pi 5.



I have captured a side-by-side video showing the image quality and adaptive
rate of the AWB for both platforms : https://youtu.be/roYnDhWECWw



Before diving into creating a "IPA" for this use case, I need to determine
which modifications I need to make to the PL-based capture pipeline:

   - add capability to capture RAW images (? do I need this ?)
   - add capture of meta-data (containing exposure/gain registers for
   imx219,imx708,imx477,imx500, in addition to classification results and/or
   detection boxes for imx500)
   - expose image statistics to linux driver (currently not exposed to host
   CPU)
   - probably augment the statistics that are being generated


Which statistics should be generated for the host CPU ?

Which soft ISP should I refer to for my initial implementation ?


Any recommendations would be greatly appreciated.

Also, any collaboration is welcome !
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.libcamera.org/pipermail/libcamera-devel/attachments/20250210/e0df1acf/attachment.htm>