[PATCH 2/4] libipa: FCQueue: Make sure FrameContext#0 is initialized
Jacopo Mondi
jacopo.mondi at ideasonboard.com
Mon Oct 28 11:39:13 CET 2024
Hi Stefan
On Mon, Oct 28, 2024 at 11:16:23AM +0100, Stefan Klug wrote:
> Hi Jacopo,
>
> Thank you for the patch.
>
> On Wed, Oct 16, 2024 at 07:03:43PM +0200, Jacopo Mondi wrote:
> > Some IPA modules, like the RkISP1 one, call FCQueue::get(0) at
> > IPA::start() time, before any frame context has been allocated with
> > FCQueue::alloc() called at queueRequest() time.
> >
> > The FCQueue implementation aims to detect when a FrameContext is get()
> > before it is alloc()-ated, Warns about it, and initializes the
> > FrameContext before returning it.
> >
> > In case of frame#0, a get() preceding an alloc() call is not detected
> > as the "frame == frameContext.frame" test returns success, as
> > FrameContexts are zeroed by default.
> >
> > As a result, the first returned FrameContext is not initialized.
> >
> > Explicitly test for frame#0 to make sure the FrameContext is initialized
> > if get(0) is called before alloc(0). To avoid re-initializing a frame
> > context, in case alloc() has been called correctly before get(),
> > introduce an "initialised" state variable that tracks the FrameContext
> > initialisation state.
> >
> > Signed-off-by: Jacopo Mondi <jacopo.mondi at ideasonboard.com>
> > ---
> > src/ipa/libipa/fc_queue.h | 21 ++++++++++++++++++++-
> > 1 file changed, 20 insertions(+), 1 deletion(-)
> >
> > diff --git a/src/ipa/libipa/fc_queue.h b/src/ipa/libipa/fc_queue.h
> > index b1e8bc1485d4..bfcce5a81356 100644
> > --- a/src/ipa/libipa/fc_queue.h
> > +++ b/src/ipa/libipa/fc_queue.h
> > @@ -26,11 +26,13 @@ protected:
> > virtual void init(const uint32_t frameNum)
> > {
> > frame = frameNum;
> > + initialised = true;
>
> If I got it right, this only applies to the first initialization and not
> when the frame context gets reused for another frame.
>
> I believe we need to implement start controls anyways. I had a prototype
> for that in:
>
> c67de53b882e ("pipeline: rkisp1: Apply initial controls")
>
> If I'm not mistaken we could do the the explicit alloc of the context
> for frame 0 there.
>
>
> > }
> >
> > private:
> > template<typename T> friend class FCQueue;
> > uint32_t frame;
> > + bool initialised = false;
> > };
> >
> > template<typename FrameContext>
> > @@ -44,8 +46,10 @@ public:
> >
> > void clear()
> > {
> > - for (FrameContext &ctx : contexts_)
> > + for (FrameContext &ctx : contexts_) {
> > + ctx.initialised = false;
> > ctx.frame = 0;
> > + }
> > }
> >
> > FrameContext &alloc(const uint32_t frame)
> > @@ -89,6 +93,21 @@ public:
> > << " has been overwritten by "
> > << frameContext.frame;
> >
> > + if (frame == 0 && !frameContext.initialised) {
> > + /*
> > + * If the IPA calls get() at start() time it will get an
> > + * un-intialized FrameContext as the below "frame ==
> > + * frameContext.frame" check will return success because
> > + * FrameContexts are zeroed at creation time.
> > + *
> > + * Make sure the FrameContext gets initialised if get()
> > + * is called before alloc() by the IPA for frame#0.
> > + */
> > + frameContext.init(frame);
>
> Wouldn't it be more consistent if we warn in the get(0) case as for the
> other cases and ensure alloc get's called for frame 0?
>
The only entry point (in the current implementation) for alloc() is
queueRequest. So if we set controls at start() when no request is
queued we will always get(0) before alloc(0).
I think this should change going forward once we rework the IPA to
work based on when a frame/stats are available instead of being
clocked by the user submitted requests, but for now I think this is
what we have. Or did you mean something completely different I have
missed ?
Thanks
j
> Cheers,
> Stefan
>
> > +
> > + return frameContext;
> > + }
> > +
> > if (frame == frameContext.frame)
> > return frameContext;
> >
> > --
> > 2.47.0
> >
More information about the libcamera-devel
mailing list