[libcamera-devel] raspberrypi: "Dropping unmatched input frame in stream..."

Kieran Bingham kieran.bingham at ideasonboard.com
Mon Nov 23 18:33:46 CET 2020


Hi Naush,

On 23/11/2020 17:25, Naushir Patuck wrote:
> Hi Kieran,
> 
> On Mon, 23 Nov 2020, 5:19 pm Kieran Bingham,
> <kieran.bingham at ideasonboard.com
> <mailto:kieran.bingham at ideasonboard.com>> wrote:
> 
>     Hi Naush,
> 
>     On 23/11/2020 15:48, Naushir Patuck wrote:
>     > Hi Kieran,
>     >
>     > Hmmmm, this could be related to my last set of changes to fix the sync
>     > issue when using 1 bayer + embedded buffer.  I've not seen this myself
>     > during my testing though.  Your log suggests it's still happening. 
>     > Could you share the exact configuration (sensor used, command line,
>     > etc.) and I will see if I can reproduce this.
> 
>     The kernel is (I believe) an upstream RPi kernel. I've run rpi-updates
>     recently, so I expect to have the latest public firmwares/kernel.
> 
>     uname -a
>     Linux mercury 5.4.72-v8+ #1356 SMP PREEMPT Thu Oct 22 13:58:52 BST 2020
>     aarch64 GNU/Linux
> 
>     Other than that, it's just run 'qcam' on the master branch of libcamera.
>     I'm using the IMX219/Camera V2.
> 
>     Seems quite hit/miss when it happens ... maybe like 50/50 for me ...
> 
> 
> Thanks for the info. If you're able to capture log with RPI trace
> logging enabled, that would be very useful. I'll try and reproduce the
> same my side as well.


I was almost going to say this bug must only happen in the morning. (Or
with the logging disabled). But then I managed to make it happen with
logs on, and then I managed to catch it with logs on - and redirected to
a file.

So you're in luck (or not ... depending on your point of view hehe)

I'll mail the log to you separately rather than send a 500kb file to the
list.

Thanks.

Kieran



> 
> Regards,
> Naush
> 
> 
>     --
>     Kieran
> 
>     > Regards,
>     > Naush
>     >
>     >
>     > On Mon, 23 Nov 2020 at 15:40, Kieran Bingham
>     > <kieran.bingham at ideasonboard.com
>     <mailto:kieran.bingham at ideasonboard.com>
>     > <mailto:kieran.bingham at ideasonboard.com
>     <mailto:kieran.bingham at ideasonboard.com>>> wrote:
>     >
>     >     Hi Naush, David,
>     >
>     >     Lately I've been using the RPi a lot more for my testing, and I've
>     >     frequently been hitting the messages:
>     >
>     >     > [0:34:28.098973998] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.099113982] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >
>     >     Pressing stop then start in qcam resolves it, but I was
>     wondering if
>     >     this is something you're aware of/hitting? Or maybe I have
>     something
>     >     wrong here...
>     >
>     >     QCam sits stuck displaying one of the first early frames that
>     came in.
>     >
>     >
>     >     More complete log below, I can generate a full log enabled log
>     if it
>     >     helps too of course.
>     >
>     >     > ./build/src/qcam/qcam
>     >     > qt5ct: using qt5ct plugin
>     >     > [0:34:27.034662002] [4064]  INFO IPAManager ipa_manager.cpp:136
>     >     libcamera is not installed. Adding
>     >     '/home/pi/libcamera/build/src/ipa' to the IPA search path
>     >     > [0:34:27.038692834] [4064]  INFO Camera camera_manager.cpp:293
>     >     libcamera v0.0.11+1168-845c9fca-dirty (2020-11-23T15:14:44+00:00)
>     >     > [0:34:27.062336317] [4066] ERROR Configuration
>     >     configuration.cpp:141 Trying /usr/local/etc/libcamera
>     >     > [0:34:27.062585117] [4066]  INFO Configuration
>     >     configuration.cpp:169 Read from
>     >     /usr/local/etc/libcamera/camera_sensor.json
>     >     > [0:34:27.163838378] [4066]  INFO IPAProxy ipa_proxy.cpp:122
>     >     libcamera is not installed. Loading IPA configuration from
>     >     '/home/pi/libcamera/src/ipa/raspberrypi/data'
>     >     > [0:34:27.200413179] [4064]  INFO Camera camera.cpp:830
>     configuring
>     >     streams: (0) 800x600-BGR888
>     >     > [0:34:27.201089300] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     3280x2464 fmt RG10 Score: 2592.49 (best 2592.49)
>     >     > [0:34:27.201240264] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     1920x1080 fmt RG10 Score: 2066.67 (best 2066.67)
>     >     > [0:34:27.201325969] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     1640x1232 fmt RG10 Score: 1874.49 (best 1874.49)
>     >     > [0:34:27.201396859] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     640x480 fmt RG10 Score: 2060 (best 1874.49)
>     >     > [0:34:27.201471527] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     3280x2464 fmt pRAA Score: 2092.49 (best 1874.49)
>     >     > [0:34:27.201542380] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     1920x1080 fmt pRAA Score: 1566.67 (best 1566.67)
>     >     > [0:34:27.201612844] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     1640x1232 fmt pRAA Score: 1374.49 (best 1374.49)
>     >     > [0:34:27.201682104] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     640x480 fmt pRAA Score: 1560 (best 1374.49)
>     >     > [0:34:27.201761660] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     3280x2464 fmt RGGB Score: 3592.49 (best 1374.49)
>     >     > [0:34:27.201830698] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     1920x1080 fmt RGGB Score: 3066.67 (best 1374.49)
>     >     > [0:34:27.201899607] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     1640x1232 fmt RGGB Score: 2874.49 (best 1374.49)
>     >     > [0:34:27.201968700] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     >     640x480 fmt RGGB Score: 3060 (best 1374.49)
>     >     > [0:34:27.202062090] [4066]  INFO RPI raspberrypi.cpp:593 Sensor:
>     >     /base/soc/i2c0mux/i2c at 1/imx219 at 10 - Selected mode: 1640x1232-pRAA
>     >     > [0:34:27.271700683] [4066]  INFO RPI_S_W staggered_ctrl.cpp:36
>     >     Init ctrl 0x00980911 with delay 2
>     >     > [0:34:27.271882278] [4066]  INFO RPI_S_W staggered_ctrl.cpp:36
>     >     Init ctrl 0x009e0903 with delay 1
>     >     > Zero-copy enabled
>     >     > [0:34:27.299640832] [4066]  INFO RPISTREAM rpi_stream.cpp:120 No
>     >     buffers available for ISP Output0
>     >     > [0:34:27.299773001] [4066]  INFO RPISTREAM rpi_stream.cpp:120 No
>     >     buffers available for ISP Output0
>     >     > [0:34:27.390836360] [4066]  INFO RPI raspberrypi.cpp:1589
>     Dropping
>     >     frame at the request of the IPA (5 left)
>     >     > [0:34:27.425213113] [4066]  INFO RPI raspberrypi.cpp:1589
>     Dropping
>     >     frame at the request of the IPA (4 left)
>     >     > [0:34:27.456147580] [4066]  INFO RPI raspberrypi.cpp:1589
>     Dropping
>     >     frame at the request of the IPA (3 left)
>     >     > [0:34:27.490536352] [4066]  INFO RPI raspberrypi.cpp:1589
>     Dropping
>     >     frame at the request of the IPA (2 left)
>     >     > [0:34:27.517387765] [4066]  INFO RPI raspberrypi.cpp:1589
>     Dropping
>     >     frame at the request of the IPA (1 left)
>     >     > [0:34:27.547963968] [4066]  INFO RPI raspberrypi.cpp:1589
>     Dropping
>     >     frame at the request of the IPA (0 left)
>     >     > seq: 000006 bytesused: 1440000 timestamp: 2067542179000 fps:
>     0.00
>     >     > seq: 000007 bytesused: 1440000 timestamp: 2067575507000 fps:
>     30.00
>     >     > seq: 000008 bytesused: 1440000 timestamp: 2067608835000 fps:
>     30.00
>     >     > seq: 000009 bytesused: 1440000 timestamp: 2067642164000 fps:
>     30.00
>     >     > libpng warning: iCCP: known incorrect sRGB profile
>     >     > seq: 000010 bytesused: 1440000 timestamp: 2067675491000 fps:
>     30.01
>     >     > seq: 000011 bytesused: 1440000 timestamp: 2067708818000 fps:
>     30.01
>     >     > seq: 000012 bytesused: 1440000 timestamp: 2067742146000 fps:
>     30.00
>     >     > seq: 000013 bytesused: 1440000 timestamp: 2067775474000 fps:
>     30.00
>     >     > seq: 000014 bytesused: 1440000 timestamp: 2067942122000 fps:
>     6.00
>     >     > seq: 000015 bytesused: 1440000 timestamp: 2067975446000 fps:
>     30.01
>     >     > seq: 000016 bytesused: 1440000 timestamp: 2068008776000 fps:
>     30.00
>     >     > [0:34:28.098973998] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.099113982] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.132438666] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.132583242] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.165782294] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.165931352] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.199099938] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.199253663] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.232412193] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.232550806] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.265741745] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.265879691] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.299050760] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.299185502] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.332445497] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.332581481] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.365708104] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.365842531] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.399035915] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.399171898] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.432365726] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.432502876] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.465699481] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >     > [0:34:28.465838576] [4066]  WARN RPI raspberrypi.cpp:1726
>     Dropping
>     >     unmatched input frame in stream Unicam Image
>     >     > [0:34:28.499051237] [4066]  WARN RPI raspberrypi.cpp:1687
>     Dropping
>     >     unmatched input frame in stream Unicam Embedded
>     >
>     >
>     >
>     >
>     >     --
>     >     Regards
>     >     --
>     >     Kieran
>     >
> 
>     -- 
>     Regards
>     --
>     Kieran
> 

-- 
Regards
--
Kieran


More information about the libcamera-devel mailing list