[libcamera-devel] raspberrypi: "Dropping unmatched input frame in stream..."

Kieran Bingham kieran.bingham at ideasonboard.com
Mon Nov 23 18:18:57 CET 2020


Hi Naush,

On 23/11/2020 15:48, Naushir Patuck wrote:
> Hi Kieran,
> 
> Hmmmm, this could be related to my last set of changes to fix the sync
> issue when using 1 bayer + embedded buffer.  I've not seen this myself
> during my testing though.  Your log suggests it's still happening. 
> Could you share the exact configuration (sensor used, command line,
> etc.) and I will see if I can reproduce this.

The kernel is (I believe) an upstream RPi kernel. I've run rpi-updates
recently, so I expect to have the latest public firmwares/kernel.

uname -a
Linux mercury 5.4.72-v8+ #1356 SMP PREEMPT Thu Oct 22 13:58:52 BST 2020
aarch64 GNU/Linux

Other than that, it's just run 'qcam' on the master branch of libcamera.
I'm using the IMX219/Camera V2.

Seems quite hit/miss when it happens ... maybe like 50/50 for me ...

--
Kieran

> Regards,
> Naush
> 
> 
> On Mon, 23 Nov 2020 at 15:40, Kieran Bingham
> <kieran.bingham at ideasonboard.com
> <mailto:kieran.bingham at ideasonboard.com>> wrote:
> 
>     Hi Naush, David,
> 
>     Lately I've been using the RPi a lot more for my testing, and I've
>     frequently been hitting the messages:
> 
>     > [0:34:28.098973998] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.099113982] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
> 
>     Pressing stop then start in qcam resolves it, but I was wondering if
>     this is something you're aware of/hitting? Or maybe I have something
>     wrong here...
> 
>     QCam sits stuck displaying one of the first early frames that came in.
> 
> 
>     More complete log below, I can generate a full log enabled log if it
>     helps too of course.
> 
>     > ./build/src/qcam/qcam
>     > qt5ct: using qt5ct plugin
>     > [0:34:27.034662002] [4064]  INFO IPAManager ipa_manager.cpp:136
>     libcamera is not installed. Adding
>     '/home/pi/libcamera/build/src/ipa' to the IPA search path
>     > [0:34:27.038692834] [4064]  INFO Camera camera_manager.cpp:293
>     libcamera v0.0.11+1168-845c9fca-dirty (2020-11-23T15:14:44+00:00)
>     > [0:34:27.062336317] [4066] ERROR Configuration
>     configuration.cpp:141 Trying /usr/local/etc/libcamera
>     > [0:34:27.062585117] [4066]  INFO Configuration
>     configuration.cpp:169 Read from
>     /usr/local/etc/libcamera/camera_sensor.json
>     > [0:34:27.163838378] [4066]  INFO IPAProxy ipa_proxy.cpp:122
>     libcamera is not installed. Loading IPA configuration from
>     '/home/pi/libcamera/src/ipa/raspberrypi/data'
>     > [0:34:27.200413179] [4064]  INFO Camera camera.cpp:830 configuring
>     streams: (0) 800x600-BGR888
>     > [0:34:27.201089300] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     3280x2464 fmt RG10 Score: 2592.49 (best 2592.49)
>     > [0:34:27.201240264] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     1920x1080 fmt RG10 Score: 2066.67 (best 2066.67)
>     > [0:34:27.201325969] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     1640x1232 fmt RG10 Score: 1874.49 (best 1874.49)
>     > [0:34:27.201396859] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     640x480 fmt RG10 Score: 2060 (best 1874.49)
>     > [0:34:27.201471527] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     3280x2464 fmt pRAA Score: 2092.49 (best 1874.49)
>     > [0:34:27.201542380] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     1920x1080 fmt pRAA Score: 1566.67 (best 1566.67)
>     > [0:34:27.201612844] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     1640x1232 fmt pRAA Score: 1374.49 (best 1374.49)
>     > [0:34:27.201682104] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     640x480 fmt pRAA Score: 1560 (best 1374.49)
>     > [0:34:27.201761660] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     3280x2464 fmt RGGB Score: 3592.49 (best 1374.49)
>     > [0:34:27.201830698] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     1920x1080 fmt RGGB Score: 3066.67 (best 1374.49)
>     > [0:34:27.201899607] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     1640x1232 fmt RGGB Score: 2874.49 (best 1374.49)
>     > [0:34:27.201968700] [4066]  INFO RPI raspberrypi.cpp:118 Mode:
>     640x480 fmt RGGB Score: 3060 (best 1374.49)
>     > [0:34:27.202062090] [4066]  INFO RPI raspberrypi.cpp:593 Sensor:
>     /base/soc/i2c0mux/i2c at 1/imx219 at 10 - Selected mode: 1640x1232-pRAA
>     > [0:34:27.271700683] [4066]  INFO RPI_S_W staggered_ctrl.cpp:36
>     Init ctrl 0x00980911 with delay 2
>     > [0:34:27.271882278] [4066]  INFO RPI_S_W staggered_ctrl.cpp:36
>     Init ctrl 0x009e0903 with delay 1
>     > Zero-copy enabled
>     > [0:34:27.299640832] [4066]  INFO RPISTREAM rpi_stream.cpp:120 No
>     buffers available for ISP Output0
>     > [0:34:27.299773001] [4066]  INFO RPISTREAM rpi_stream.cpp:120 No
>     buffers available for ISP Output0
>     > [0:34:27.390836360] [4066]  INFO RPI raspberrypi.cpp:1589 Dropping
>     frame at the request of the IPA (5 left)
>     > [0:34:27.425213113] [4066]  INFO RPI raspberrypi.cpp:1589 Dropping
>     frame at the request of the IPA (4 left)
>     > [0:34:27.456147580] [4066]  INFO RPI raspberrypi.cpp:1589 Dropping
>     frame at the request of the IPA (3 left)
>     > [0:34:27.490536352] [4066]  INFO RPI raspberrypi.cpp:1589 Dropping
>     frame at the request of the IPA (2 left)
>     > [0:34:27.517387765] [4066]  INFO RPI raspberrypi.cpp:1589 Dropping
>     frame at the request of the IPA (1 left)
>     > [0:34:27.547963968] [4066]  INFO RPI raspberrypi.cpp:1589 Dropping
>     frame at the request of the IPA (0 left)
>     > seq: 000006 bytesused: 1440000 timestamp: 2067542179000 fps: 0.00
>     > seq: 000007 bytesused: 1440000 timestamp: 2067575507000 fps: 30.00
>     > seq: 000008 bytesused: 1440000 timestamp: 2067608835000 fps: 30.00
>     > seq: 000009 bytesused: 1440000 timestamp: 2067642164000 fps: 30.00
>     > libpng warning: iCCP: known incorrect sRGB profile
>     > seq: 000010 bytesused: 1440000 timestamp: 2067675491000 fps: 30.01
>     > seq: 000011 bytesused: 1440000 timestamp: 2067708818000 fps: 30.01
>     > seq: 000012 bytesused: 1440000 timestamp: 2067742146000 fps: 30.00
>     > seq: 000013 bytesused: 1440000 timestamp: 2067775474000 fps: 30.00
>     > seq: 000014 bytesused: 1440000 timestamp: 2067942122000 fps: 6.00
>     > seq: 000015 bytesused: 1440000 timestamp: 2067975446000 fps: 30.01
>     > seq: 000016 bytesused: 1440000 timestamp: 2068008776000 fps: 30.00
>     > [0:34:28.098973998] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.099113982] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.132438666] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.132583242] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.165782294] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.165931352] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.199099938] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.199253663] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.232412193] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.232550806] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.265741745] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.265879691] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.299050760] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.299185502] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.332445497] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.332581481] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.365708104] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.365842531] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.399035915] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.399171898] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.432365726] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.432502876] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.465699481] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
>     > [0:34:28.465838576] [4066]  WARN RPI raspberrypi.cpp:1726 Dropping
>     unmatched input frame in stream Unicam Image
>     > [0:34:28.499051237] [4066]  WARN RPI raspberrypi.cpp:1687 Dropping
>     unmatched input frame in stream Unicam Embedded
> 
> 
> 
> 
>     -- 
>     Regards
>     --
>     Kieran
> 

-- 
Regards
--
Kieran


More information about the libcamera-devel mailing list