[libcamera-devel] [PATCH v10] test: gstreamer: Add test for gstreamer single stream
Vedant Paranjape
vedantparanjape160201 at gmail.com
Fri Aug 13 18:44:09 CEST 2021
Hi Laurent,
I was unable to reproduce the issue with address sanitizer.
Steps I followed:
1) meson --reconfigure build -Db_sanitize=address
2) ninja -C build test
Regards,
Vedant
On Fri, Aug 13, 2021 at 8:07 PM Laurent Pinchart <
laurent.pinchart at ideasonboard.com> wrote:
> On Fri, Aug 13, 2021 at 05:04:01PM +0300, Laurent Pinchart wrote:
> > On Fri, Aug 13, 2021 at 03:57:22PM +0300, Laurent Pinchart wrote:
> > > Hi Vedant,
> > >
> > > Thank you for the patch.
> > >
> > > On Fri, Aug 13, 2021 at 04:13:02PM +0530, Vedant Paranjape wrote:
> > > > This patch adds a test to test if single stream using
> > > > libcamera's gstreamer element works.
> > > >
> > > > Signed-off-by: Vedant Paranjape <vedantparanjape160201 at gmail.com>
> > > > Reviewed-by: Paul Elder <paul.elder at ideasonboard.com>
> > > > Reviewed-by: Kieran Bingham <kieran.bingham at ideasonboard.com>
> > > > ---
> > > > .../gstreamer_single_stream_test.cpp | 153
> ++++++++++++++++++
> > > > test/gstreamer/meson.build | 19 +++
> > > > test/meson.build | 1 +
> > > > 3 files changed, 173 insertions(+)
> > > > create mode 100644 test/gstreamer/gstreamer_single_stream_test.cpp
> > > > create mode 100644 test/gstreamer/meson.build
> > > >
> > > > diff --git a/test/gstreamer/gstreamer_single_stream_test.cpp
> b/test/gstreamer/gstreamer_single_stream_test.cpp
> > > > new file mode 100644
> > > > index 00000000..eecd3274
> > > > --- /dev/null
> > > > +++ b/test/gstreamer/gstreamer_single_stream_test.cpp
> > > > @@ -0,0 +1,153 @@
> > > > +/* SPDX-License-Identifier: GPL-2.0-or-later */
> > > > +/*
> > > > + * Copyright (C) 2021, Vedant Paranjape
> > > > + *
> > > > + * ipa_interface_test.cpp - Test the IPA interface
> > > > + */
> > > > +
> > > > +#include <iostream>
> > > > +
> > > > +#include <libcamera/base/utils.h>
> > > > +
> > > > +#include <gst/gst.h>
> > > > +
> > > > +#include "test.h"
> > > > +
> > > > +using namespace std;
> > > > +
> > > > +class GstreamerSingleStreamTest : public Test
> > > > +{
> > > > +protected:
> > > > + int init() override
> > > > + {
> > > > + /* Initialize GStreamer */
> > > > + GError *errInit = nullptr;
> > > > + if (!gst_init_check(nullptr, nullptr, &errInit)) {
> > > > + g_printerr("Could not initialize GStreamer: %s\n",
> > > > + errInit ? errInit->message : "unknown
> error");
> > > > + if (errInit)
> > > > + g_error_free(errInit);
> > > > +
> > > > + return TestFail;
> > > > + }
> > > > +
> > > > + /*
> > > > + * Remove the system libcamera plugin, if any, and add the
> > > > + * plugin from the build directory.
> > > > + */
> > >
> > > Missing space before *
> > >
> > > > + GstRegistry *registry = gst_registry_get();
> > > > + GstPlugin *plugin = gst_registry_lookup(registry,
> "libgstlibcamera.so");
> > > > + if (plugin) {
> > > > + gst_registry_remove_plugin(registry, plugin);
> > > > + gst_object_unref(plugin);
> > > > + }
> > > > +
> > >
> > > Extra blank spaces at the end of the line.
> > >
> > > > + std::string path =
> std::string(libcamera::utils::libcameraBuildPath()
> > > > + + "src/gstreamer");
> > >
> > > No need for calling the std::string constructor explictly,
> > > libcamera::utils::libcameraBuildPath() returns an std::string and the
> > > result of the operator+() call is also an std::string.
> > >
> > > You should #include "libcamera/internal/source_paths.h"" for
> > > libcamera::utils::libcameraBuildPath().
> > >
> > > I'll fix these small issues when applying.
> > >
> > > > + if (!gst_registry_scan_path(registry, path.c_str())) {
> > > > + g_printerr("Failed to add plugin to registry\n");
> > > > + gst_deinit();
> > > > + return TestFail;
> > > > + }
> > > > +
> > > > + /* Create the elements */
> > > > + libcameraSrc_ = gst_element_factory_make("libcamerasrc",
> "libcamera");
>
> And now I'm getting a failure here :-( When compiling with gcc, and with
> the meson b_sanitize option set to 'address', this call returns null.
>
> 10/64 libcamera:gstreamer / single_stream_test
> FAIL 0.48s exit status 1
> >>> MALLOC_PERTURB_=101
> build/x86-gcc-11.1.0/test/gstreamer/single_stream_test
> ―――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――
> ✀
> ―――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――
> stderr:
> ==14992==ASan runtime does not come first in initial library list; you
> should either link runtime to your application or manually preload it with
> LD_PRELOAD.
> ==14993==ASan runtime does not come first in initial library list; you
> should either link runtime to your application or manually preload it with
> LD_PRELOAD.
> Not all elements could be created.
> 0x6290000241f0.0x61a000019950.0x61a00001a670.(nil)
>
> =================================================================
> ==14990==ERROR: LeakSanitizer: detected memory leaks
>
> Direct leak of 16384 byte(s) in 1 object(s) allocated from:
> #0 0x7f9daade1ac7 in __interceptor_malloc
> /var/tmp/portage/sys-devel/gcc-11.1.0-r2/work/gcc-11.1.0/libsanitizer/asan/asan_malloc_linux.cpp:145
> #1 0x7f9da776a938 in g_malloc ../glib-2.68.3/glib/gmem.c:106
>
> SUMMARY: AddressSanitizer: 16384 byte(s) leaked in 1 allocation(s).
>
> ――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――――
>
> 11/64 libcamera:ipa / ipa_module_test
> OK 0.08s
>
> Interestingly, if I run the test with
>
> LD_PRELOAD=/usr/lib/gcc/x86_64-pc-linux-gnu/11.1.0/libasan.so.6
> ./test/gstreamer/single_stream_test
>
> then is runs fine:
>
> [25:59:46.412146534] [18711] INFO IPAManager ipa_manager.cpp:138
> libcamera is not installed. Adding '[...]/build/x86-gcc-11.1.0/src/ipa' to
> the IPA search path
> [25:59:46.413634330] [18711] INFO Camera camera_manager.cpp:294 libcamera
> v0.0.0+2881-24c1e91b-dirty (2021-08-13T17:24:37+03:00)
> [25:59:46.663097368] [18714] WARN CameraSensorProperties
> camera_sensor_properties.cpp:123 No static properties available for 'Sensor
> B'
> [25:59:46.663129122] [18714] WARN CameraSensorProperties
> camera_sensor_properties.cpp:125 Please consider updating the camera sensor
> properties database
> [25:59:46.663156409] [18714] WARN CameraSensor camera_sensor.cpp:403
> 'Sensor B': Failed to retrieve the camera location
> [25:59:46.664891182] [18714] INFO IPAProxy ipa_proxy.cpp:130 libcamera is
> not installed. Loading IPA configuration from '[...]/src/ipa/vimc/data'
> [25:59:46.680563655] [18715] INFO Camera camera.cpp:870 configuring
> streams: (0) 160x120-YUYV
>
> =================================================================
> ==18711==ERROR: LeakSanitizer: detected memory leaks
>
> Direct leak of 16384 byte(s) in 1 object(s) allocated from:
> #0 0x7effa6393ac7 in __interceptor_malloc
> /var/tmp/portage/sys-devel/gcc-11.1.0-r2/work/gcc-11.1.0/libsanitizer/asan/asan_malloc_linux.cpp:145
> #1 0x7effa57be938 in g_malloc ../glib-2.68.3/glib/gmem.c:106
>
> SUMMARY: AddressSanitizer: 16384 byte(s) leaked in 1 allocation(s).
>
> The leak is a known glib issue, caught by valgrind too, so I'm not
> worried about it. The test failing to run is however a blocker.
>
> Vedant, can you reproduce the failure with the address sanitizer ?
>
> > > > + convert0_ = gst_element_factory_make("videoconvert",
> "convert0");
> > > > + sink0_ = gst_element_factory_make("fakesink", "sink0");
> > > > +
> > > > + /* Create the empty pipeline_ */
> > > > + pipeline_ = gst_pipeline_new("test-pipeline");
> > > > +
> > > > + if (!pipeline_ || !convert0_ || !sink0_ || !libcameraSrc_)
> {
> > > > + g_printerr("Not all elements could be created.
> %p.%p.%p.%p\n",
> > > > + pipeline_, convert0_, sink0_,
> libcameraSrc_);
> > > > + if (pipeline_)
> > > > + gst_object_unref(pipeline_);
> > > > + if (convert0_)
> > > > + gst_object_unref(convert0_);
> > > > + if (sink0_)
> > > > + gst_object_unref(sink0_);
> > > > + if (libcameraSrc_)
> > > > + gst_object_unref(libcameraSrc_);
> > > > + gst_deinit();
> > > > +
> > > > + return TestFail;
> > > > + }
> > > > +
> > > > + return TestPass;
> > > > + }
> > > > +
> > > > + void cleanup() override
> > > > + {
> > > > + gst_object_unref(pipeline_);
> > > > + gst_deinit();
> > > > + }
> > > > +
> > > > + int run() override
> > > > + {
> > > > + GstStateChangeReturn ret;
> > > > + g_autoptr(GstBus) bus;
> > > > + g_autoptr(GstMessage) msg;
> >
> > I've also had to initialize those two variables to nullptr, to fix
> >
> > In file included from /usr/lib/glib-2.0/include/glibconfig.h:9,
> > from /usr/include/glib-2.0/glib/gtypes.h:32,
> > from /usr/include/glib-2.0/glib/galloca.h:32,
> > from /usr/include/glib-2.0/glib.h:30,
> > from /usr/include/gstreamer-1.0/gst/gst.h:27,
> > from
> ../../test/gstreamer/gstreamer_single_stream_test.cpp:14:
> > /usr/include/glib-2.0/glib/gmacros.h: In member function ‘virtual int
> GstreamerSingleStreamTest::run()’:
> > /usr/include/glib-2.0/glib/gmacros.h:1045:7: error: ‘msg’ may be used
> uninitialized in this function [-Werror=maybe-uninitialized]
> > 1045 | { if (_ptr) (cleanup) ((ParentName *) _ptr); }
> \
> > | ^~
> > ../../test/gstreamer/gstreamer_single_stream_test.cpp:108:25: note:
> ‘msg’ was declared here
> > 108 | g_autoptr(GstMessage) msg;
> > | ^~~
> >
> > when cross-compiling for ARM.
> >
> > > > +
> > > > + /* Build the pipeline */
> > > > + gst_bin_add_many(GST_BIN(pipeline_), libcameraSrc_,
> convert0_, sink0_, NULL);
> > > > + if (gst_element_link_many(libcameraSrc_, convert0_,
> sink0_, NULL) != TRUE) {
> > > > + g_printerr("Elements could not be linked.\n");
> > > > + return TestFail;
> > > > + }
> > > > +
> > > > + /* Start playing */
> > > > + ret = gst_element_set_state(pipeline_, GST_STATE_PLAYING);
> > > > + if (ret == GST_STATE_CHANGE_FAILURE) {
> > > > + g_printerr("Unable to set the pipeline to the
> playing state.\n");
> > > > + return TestFail;
> > > > + }
> > > > +
> > > > + /* Wait until error or EOS or timeout after 2 seconds */
> > > > + GstClockTime timeout = 2000000000;
> > > > + bus = gst_element_get_bus(pipeline_);
> > > > + msg = gst_bus_timed_pop_filtered(bus, timeout,
> > > > +
> GstMessageType((uint)GST_MESSAGE_ERROR | (uint)GST_MESSAGE_EOS));
> > > > + gst_element_set_state(pipeline_, GST_STATE_NULL);
> > > > +
> > > > + /* Parse error message */
> > > > + if (msg == NULL)
> > > > + return TestPass;
> > > > +
> > > > + switch (GST_MESSAGE_TYPE(msg)) {
> > > > + case GST_MESSAGE_ERROR:
> > > > + gstreamer_print_error(msg);
> > > > + break;
> > > > + case GST_MESSAGE_EOS:
> > > > + g_print("End-Of-Stream reached.\n");
> > > > + break;
> > > > + default:
> > > > + g_printerr("Unexpected message received.\n");
> > > > + break;
> > > > + }
> > > > +
> > > > + return TestFail;
> > > > + }
> > > > +
> > > > +private:
> > > > + void gstreamer_print_error(GstMessage *msg)
> > > > + {
> > > > + GError *err;
> > > > + gchar *debug_info;
> > > > +
> > > > + gst_message_parse_error(msg, &err, &debug_info);
> > > > + g_printerr("Error received from element %s: %s\n",
> > > > + GST_OBJECT_NAME(msg->src), err->message);
> > > > + g_printerr("Debugging information: %s\n",
> > > > + debug_info ? debug_info : "none");
> > > > + g_clear_error(&err);
> > > > + g_free(debug_info);
> > > > + }
> > > > +
> > > > + GstElement *pipeline_;
> > > > + GstElement *libcameraSrc_;
> > > > + GstElement *convert0_;
> > > > + GstElement *sink0_;
> > > > +};
> > > > +
> > > > +TEST_REGISTER(GstreamerSingleStreamTest)
> > > > diff --git a/test/gstreamer/meson.build b/test/gstreamer/meson.build
> > > > new file mode 100644
> > > > index 00000000..b99aa0da
> > > > --- /dev/null
> > > > +++ b/test/gstreamer/meson.build
> > > > @@ -0,0 +1,19 @@
> > > > +# SPDX-License-Identifier: CC0-1.0
> > > > +
> > > > +if not gst_enabled
> > > > + subdir_done()
> > > > +endif
> > > > +
> > > > +gstreamer_tests = [
> > > > + ['single_stream_test', 'gstreamer_single_stream_test.cpp'],
> > > > +]
> > > > +gstreamer_dep = dependency('gstreamer-1.0', required: true)
> > > > +
> > > > +foreach t : gstreamer_tests
> > > > + exe = executable(t[0], t[1],
> > > > + dependencies : [libcamera_private,
> gstreamer_dep],
> > > > + link_with : test_libraries,
> > > > + include_directories : test_includes_internal)
> > > > +
> > > > + test(t[0], exe, suite : 'gstreamer', is_parallel : false)
> > > > +endforeach
> > > > diff --git a/test/meson.build b/test/meson.build
> > > > index 3bceb5df..d0466f17 100644
> > > > --- a/test/meson.build
> > > > +++ b/test/meson.build
> > > > @@ -11,6 +11,7 @@ subdir('libtest')
> > > >
> > > > subdir('camera')
> > > > subdir('controls')
> > > > +subdir('gstreamer')
> > > > subdir('ipa')
> > > > subdir('ipc')
> > > > subdir('log')
>
> --
> Regards,
>
> Laurent Pinchart
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.libcamera.org/pipermail/libcamera-devel/attachments/20210813/40258032/attachment-0001.htm>
More information about the libcamera-devel
mailing list