Video for Ultibo

Anything and everything about programming graphics with Ultibo
Elther
Posts: 3
Joined: Mon May 14, 2018 3:56 pm

Video for Ultibo

Postby Elther » Wed May 16, 2018 9:15 am

Hello
thanks to the staff, I wondered for year some like Ultibo and
now is reality :)

Well, nice stuff, the port of raspivid/raspistill...

Here my proposal

I'd like to take RGB camera video stream and custom compress it
with xyz codec of my choice insted of use internal engine, and of
course record all on sdcard

Is possible someone port the picamera system, and create some like
Video for Win compressor manager to add own codecs?

PS
I'd also like a port for MIPS (Omega2), with strong emphasis on
audio support
User avatar
Ultibo
Site Admin
Posts: 1932
Joined: Sat Dec 19, 2015 3:49 am
Location: Australia

Re: Video for Ultibo

Postby Ultibo » Wed May 16, 2018 11:49 am

Hello Elther, welcome to the Ultibo project!

Elther wrote:I'd like to take RGB camera video stream and custom compress it
with xyz codec of my choice insted of use internal engine, and of
course record all on sdcard

Is possible someone port the picamera system, and create some like
Video for Win compressor manager to add own codecs?

It should be easy enough to make some progress on porting the camera code to Ultibo, both raspivid and raspistill use MMAL which @pjde has already done some work on porting the headers for.

The raspistill and raspivid code contains a lot of options so the starting point would be porting only the functionality you need, if you do some searching there are also a number of other libraries around that provide access to the Pi Camera and some of them are simpler in design so they might be a better choice to port from.

As for codecs you have the choice of either writing them in Pascal or porting one of the many libraries so that it can be used on Ultibo, many of them don't have a lot of O/S specific code so they can be ported quite easily.

Elther wrote:PS
I'd also like a port for MIPS (Omega2), with strong emphasis on
audio support

Maybe one day when they've sold a lot more of them, of course anyone else is welcome to take it on as a challenge if they want to.
Ultibo.org | Make something amazing
https://ultibo.org
pjde
Posts: 378
Joined: Tue Feb 09, 2016 6:21 am
Location: Sydney, Australia

Re: Video for Ultibo

Postby pjde » Wed May 16, 2018 9:12 pm

I would recommend researching the OMX (OpenMAX) path before committing to MMAL.

MMAL is a proprietary application layer by Broadcom that has next to no documentation. It apparently uses the OMX interface anyway to implement the layer.

OMX is an open standard and, while still very temperamental, has more docs and forum posts that may help you. There is the also the bible Raspberry PI GPU Audio Video Programming by Jan Mewmarch although this does not specifically include the camera, it does include methods of incorporating FFmpeg or LibAV so you can gain access to their software codecs. You may need to be mindful of their licence terms.

For a start on the camera, check out https://ultibo.org/forum/viewtopic.php?f=15&t=1040

The integration layer components (OpenMAXLIL) supplied by Broadcom do include the PI cameras.

Regards

Paul
Gavinmc42
Posts: 1367
Joined: Sun Jun 05, 2016 12:38 pm
Location: Brisbane, Australia

Re: Video for Ultibo

Postby Gavinmc42 » Thu May 17, 2018 7:17 am

There is also the raspiraw code that will give use raw data unprocessed by the VC4.
https://github.com/6by9/userland/tree/r ... s/raspicam
https://www.raspberrypi.org/forums/view ... 3&t=109137
https://www.raspberrypi.org/forums/view ... ?p=1232058

The fcl-image(FPimage) unit works in Ultibo, might not be fast but it was painless to use.
viewtopic.php?f=15&t=534&hilit=screenshot&start=30

There is some jpeg, bmp, png code guys have done too.
Ultibo now has quite a few free pascal units that just work, most only with limited testing.
Because so much works now it is getting harder to test everything ;)

I am hoping one day to have Ultibo Aarch64 for I can use the NEON a bit faster for processing vision.
Hmm, can NEON be used in Ultibo 32bit? I have forgotten.
viewtopic.php?f=12&t=300&hilit=neon&start=20

What is the current NEON support status?
Lots of vision software supports ARM NEON, mostly in C which could be ported to Pascal.
Or C libs could be made for Arm's Compute library and NE10 ?
Elther
Posts: 3
Joined: Mon May 14, 2018 3:56 pm

Re: Video for Ultibo

Postby Elther » Fri May 18, 2018 9:27 am

Too much raspi business... I start the work :)
Elther
Posts: 3
Joined: Mon May 14, 2018 3:56 pm

Re: Video for Ultibo

Postby Elther » Mon May 21, 2018 4:19 pm

But, argh
there 's no apparent port of some video compressors on pascal...
User avatar
Ultibo
Site Admin
Posts: 1932
Joined: Sat Dec 19, 2015 3:49 am
Location: Australia

Re: Video for Ultibo

Postby Ultibo » Mon May 21, 2018 11:24 pm

Elther wrote:But, argh
there 's no apparent port of some video compressors on pascal...

Which ones are you wanting to use?
Are they available as open source?
What would you use for the same thing from Windows or Linux?

Many things are not available as native Pascal source, that is why we have library support. The process of recompiling a C library to work with Ultibo can be much easier than you might think.
Ultibo.org | Make something amazing
https://ultibo.org

Return to “Graphics”

Who is online

Users browsing this forum: No registered users and 1 guest