cdocutils.nodes document q)q}q(U nametypesq}q(Xgstreamer-plugins-limitationsqX7loading-firmware-during-initial-boot-without-using-udevqXopen-source-gstreamer-overviewqX#dsp-c66x-gstreamer-plugin-internalsq Xmodifying-the-existing-pluginq Xrunning-a-gstreamer-pipelineq Xdecode-pipelineq X build-ipumm-1q X&file-to-file-4k-h264-encoding-pipelineqX multimediaqNXencode-pipelineqXipumm-build-toolsqX&capabilities-of-iva-hd-vpe-dsp-and-armqXnetwork-loopbackqX4software-stack-of-accelerated-codec-encodingdecodingqXrebuild-ipumm-firmwareqX overview-of-existing-source-codeqX build-ipummqXsetup-environmentqX$rebuilding-and-installing-the-pluginqX-list-of-features-not-supported-with-gstreamerqXipumm-git-repoqXti-provided-gstreamer-pluginsqX,unloading-and-loading-remotecores-at-runtimeqXadding-custom-dsp-kernelsqX)changing-the-remotecore-binary-at-runtimeqX)introduction-linux-accelerated-multimediaq Xfirmware-loading-and-unloadingq!Xfull-hd-at-60fps-encodingq"Xmulti-channel-encodingq#X4visual-representation-of-typical-gstreamer-pipelinesq$X"gstreamer-pipelines-for-multimediaq%X%multimedia-demos-available-via-matrixq&uUsubstitution_defsq'}q(Uparse_messagesq)]q*(cdocutils.nodes system_message q+)q,}q-(U rawsourceq.UUparentq/cdocutils.nodes section q0)q1}q2(h.Uh/hUsourceq3Xh/home/gtbldadm/nightlybuilds/processor-sdk-doc/source/linux/Foundational_Components_Multimedia_IVAHD.rstq4Utagnameq5Usectionq6U attributesq7}q8(Udupnamesq9]Uclassesq:]Ubackrefsq;]Uidsq<]q=U multimediaq>aUnamesq?]q@hauUlineqAKUdocumentqBhUchildrenqC]qD(cdocutils.nodes title qE)qF}qG(h.X MultimediaqHh/h1h3h4h5UtitleqIh7}qJ(h9]h:]h;]h<]h?]uhAKhBhhC]qKcdocutils.nodes Text qLX MultimediaqMqN}qO(h.hHh/hFubaubcdocutils.nodes comment qP)qQ}qR(h.XFhttp://processors.wiki.ti.com/index.php/Processor_Training:_Multimediah/h1h3h4h5UcommentqSh7}qT(U xml:spaceqUUpreserveqVh<]h;]h9]h:]h?]uhAKhBhhC]qWhLXFhttp://processors.wiki.ti.com/index.php/Processor_Training:_MultimediaqXqY}qZ(h.Uh/hQubaubcdocutils.nodes rubric q[)q\}q](h.X Introductionq^h/h1h3h4h5Urubricq_h7}q`(h<]qaU)introduction-linux-accelerated-multimediaqbah;]h9]h:]h?]qch auhANhBhhC]qdhLX Introductionqeqf}qg(h.h^h/h\ubaubcdocutils.nodes paragraph qh)qi}qj(h.XMTI's embedded processors such as AM57xx have following hardware accelerators.qkh/h1h3h4h5U paragraphqlh7}qm(h9]h:]h;]h<]h?]uhAK hBhhC]qnhLXMTI's embedded processors such as AM57xx have following hardware accelerators.qoqp}qq(h.hkh/hiubaubcdocutils.nodes bullet_list qr)qs}qt(h.Uh/h1h3h4h5U bullet_listquh7}qv(UbulletqwX-h<]h;]h9]h:]h?]uhAK hBhhC]qx(cdocutils.nodes list_item qy)qz}q{(h.XPIVA (Image and Video Accelerator) for accelerating multimedia encode and decode.h/hsh3h4h5U list_itemq|h7}q}(h9]h:]h;]h<]h?]uhANhBhhC]q~hh)q}q(h.XPIVA (Image and Video Accelerator) for accelerating multimedia encode and decode.qh/hzh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAK hC]qhLXPIVA (Image and Video Accelerator) for accelerating multimedia encode and decode.qq}q(h.hh/hubaubaubhy)q}q(h.XTVPE (Video Processing Engine) for Scaling, Color Space Conversion and Deinterlacing.h/hsh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.XTVPE (Video Processing Engine) for Scaling, Color Space Conversion and Deinterlacing.qh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhC]qhLXTVPE (Video Processing Engine) for Scaling, Color Space Conversion and Deinterlacing.qq}q(h.hh/hubaubaubhy)q}q(h.XQC66x DSP cores for offloading certain image/video and/or voice/audio processing. h/hsh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.XPC66x DSP cores for offloading certain image/video and/or voice/audio processing.qh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhC]qhLXPC66x DSP cores for offloading certain image/video and/or voice/audio processing.qq}q(h.hh/hubaubaubeubhh)q}q(h.XIn order to make it easy for customers to write applications, and to leverage open source elements that provide functionality such as AVI stream demuxing, audio encode/decode, etc, TI's PROCESSOR-SDK supplies ARM based GStreamer plugins that abstracts the hardware accelerator offload.qh/h1h3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhBhhC]qhLXIn order to make it easy for customers to write applications, and to leverage open source elements that provide functionality such as AVI stream demuxing, audio encode/decode, etc, TI's PROCESSOR-SDK supplies ARM based GStreamer plugins that abstracts the hardware accelerator offload.qq}q(h.hh/hubaubhh)q}q(h.X>This multimedia training page will cover the following topics.qh/h1h3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhBhhC]qhLX>This multimedia training page will cover the following topics.qq}q(h.hh/hubaubhr)q}q(h.Uh/h1h3h4h5huh7}q(hwX-h<]h;]h9]h:]h?]uhAKhBhhC]q(hy)q}q(h.X)Capabilities of IVA-HD, VPE, DSP, and ARMqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.hh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhC]qhLX)Capabilities of IVA-HD, VPE, DSP, and ARMqq}q(h.hh/hubaubaubhy)q}q(h.X,Out of Box Multimedia Demos in PROCESSOR-SDKqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.hh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhC]qhLX,Out of Box Multimedia Demos in PROCESSOR-SDKqȅq}q(h.hh/hubaubaubhy)q}q(h.X5Software Stack of Accerelated Codec Encoding/Decodingqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.hh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhC]qhLX5Software Stack of Accerelated Codec Encoding/Decodingqԅq}q(h.hh/hubaubaubhy)q}q(h.X/Gstreamer Pipelines for Multimedia Applicationsqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.hh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAKhC]qhLX/Gstreamer Pipelines for Multimedia Applicationsqq}q(h.hh/hubaubaubhy)q}q(h.XGstreamer Plugins Limitationsqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.hh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAK hC]qhLXGstreamer Plugins Limitationsq셁q}q(h.hh/hubaubaubhy)q}q(h.X-List of Features not Supported with Gstreamerqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)q}q(h.hh/hh3h4h5hlh7}q(h9]h:]h;]h<]h?]uhAK!hC]qhLX-List of Features not Supported with Gstreamerqq}q(h.hh/hubaubaubhy)q}q(h.X#DSP C66x Gstreamer Plugin Internalsqh/hh3h4h5h|h7}q(h9]h:]h;]h<]h?]uhANhBhhC]qhh)r}r(h.hh/hh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK"hC]rhLX#DSP C66x Gstreamer Plugin Internalsrr}r(h.hh/jubaubaubhy)r}r(h.XRebuild IPUMM Firmwarer h/hh3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.j h/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK#hC]rhLXRebuild IPUMM Firmwarerr}r(h.j h/j ubaubaubhy)r}r(h.XLoad and Unload Firmware h/hh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.XLoad and Unload Firmwarerh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK$hC]rhLXLoad and Unload Firmwarerr}r(h.jh/jubaubaubeubcdocutils.nodes line_block r)r }r!(h.Uh/h1h3h4h5U line_blockr"h7}r#(h9]h:]h;]h<]h?]uhAK&hBhhC]r$cdocutils.nodes line r%)r&}r'(h.UUindentr(Kh/j h3h4h5hAh7}r)(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubh[)r*}r+(h.X)Capabilities of IVA-HD, VPE, DSP, and ARMr,h/h1h3h4h5h_h7}r-(h<]r.U&capabilities-of-iva-hd-vpe-dsp-and-armr/ah;]h9]h:]h?]r0hauhANhBhhC]r1hLX)Capabilities of IVA-HD, VPE, DSP, and ARMr2r3}r4(h.j,h/j*ubaubhh)r5}r6(h.XuIn PROCESSOR-SDK, IVA-HD, and hence the multimedia encoding and decoding applications, supports the following codecs.r7h/h1h3h4h5hlh7}r8(h9]h:]h;]h<]h?]uhAK+hBhhC]r9hLXuIn PROCESSOR-SDK, IVA-HD, and hence the multimedia encoding and decoding applications, supports the following codecs.r:r;}r<(h.j7h/j5ubaubhr)r=}r>(h.Uh/h1h3h4h5huh7}r?(hwX-h<]h;]h9]h:]h?]uhAK.hBhhC]r@(hy)rA}rB(h.X)Video Decode: H264, MPEG4, MPEG2, and VC1rCh/j=h3h4h5h|h7}rD(h9]h:]h;]h<]h?]uhANhBhhC]rEhh)rF}rG(h.jCh/jAh3h4h5hlh7}rH(h9]h:]h;]h<]h?]uhAK.hC]rIhLX)Video Decode: H264, MPEG4, MPEG2, and VC1rJrK}rL(h.jCh/jFubaubaubhy)rM}rN(h.XVideo Encode: H264, and MPEG4rOh/j=h3h4h5h|h7}rP(h9]h:]h;]h<]h?]uhANhBhhC]rQhh)rR}rS(h.jOh/jMh3h4h5hlh7}rT(h9]h:]h;]h<]h?]uhAK/hC]rUhLXVideo Encode: H264, and MPEG4rVrW}rX(h.jOh/jRubaubaubhy)rY}rZ(h.XImage Decode: MJPEG h/j=h3h4h5h|h7}r[(h9]h:]h;]h<]h?]uhANhBhhC]r\hh)r]}r^(h.XImage Decode: MJPEGr_h/jYh3h4h5hlh7}r`(h9]h:]h;]h<]h?]uhAK0hC]rahLXImage Decode: MJPEGrbrc}rd(h.j_h/j]ubaubaubeubhh)re}rf(h.XCodec datasheet can be downloaded from git repository here - https://git.ti.com/ivimm/ipumm/trees/master/extrel/ti/ivahd_codecs/packages/ti/sdo/codecsh/h1h3h4h5hlh7}rg(h9]h:]h;]h<]h?]uhAK2hBhhC]rh(hLX=Codec datasheet can be downloaded from git repository here - rirj}rk(h.X=Codec datasheet can be downloaded from git repository here - h/jeubcdocutils.nodes reference rl)rm}rn(h.XYhttps://git.ti.com/ivimm/ipumm/trees/master/extrel/ti/ivahd_codecs/packages/ti/sdo/codecsroh7}rp(Urefurijoh<]h;]h9]h:]h?]uh/jehC]rqhLXYhttps://git.ti.com/ivimm/ipumm/trees/master/extrel/ti/ivahd_codecs/packages/ti/sdo/codecsrrrs}rt(h.Uh/jmubah5U referenceruubeubhh)rv}rw(h.XZVPE supports video operations such as scaling, color space conversion, and de-interlacing.rxh/h1h3h4h5hlh7}ry(h9]h:]h;]h<]h?]uhAK5hBhhC]rzhLXZVPE supports video operations such as scaling, color space conversion, and de-interlacing.r{r|}r}(h.jxh/jvubaubhr)r~}r(h.Uh/h1h3h4h5huh7}r(hwX-h<]h;]h9]h:]h?]uhAK8hBhhC]r(hy)r}r(h.X)Supported Input formats: NV12, YUYV, UYVYrh/j~h3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK8hC]rhLX)Supported Input formats: NV12, YUYV, UYVYrr}r(h.jh/jubaubaubhy)r}r(h.XISupported Output formats: NV12, YUYV, UYVY, RGB24, BGR24, ARGB24, ABGR24 h/j~h3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.XHSupported Output formats: NV12, YUYV, UYVY, RGB24, BGR24, ARGB24, ABGR24rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK9hC]rhLXHSupported Output formats: NV12, YUYV, UYVY, RGB24, BGR24, ARGB24, ABGR24rr}r(h.jh/jubaubaubeubhh)r}r(h.X^DSP is a general purpose programmable core available for offloading signal processing kernels.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhLXIVAHD H264 Decoder?r@}rA(h.j<h/j:ubaubah5j ubj )rB}rC(h.Uh7}rD(h9]h:]h;]h<]h?]uh/j2hC]rEhh)rF}rG(h.XThis demo runs a gstreamer playbin pipeline to decode H264 using IVAHD. The demo plays back audio as well and you can listen if speakers are connected.rHh/jBh3h4h5hlh7}rI(h9]h:]h;]h<]h?]uhAKUhC]rJhLXThis demo runs a gstreamer playbin pipeline to decode H264 using IVAHD. The demo plays back audio as well and you can listen if speakers are connected.rKrL}rM(h.jHh/jFubaubah5j ubeh5j1ubj)rN}rO(h.Uh7}rP(h9]h:]h;]h<]h?]uh/jhC]rQ(j )rR}rS(h.Uh7}rT(h9]h:]h;]h<]h?]uh/jNhC]rUhh)rV}rW(h.XIVAHD H264 EncoderXh/jRh3h4h5hlh7}rY(h9]h:]h;]h<]h?]uhAKWhC]rZhLXIVAHD H264 Encoder[r\}r](h.jXh/jVubaubah5j ubj )r^}r_(h.Uh7}r`(h9]h:]h;]h<]h?]uh/jNhC]rahh)rb}rc(h.XThis demo runs a gstreamer pipeline to do H264 encoding on IVAHD. The input clip is in NV12 format. The output is saved to /home/root directoryrdh/j^h3h4h5hlh7}re(h9]h:]h;]h<]h?]uhAKWhC]rfhLXThis demo runs a gstreamer pipeline to do H264 encoding on IVAHD. The input clip is in NV12 format. The output is saved to /home/root directoryrgrh}ri(h.jdh/jbubaubah5j ubeh5j1ubj)rj}rk(h.Uh7}rl(h9]h:]h;]h<]h?]uh/jhC]rm(j )rn}ro(h.Uh7}rp(h9]h:]h;]h<]h?]uh/jjhC]rqhh)rr}rs(h.X AAC Decoderth/jnh3h4h5hlh7}ru(h9]h:]h;]h<]h?]uhAKYhC]rvhLX AAC Decoderwrx}ry(h.jth/jrubaubah5j ubj )rz}r{(h.Uh7}r|(h9]h:]h;]h<]h?]uh/jjhC]r}hh)r~}r(h.XOThis demo runs a gstreamer playbin pipeline for ARM audio decoding and playout.rh/jzh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKYhC]rhLXOThis demo runs a gstreamer playbin pipeline for ARM audio decoding and playout.rr}r(h.jh/j~ubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XH.265 (HEVC) Decoderh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK[hC]rhLXH.265 (HEVC) Decoderr}r(h.jh/jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XbThis demonstrates HEVC decoding on ARM. The gstreamer pipeline decodes and display an H265 stream.rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK[hC]rhLXbThis demonstrates HEVC decoding on ARM. The gstreamer pipeline decodes and display an H265 stream.rr}r(h.jh/jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X%VIP VPE IVAHD MPEG4 Encode and Decoderh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK]hC]rhLX%VIP VPE IVAHD MPEG4 Encode and Decoderr}r(h.jh/jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XThis demonstrates video capture via Video Input Port (VIP), color space conversion and scaling with Video Processing Engine (VPE), IVAHD MPEG4 encoding, IVAHD MPEG4 decoding and displayrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK]hC]rhLXThis demonstrates video capture via Video Input Port (VIP), color space conversion and scaling with Video Processing Engine (VPE), IVAHD MPEG4 encoding, IVAHD MPEG4 decoding and displayrr}r(h.jh/jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XDSP C66 Image Processingrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK_hC]rhLXDSP C66 Image Processingrr}r(h.jh/jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XmThis demonstrates the use of DSP C66x plugin (dsp66videokernel) for offloading image processing tasks to DSP.rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAK_hC]rhLXmThis demonstrates the use of DSP C66x plugin (dsp66videokernel) for offloading image processing tasks to DSP.rr}r(h.jh/jubaubah5j ubeh5j1ubeh5Utbodyrubeh5Utgrouprubaubj)r}r(h.Uh/h1h3h4h5j"h7}r(h9]h:]h;]h<]h?]uhAKbhBhhC]rj%)r}r(h.Uj(Kh/jh3h4h5hAh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubh[)r}r(h.X5Software Stack of Accelerated Codec Encoding/Decodingrh/h1h3h4h5h_h7}r(h<]rU4software-stack-of-accelerated-codec-encodingdecodingrah;]h9]h:]h?]rhauhANhBhhC]rhLX5Software Stack of Accelerated Codec Encoding/Decodingrr}r(h.jh/jubaubhh)r}r(h.XAs shown in the figure below, the software stack of the accelerated codec encoding/decoding runs on two subsystems: MPU subsystem on ARM-A15, and IPU subsystem on ARM-M4. The two subsystems communicate with each other through RPMSG. At the highest level in MPU subsystem on ARM-A15, there is Linux user space application which is based on Gstreamer. GStreamer is an open source framework that simplifies the development of multimedia applications. The GStreamer library loads and interfaces with the TI GStreamer plugin (GST-Ducati plugin), which handles all the details specific to use of the hardware accelerator. Specifically, TI GStreamer plugin interfaces libdce in user space. On one hand, libdec interacts with libdrm in user space for displaying video in Wayland window system. On the other hand, libdce interfaces with RPMSG in Linux kernel to communicate with the IPU subsystem on ARM-M4. The IPU subsystem builds on SYS/BIOS RTOS and runs IVAHD video/image codecs, utilizing framework components and codec engine.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKghBhhC]rhLXAs shown in the figure below, the software stack of the accelerated codec encoding/decoding runs on two subsystems: MPU subsystem on ARM-A15, and IPU subsystem on ARM-M4. The two subsystems communicate with each other through RPMSG. At the highest level in MPU subsystem on ARM-A15, there is Linux user space application which is based on Gstreamer. GStreamer is an open source framework that simplifies the development of multimedia applications. The GStreamer library loads and interfaces with the TI GStreamer plugin (GST-Ducati plugin), which handles all the details specific to use of the hardware accelerator. Specifically, TI GStreamer plugin interfaces libdce in user space. On one hand, libdec interacts with libdrm in user space for displaying video in Wayland window system. On the other hand, libdce interfaces with RPMSG in Linux kernel to communicate with the IPU subsystem on ARM-M4. The IPU subsystem builds on SYS/BIOS RTOS and runs IVAHD video/image codecs, utilizing framework components and codec engine.rr}r(h.jh/jubaubcdocutils.nodes raw r)r}r(h.X
h/h1h3h4h5Urawrh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAKwhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAK{hBhhC]rhLX
rr}r(h.Uh/jubaubcdocutils.nodes image r)r}r(h.X1.. Image:: ../images/Mm_software_overview_v3.png h/h1h3h4h5Uimager h7}r (UuriX+linux/../images/Mm_software_overview_v3.pngr h<]h;]h9]h:]U candidatesr }r U*j sh?]uhAKhBhhC]ubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAKhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAKhBhhC]rhLX
rr}r(h.Uh/jubaubhh)r}r(h.X-**Overview of the Multimedia Software Stack**rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]r j)r!}r"(h.jh7}r#(h9]h:]h;]h<]h?]uh/jhC]r$hLX)Overview of the Multimedia Software Stackr%r&}r'(h.Uh/j!ubah5jubaubhh)r(}r)(h.XKThe Multimedia software contains many software components. Some are developed by Texas Instruments and some are developed in and by the open source community(White). TI contributes, and sometimes even maintains, some of these open source community projects, but the support model is different from a project developed solely by TI.r*h/h1h3h4h5hlh7}r+(h9]h:]h;]h<]h?]uhAKhBhhC]r,hLXKThe Multimedia software contains many software components. Some are developed by Texas Instruments and some are developed in and by the open source community(White). TI contributes, and sometimes even maintains, some of these open source community projects, but the support model is different from a project developed solely by TI.r-r.}r/(h.j*h/j(ubaubh[)r0}r1(h.X"Gstreamer Pipelines for Multimediar2h/h1h3h4h5h_h7}r3(h<]r4U"gstreamer-pipelines-for-multimediar5ah;]h9]h:]h?]r6h%auhANhBhhC]r7hLX"Gstreamer Pipelines for Multimediar8r9}r:(h.j2h/j0ubaubh[)r;}r<(h.XOpen Source GStreamer Overviewr=h/h1h3h4h5h_h7}r>(h<]r?Uopen-source-gstreamer-overviewr@ah;]h9]h:]h?]rAhauhANhBhhC]rBhLXOpen Source GStreamer OverviewrCrD}rE(h.j=h/j;ubaubhh)rF}rG(h.XZGStreamer is an open source framework that simplifies the development of multimedia applications, such as media players and capture encoders. It encapsulates existing multimedia software components, such as codecs, filters, and platform-specific I/O operations, by using a standard interface and providing a uniform framework across applications.rHh/h1h3h4h5hlh7}rI(h9]h:]h;]h<]h?]uhAKhBhhC]rJhLXZGStreamer is an open source framework that simplifies the development of multimedia applications, such as media players and capture encoders. It encapsulates existing multimedia software components, such as codecs, filters, and platform-specific I/O operations, by using a standard interface and providing a uniform framework across applications.rKrL}rM(h.jHh/jFubaubhh)rN}rO(h.XThe modular nature of GStreamer facilitates the addition of new functionality, transparent inclusion of component advancements and allows for flexibility in application development and testing. Processing nodes are implemented via Gstreamer plugins with several sink and/or source pads. Many plugins are running as ARM software implementation, but for more complex SoCs certain functions are better executed on hardware accelerated IPs like IVAHD (video codecs) or VPE.rPh/h1h3h4h5hlh7}rQ(h9]h:]h;]h<]h?]uhAKhBhhC]rRhLXThe modular nature of GStreamer facilitates the addition of new functionality, transparent inclusion of component advancements and allows for flexibility in application development and testing. Processing nodes are implemented via Gstreamer plugins with several sink and/or source pads. Many plugins are running as ARM software implementation, but for more complex SoCs certain functions are better executed on hardware accelerated IPs like IVAHD (video codecs) or VPE.rSrT}rU(h.jPh/jNubaubhh)rV}rW(h.XGstreamer is multimedia framework based on data flow paradigm. It allows easy plugin registration just by deploying new shared objects to /usr/lib/gstreamer-1.0 folder. The shared libraries in this folder are scanned for reserved data structures identifying capabilities of individual plugins. Individual processing nodes can be interconnected as a pipeline in run-time creating complex topologies. Node interfacing compatibility is verified at that time - before pipeline is started.rXh/h1h3h4h5hlh7}rY(h9]h:]h;]h<]h?]uhAKhBhhC]rZhLXGstreamer is multimedia framework based on data flow paradigm. It allows easy plugin registration just by deploying new shared objects to /usr/lib/gstreamer-1.0 folder. The shared libraries in this folder are scanned for reserved data structures identifying capabilities of individual plugins. Individual processing nodes can be interconnected as a pipeline in run-time creating complex topologies. Node interfacing compatibility is verified at that time - before pipeline is started.r[r\}r](h.jXh/jVubaubhh)r^}r_(h.XGStreamer brings a lot of value-added features to Processor SDK, including audio encoding and decoding, audio and video synchronization, interaction with a wide variety of open source plugins (muxers, demuxers, codecs, and filters). New GStreamer features are continuously being added, and the core libraries are actively supported by participants in the GStreamer community. Additional information about the GStreamer framework is available on the GStreamer project site: http://gstreamer.freedesktop.org/.h/h1h3h4h5hlh7}r`(h9]h:]h;]h<]h?]uhAKhBhhC]ra(hLXGStreamer brings a lot of value-added features to Processor SDK, including audio encoding and decoding, audio and video synchronization, interaction with a wide variety of open source plugins (muxers, demuxers, codecs, and filters). New GStreamer features are continuously being added, and the core libraries are actively supported by participants in the GStreamer community. Additional information about the GStreamer framework is available on the GStreamer project site: rbrc}rd(h.XGStreamer brings a lot of value-added features to Processor SDK, including audio encoding and decoding, audio and video synchronization, interaction with a wide variety of open source plugins (muxers, demuxers, codecs, and filters). New GStreamer features are continuously being added, and the core libraries are actively supported by participants in the GStreamer community. Additional information about the GStreamer framework is available on the GStreamer project site: h/j^ubjl)re}rf(h.X!http://gstreamer.freedesktop.org/rgh7}rh(Urefurijgh<]h;]h9]h:]h?]uh/j^hC]rihLX!http://gstreamer.freedesktop.org/rjrk}rl(h.Uh/jeubah5juubhLX.rm}rn(h.X.h/j^ubeubh[)ro}rp(h.XTI Provided Gstreamer Pluginsrqh/h1h3h4h5h_h7}rr(h<]rsUti-provided-gstreamer-pluginsrtah;]h9]h:]h?]ruhauhANhBhhC]rvhLXTI Provided Gstreamer Pluginsrwrx}ry(h.jqh/joubaubhh)rz}r{(h.X6One benefit of using GStreamer as a multimedia framework is that the core libraries already build and run on ARM Linux. Only a GStreamer plugin is required to enable additional hardware features on TI's embedded processors with both ARM and hardware accelerators for multimedia. The TI GStreamer plugins provide elements for GStreamer pipelines that enable the use of plug-and-play IVAHD codecs, certain hardware-accelerated operations such as video frame resizing, de-interlacing, and color space conversion, image processing offloaded to DSP, and ARM based HEVC decoding. The TI GStreamer plugins provide baseline support for eXpressDSPTM Digital Media (xDM1) plug-and-play codecs. Multiple xDM versions are supported, making it easy to migrate between codecs that conform to different versions of the xDM specification.r|h/h1h3h4h5hlh7}r}(h9]h:]h;]h<]h?]uhAKhBhhC]r~hLX6One benefit of using GStreamer as a multimedia framework is that the core libraries already build and run on ARM Linux. Only a GStreamer plugin is required to enable additional hardware features on TI's embedded processors with both ARM and hardware accelerators for multimedia. The TI GStreamer plugins provide elements for GStreamer pipelines that enable the use of plug-and-play IVAHD codecs, certain hardware-accelerated operations such as video frame resizing, de-interlacing, and color space conversion, image processing offloaded to DSP, and ARM based HEVC decoding. The TI GStreamer plugins provide baseline support for eXpressDSPTM Digital Media (xDM1) plug-and-play codecs. Multiple xDM versions are supported, making it easy to migrate between codecs that conform to different versions of the xDM specification.rr}r(h.j|h/jzubaubhh)r}r(h.XBBelow is a list of TI GStreamer plugins provided in Processor SDK.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]rhLXBBelow is a list of TI GStreamer plugins provided in Processor SDK.rr}r(h.jh/jubaubhr)r}r(h.Uh/h1h3h4h5huh7}r(hwX-h<]h;]h9]h:]h?]uhAKhBhhC]rhy)r}r(h.XDucati Decoding and Encoding h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.XDucati Decoding and Encodingrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXDucati Decoding and Encodingrr}r(h.jh/jubaubaubaubcdocutils.nodes enumerated_list r)r}r(h.Uh/h1h3h4h5Uenumerated_listrh7}r(UsuffixrU.h<]h;]h9]UprefixrUh:]h?]UenumtyperUarabicruhAKhBhhC]r(hy)r}r(h.X ducatih264decrh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLX ducatih264decrr}r(h.jh/jubaubaubhy)r}r(h.Xducatimpeg4decrh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXducatimpeg4decrr}r(h.jh/jubaubaubhy)r}r(h.Xducatimpeg2decrh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXducatimpeg2decrr}r(h.jh/jubaubaubhy)r}r(h.X ducativc1decrh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLX ducativc1decrr}r(h.jh/jubaubaubhy)r}r(h.X ducatijpegdecrh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLX ducatijpegdecrr}r(h.jh/jubaubaubhy)r}r(h.X ducatih264encrh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLX ducatih264encrr}r(h.jh/jubaubaubhy)r}r(h.Xducatimpeg4enc h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.Xducatimpeg4encrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXducatimpeg4encrr}r(h.jh/jubaubaubeubhr)r}r(h.Uh/h1h3h4h5huh7}r(hwX-h<]h;]h9]h:]h?]uhAKhBhhC]rhy)r}r(h.X Ducati VPE h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.X Ducati VPErh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLX Ducati VPErr}r(h.jh/jubaubaubaubj)r}r (h.Uh/h1h3h4h5jh7}r (jU.h<]h;]h9]jUh:]h?]jjuhAKhBhhC]r (hy)r }r (h.Xvperh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/j h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXvperr}r(h.jh/jubaubaubhy)r}r(h.Xducatih264decvperh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]r hLXducatih264decvper!r"}r#(h.jh/jubaubaubhy)r$}r%(h.Xducatimpeg2decvper&h/jh3h4h5h|h7}r'(h9]h:]h;]h<]h?]uhANhBhhC]r(hh)r)}r*(h.j&h/j$h3h4h5hlh7}r+(h9]h:]h;]h<]h?]uhAKhC]r,hLXducatimpeg2decvper-r.}r/(h.j&h/j)ubaubaubhy)r0}r1(h.Xducatimpeg4decvper2h/jh3h4h5h|h7}r3(h9]h:]h;]h<]h?]uhANhBhhC]r4hh)r5}r6(h.j2h/j0h3h4h5hlh7}r7(h9]h:]h;]h<]h?]uhAKhC]r8hLXducatimpeg4decvper9r:}r;(h.j2h/j5ubaubaubhy)r<}r=(h.Xducatijpegdecvper>h/jh3h4h5h|h7}r?(h9]h:]h;]h<]h?]uhANhBhhC]r@hh)rA}rB(h.j>h/j<h3h4h5hlh7}rC(h9]h:]h;]h<]h?]uhAKhC]rDhLXducatijpegdecvperErF}rG(h.j>h/jAubaubaubhy)rH}rI(h.Xducativc1decvpe h/jh3h4h5h|h7}rJ(h9]h:]h;]h<]h?]uhANhBhhC]rKhh)rL}rM(h.Xducativc1decvperNh/jHh3h4h5hlh7}rO(h9]h:]h;]h<]h?]uhAKhC]rPhLXducativc1decvperQrR}rS(h.jNh/jLubaubaubeubhr)rT}rU(h.Uh/h1h3h4h5huh7}rV(hwX-h<]h;]h9]h:]h?]uhAKhBhhC]rWhy)rX}rY(h.XDSP Image Processing h/jTh3h4h5h|h7}rZ(h9]h:]h;]h<]h?]uhANhBhhC]r[hh)r\}r](h.XDSP Image Processingr^h/jXh3h4h5hlh7}r_(h9]h:]h;]h<]h?]uhAKhC]r`hLXDSP Image Processingrarb}rc(h.j^h/j\ubaubaubaubj)rd}re(h.Uh/h1h3h4h5jh7}rf(jU.h<]h;]h9]jUh:]h?]jjuhAKhBhhC]rghy)rh}ri(h.Xdsp66videokernel h/jdh3h4h5h|h7}rj(h9]h:]h;]h<]h?]uhANhBhhC]rkhh)rl}rm(h.Xdsp66videokernelrnh/jhh3h4h5hlh7}ro(h9]h:]h;]h<]h?]uhAKhC]rphLXdsp66videokernelrqrr}rs(h.jnh/jlubaubaubaubhr)rt}ru(h.Uh/h1h3h4h5huh7}rv(hwX-h<]h;]h9]h:]h?]uhAKhBhhC]rwhy)rx}ry(h.XARM HEVC Decoding h/jth3h4h5h|h7}rz(h9]h:]h;]h<]h?]uhANhBhhC]r{hh)r|}r}(h.XARM HEVC Decodingr~h/jxh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXARM HEVC Decodingrr}r(h.j~h/j|ubaubaubaubj)r}r(h.Uh/h1h3h4h5jh7}r(jU.h<]h;]h9]jUh:]h?]jjuhAKhBhhC]rhy)r}r(h.Xh265dec h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.Xh265decrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhC]rhLXh265decrr}r(h.jh/jubaubaubaubh[)r}r(h.X4Visual Representation of Typical GStreamer Pipelinesrh/h1h3h4h5h_h7}r(h<]rU4visual-representation-of-typical-gstreamer-pipelinesrah;]h9]h:]h?]rh$auhANhBhhC]rhLX4Visual Representation of Typical GStreamer Pipelinesrr}r(h.jh/jubaubhh)r}r(h.X<A typical GStreamer pipeline starts with one or more source elements, uses zero or more filter elements, and ends in a sink or multiple sinks. This section provides visual representation of two typical gstreamer pipelines: 1) multimedia decoding and playout, and 2) video capture, encoding, and network transmission.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]rhLX<A typical GStreamer pipeline starts with one or more source elements, uses zero or more filter elements, and ends in a sink or multiple sinks. This section provides visual representation of two typical gstreamer pipelines: 1) multimedia decoding and playout, and 2) video capture, encoding, and network transmission.rr}r(h.jh/jubaubh[)r}r(h.XDecode Pipelinerh/h1h3h4h5h_h7}r(h<]rUdecode-pipelinerah;]h9]h:]h?]rh auhANhBhhC]rhLXDecode Pipelinerr}r(h.jh/jubaubhh)r}r(h.XjThe example pipeline shown in the figure below demonstrates the demuxing and playback of a transport stream. The input is first read using the source element, and then processed by gstreamer playbin2. Inside playbin2, demuxer first demuxes the stream into its audio and video stream components. The video stream is then queued and sent to TI ducati gstreamer plugin for decoding. Finally, it is sent to a video sink to display the decoded video on the screen. The audio stream is queued and then decoded by ARM audio gstreamer plugin, and then reaches its destination at the alsasink element to play the decoded audio.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]rhLXjThe example pipeline shown in the figure below demonstrates the demuxing and playback of a transport stream. The input is first read using the source element, and then processed by gstreamer playbin2. Inside playbin2, demuxer first demuxes the stream into its audio and video stream components. The video stream is then queued and sent to TI ducati gstreamer plugin for decoding. Finally, it is sent to a video sink to display the decoded video on the screen. The audio stream is queued and then decoded by ARM audio gstreamer plugin, and then reaches its destination at the alsasink element to play the decoded audio.rr}r(h.jh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAKhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAKhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X/.. Image:: ../images/Gst_decode_playout_v2.png h/h1h3h4h5j h7}r(UuriX)linux/../images/Gst_decode_playout_v2.pngrh<]h;]h9]h:]j }rU*jsh?]uhAMhBhhC]ubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.Uh/h1h3h4h5j"h7}r(h9]h:]h;]h<]h?]uhAM hBhhC]rj%)r}r(h.Uj(Kh/jh3h4h5hAh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubh[)r}r(h.XEncode Pipelinerh/h1h3h4h5h_h7}r(h<]rUencode-pipelinerah;]h9]h:]h?]rhauhANhBhhC]rhLXEncode Pipelinerr}r(h.jh/jubaubhh)r}r(h.X7The example pipeline shown in the figure below demonstrates video capture, encode, muxing, and network transmission. The camera capture is processed by VPE, and then queued for video encoding. After that, it is queued for video parsing, muxing. Finally, it is sent to network through RTP payloader and udp sink.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rhLX7The example pipeline shown in the figure below demonstrates video capture, encode, muxing, and network transmission. The camera capture is processed by VPE, and then queued for video encoding. After that, it is queued for video parsing, muxing. Finally, it is sent to network through RTP payloader and udp sink.rr}r(h.jh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLX
rr}r(h.Uh/jubaubj)r}r(h.X4.. Image:: ../images/Gst_capture_encode_network.png h/h1h3h4h5j h7}r(UuriX.linux/../images/Gst_capture_encode_network.pngrh<]h;]h9]h:]j }rU*jsh?]uhAM hBhhC]ubj)r}r (h.X
h/h1h3h4h5jh7}r (UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAM!hBhhC]r hLX
r r }r(h.Uh/jubaubj)r}r(h.X
h/h1h3h4h5jh7}r(UformatXhtmlhUhVh<]h;]h9]h:]h?]uhAM%hBhhC]rhLX
rr}r(h.Uh/jubaubhh)r}r(h.XGstreamer test pipeline:rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAM)hBhhC]rhLXGstreamer test pipeline:rr}r(h.jh/jubaubhh)r}r(h.XG--need someone to add this code to make it work. only showing a figure.r h/h1h3h4h5hlh7}r!(h9]h:]h;]h<]h?]uhAM+hBhhC]r"hLXG--need someone to add this code to make it work. only showing a figure.r#r$}r%(h.j h/jubaubh[)r&}r'(h.XRunning a gstreamer pipeliner(h/h1h3h4h5h_h7}r)(h<]r*Urunning-a-gstreamer-pipeliner+ah;]h9]h:]h?]r,h auhANhBhhC]r-hLXRunning a gstreamer pipeliner.r/}r0(h.j(h/j&ubaubhh)r1}r2(h.XhGstreamer pipelines can also run from command line. In order to do so, exit Weston by pressing Ctrl-Alt-Backspace from the keyboard which connects to the EVM. Then, if the LCD screen stays in "Please wait...", press Ctrl-Alt-F1 to go to the command line on LCD console. After that, the command line can be used from serial console, SSH console, or LCD console.r3h/h1h3h4h5hlh7}r4(h9]h:]h;]h<]h?]uhAM0hBhhC]r5hLXhGstreamer pipelines can also run from command line. In order to do so, exit Weston by pressing Ctrl-Alt-Backspace from the keyboard which connects to the EVM. Then, if the LCD screen stays in "Please wait...", press Ctrl-Alt-F1 to go to the command line on LCD console. After that, the command line can be used from serial console, SSH console, or LCD console.r6r7}r8(h.j3h/j1ubaubhh)r9}r:(h.XOne can run an audio video file using the gstreamer playbin from the console. Currently, the supported Audio/video sink is kmssink, waylandsink and alsassink.r;h/h1h3h4h5hlh7}r<(h9]h:]h;]h<]h?]uhAM7hBhhC]r=hLXOne can run an audio video file using the gstreamer playbin from the console. Currently, the supported Audio/video sink is kmssink, waylandsink and alsassink.r>r?}r@(h.j;h/j9ubaubcdocutils.nodes literal_block rA)rB}rC(h.Xmkmssink: target # gst-launch-1.0 playbin uri=file:/// video-sink=kmssink audio-sink=alsasinkh/h1h3h4h5U literal_blockrDh7}rE(hUhVh<]h;]h9]h:]h?]uhAM=hBhhC]rFhLXmkmssink: target # gst-launch-1.0 playbin uri=file:/// video-sink=kmssink audio-sink=alsasinkrGrH}rI(h.Uh/jBubaubjA)rJ}rK(h.Xwaylandsink: 1. refer Wayland/Weston to start the weston 2. target # gst-launch-1.0 playbin uri=file:/// video-sink=waylandsink audio-sink=alsasinkh/h1h3h4h5jDh7}rL(hUhVh<]h;]h9]h:]h?]uhAMBhBhhC]rMhLXwaylandsink: 1. refer Wayland/Weston to start the weston 2. target # gst-launch-1.0 playbin uri=file:/// video-sink=waylandsink audio-sink=alsasinkrNrO}rP(h.Uh/jJubaubhh)rQ}rR(h.XSThe following pipelines show how to use vpe for scaling and color space conversion.rSh/h1h3h4h5hlh7}rT(h9]h:]h;]h<]h?]uhAMFhBhhC]rUhLXSThe following pipelines show how to use vpe for scaling and color space conversion.rVrW}rX(h.jSh/jQubaubjA)rY}rZ(h.X 1. Decode-> Scale->Display target # gst-launch-1.0 -v filesrc location=example_h264.mp4 ! qtdemux ! h264parse ! \ ducatih264dec ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)720, height=(int)480' ! kmssinkh/h1h3h4h5jDh7}r[(hUhVh<]h;]h9]h:]h?]uhAMKhBhhC]r\hLX 1. Decode-> Scale->Display target # gst-launch-1.0 -v filesrc location=example_h264.mp4 ! qtdemux ! h264parse ! \ ducatih264dec ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)720, height=(int)480' ! kmssinkr]r^}r_(h.Uh/jYubaubjA)r`}ra(h.X 2. Color space conversion: target # gst-launch-1.0 -v videotestsrc ! 'video/x-raw, format=(string)YUY2, width= \ (int)1280, height=(int)720' ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)720, height=(int)480' \ ! kmssinkh/h1h3h4h5jDh7}rb(hUhVh<]h;]h9]h:]h?]uhAMQhBhhC]rchLX 2. Color space conversion: target # gst-launch-1.0 -v videotestsrc ! 'video/x-raw, format=(string)YUY2, width= \ (int)1280, height=(int)720' ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)720, height=(int)480' \ ! kmssinkrdre}rf(h.Uh/j`ubaubcdocutils.nodes note rg)rh}ri(h.X\1. While using playbin for playing the stream, vpe plugin is automatically picked up. However vpe cannot be used with playbin for scaling. For utilizing scaling capabilities of vpe, using manual pipeline given above is recommended. 2. Waylandsink and Kmssink uses the cropping metadata set on buffers and does not require vpe plugin for croppingh/h1h3Nh5Unoterjh7}rk(h9]h:]h;]h<]h?]uhANhBhhC]rlj)rm}rn(h.Uh7}ro(jU.h<]h;]h9]jUh:]h?]jjuh/jhhC]rp(hy)rq}rr(h.XWhile using playbin for playing the stream, vpe plugin is automatically picked up. However vpe cannot be used with playbin for scaling. For utilizing scaling capabilities of vpe, using manual pipeline given above is recommended.h7}rs(h9]h:]h;]h<]h?]uh/jmhC]rthh)ru}rv(h.XWhile using playbin for playing the stream, vpe plugin is automatically picked up. However vpe cannot be used with playbin for scaling. For utilizing scaling capabilities of vpe, using manual pipeline given above is recommended.rwh/jqh3h4h5hlh7}rx(h9]h:]h;]h<]h?]uhAMWhC]ryhLXWhile using playbin for playing the stream, vpe plugin is automatically picked up. However vpe cannot be used with playbin for scaling. For utilizing scaling capabilities of vpe, using manual pipeline given above is recommended.rzr{}r|(h.jwh/juubaubah5h|ubhy)r}}r~(h.XnWaylandsink and Kmssink uses the cropping metadata set on buffers and does not require vpe plugin for croppingrh7}r(h9]h:]h;]h<]h?]uh/jmhC]rhh)r}r(h.jh/j}h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMYhC]rhLXnWaylandsink and Kmssink uses the cropping metadata set on buffers and does not require vpe plugin for croppingrr}r(h.jh/jubaubah5h|ubeh5jubaubhh)r}r(h.XThe following pipelines show how to use v4l2src and ducatimpeg4enc elements to capture video from VIP and encode captured video respectively.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAM[hBhhC]rhLXThe following pipelines show how to use v4l2src and ducatimpeg4enc elements to capture video from VIP and encode captured video respectively.rr}r(h.jh/jubaubjA)r}r(h.XCapture and Display Fullscreen target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720' ! vpe num-input-buffers=8 ! queue ! kmssinkh/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMahBhhC]rhLXCapture and Display Fullscreen target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720' ! vpe num-input-buffers=8 ! queue ! kmssinkrr}r(h.Uh/jubaubjA)r}r(h.XNote: The following pipelines can also be used for NV12 capture-display usecase. Dmabuf is allocated by v4l2src if io-mode=4 and by kmssink and imported by v4l2src if io-mode=5 target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! kmssink target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=5 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! kmssinkh/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMghBhhC]rhLXNote: The following pipelines can also be used for NV12 capture-display usecase. Dmabuf is allocated by v4l2src if io-mode=4 and by kmssink and imported by v4l2src if io-mode=5 target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! kmssink target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=5 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! kmssinkrr}r(h.Uh/jubaubj)r}r(h.Uh/h1h3h4h5j"h7}r(h9]h:]h;]h<]h?]uhAMohBhhC]rj%)r}r(h.Uj(Kh/jh3h4h5hAh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubjA)r}r(h.X)Capture and Display to a window in wayland 1. refer Wayland/Weston to start the weston 2. target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720' ! vpe num-input-buffers=8 ! queue ! waylandsinkh/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMshBhhC]rhLX)Capture and Display to a window in wayland 1. refer Wayland/Weston to start the weston 2. target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720' ! vpe num-input-buffers=8 ! queue ! waylandsinkrr}r(h.Uh/jubaubjA)r}r(h.XNote: The following pipelines can also be used for NV12 capture-display usecase. Dmabuf is allocated by v4l2src if io-mode=4 and by waylandsink and imported by v4l2src if io-mode=5. Waylandsink supports both shm and drm. A new property use-drm is added to specify drm allocator based bufferpool to be used. When using ducati or vpe plugins, use-drm is set in caps as true. target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! waylandsink use-drm=true target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=5 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! waylandsink use-drm=trueh/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMzhBhhC]rhLXNote: The following pipelines can also be used for NV12 capture-display usecase. Dmabuf is allocated by v4l2src if io-mode=4 and by waylandsink and imported by v4l2src if io-mode=5. Waylandsink supports both shm and drm. A new property use-drm is added to specify drm allocator based bufferpool to be used. When using ducati or vpe plugins, use-drm is set in caps as true. target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! waylandsink use-drm=true target # gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=1000 io-mode=5 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720' ! waylandsink use-drm=truerr}r(h.Uh/jubaubj)r}r(h.Uh/h1h3h4h5j"h7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rj%)r}r(h.Uj(Kh/jh3h4h5hAh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubjA)r}r(h.X`Capture and Encode into a MP4 file. target # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! vpe num-input-buffers=8 ! \ queue ! ducatimpeg4enc bitrate=4000 ! queue ! mpeg4videoparse ! qtmux ! filesink location=x.mp4h/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLX`Capture and Encode into a MP4 file. target # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! vpe num-input-buffers=8 ! \ queue ! ducatimpeg4enc bitrate=4000 ! queue ! mpeg4videoparse ! qtmux ! filesink location=x.mp4rr}r(h.Uh/jubaubjA)r}r(h.XtNote: The following pipeline can be used in usecases where vpe processing is not required. target # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=5 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! ducatimpeg4enc bitrate=4000 ! \ queue ! mpeg4videoparse ! qtmux ! filesink location=x.mp4h/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLXtNote: The following pipeline can be used in usecases where vpe processing is not required. target # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=5 ! 'video/x-raw, \ format=(string)NV12, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! ducatimpeg4enc bitrate=4000 ! \ queue ! mpeg4videoparse ! qtmux ! filesink location=x.mp4rr}r(h.Uh/jubaubjA)r}r(h.XCapture and Encode and Display in parallel. target # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! vpe num-input-buffers=8 ! tee name=t  ! \ queue ! ducatimpeg4enc bitrate=4000 ! queue ! mpeg4videoparse ! qtmux ! filesink location=x.mp4 t. ! queue ! kmssinkh/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLXCapture and Encode and Display in parallel. target # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, \ format=(string)YUY2, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! vpe num-input-buffers=8 ! tee name=t  ! \ queue ! ducatimpeg4enc bitrate=4000 ! queue ! mpeg4videoparse ! qtmux ! filesink location=x.mp4 t. ! queue ! kmssinkrr}r(h.Uh/jubaubhh)r}r(h.X0Below provides more gstreamer pipeline examples.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rhLX0Below provides more gstreamer pipeline examples.rr}r(h.jh/jubaubh[)r}r(h.X%File to file video encoding pipeline:rh/h1h3h4h5h_h7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rhLX%File to file video encoding pipeline:rr}r(h.jh/jubaubjA)r}r(h.Xtarget # gst-launch-1.0 filesrc location=waterfall-352-288-nv12-inp.yuv ! videoparse width=352 height=288 format=nv12 ! video/x-raw, width=352, height=288 ! ducatih264enc ! filesink location=waterfall-352-288-nv12-inp_gst.h264h/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLXtarget # gst-launch-1.0 filesrc location=waterfall-352-288-nv12-inp.yuv ! videoparse width=352 height=288 format=nv12 ! video/x-raw, width=352, height=288 ! ducatih264enc ! filesink location=waterfall-352-288-nv12-inp_gst.h264rr}r(h.Uh/jubaubhh)r}r(h.XThe cap filter of "video/x-raw, width=352, height=288" is needed in this pipeline to specify the width and height. Otherwise, variable width and height are configured for the encoder and the encoded output can be corrupted.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rhLXThe cap filter of "video/x-raw, width=352, height=288" is needed in this pipeline to specify the width and height. Otherwise, variable width and height are configured for the encoder and the encoded output can be corrupted.rr}r(h.jh/jubaubh[)r}r(h.X&File to file 4K H264 encoding pipelinerh/h1h3h4h5h_h7}r(h<]rU&file-to-file-4k-h264-encoding-pipelinerah;]h9]h:]h?]rhauhANhBhhC]rhLX&File to file 4K H264 encoding pipelinerr}r(h.jh/jubaubjA)r}r(h.Xtarget # gst-launch-1.0 filesrc location= 4k.nv12 ! videoparse width=3840 height=2160 format=nv12 framerate=12/1 ! video/x-raw, width=3840, height=2160 ! ducatih264enc level=51 profile=100 bitrate=16000 ! filesink location=4k.h264h/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLXtarget # gst-launch-1.0 filesrc location= 4k.nv12 ! videoparse width=3840 height=2160 format=nv12 framerate=12/1 ! video/x-raw, width=3840, height=2160 ! ducatih264enc level=51 profile=100 bitrate=16000 ! filesink location=4k.h264rr}r(h.Uh/jubaubh[)r}r(h.XFull HD at 60fps Encodingrh/h1h3h4h5h_h7}r(h<]rUfull-hd-at-60fps-encodingrah;]h9]h:]h?]rh"auhANhBhhC]rhLXFull HD at 60fps Encodingr r }r (h.jh/jubaubjA)r }r (h.Xtarget # gst-launch-1.0 videotestsrc num-buffers=1000 ! 'video/x-raw,format=(string)NV12,width=1920,height=1080,framerate=(fraction)60/1' ! ducatih264enc level=level-51 profile=high ! queue ! h264parse ! mp4mux ! filesink location=test.mp4h/h1h3h4h5jDh7}r(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rhLXtarget # gst-launch-1.0 videotestsrc num-buffers=1000 ! 'video/x-raw,format=(string)NV12,width=1920,height=1080,framerate=(fraction)60/1' ! ducatih264enc level=level-51 profile=high ! queue ! h264parse ! mp4mux ! filesink location=test.mp4rr}r(h.Uh/j ubaubh[)r}r(h.XMulti-channel Encodingrh/h1h3h4h5h_h7}r(h<]rUmulti-channel-encodingrah;]h9]h:]h?]rh#auhANhBhhC]rhLXMulti-channel Encodingrr}r(h.jh/jubaubjA)r}r(h.Xtarget # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! tee name=t ! vpe num-input-buffers=8 ! queue ! ducatih264enc ! queue ! h264parse ! qtmux ! filesink location=test.mov t. ! vpe num-input-buffers=8 ! 'video/x-raw, format=(string)NV12, width=(int)640, height=(int)480' ! queue ! ducatih264enc ! queue ! h264parse ! qtmux ! filesink location=test1.movh/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r!hLXtarget # gst-launch-1.0 -e v4l2src device=/dev/video1 num-buffers=1000 io-mode=4 ! 'video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)720, framerate=(fraction)30/1' ! tee name=t ! vpe num-input-buffers=8 ! queue ! ducatih264enc ! queue ! h264parse ! qtmux ! filesink location=test.mov t. ! vpe num-input-buffers=8 ! 'video/x-raw, format=(string)NV12, width=(int)640, height=(int)480' ! queue ! ducatih264enc ! queue ! h264parse ! qtmux ! filesink location=test1.movr"r#}r$(h.Uh/jubaubh[)r%}r&(h.XNetwork Loopbackr'h/h1h3h4h5h_h7}r((h<]r)Unetwork-loopbackr*ah;]h9]h:]h?]r+hauhANhBhhC]r,hLXNetwork Loopbackr-r.}r/(h.j'h/j%ubaubjA)r0}r1(h.X$Sender: target # gst-launch-1.0 -e v4l2src device=/dev/video1 io-mode=4 ! 'video/x-raw,format=(string)YUY2,width=1280,height=720,framerate=(fraction)30/1' ! vpe num-input-buffers=8 ! queue ! ducatih264enc intra-interval=1 ! h264parse ! rtph264pay mtu=200 ! udpsink host=127.0.0.1 port=5000 &h/h1h3h4h5jDh7}r2(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r3hLX$Sender: target # gst-launch-1.0 -e v4l2src device=/dev/video1 io-mode=4 ! 'video/x-raw,format=(string)YUY2,width=1280,height=720,framerate=(fraction)30/1' ! vpe num-input-buffers=8 ! queue ! ducatih264enc intra-interval=1 ! h264parse ! rtph264pay mtu=200 ! udpsink host=127.0.0.1 port=5000 &r4r5}r6(h.Uh/j0ubaubjA)r7}r8(h.X Receiver: target # gst-launch-1.0 -v udpsrc port=5000 ! 'application/x-rtp,media=(string)video, clock-rate=(int)90000, payload=(int)96' ! rtph264depay ! h264parse ! ducatih264dec ! vpe ! 'video/x-raw,format=(string)NV12, width=320,height=240' ! waylandsink sync=falseh/h1h3h4h5jDh7}r9(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r:hLX Receiver: target # gst-launch-1.0 -v udpsrc port=5000 ! 'application/x-rtp,media=(string)video, clock-rate=(int)90000, payload=(int)96' ! rtph264depay ! h264parse ! ducatih264dec ! vpe ! 'video/x-raw,format=(string)NV12, width=320,height=240' ! waylandsink sync=falser;r<}r=(h.Uh/j7ubaubjA)r>}r?(h.X7Note: Both pipelines must be executed on target board.h/h1h3h4h5jDh7}r@(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rAhLX7Note: Both pipelines must be executed on target board.rBrC}rD(h.Uh/j>ubaubjA)rE}rF(h.X-.. rubric:: ARM H265 (HEVC) decoding pipelinerGh/h1h3h4h5jDh7}rH(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rIhLX-.. rubric:: ARM H265 (HEVC) decoding pipelinerJrK}rL(h.Uh/jEubaubjA)rM}rN(h.Xtarget # gst-launch-1.0 filesrc location=.265 ! 'video/x-raw, format=(string)NV12, framerate=(fraction)24/1, width=(int)1280, height=(int)720'  ! h265dec threads=2 ! vpe ! kmssinkh/h1h3h4h5jDh7}rO(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rPhLXtarget # gst-launch-1.0 filesrc location=.265 ! 'video/x-raw, format=(string)NV12, framerate=(fraction)24/1, width=(int)1280, height=(int)720'  ! h265dec threads=2 ! vpe ! kmssinkrQrR}rS(h.Uh/jMubaubh[)rT}rU(h.X'DSP offloaded image processing pipelinerVh/h1h3h4h5h_h7}rW(h9]h:]h;]h<]h?]uhAMhBhhC]rXhLX'DSP offloaded image processing pipelinerYrZ}r[(h.jVh/jTubaubjA)r\}r](h.X^target # gst-launch-1.0 filesrc location=.265 ! 'video/x-raw, format=(string)NV12, framerate=(fraction)24/1, width=(int)1280, height=(int)720'  ! h265dec threads=1 ! videoconvert ! dsp66videokernel kerneltype=1 filtersize=9 lum-only=1 ! videoconvert ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)640, height=(int)480' ! kmssinkh/h1h3h4h5jDh7}r^(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r_hLX^target # gst-launch-1.0 filesrc location=.265 ! 'video/x-raw, format=(string)NV12, framerate=(fraction)24/1, width=(int)1280, height=(int)720'  ! h265dec threads=1 ! videoconvert ! dsp66videokernel kerneltype=1 filtersize=9 lum-only=1 ! videoconvert ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)640, height=(int)480' ! kmssinkr`ra}rb(h.Uh/j\ubaubhh)rc}rd(h.XThis pipeline decodes an H265 clip on ARM A15, offloads the image processing task (Sobel 3x3 kernel) to DSP, and the processed clip is then re-sized and displayed.reh/h1h3h4h5hlh7}rf(h9]h:]h;]h<]h?]uhAMhBhhC]rghLXThis pipeline decodes an H265 clip on ARM A15, offloads the image processing task (Sobel 3x3 kernel) to DSP, and the processed clip is then re-sized and displayed.rhri}rj(h.jeh/jcubaubhh)rk}rl(h.XProcessor SDK provides reference implementation of multiple image processing kernels, for which the pipeline can be configured as shown in the table below.rmh/h1h3h4h5hlh7}rn(h9]h:]h;]h<]h?]uhAMhBhhC]rohLXProcessor SDK provides reference implementation of multiple image processing kernels, for which the pipeline can be configured as shown in the table below.rprq}rr(h.jmh/jkubaubj)rs}rt(h.Uh/h1h3h4h5jh7}ru(h9]h:]h;]h<]h?]uhANhBhhC]rvj)rw}rx(h.Uh7}ry(h<]h;]h9]h:]h?]UcolsKuh/jshC]rz(j)r{}r|(h.Uh7}r}(h<]h;]h9]h:]h?]UcolwidthK8uh/jwhC]h5jubj)r~}r(h.Uh7}r(h<]h;]h9]h:]h?]UcolwidthKLuh/jwhC]h5jubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jwhC]r(j)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X**Kernel Type**rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rj)r}r(h.jh7}r(h9]h:]h;]h<]h?]uh/jhC]rhLX Kernel Typerr}r(h.Uh/jubah5jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X**Definition in GST Pipeline**rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rj)r}r(h.jh7}r(h9]h:]h;]h<]h?]uh/jhC]rhLXDefinition in GST Pipelinerr}r(h.Uh/jubah5jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X Median2x2rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX Median2x2rr}r(h.jh/jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X5dsp66videokernel kerneltype=0 filtersize=5 lum-only=0rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX5dsp66videokernel kerneltype=0 filtersize=5 lum-only=0rr}r(h.jh/jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XMedian3x3 with luminance onlyrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLXMedian3x3 with luminance onlyrr}r(h.jh/jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X5dsp66videokernel kerneltype=0 filtersize=9 lum-only=1rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX5dsp66videokernel kerneltype=0 filtersize=9 lum-only=1rr}r(h.jh/jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XSobel3x3 with luminance onlyrh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLXSobel3x3 with luminance onlyrr}r(h.jh/jubaubah5j ubj )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X5dsp66videokernel kerneltype=1 filtersize=9 lum-only=1rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX5dsp66videokernel kerneltype=1 filtersize=9 lum-only=1rr}r(h.jh/jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.XConv5x5rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]r hLXConv5x5r r }r (h.jh/jubaubah5j ubj )r }r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]rhh)r}r(h.X6dsp66videokernel kerneltype=2 filtersize=25 lum-only=0rh/j h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX6dsp66videokernel kerneltype=2 filtersize=25 lum-only=0rr}r(h.jh/jubaubah5j ubeh5j1ubj)r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r(j )r}r(h.Uh7}r(h9]h:]h;]h<]h?]uh/jhC]r hh)r!}r"(h.X4User defined kernel with Sobel3x3 and luminance onlyr#h/jh3h4h5hlh7}r$(h9]h:]h;]h<]h?]uhAMhC]r%hLX4User defined kernel with Sobel3x3 and luminance onlyr&r'}r((h.j#h/j!ubaubah5j ubj )r)}r*(h.Uh7}r+(h9]h:]h;]h<]h?]uh/jhC]r,hh)r-}r.(h.XHdsp66videokernel kerneltype=4 arbkernel=Sobel3x3 filtersize=9 lum-only=1r/h/j)h3h4h5hlh7}r0(h9]h:]h;]h<]h?]uhAMhC]r1hLXHdsp66videokernel kerneltype=4 arbkernel=Sobel3x3 filtersize=9 lum-only=1r2r3}r4(h.j/h/j-ubaubah5j ubeh5j1ubeh5jubeh5jubaubj)r5}r6(h.Uh/h1h3h4h5jh7}r7(jU.Ustartr8Kh<]h;]h9]jUh:]h?]jjuhAMhBhhC]r9hy)r:}r;(h.X,Audio/Video decoding with http input source h/j5h3h4h5h|h7}r<(h9]h:]h;]h<]h?]uhANhBhhC]r=hh)r>}r?(h.X+Audio/Video decoding with http input sourcer@h/j:h3h4h5hlh7}rA(h9]h:]h;]h<]h?]uhAMhC]rBhLX+Audio/Video decoding with http input sourcerCrD}rE(h.j@h/j>ubaubaubaubjA)rF}rG(h.Xatarget # gst-launch-1.0 playbin uri=http:// video-sink=kmssink audio-sink=alsasinkh/h1h3h4h5jDh7}rH(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rIhLXatarget # gst-launch-1.0 playbin uri=http:// video-sink=kmssink audio-sink=alsasinkrJrK}rL(h.Uh/jFubaubj)rM}rN(h.Uh/h1h3h4h5jh7}rO(jU.j8Kh<]h;]h9]jUh:]h?]jjuhAMhBhhC]rPhy)rQ}rR(h.XxAudio/Video decoding with rtsp input source First, set up and run RTSP server on host. Then, run the following command: h/jMh3h4h5h|h7}rS(h9]h:]h;]h<]h?]uhANhBhhC]rThh)rU}rV(h.XwAudio/Video decoding with rtsp input source First, set up and run RTSP server on host. Then, run the following command:rWh/jQh3h4h5hlh7}rX(h9]h:]h;]h<]h?]uhAMhC]rYhLXwAudio/Video decoding with rtsp input source First, set up and run RTSP server on host. Then, run the following command:rZr[}r\(h.jWh/jUubaubaubaubjA)r]}r^(h.Xatarget # gst-launch-1.0 playbin uri=rtsp:// video-sink=kmssink audio-sink=alsasinkh/h1h3h4h5jDh7}r_(hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r`hLXatarget # gst-launch-1.0 playbin uri=rtsp:// video-sink=kmssink audio-sink=alsasinkrarb}rc(h.Uh/j]ubaubj)rd}re(h.Uh/h1h3h4h5jh7}rf(jU.j8Kh<]h;]h9]jUh:]h?]jjuhAMhBhhC]rghy)rh}ri(h.X'Record real-time FPS of video decoding h/jdh3h4h5h|h7}rj(h9]h:]h;]h<]h?]uhANhBhhC]rkhh)rl}rm(h.X&Record real-time FPS of video decodingrnh/jhh3h4h5hlh7}ro(h9]h:]h;]h<]h?]uhAMhC]rphLX&Record real-time FPS of video decodingrqrr}rs(h.jnh/jlubaubaubaubjA)rt}ru(h.Xztarget # gst-launch-1.0 -v playbin uri=file:/// video-sink=fpsdisplaysink audio-sink=alsasink > fps_log.txth/h1h3h4h5jDh7}rv(hUhVh<]h;]h9]h:]h?]uhAM hBhhC]rwhLXztarget # gst-launch-1.0 -v playbin uri=file:/// video-sink=fpsdisplaysink audio-sink=alsasink > fps_log.txtrxry}rz(h.Uh/jtubaubhh)r{}r|(h.X\Note: please view fps\_log.txt to find out the FPS information after the pipeline completes.h/h1h3h4h5hlh7}r}(h9]h:]h;]h<]h?]uhAM hBhhC]r~hLX[Note: please view fps_log.txt to find out the FPS information after the pipeline completes.rr}r(h.X\Note: please view fps\_log.txt to find out the FPS information after the pipeline completes.h/j{ubaubj)r}r(h.Uh/h1h3h4h5j"h7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rj%)r}r(h.Uj(Kh/jh3h4h5hAh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubcdocutils.nodes block_quote r)r}r(h.Uh/h1h3Nh5U block_quoterh7}r(h9]h:]h;]h<]h?]uhANhBhhC]rh[)r}r(h.XGstreamer Plugins Limitationsrh/jh3h4h5h_h7}r(h<]rUgstreamer-plugins-limitationsrah;]h9]h:]h?]rhauhAKhC]rhLXGstreamer Plugins Limitationsrr}r(h.jh/jubaubaubhr)r}r(h.Uh/h1h3h4h5huh7}r(hwX*h<]h;]h9]h:]h?]uhAMhBhhC]r(hy)r}r(h.XIGstreamer VPE plugin supports only YUY2, NV12, YUYV input/output formats.rh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLXIGstreamer VPE plugin supports only YUY2, NV12, YUYV input/output formats.rr}r(h.jh/jubaubaubhy)r}r(h.XMNot all encoder's parameters are exposed as gstreamer encoder's properties. h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.XKNot all encoder's parameters are exposed as gstreamer encoder's properties.rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLXKNot all encoder's parameters are exposed as gstreamer encoder's properties.rr}r(h.jh/jubaubaubeubj)r}r(h.Uh/h1h3Nh5jh7}r(h9]h:]h;]h<]h?]uhANhBhhC]rh[)r}r(h.X-List of Features not Supported with Gstreamerrh/jh3h4h5h_h7}r(h<]rU-list-of-features-not-supported-with-gstreamerrah;]h9]h:]h?]rhauhAKhC]rhLX-List of Features not Supported with Gstreamerrr}r(h.jh/jubaubaubhr)r}r(h.Uh/h1h3h4h5huh7}r(hwX*h<]h;]h9]h:]h?]uhAMhBhhC]r(hy)r}r(h.X'DSS WB is not supported with gstreamer.rh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX'DSS WB is not supported with gstreamer.rr}r(h.jh/jubaubaubhy)r}r(h.X,Ivi-shell is not supported with gstreamer. h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.X*Ivi-shell is not supported with gstreamer.rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhC]rhLX*Ivi-shell is not supported with gstreamer.rr}r(h.jh/jubaubaubeubj)r}r(h.Uh/h1h3h4h5j"h7}r(h9]h:]h;]h<]h?]uhAM hBhhC]rj%)r}r(h.Uj(Kh/jh3h4h5hAh7}r(h9]h:]h;]h<]h?]uhAKhBhhC]ubaubh[)r}r(h.X#DSP C66x Gstreamer Plugin Internalsrh/h1h3h4h5h_h7}r(h<]rU#dsp-c66x-gstreamer-plugin-internalsrah;]h9]h:]h?]rh auhANhBhhC]rhLX#DSP C66x Gstreamer Plugin Internalsrr}r(h.jh/jubaubhh)r}r(h.XTI's Processor SDK Linux supplies ARM based GStreamer plugin that abstracts C66x DSP offload. The primary goal of this DSP GStreamer plugin is to demonstrate how C66x can be used in GStreamer framework, in combination with other GStreamer plugins. The plugin, under the hood, uses OpenCL to dispatch to the C66x cores. This plugin provides sample DSP kernels and can be used as a reference to develop user's own DSP kernels.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAM%hBhhC]rhLXTI's Processor SDK Linux supplies ARM based GStreamer plugin that abstracts C66x DSP offload. The primary goal of this DSP GStreamer plugin is to demonstrate how C66x can be used in GStreamer framework, in combination with other GStreamer plugins. The plugin, under the hood, uses OpenCL to dispatch to the C66x cores. This plugin provides sample DSP kernels and can be used as a reference to develop user's own DSP kernels.rr}r(h.jh/jubaubh[)r}r(h.X Overview of Existing Source Coderh/h1h3h4h5h_h7}r(h<]rU overview-of-existing-source-coderah;]h9]h:]h?]rhauhANhBhhC]rhLX Overview of Existing Source Coderr}r(h.jh/jubaubhh)r}r(h.XaSource code of the DSP plugin can be found from http://git.ti.com/processor-sdk/gst-plugin-dsp66.h/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAM0hBhhC]r (hLX0Source code of the DSP plugin can be found from r r }r (h.X0Source code of the DSP plugin can be found from h/jubjl)r }r(h.X0http://git.ti.com/processor-sdk/gst-plugin-dsp66rh7}r(Urefurijh<]h;]h9]h:]h?]uh/jhC]rhLX0http://git.ti.com/processor-sdk/gst-plugin-dsp66rr}r(h.Uh/j ubah5juubhLX.r}r(h.X.h/jubeubhh)r}r(h.XAs shown in the figure below, the GST plugin code (gstdsp66\*.c and gstdsp66\*.h files) is directly under the ./src folder. It is implemented in C following GST framework requirements, and therefore it is compatible with the gstreamer version used in Processor-SDK-Linux.h/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAM3hBhhC]rhLX As shown in the figure below, the GST plugin code (gstdsp66*.c and gstdsp66*.h files) is directly under the ./src folder. It is implemented in C following GST framework requirements, and therefore it is compatible with the gstreamer version used in Processor-SDK-Linux.rr}r(h.XAs shown in the figure below, the GST plugin code (gstdsp66\*.c and gstdsp66\*.h files) is directly under the ./src folder. It is implemented in C following GST framework requirements, and therefore it is compatible with the gstreamer version used in Processor-SDK-Linux.h/jubaubhh)r}r(h.X5Dispatch of work load to DSP is done via call to functions in independent shared objects, which are implemented in OpenCL code organized under the kernels folder. The kernels folder currently has a sub-folder of oclconv, which provides sample DSP kernels for image processing. As long as the APIs between the GST plugin code (in ./src folder) and OpenCL code (in ./src/kernels/oclconv folder) are the same, this shared object can be compiled and installed separately. This approach allows easier modification, implementation and maintenance once the APIs are fixed.r h/h1h3h4h5hlh7}r!(h9]h:]h;]h<]h?]uhAM8hBhhC]r"hLX5Dispatch of work load to DSP is done via call to functions in independent shared objects, which are implemented in OpenCL code organized under the kernels folder. The kernels folder currently has a sub-folder of oclconv, which provides sample DSP kernels for image processing. As long as the APIs between the GST plugin code (in ./src folder) and OpenCL code (in ./src/kernels/oclconv folder) are the same, this shared object can be compiled and installed separately. This approach allows easier modification, implementation and maintenance once the APIs are fixed.r#r$}r%(h.j h/jubaubj)r&}r'(h.X'.. Image:: ../images/GST-dsp66-src.png h/h1h3h4h5j h7}r((UuriX!linux/../images/GST-dsp66-src.pngr)h<]h;]h9]h:]j }r*U*j)sh?]uhAMChBhhC]ubhh)r+}r,(h.XThe image processing functions in oclconv are implemented via calls to DSP optimized imglib and vlib library functions, or implemented in OpenCL C.r-h/h1h3h4h5hlh7}r.(h9]h:]h;]h<]h?]uhAMDhBhhC]r/hLXThe image processing functions in oclconv are implemented via calls to DSP optimized imglib and vlib library functions, or implemented in OpenCL C.r0r1}r2(h.j-h/j+ubaubhr)r3}r4(h.Uh/h1h3h4h5huh7}r5(hwX-h<]h;]h9]h:]h?]uhAMHhBhhC]r6(hy)r7}r8(h.X,Kernels implemented with OpenCL C: Median2x2r9h/j3h3h4h5h|h7}r:(h9]h:]h;]h<]h?]uhANhBhhC]r;hh)r<}r=(h.j9h/j7h3h4h5hlh7}r>(h9]h:]h;]h<]h?]uhAMHhC]r?hLX,Kernels implemented with OpenCL C: Median2x2r@rA}rB(h.j9h/j<ubaubaubhy)rC}rD(h.XZKernels implemented with imglib function calls from OpenCL C: Median3x3, Sobel3x3, Conv5x5h/j3h3h4h5h|h7}rE(h9]h:]h;]h<]h?]uhANhBhhC]rFhh)rG}rH(h.XZKernels implemented with imglib function calls from OpenCL C: Median3x3, Sobel3x3, Conv5x5rIh/jCh3h4h5hlh7}rJ(h9]h:]h;]h<]h?]uhAMIhC]rKhLXZKernels implemented with imglib function calls from OpenCL C: Median3x3, Sobel3x3, Conv5x5rLrM}rN(h.jIh/jGubaubaubhy)rO}rP(h.XBKernels implemented with vlib function calls from OpenCL C: Canny h/j3h3h4h5h|h7}rQ(h9]h:]h;]h<]h?]uhANhBhhC]rRhh)rS}rT(h.XAKernels implemented with vlib function calls from OpenCL C: CannyrUh/jOh3h4h5hlh7}rV(h9]h:]h;]h<]h?]uhAMKhC]rWhLXAKernels implemented with vlib function calls from OpenCL C: CannyrXrY}rZ(h.jUh/jSubaubaubeubh[)r[}r\(h.XAdding Custom DSP Kernelsr]h/h1h3h4h5h_h7}r^(h<]r_Uadding-custom-dsp-kernelsr`ah;]h9]h:]h?]rahauhANhBhhC]rbhLXAdding Custom DSP Kernelsrcrd}re(h.j]h/j[ubaubhh)rf}rg(h.X?Using the existing oclconv as the template, more folders can be added under ./src/kernels folder to create shared libraries with additional wrappers (for functions invoked from GST plugin context) and OCL (host side and DSP) kernels. Makefile in ./src/kernels folder will attempt make in all sub-folders. Each sub-folder will provide independent shared library object that can be invoked from gstdsp66 context (e.g., function calls in ./src/gstdsp66videokernel.c file). Individual shared object libraries can be independently recompiled and updated in the target file system.rhh/h1h3h4h5hlh7}ri(h9]h:]h;]h<]h?]uhAMPhBhhC]rjhLX?Using the existing oclconv as the template, more folders can be added under ./src/kernels folder to create shared libraries with additional wrappers (for functions invoked from GST plugin context) and OCL (host side and DSP) kernels. Makefile in ./src/kernels folder will attempt make in all sub-folders. Each sub-folder will provide independent shared library object that can be invoked from gstdsp66 context (e.g., function calls in ./src/gstdsp66videokernel.c file). Individual shared object libraries can be independently recompiled and updated in the target file system.rkrl}rm(h.jhh/jfubaubh[)rn}ro(h.XModifying the Existing Pluginrph/h1h3h4h5h_h7}rq(h<]rrUmodifying-the-existing-pluginrsah;]h9]h:]h?]rth auhANhBhhC]ruhLXModifying the Existing Pluginrvrw}rx(h.jph/jnubaubhh)ry}rz(h.XYThe DSP plugin also allows easy modifications and additions, and below are some examples.r{h/h1h3h4h5hlh7}r|(h9]h:]h;]h<]h?]uhAM]hBhhC]r}hLXYThe DSP plugin also allows easy modifications and additions, and below are some examples.r~r}r(h.j{h/jyubaubhh)r}r(h.XCurrently the DSP plugin provides five sample image process operations: 1) Median2x2; 2) Median3x3; 3) Sobel3x3; 4) Conv5x5; and 5) Canny. Users can modify the source code to add more image processing operations as needed.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAM`hBhhC]rhLXCurrently the DSP plugin provides five sample image process operations: 1) Median2x2; 2) Median3x3; 3) Sobel3x3; 4) Conv5x5; and 5) Canny. Users can modify the source code to add more image processing operations as needed.rr}r(h.jh/jubaubhh)r}r(h.XCurrently the DSP plugin provides properties as below. More properties can be added so that they can be passed from gst-launcher.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMehBhhC]rhLXCurrently the DSP plugin provides properties as below. More properties can be added so that they can be passed from gst-launcher.rr}r(h.jh/jubaubhr)r}r(h.Uh/h1h3h4h5huh7}r(hwX-h<]h;]h9]h:]h?]uhAMhhBhhC]r(hy)r}r(h.X"kerneltype: select the kernel typerh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhhC]rhLX"kerneltype: select the kernel typerr}r(h.jh/jubaubaubhy)r}r(h.X8filtersize: the size of the filter, choose from (5,9,25)rh/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.jh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMihC]rhLX8filtersize: the size of the filter, choose from (5,9,25)rr}r(h.jh/jubaubaubhy)r}r(h.Xalum-only: true for applying the filter on luminance only, false for applying on all three planes.h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.Xalum-only: true for applying the filter on luminance only, false for applying on all three planes.rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMjhC]rhLXalum-only: true for applying the filter on luminance only, false for applying on all three planes.rr}r(h.jh/jubaubaubhy)r}r(h.XOarbkernel: provide a way to specify the name of the kernel invoked via OpenCL. h/jh3h4h5h|h7}r(h9]h:]h;]h<]h?]uhANhBhhC]rhh)r}r(h.XNarbkernel: provide a way to specify the name of the kernel invoked via OpenCL.rh/jh3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMlhC]rhLXNarbkernel: provide a way to specify the name of the kernel invoked via OpenCL.rr}r(h.jh/jubaubaubeubhh)r}r(h.XDetails of a specific image processing kernel can also be modified, e.g., the coefficients for Conv5x5 kernel, which are defined in kernels/oclconv/conv.cl::kernel void Conv5x5() function.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMohBhhC]rhLXDetails of a specific image processing kernel can also be modified, e.g., the coefficients for Conv5x5 kernel, which are defined in kernels/oclconv/conv.cl::kernel void Conv5x5() function.rr}r(h.jh/jubaubh[)r}r(h.X$Rebuilding and Installing the Pluginrh/h1h3h4h5h_h7}r(h<]rU$rebuilding-and-installing-the-pluginrah;]h9]h:]h?]rhauhANhBhhC]rhLX$Rebuilding and Installing the Pluginrr}r(h.jh/jubaubhh)r}r(h.XAfter modifications/additions are made for the DSP plugin source code, the plugin needs to be rebuilt, and this can be done from the Yocto build.rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMvhBhhC]rhLXAfter modifications/additions are made for the DSP plugin source code, the plugin needs to be rebuilt, and this can be done from the Yocto build.rr}r(h.jh/jubaubhh)r}r(h.XFirst, please refer to `Processor SDK Building The SDK `__ to set up the build environment and bitbake the original recipe for gstreamer1.0-plugins-dsp66, i.e.,h/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMzhBhhC]r(hLXFirst, please refer to rr}r(h.XFirst, please refer to h/jubjl)r}r(h.Xk`Processor SDK Building The SDK `__h7}r(UnameXProcessor SDK Building The SDKUrefurirXFhttp://processors.wiki.ti.com/index.php/Processor_SDK_Building_The_SDKh<]h;]h9]h:]h?]uh/jhC]rhLXProcessor SDK Building The SDKrr}r(h.Uh/jubah5juubhLXf to set up the build environment and bitbake the original recipe for gstreamer1.0-plugins-dsp66, i.e.,rr}r(h.Xf to set up the build environment and bitbake the original recipe for gstreamer1.0-plugins-dsp66, i.e.,h/jubeubhh)r}r(h.X9``MACHINE=am57xx-evm bitbake gstreamer1.0-plugins-dsp66``rh/h1h3h4h5hlh7}r(h9]h:]h;]h<]h?]uhAMhBhhC]rcdocutils.nodes literal r)r}r(h.jh7}r(h9]h:]h;]h<]h?]uh/jhC]rhLX5MACHINE=am57xx-evm bitbake gstreamer1.0-plugins-dsp66rr}r(h.Uh/jubah5Uliteralrubaubhh)r }r (h.XAfter the bitbake command above is successfully done, ./build/arago-tmp-external-arm-toolchain/work/armv7ahf-neon-linux-gnueabi/gstreamer1.0-plugins-dsp66/git-r<\*> will be created with the original source code under the git sub-folder. Copy the modified and/or the newly added files to the git sub-folder, and rebuild the plugin referring to `Rebuild Recipe `__.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r (hLXVAfter the bitbake command above is successfully done, ./build/arago-tmp-external-arm-toolchain/work/armv7ahf-neon-linux-gnueabi/gstreamer1.0-plugins-dsp66/git-r<*> will be created with the original source code under the git sub-folder. Copy the modified and/or the newly added files to the git sub-folder, and rebuild the plugin referring to r r }r (h.XWAfter the bitbake command above is successfully done, ./build/arago-tmp-external-arm-toolchain/work/armv7ahf-neon-linux-gnueabi/gstreamer1.0-plugins-dsp66/git-r<\*> will be created with the original source code under the git sub-folder. Copy the modified and/or the newly added files to the git sub-folder, and rebuild the plugin referring to h/j ubjl)r }r (h.Xq`Rebuild Recipe `__h7}r (UnameXRebuild RecipejX\http://processors.wiki.ti.com/index.php/Processor_SDK_Building_The_SDK#Forced_Re-compilationh<]h;]h9]h:]h?]uh/j hC]r hLXRebuild Reciper r }r (h.Uh/j ubah5juubhLX.r }r (h.X.h/j ubeubhh)r }r (h.XQLast, install the rebuilt plugin on target filesystem referring to `Install Package `__. After the installation, the following files will be updated and/or added. Gstreamer framework includes seamless detection and registration of the new plugin.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r (hLXCLast, install the rebuilt plugin on target filesystem referring to r r }r (h.XCLast, install the rebuilt plugin on target filesystem referring to h/j ubjl)r }r (h.Xo`Install Package `__h7}r (UnameXInstall PackagejXYhttp://processors.wiki.ti.com/index.php/Processor_SDK_Building_The_SDK#Installing_Packageh<]h;]h9]h:]h?]uh/j hC]r hLXInstall Packager r }r (h.Uh/j ubah5juubhLX. After the installation, the following files will be updated and/or added. Gstreamer framework includes seamless detection and registration of the new plugin.r r }r (h.X. After the installation, the following files will be updated and/or added. Gstreamer framework includes seamless detection and registration of the new plugin.h/j ubeubhr)r! }r" (h.Uh/h1h3h4h5huh7}r# (hwX-h<]h;]h9]h:]h?]uhAMhBhhC]r$ (hy)r% }r& (h.X%/usr/lib/gstreamer-1.0/libgstdsp66.sor' h/j! h3h4h5h|h7}r( (h9]h:]h;]h<]h?]uhANhBhhC]r) hh)r* }r+ (h.j' h/j% h3h4h5hlh7}r, (h9]h:]h;]h<]h?]uhAMhC]r- hLX%/usr/lib/gstreamer-1.0/libgstdsp66.sor. r/ }r0 (h.j' h/j* ubaubaubhy)r1 }r2 (h.X/usr/lib/liboclconv.sor3 h/j! h3h4h5h|h7}r4 (h9]h:]h;]h<]h?]uhANhBhhC]r5 hh)r6 }r7 (h.j3 h/j1 h3h4h5hlh7}r8 (h9]h:]h;]h<]h?]uhAMhC]r9 hLX/usr/lib/liboclconv.sor: r; }r< (h.j3 h/j6 ubaubaubhy)r= }r> (h.Xj[optional] any additional shared library (as described in previous section), should be placed in /usr/lib h/j! h3h4h5h|h7}r? (h9]h:]h;]h<]h?]uhANhBhhC]r@ hh)rA }rB (h.Xi[optional] any additional shared library (as described in previous section), should be placed in /usr/librC h/j= h3h4h5hlh7}rD (h9]h:]h;]h<]h?]uhAMhC]rE hLXi[optional] any additional shared library (as described in previous section), should be placed in /usr/librF rG }rH (h.jC h/jA ubaubaubeubj)rI }rJ (h.Uh/h1h3h4h5j"h7}rK (h9]h:]h;]h<]h?]uhAMhBhhC]rL j%)rM }rN (h.Uj(Kh/jI h3h4h5hAh7}rO (h9]h:]h;]h<]h?]uhAKhBhhC]ubaubh[)rP }rQ (h.XRebuild IPUMM FirmwarerR h/h1h3h4h5h_h7}rS (h<]rT Urebuild-ipumm-firmwarerU ah;]h9]h:]h?]rV hauhANhBhhC]rW hLXRebuild IPUMM FirmwarerX rY }rZ (h.jR h/jP ubaubhh)r[ }r\ (h.XPre-built IPUMM firmware images can be located on target file system at /lib/firmware/dra7-ipu2-fw.xem4. In case there is a need to rebuild the IPUMM firmware, the instructions below are provided for rebuilding IPUMM firmware. It assumes that everything is done on a Ubuntu machine.r] h/h1h3h4h5hlh7}r^ (h9]h:]h;]h<]h?]uhAMhBhhC]r_ hLXPre-built IPUMM firmware images can be located on target file system at /lib/firmware/dra7-ipu2-fw.xem4. In case there is a need to rebuild the IPUMM firmware, the instructions below are provided for rebuilding IPUMM firmware. It assumes that everything is done on a Ubuntu machine.r` ra }rb (h.j] h/j[ ubaubh[)rc }rd (h.XIPUMM GIT Repore h/h1h3h4h5h_h7}rf (h<]rg Uipumm-git-reporh ah;]h9]h:]h?]ri hauhANhBhhC]rj hLXIPUMM GIT Repork rl }rm (h.je h/jc ubaubhh)rn }ro (h.X|IPUMM is publically available at https://git.ti.com/ivimm/ipumm. To clone the git repository, execute the following command.h/h1h3h4h5hlh7}rp (h9]h:]h;]h<]h?]uhAMhBhhC]rq (hLX!IPUMM is publically available at rr rs }rt (h.X!IPUMM is publically available at h/jn ubjl)ru }rv (h.Xhttps://git.ti.com/ivimm/ipummrw h7}rx (Urefurijw h<]h;]h9]h:]h?]uh/jn hC]ry hLXhttps://git.ti.com/ivimm/ipummrz r{ }r| (h.Uh/ju ubah5juubhLX=. To clone the git repository, execute the following command.r} r~ }r (h.X=. To clone the git repository, execute the following command.h/jn ubeubjA)r }r (h.X*git clone git://git.ti.com/ivimm/ipumm.gith/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r hLX*git clone git://git.ti.com/ivimm/ipumm.gitr r }r (h.Uh/j ubaubhh)r }r (h.XJTo checkout a particular tag, e.g., 3.00.09.01, run the following command:r h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r hLXJTo checkout a particular tag, e.g., 3.00.09.01, run the following command:r r }r (h.j h/j ubaubjA)r }r (h.X-cd ipumm git checkout [tag, e.g., 3.00.09.01]h/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r hLX-cd ipumm git checkout [tag, e.g., 3.00.09.01]r r }r (h.Uh/j ubaubh[)r }r (h.XIPUMM Build Toolsr h/h1h3h4h5h_h7}r (h<]r Uipumm-build-toolsr ah;]h9]h:]h?]r hauhANhBhhC]r hLXIPUMM Build Toolsr r }r (h.j h/j ubaubhh)r }r (h.X,Making IPUMM depends on the following tools.r h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r hLX,Making IPUMM depends on the following tools.r r }r (h.j h/j ubaubhr)r }r (h.Uh/h1h3h4h5huh7}r (hwX-h<]h;]h9]h:]h?]uhAMhBhhC]r (hy)r }r (h.X|**Codec Engine**: `Codec Engine Product Releases `__h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.X|**Codec Engine**: `Codec Engine Product Releases `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (j)r }r (h.X**Codec Engine**h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLX Codec Enginer r }r (h.Uh/j ubah5jubhLX: r r }r (h.X: h/j ubjl)r }r (h.Xj`Codec Engine Product Releases `__h7}r (UnameXCodec Engine Product ReleasesjXFhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/ce/h<]h;]h9]h:]h?]uh/j hC]r hLXCodec Engine Product Releasesr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.X**Framework Components**: `Framework Components Product Releases `__h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.X**Framework Components**: `Framework Components Product Releases `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (j)r }r (h.X**Framework Components**h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXFramework Componentsr r }r (h.Uh/j ubah5jubhLX: r r }r (h.X: h/j ubjl)r }r (h.Xq`Framework Components Product Releases `__h7}r (UnameX%Framework Components Product ReleasesjXEhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/fch<]h;]h9]h:]h?]uh/j hC]r hLX%Framework Components Product Releasesr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.Xj**IPC**: `IPC Product Releases `__h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.Xj**IPC**: `IPC Product Releases `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (j)r }r (h.X**IPC**h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXIPCr r }r (h.Uh/j ubah5jubhLX: r r }r (h.X: h/j ubjl)r }r (h.Xa`IPC Product Releases `__h7}r (UnameXIPC Product ReleasesjXFhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/ipch<]h;]h9]h:]h?]uh/j hC]r hLXIPC Product Releasesr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.X{**XDAIS**: `XDAIS Product Releases `__h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.X{**XDAIS**: `XDAIS Product Releases `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (j)r }r (h.X **XDAIS**h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXXDAISr r }r (h.Uh/j ubah5jubhLX: r r }r (h.X: h/j ubjl)r }r (h.Xp`XDAIS Product Releases `__h7}r (UnameXXDAIS Product ReleasesjXShttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/xdais/index.htmlh<]h;]h9]h:]h?]uh/j hC]r hLXXDAIS Product Releasesr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.Xy**BIOS**: `SYS/BIOS Product Releases `__h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.Xy**BIOS**: `SYS/BIOS Product Releases `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (j)r }r (h.X**BIOS**h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXBIOSr r }r (h.Uh/j ubah5jubhLX: r r! }r" (h.X: h/j ubjl)r# }r$ (h.Xo`SYS/BIOS Product Releases `__h7}r% (UnameXSYS/BIOS Product ReleasesjXOhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/bios/sysbiosh<]h;]h9]h:]h?]uh/j hC]r& hLXSYS/BIOS Product Releasesr' r( }r) (h.Uh/j# ubah5juubeubaubhy)r* }r+ (h.Xv**XDC Tools**: `XDCTools Product Releases `__h/j h3h4h5h|h7}r, (h9]h:]h;]h<]h?]uhANhBhhC]r- hh)r. }r/ (h.Xv**XDC Tools**: `XDCTools Product Releases `__h/j* h3h4h5hlh7}r0 (h9]h:]h;]h<]h?]uhAMhC]r1 (j)r2 }r3 (h.X **XDC Tools**h7}r4 (h9]h:]h;]h<]h?]uh/j. hC]r5 hLX XDC Toolsr6 r7 }r8 (h.Uh/j2 ubah5jubhLX: r9 r: }r; (h.X: h/j. ubjl)r< }r= (h.Xg`XDCTools Product Releases `__h7}r> (UnameXXDCTools Product ReleasesjXGhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/rtsch<]h;]h9]h:]h?]uh/j. hC]r? hLXXDCTools Product Releasesr@ rA }rB (h.Uh/j< ubah5juubeubaubhy)rC }rD (h.X**TMS470 CGT ARM**: The compiler tools are provided as part of CCS.\ `CCSv6 Download `__ h/j h3h4h5h|h7}rE (h9]h:]h;]h<]h?]uhANhBhhC]rF hh)rG }rH (h.X**TMS470 CGT ARM**: The compiler tools are provided as part of CCS.\ `CCSv6 Download `__h/jC h3h4h5hlh7}rI (h9]h:]h;]h<]h?]uhAMhC]rJ (j)rK }rL (h.X**TMS470 CGT ARM**h7}rM (h9]h:]h;]h<]h?]uh/jG hC]rN hLXTMS470 CGT ARMrO rP }rQ (h.Uh/jK ubah5jubhLX1: The compiler tools are provided as part of CCS.rR rS }rT (h.X3: The compiler tools are provided as part of CCS.\ h/jG ubjl)rU }rV (h.Xr`CCSv6 Download `__h7}rW (UnameXCCSv6 DownloadjX]http://processors.wiki.ti.com/index.php/Download_CCS#Code_Composer_Studio_Version_6_Downloadsh<]h;]h9]h:]h?]uh/jG hC]rX hLXCCSv6 DownloadrY rZ }r[ (h.Uh/jU ubah5juubeubaubeubhh)r\ }r] (h.XEach release of IPUMM is verified with particular versions of the tools above. Check top level Makefile of ipumm to identify the versions to be downloaded and installed. For example, the tool versions used in IPUMM 3.00.09.01 are listed as below:r^ h/h1h3h4h5hlh7}r_ (h9]h:]h;]h<]h?]uhAMhBhhC]r` hLXEach release of IPUMM is verified with particular versions of the tools above. Check top level Makefile of ipumm to identify the versions to be downloaded and installed. For example, the tool versions used in IPUMM 3.00.09.01 are listed as below:ra rb }rc (h.j^ h/j\ ubaubjA)rd }re (h.XbXDCVERSION  ?= xdctools_3_31_02_38_core BIOSVERSION  ?= bios_6_42_02_29 IPCVERSION  ?= ipc_3_40_01_08 CEVERSION  ?= codec_engine_3_24_00_08 FCVERSION  ?= framework_components_3_40_01_04 XDAISVERSION  ?= xdais_7_24_00_04 # TI Compiler Settings export TMS470CGTOOLPATH ?= $(BIOSTOOLSROOT)/ccsv6/tools/compiler/ti-cgt-arm_5.2.5h/h1h3h4h5jDh7}rf (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rg hLXbXDCVERSION  ?= xdctools_3_31_02_38_core BIOSVERSION  ?= bios_6_42_02_29 IPCVERSION  ?= ipc_3_40_01_08 CEVERSION  ?= codec_engine_3_24_00_08 FCVERSION  ?= framework_components_3_40_01_04 XDAISVERSION  ?= xdais_7_24_00_04 # TI Compiler Settings export TMS470CGTOOLPATH ?= $(BIOSTOOLSROOT)/ccsv6/tools/compiler/ti-cgt-arm_5.2.5rh ri }rj (h.Uh/jd ubaubhh)rk }rl (h.XBelow are direct download links and install instructions for IPUMM 3.00.09.01 build tools. When installing the tools, it is preferable to install all the tools to the same directory, e.g., /opt/ti.rm h/h1h3h4h5hlh7}rn (h9]h:]h;]h<]h?]uhAMhBhhC]ro hLXBelow are direct download links and install instructions for IPUMM 3.00.09.01 build tools. When installing the tools, it is preferable to install all the tools to the same directory, e.g., /opt/ti.rp rq }rr (h.jm h/jk ubaubhr)rs }rt (h.Uh/h1h3h4h5huh7}ru (hwX-h<]h;]h9]h:]h?]uhAMhBhhC]rv (hy)rw }rx (h.XDownload and untar `codec\_engine\_3\_24\_00\_08,lite.tar.gz `__h/js h3h4h5h|h7}ry (h9]h:]h;]h<]h?]uhANhBhhC]rz hh)r{ }r| (h.XDownload and untar `codec\_engine\_3\_24\_00\_08,lite.tar.gz `__h/jw h3h4h5hlh7}r} (h9]h:]h;]h<]h?]uhAMhC]r~ (hLXDownload and untar r r }r (h.XDownload and untar h/j{ ubjl)r }r (h.X`codec\_engine\_3\_24\_00\_08,lite.tar.gz `__h7}r (UnameX#codec_engine_3_24_00_08,lite.tar.gzjX|http://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/ce/3_24_00_08/exports/codec_engine_3_24_00_08,lite.tar.gzh<]h;]h9]h:]h?]uh/j{ hC]r hLX#codec_engine_3_24_00_08,lite.tar.gzr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.XDownload and untar `framework\_components\_3\_40\_01\_04,lite.tar.gz `__h/js h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XDownload and untar `framework\_components\_3\_40\_01\_04,lite.tar.gz `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (hLXDownload and untar r r }r (h.XDownload and untar h/j ubjl)r }r (h.X`framework\_components\_3\_40\_01\_04,lite.tar.gz `__h7}r (UnameX+framework_components_3_40_01_04,lite.tar.gzjXhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/fc/3_40_01_04/exports/framework_components_3_40_01_04,lite.tar.gzh<]h;]h9]h:]h?]uh/j hC]r hLX+framework_components_3_40_01_04,lite.tar.gzr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.XDownload and unzip `ipc\_3\_40\_01\_08.zip `__h/js h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XDownload and unzip `ipc\_3\_40\_01\_08.zip `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (hLXDownload and unzip r r }r (h.XDownload and unzip h/j ubjl)r }r (h.X`ipc\_3\_40\_01\_08.zip `__h7}r (UnameXipc_3_40_01_08.zipjXlhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/ipc/3_40_01_08/exports/ipc_3_40_01_08.ziph<]h;]h9]h:]h?]uh/j hC]r hLXipc_3_40_01_08.zipr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.XDownload and untar `xdais\_7\_24\_00\_04.tar.gz `__h/js h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XDownload and untar `xdais\_7\_24\_00\_04.tar.gz `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (hLXDownload and untar r r }r (h.XDownload and untar h/j ubjl)r }r (h.X`xdais\_7\_24\_00\_04.tar.gz `__h7}r (UnameXxdais_7_24_00_04.tar.gzjXshttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/xdais/7_24_00_04/exports/xdais_7_24_00_04.tar.gzh<]h;]h9]h:]h?]uh/j hC]r hLXxdais_7_24_00_04.tar.gzr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.XDownload and install `bios\_setuplinux\_6\_42\_02\_29.bin `__h/js h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XDownload and install `bios\_setuplinux\_6\_42\_02\_29.bin `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (hLXDownload and install r r }r (h.XDownload and install h/j ubjl)r }r (h.X`bios\_setuplinux\_6\_42\_02\_29.bin `__h7}r (UnameXbios_setuplinux_6_42_02_29.binjXhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/bios/sysbios/6_42_02_29/exports/bios_setuplinux_6_42_02_29.binh<]h;]h9]h:]h?]uh/j hC]r hLXbios_setuplinux_6_42_02_29.binr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.XDownload and untar `xdctools\_3\_31\_02\_38\_core\_linux.zip `__h/js h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XDownload and untar `xdctools\_3\_31\_02\_38\_core\_linux.zip `__h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (hLXDownload and untar r r }r (h.XDownload and untar h/j ubjl)r }r (h.X`xdctools\_3\_31\_02\_38\_core\_linux.zip `__h7}r (UnameX"xdctools_3_31_02_38_core_linux.zipjXhttp://software-dl.ti.com/dsps/dsps_public_sw/sdo_sb/targetcontent/rtsc/3_31_02_38/exports/xdccore/xdctools_3_31_02_38_core_linux.ziph<]h;]h9]h:]h?]uh/j hC]r hLX"xdctools_3_31_02_38_core_linux.zipr r }r (h.Uh/j ubah5juubeubaubhy)r }r (h.X[Download and install `CCSv6 Build#6.1.1.00022 `__. Ensure that "TI ARM Compiler" is selected during the installation. After the installation, the compiler tools (version 5.2.5) are located at [ccs\_install\_dir]/ccsv6/tools/compiler/ti-cgt-arm\_5.2.5. h/js h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XZDownload and install `CCSv6 Build#6.1.1.00022 `__. Ensure that "TI ARM Compiler" is selected during the installation. After the installation, the compiler tools (version 5.2.5) are located at [ccs\_install\_dir]/ccsv6/tools/compiler/ti-cgt-arm\_5.2.5.h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhC]r (hLXDownload and install r r }r (h.XDownload and install h/j ubjl)r }r (h.X{`CCSv6 Build#6.1.1.00022 `__h7}r (UnameXCCSv6 Build#6.1.1.00022jX]http://processors.wiki.ti.com/index.php/Download_CCS#Code_Composer_Studio_Version_6_Downloadsh<]h;]h9]h:]h?]uh/j hC]r hLXCCSv6 Build#6.1.1.00022r r }r (h.Uh/j ubah5juubhLX. Ensure that "TI ARM Compiler" is selected during the installation. After the installation, the compiler tools (version 5.2.5) are located at [ccs_install_dir]/ccsv6/tools/compiler/ti-cgt-arm_5.2.5.r r }r (h.X. Ensure that "TI ARM Compiler" is selected during the installation. After the installation, the compiler tools (version 5.2.5) are located at [ccs\_install\_dir]/ccsv6/tools/compiler/ti-cgt-arm\_5.2.5.h/j ubeubaubeubh[)r }r (h.X Build IPUMMr h/h1h3h4h5h_h7}r (h<]r U build-ipummr ah;]h9]h:]h?]r hauhANhBhhC]r hLX Build IPUMMr r }r (h.j h/j ubaubh[)r }r (h.XSetup Environmentr h/h1h3h4h5h_h7}r (h<]r Usetup-environmentr ah;]h9]h:]h?]r hauhANhBhhC]r hLXSetup Environmentr r }r (h.j h/j ubaubhh)r }r (h.X+Export the following environment variables:r h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r hLX+Export the following environment variables:r r }r (h.j h/j ubaubjA)r }r (h.Xexport BIOSTOOLSROOT= export IPCSRC= export TMS470CGTOOLPATH=h/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r hLXexport BIOSTOOLSROOT= export IPCSRC= export TMS470CGTOOLPATH=r r }r (h.Uh/j ubaubhh)r }r (h.XWExample for IPUMM 3.00.09.01 assuming all the tools are installed to /opt/ti directory:r h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r! hLXWExample for IPUMM 3.00.09.01 assuming all the tools are installed to /opt/ti directory:r" r# }r$ (h.j h/j ubaubjA)r% }r& (h.Xexport BIOSTOOLSROOT=/opt/ti export IPCSRC=/opt/ti/ipc_3_40_01_08 export TMS470CGTOOLPATH=/opt/ti/ccsv6/tools/compiler/ti-cgt-arm_5.2.5h/h1h3h4h5jDh7}r' (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r( hLXexport BIOSTOOLSROOT=/opt/ti export IPCSRC=/opt/ti/ipc_3_40_01_08 export TMS470CGTOOLPATH=/opt/ti/ccsv6/tools/compiler/ti-cgt-arm_5.2.5r) r* }r+ (h.Uh/j% ubaubh[)r, }r- (h.X Build IPUMMr. h/h1h3h4h5h_h7}r/ (h<]r0 U build-ipumm-1r1 ah;]h9]h:]h?]r2 h auhANhBhhC]r3 hLX Build IPUMMr4 r5 }r6 (h.j. h/j, ubaubhh)r7 }r8 (h.X/Follow the steps below to build IPUMM firmware.r9 h/h1h3h4h5hlh7}r: (h9]h:]h;]h<]h?]uhAMhBhhC]r; hLX/Follow the steps below to build IPUMM firmware.r< r= }r> (h.j9 h/j7 ubaubjA)r? }r@ (h.X[export HWVERSION=ES10 cd ipumm make unconfig make vayu_smp_config make clean make ducatibinh/h1h3h4h5jDh7}rA (hUhVh<]h;]h9]h:]h?]uhAM hBhhC]rB hLX[export HWVERSION=ES10 cd ipumm make unconfig make vayu_smp_config make clean make ducatibinrC rD }rE (h.Uh/j? ubaubhh)rF }rG (h.XmAfter the build is completed, two different images will get created. Select the correct one for your devices.rH h/h1h3h4h5hlh7}rI (h9]h:]h;]h<]h?]uhAMhBhhC]rJ hLXmAfter the build is completed, two different images will get created. Select the correct one for your devices.rK rL }rM (h.jH h/jF ubaubjA)rN }rO (h.X * dra7-ipu2-fw.xem4: This firmware will be used for Linux or Android. The firmware is built with the resource table defined in platform/ti/dce/baseimage/custom_rsc_table_vayu_ipu.h The corresponding map file is: platform/ti/dce/baseimage/package/cfg/out/ipu/release/ipu.xem4.maph/h1h3h4h5jDh7}rP (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rQ hLX * dra7-ipu2-fw.xem4: This firmware will be used for Linux or Android. The firmware is built with the resource table defined in platform/ti/dce/baseimage/custom_rsc_table_vayu_ipu.h The corresponding map file is: platform/ti/dce/baseimage/package/cfg/out/ipu/release/ipu.xem4.maprR rS }rT (h.Uh/jN ubaubjA)rU }rV (h.X * dra7xx-m4-ipu2.xem4: This firmware will be used for QNX. The firmware is built with the resource table defined in platform/ti/dce/baseimage/qnx_custom_rsc_table_vayu_ipu.h The corresponding map file is: platform/ti/dce/baseimage/package/cfg/out/ipu/release/qnx_ipu.xem4.maph/h1h3h4h5jDh7}rW (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rX hLX * dra7xx-m4-ipu2.xem4: This firmware will be used for QNX. The firmware is built with the resource table defined in platform/ti/dce/baseimage/qnx_custom_rsc_table_vayu_ipu.h The corresponding map file is: platform/ti/dce/baseimage/package/cfg/out/ipu/release/qnx_ipu.xem4.maprY rZ }r[ (h.Uh/jU ubaubj)r\ }r] (h.Uh/h1h3h4h5j"h7}r^ (h9]h:]h;]h<]h?]uhAM!hBhhC]r_ j%)r` }ra (h.Uj(Kh/j\ h3h4h5hAh7}rb (h9]h:]h;]h<]h?]uhAKhBhhC]ubaubh[)rc }rd (h.XFirmware Loading and Unloadingre h/h1h3h4h5h_h7}rf (h<]rg Ufirmware-loading-and-unloadingrh ah;]h9]h:]h?]ri h!auhANhBhhC]rj hLXFirmware Loading and Unloadingrk rl }rm (h.je h/jc ubaubhh)rn }ro (h.X!The table below shows the remote cores and their corresponding definitions in the kernel dtsi files (``[ti-processor-sdk-linux-am57xx-evm-[ver]]/board-support/linux-[ver]/arch/arm/boot/dts/dra7.dtsi, and dra74x.dtsi``), as well as the argument to be used in the loading/unloading commands.h/h1h3h4h5hlh7}rp (h9]h:]h;]h<]h?]uhAM&hBhhC]rq (hLXeThe table below shows the remote cores and their corresponding definitions in the kernel dtsi files (rr rs }rt (h.XeThe table below shows the remote cores and their corresponding definitions in the kernel dtsi files (h/jn ubj)ru }rv (h.Xt``[ti-processor-sdk-linux-am57xx-evm-[ver]]/board-support/linux-[ver]/arch/arm/boot/dts/dra7.dtsi, and dra74x.dtsi``h7}rw (h9]h:]h;]h<]h?]uh/jn hC]rx hLXp[ti-processor-sdk-linux-am57xx-evm-[ver]]/board-support/linux-[ver]/arch/arm/boot/dts/dra7.dtsi, and dra74x.dtsiry rz }r{ (h.Uh/ju ubah5jubhLXH), as well as the argument to be used in the loading/unloading commands.r| r} }r~ (h.XH), as well as the argument to be used in the loading/unloading commands.h/jn ubeubj)r }r (h.Uh/h1h3h4h5jh7}r (h9]h:]h;]h<]h?]uhANhBhhC]r j)r }r (h.Uh7}r (h<]h;]h9]h:]h?]UcolsKuh/j hC]r (j)r }r (h.Uh7}r (h<]h;]h9]h:]h?]UcolwidthKuh/j hC]h5jubj)r }r (h.Uh7}r (h<]h;]h9]h:]h?]UcolwidthKuh/j hC]h5jubj)r }r (h.Uh7}r (h<]h;]h9]h:]h?]UcolwidthK%uh/j hC]h5jubj)r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r (j)r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r (j )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X**Remote Core**r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM,hC]r j)r }r (h.j h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLX Remote Corer r }r (h.Uh/j ubah5jubaubah5j ubj )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X**Definition in dtsi file**r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM,hC]r j)r }r (h.j h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXDefinition in dtsi filer r }r (h.Uh/j ubah5jubaubah5j ubj )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X!**Argument in loading/unloading**r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM,hC]r j)r }r (h.j h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXArgument in loading/unloadingr r }r (h.Uh/j ubah5jubaubah5j ubeh5j1ubj)r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r (j )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.XIPU1r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM.hC]r hLXIPU1r r }r (h.j h/j ubaubah5j ubj )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X ipu@58820000r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM.hC]r jl)r }r (h.j h7}r (UrefuriXmailto:ipu@58820000h<]h;]h9]h:]h?]uh/j hC]r hLX ipu@58820000r r }r (h.Uh/j ubah5juubaubah5j ubj )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X 58820000.ipur h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM.hC]r hLX 58820000.ipur r }r (h.j h/j ubaubah5j ubeh5j1ubj)r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r (j )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.XIPU2r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM0hC]r hLXIPU2r r }r (h.j h/j ubaubah5j ubj )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X ipu@55020000r h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM0hC]r jl)r }r (h.j h7}r (UrefuriXmailto:ipu@55020000h<]h;]h9]h:]h?]uh/j hC]r hLX ipu@55020000r r }r (h.Uh/j ubah5juubaubah5j ubj )r }r (h.Uh7}r (h9]h:]h;]h<]h?]uh/j hC]r hh)r }r (h.X 55020000.ipur h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM0hC]r hLX 55020000.ipur r }r (h.j h/j ubaubah5j ubeh5j1ubj)r }r! (h.Uh7}r" (h9]h:]h;]h<]h?]uh/j hC]r# (j )r$ }r% (h.Uh7}r& (h9]h:]h;]h<]h?]uh/j hC]r' hh)r( }r) (h.XDSP1r* h/j$ h3h4h5hlh7}r+ (h9]h:]h;]h<]h?]uhAM2hC]r, hLXDSP1r- r. }r/ (h.j* h/j( ubaubah5j ubj )r0 }r1 (h.Uh7}r2 (h9]h:]h;]h<]h?]uh/j hC]r3 hh)r4 }r5 (h.X dsp@40800000r6 h/j0 h3h4h5hlh7}r7 (h9]h:]h;]h<]h?]uhAM2hC]r8 jl)r9 }r: (h.j6 h7}r; (UrefuriXmailto:dsp@40800000h<]h;]h9]h:]h?]uh/j4 hC]r< hLX dsp@40800000r= r> }r? (h.Uh/j9 ubah5juubaubah5j ubj )r@ }rA (h.Uh7}rB (h9]h:]h;]h<]h?]uh/j hC]rC hh)rD }rE (h.X 40800000.dsprF h/j@ h3h4h5hlh7}rG (h9]h:]h;]h<]h?]uhAM2hC]rH hLX 40800000.dsprI rJ }rK (h.jF h/jD ubaubah5j ubeh5j1ubj)rL }rM (h.Uh7}rN (h9]h:]h;]h<]h?]uh/j hC]rO (j )rP }rQ (h.Uh7}rR (h9]h:]h;]h<]h?]uh/jL hC]rS hh)rT }rU (h.XDSP2rV h/jP h3h4h5hlh7}rW (h9]h:]h;]h<]h?]uhAM4hC]rX hLXDSP2rY rZ }r[ (h.jV h/jT ubaubah5j ubj )r\ }r] (h.Uh7}r^ (h9]h:]h;]h<]h?]uh/jL hC]r_ hh)r` }ra (h.X dsp@41000000rb h/j\ h3h4h5hlh7}rc (h9]h:]h;]h<]h?]uhAM4hC]rd jl)re }rf (h.jb h7}rg (UrefuriXmailto:dsp@41000000h<]h;]h9]h:]h?]uh/j` hC]rh hLX dsp@41000000ri rj }rk (h.Uh/je ubah5juubaubah5j ubj )rl }rm (h.Uh7}rn (h9]h:]h;]h<]h?]uh/jL hC]ro hh)rp }rq (h.X 41000000.dsprr h/jl h3h4h5hlh7}rs (h9]h:]h;]h<]h?]uhAM4hC]rt hLX 41000000.dspru rv }rw (h.jr h/jp ubaubah5j ubeh5j1ubeh5jubeh5jubaubhh)rx }ry (h.XdFor example, the argument of ``55020000.ipu`` corresponds to IPU2 as can be seen from ``dra7.dtsi``.h/h1h3h4h5hlh7}rz (h9]h:]h;]h<]h?]uhAM7hBhhC]r{ (hLXFor example, the argument of r| r} }r~ (h.XFor example, the argument of h/jx ubj)r }r (h.X``55020000.ipu``h7}r (h9]h:]h;]h<]h?]uh/jx hC]r hLX 55020000.ipur r }r (h.Uh/j ubah5jubhLX) corresponds to IPU2 as can be seen from r r }r (h.X) corresponds to IPU2 as can be seen from h/jx ubj)r }r (h.X ``dra7.dtsi``h7}r (h9]h:]h;]h<]h?]uh/jx hC]r hLX dra7.dtsir r }r (h.Uh/j ubah5jubhLX.r }r (h.X.h/jx ubeubjA)r }r (h.X;ipu2: ipu@55020000 { compatible = "ti,dra7-rproc-ipu";h/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAM<hBhhC]r hLX;ipu2: ipu@55020000 { compatible = "ti,dra7-rproc-ipu";r r }r (h.Uh/j ubaubhh)r }r (h.XIn the sections below, ``55020000.ipu`` will be used as the example. For a specific use case, please select the corresponding argument which is applicable.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM?hBhhC]r (hLXIn the sections below, r r }r (h.XIn the sections below, h/j ubj)r }r (h.X``55020000.ipu``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLX 55020000.ipur r }r (h.Uh/j ubah5jubhLXt will be used as the example. For a specific use case, please select the corresponding argument which is applicable.r r }r (h.Xt will be used as the example. For a specific use case, please select the corresponding argument which is applicable.h/j ubeubh[)r }r (h.X,Unloading and loading remotecores at runtimer h/h1h3h4h5h_h7}r (h<]r U,unloading-and-loading-remotecores-at-runtimer ah;]h9]h:]h?]r hauhANhBhhC]r hLX,Unloading and loading remotecores at runtimer r }r (h.j h/j ubaubhh)r }r (h.XeIt is possible to unload and reload a remotecore at runtime from Linux using the ``sysfs`` interface.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMFhBhhC]r (hLXQIt is possible to unload and reload a remotecore at runtime from Linux using the r r }r (h.XQIt is possible to unload and reload a remotecore at runtime from Linux using the h/j ubj)r }r (h.X ``sysfs``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXsysfsr r }r (h.Uh/j ubah5jubhLX interface.r r }r (h.X interface.h/j ubeubjA)r }r (h.Xwtarget $ cd /sys/bus/platform/drivers/omap-rproc/ target $ echo 55020000.ipu > unbind target $ echo 55020000.ipu > bindh/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMKhBhhC]r hLXwtarget $ cd /sys/bus/platform/drivers/omap-rproc/ target $ echo 55020000.ipu > unbind target $ echo 55020000.ipu > bindr r }r (h.Uh/j ubaubhh)r }r (h.XThe ``echo 55020000.ipu > unbind`` command tears down the communication channels between the A15 and the remotecore and unloads the remotecore. Any application level shutdown that needs to be performed needs to be handled by the system integrator.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMOhBhhC]r (hLXThe r r }r (h.XThe h/j ubj)r }r (h.X``echo 55020000.ipu > unbind``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXecho 55020000.ipu > unbindr r }r (h.Uh/j ubah5jubhLX command tears down the communication channels between the A15 and the remotecore and unloads the remotecore. Any application level shutdown that needs to be performed needs to be handled by the system integrator.r r }r (h.X command tears down the communication channels between the A15 and the remotecore and unloads the remotecore. Any application level shutdown that needs to be performed needs to be handled by the system integrator.h/j ubeubhh)r }r (h.X[The ``echo 55020000.ipu > bind`` loads the appropriate firmware binary onto the remotecore.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMThBhhC]r (hLXThe r r }r (h.XThe h/j ubj)r }r (h.X``echo 55020000.ipu > bind``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXecho 55020000.ipu > bindr r }r (h.Uh/j ubah5jubhLX; loads the appropriate firmware binary onto the remotecore.r r }r (h.X; loads the appropriate firmware binary onto the remotecore.h/j ubeubh[)r }r (h.X)Changing the remotecore binary at runtimer h/h1h3h4h5h_h7}r (h<]r U)changing-the-remotecore-binary-at-runtimer ah;]h9]h:]h?]r hauhANhBhhC]r hLX)Changing the remotecore binary at runtimer r }r (h.j h/j ubaubhh)r }r (h.X*To change the remotecore binary at runtimer h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMZhBhhC]r hLX*To change the remotecore binary at runtimer r }r (h.j h/j ubaubj)r }r (h.Uh/h1h3h4h5jh7}r (jU.h<]h;]h9]jUh:]h?]jjuhAM\hBhhC]r (hy)r }r (h.X'Unload the remotecore using ``unbind``.r h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.j h/j h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAM\hC]r (hLXUnload the remotecore using r r }r (h.XUnload the remotecore using h/j ubj)r }r (h.X ``unbind``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXunbindr r }r (h.Uh/j ubah5jubhLX.r }r (h.X.h/j ubeubaubhy)r }r (h.XtChange the remotecore binary in the firmware folder. Default location is ``/lib/firmware`` on the target filesystem.h/j h3h4h5h|h7}r (h9]h:]h;]h<]h?]uhANhBhhC]r hh)r }r (h.XtChange the remotecore binary in the firmware folder. Default location is ``/lib/firmware`` on the target filesystem.h/j h3h4h5hlh7}r! (h9]h:]h;]h<]h?]uhAM]hC]r" (hLXIChange the remotecore binary in the firmware folder. Default location is r# r$ }r% (h.XIChange the remotecore binary in the firmware folder. Default location is h/j ubj)r& }r' (h.X``/lib/firmware``h7}r( (h9]h:]h;]h<]h?]uh/j hC]r) hLX /lib/firmwarer* r+ }r, (h.Uh/j& ubah5jubhLX on the target filesystem.r- r. }r/ (h.X on the target filesystem.h/j ubeubaubhy)r0 }r1 (h.X$Load the remotecore using ``bind``. h/j h3h4h5h|h7}r2 (h9]h:]h;]h<]h?]uhANhBhhC]r3 hh)r4 }r5 (h.X#Load the remotecore using ``bind``.r6 h/j0 h3h4h5hlh7}r7 (h9]h:]h;]h<]h?]uhAM_hC]r8 (hLXLoad the remotecore using r9 r: }r; (h.XLoad the remotecore using h/j4 ubj)r< }r= (h.X``bind``h7}r> (h9]h:]h;]h<]h?]uh/j4 hC]r? hLXbindr@ rA }rB (h.Uh/j< ubah5jubhLX.rC }rD (h.X.h/j4 ubeubaubeubjA)rE }rF (h.Xtarget $ cd /sys/bus/platform/drivers/omap-rproc/ target $ echo 55020000.ipu > unbind target $ cp /home/root/new-binary.xem4 /lib/firmware/dra7-ipu2-fw.xem4 target $ echo 55020000.ipu > bindh/h1h3h4h5jDh7}rG (hUhVh<]h;]h9]h:]h?]uhAMchBhhC]rH hLXtarget $ cd /sys/bus/platform/drivers/omap-rproc/ target $ echo 55020000.ipu > unbind target $ cp /home/root/new-binary.xem4 /lib/firmware/dra7-ipu2-fw.xem4 target $ echo 55020000.ipu > bindrI rJ }rK (h.Uh/jE ubaubhh)rL }rM (h.XIf it is desirable to avoid overwriting the existing remote binaries, the method of symbolic links can be used instead of direct copy. For example, Processor SDK provides two types of DSP remotecore binaries: one for DSPDCE (dra7-dsp1-fw.xe66.dspdce-fw) and another one for OpenCL (dra7-dsp1-fw.xe66.opencl-monitor). dra7-dsp1-fw.xe66 is created as a symbolic link by default pointing to the OpenCL binary. When it is needed to switch to DSPDCE, the symbolic link of dra7-dsp1-fw.xe66 can be updated pointing to dra7-dsp1-fw.xe66.dspdce-fw.rN h/h1h3h4h5hlh7}rO (h9]h:]h;]h<]h?]uhAMhhBhhC]rP hLXIf it is desirable to avoid overwriting the existing remote binaries, the method of symbolic links can be used instead of direct copy. For example, Processor SDK provides two types of DSP remotecore binaries: one for DSPDCE (dra7-dsp1-fw.xe66.dspdce-fw) and another one for OpenCL (dra7-dsp1-fw.xe66.opencl-monitor). dra7-dsp1-fw.xe66 is created as a symbolic link by default pointing to the OpenCL binary. When it is needed to switch to DSPDCE, the symbolic link of dra7-dsp1-fw.xe66 can be updated pointing to dra7-dsp1-fw.xe66.dspdce-fw.rQ rR }rS (h.jN h/jL ubaubjA)rT }rU (h.Xtarget $ cd /sys/bus/platform/drivers/omap-rproc/ target $ echo 40800000.dsp > unbind target $ rm /lib/firmware/dra7-dsp1-fw.xe66 target $ ln -s /lib/firmware/dra7-dsp1-fw.xe66.dspdce-fw /lib/firmware/dra7-dsp1-fw.xe66 target $ echo 40800000.dsp > bindh/h1h3h4h5jDh7}rV (hUhVh<]h;]h9]h:]h?]uhAMshBhhC]rW hLXtarget $ cd /sys/bus/platform/drivers/omap-rproc/ target $ echo 40800000.dsp > unbind target $ rm /lib/firmware/dra7-dsp1-fw.xe66 target $ ln -s /lib/firmware/dra7-dsp1-fw.xe66.dspdce-fw /lib/firmware/dra7-dsp1-fw.xe66 target $ echo 40800000.dsp > bindrX rY }rZ (h.Uh/jT ubaubhh)r[ }r\ (h.XAfter the switch, copycodectest application can be run to verify that DSPDCE firmware is loaded. This application fills the input buffer with a number entered as the argument and after process the output buffer is tested for the same pattern.r] h/h1h3h4h5hlh7}r^ (h9]h:]h;]h<]h?]uhAMyhBhhC]r_ hLXAfter the switch, copycodectest application can be run to verify that DSPDCE firmware is loaded. This application fills the input buffer with a number entered as the argument and after process the output buffer is tested for the same pattern.r` ra }rb (h.j] h/j[ ubaubhh)rc }rd (h.Xusage: copycodectest pattern.re h/h1h3h4h5hlh7}rf (h9]h:]h;]h<]h?]uhAM~hBhhC]rg hLXusage: copycodectest pattern.rh ri }rj (h.je h/jc ubaubhh)rk }rl (h.XExample:rm h/h1h3h4h5hlh7}rn (h9]h:]h;]h<]h?]uhAMhBhhC]ro hLXExample:rp rq }rr (h.jm h/jk ubaubjA)rs }rt (h.Xtarget # copycodectest 123h/h1h3h4h5jDh7}ru (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]rv hLXtarget # copycodectest 123rw rx }ry (h.Uh/js ubaubhh)rz }r{ (h.XSample console output:r| h/h1h3h4h5hlh7}r} (h9]h:]h;]h<]h?]uhAMhBhhC]r~ hLXSample console output:r r }r (h.j| h/jz ubaubjA)r }r (h.Xroot@am57xx-evm:~# copycodectest 123 0x22070: Opening Engine.. Created dsp_universalCopy Fill input buffer with pattern 123 Verifing the UniversalCopy algorithm copycodectest executed successfullyh/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r hLXroot@am57xx-evm:~# copycodectest 123 0x22070: Opening Engine.. Created dsp_universalCopy Fill input buffer with pattern 123 Verifing the UniversalCopy algorithm copycodectest executed successfullyr r }r (h.Uh/j ubaubh[)r }r (h.X7Loading firmware during initial boot without using udevr h/h1h3h4h5h_h7}r (h<]r U7loading-firmware-during-initial-boot-without-using-udevr ah;]h9]h:]h?]r hauhANhBhhC]r hLX7Loading firmware during initial boot without using udevr r }r (h.j h/j ubaubhh)r }r (h.XkDuring the default boot, firmware is supplied to the kernel by ``udev``. Starting the ``udev`` service on boot causes a few seconds increase in boot time. In cases where a quick boot is required, the user may not start the ``udev`` service in boot. In such cases, firmware can be supplied to the kernel using the sysfs interface. An example script is shown below.h/h1h3h4h5hlh7}r (h9]h:]h;]h<]h?]uhAMhBhhC]r (hLX?During the default boot, firmware is supplied to the kernel by r r }r (h.X?During the default boot, firmware is supplied to the kernel by h/j ubj)r }r (h.X``udev``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXudevr r }r (h.Uh/j ubah5jubhLX. Starting the r r }r (h.X. Starting the h/j ubj)r }r (h.X``udev``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXudevr r }r (h.Uh/j ubah5jubhLX service on boot causes a few seconds increase in boot time. In cases where a quick boot is required, the user may not start the r r }r (h.X service on boot causes a few seconds increase in boot time. In cases where a quick boot is required, the user may not start the h/j ubj)r }r (h.X``udev``h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLXudevr r }r (h.Uh/j ubah5jubhLX service in boot. In such cases, firmware can be supplied to the kernel using the sysfs interface. An example script is shown below.r r }r (h.X service in boot. In such cases, firmware can be supplied to the kernel using the sysfs interface. An example script is shown below.h/j ubeubjA)r }r (h.XFW_NAMES="dra7-dsp1-fw.xe66 dra7-dsp2-fw.xe66 dra7-ipu1-fw.xem4 dra7-ipu2-fw.xem4" for FW in $FW_NAMES ; do echo 1 > /sys/class/firmware/$FW/loading cat /lib/firmware/$FW > /sys/class/firmware/$FW/data echo 0 > /sys/class/firmware/$FW/loading doneh/h1h3h4h5jDh7}r (hUhVh<]h;]h9]h:]h?]uhAMhBhhC]r hLXFW_NAMES="dra7-dsp1-fw.xe66 dra7-dsp2-fw.xe66 dra7-ipu1-fw.xem4 dra7-ipu2-fw.xem4" for FW in $FW_NAMES ; do echo 1 > /sys/class/firmware/$FW/loading cat /lib/firmware/$FW > /sys/class/firmware/$FW/data echo 0 > /sys/class/firmware/$FW/loading doner r }r (h.Uh/j ubaubeubh3h4h5Usystem_messager h7}r (h9]UlevelKh<]h;]Usourceh4h:]h?]UlineKUtypeUINFOr uhAMhBhhC]r hh)r }r (h.X:Enumerated list start value not ordinal-1: "4" (ordinal 4)h7}r (h9]h:]h;]h<]h?]uh/h,hC]r hLX:Enumerated list start value not ordinal-1: "4" (ordinal 4)r r }r (h.Uh/j ubah5hlubaubh+)r }r (h.Uh/h1h3h4h5j h7}r (h9]UlevelKh<]h;]Usourceh4h:]h?]UlineKUtypej uhAMhBhhC]r hh)r }r (h.X:Enumerated list start value not ordinal-1: "5" (ordinal 5)h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLX:Enumerated list start value not ordinal-1: "5" (ordinal 5)r r }r (h.Uh/j ubah5hlubaubh+)r }r (h.Uh/h1h3h4h5j h7}r (h9]UlevelKh<]h;]Usourceh4h:]h?]UlineKUtypej uhAMhBhhC]r hh)r }r (h.X:Enumerated list start value not ordinal-1: "6" (ordinal 6)h7}r (h9]h:]h;]h<]h?]uh/j hC]r hLX:Enumerated list start value not ordinal-1: "6" (ordinal 6)r r }r (h.Uh/j ubah5hlubaubeUcurrent_sourcer NU decorationr NUautofootnote_startr KUnameidsr }r (hjhj hj@h jh jsh j+h jh j1 hjhh>hjhj hj/hj*hjhjU hjhj hj hjhjhjh hjthj hj`hj h hbh!jh h"jh#jh$jh%j5h&juhC]r h1ah.UU transformerr NU footnote_refsr }r Urefnamesr }r Usymbol_footnotesr ]r Uautofootnote_refsr ]r Usymbol_footnote_refsr ]r U citationsr ]r hBhU current_liner NUtransform_messagesr ]r Ureporterr NUid_startr KU autofootnotesr ]r U citation_refsr }r Uindirect_targetsr ]r Usettingsr (cdocutils.frontend Values ror}r(Ufootnote_backlinksrKUrecord_dependenciesrNU rfc_base_urlrUhttps://tools.ietf.org/html/rU tracebackrUpep_referencesrNUstrip_commentsr NU toc_backlinksr j U language_coder Uenr U datestampr NU report_levelrKU _destinationrNU halt_levelrKU strip_classesrNhINUerror_encoding_error_handlerrUbackslashreplacerUdebugrNUembed_stylesheetrUoutput_encoding_error_handlerrUstrictrU sectnum_xformrKUdump_transformsrNU docinfo_xformrKUwarning_streamrNUpep_file_url_templaterUpep-%04drUexit_status_levelrKUconfigrNUstrict_visitorr NUcloak_email_addressesr!Utrim_footnote_reference_spacer"Uenvr#NUdump_pseudo_xmlr$NUexpose_internalsr%NUsectsubtitle_xformr&U source_linkr'NUrfc_referencesr(NUoutput_encodingr)Uutf-8r*U source_urlr+NUinput_encodingr,U utf-8-sigr-U_disable_configr.NU id_prefixr/UU tab_widthr0KUerror_encodingr1UUTF-8r2U_sourcer3h4Ugettext_compactr4U generatorr5NUdump_internalsr6NU smart_quotesr7U pep_base_urlr8U https://www.python.org/dev/peps/r9Usyntax_highlightr:Ulongr;Uinput_encoding_error_handlerr<jUauto_id_prefixr=Uidr>Udoctitle_xformr?Ustrip_elements_with_classesr@NU _config_filesrA]Ufile_insertion_enabledrBU raw_enabledrCKU dump_settingsrDNubUsymbol_footnote_startrEKUidsrF}rG(jjj j j@j;jjjsjnj+j&jjj1 j, jjh>h1jjj j j/j*j*j%jjjU jP jjj j j j jjjjjh jc jtjoj j j`j[j j hbh\jh jc jjjjjjj5j0jjuUsubstitution_namesrH}rIh5hBh7}rJ(h9]h<]h;]Usourceh4h:]h?]uU footnotesrK]rLUrefidsrM}rNub.