使用 Ultrascal+ 高效實現具有圖像處理 IP 核的圖像處理流水線系統。

本項目用到的品臺

硬件組件

Digilent Genesys ZU ?×1（FPGA平臺）Digilent PCAM5 ×1（MIPI攝像頭）

軟件組件

AMD-Xilinx Vivado 設計套件

介紹

從簡單的嵌入式視覺到自動駕駛汽車和無人機，圖像處理是許多應用的核心。Xilinx MPSoC 具有內置的 DisplayPort（DP） 功能，并在可編程邏輯 IO 中支持 MIPI DPhy，從這兩方面看，這是一個出色的嵌入式視覺平臺。

同時使用人工智能和機器學習功能使我們能夠創建一個復雜的嵌入式視覺處理系統。

在這個項目中，我們將探索使用 PCAM（FMC擴展板） 和 Display Port 建立和運行圖像處理。然后，我們可以添加圖像處理 IP 內核以進一步展示FPGA的處理圖像的能力。

可編程邏輯設計（PL端設計）

在我們的設計中，我們將包括以下 IP

Zynq MPSoC Processing System - 啟用 DisplayPort、I2C 和 GPIO EMIO

MIPI CSI2 RX Sub System - 從 PCAM 接收 MIPI CSI2 流。

Sensor Demosaic - 將 RAW 像素格式轉換為 RGB 像素格式。

Gamma LUT - gamma圖像校正

VDMA - 將映像寫入PS中的 DDR 內存

Video Timing Generator - 生成輸出視頻時序

AXIS to Video Out - 從 AXI 流轉換為視頻流

Clock Wizards - 用于生成視頻像素時鐘和 MIPI CSI2 參考時鐘

除了 IP，我們還需要考慮時鐘架構，對于這個解決方案，我們設計了以下時鐘樹：

AXI 時鐘 - 150 MHz - 這為 AXI Stream 和 AXI lite 接口提供時鐘

DPHY 參考時鐘 - 200 MHz - 由Clock Wizards生成

Pixel Clock - 74.25 Mhz - 用于 1280 x 720 60 FPS - 由Clock Wizards生成

完成的框圖應如下所示，內核配置如下所示。

為了控制和配置 PCAM5（FMC-MIPI擴展板），我們使用 I2C 和 GPIO，GPIO 信號用于啟用 PCAM5 并為其供電。而 I2C 用于配置 PCAM5 本身。

我們可以使用EMIO GPIO將處理器 GPIO 擴展到可編程邏輯。雖然 I2C 由 PS IIC0 提供，但是我們需要在應用程序軟件中配置器啟用。

要啟用 MPSoC 中的顯示端口，我們需要在 I/O 配置頁面下配置 DisplayPort 外設。硬件上使用了 ?Bank 505 的MGT。

我們還需要配置通過 EMIO 連接到 PL 的輔助引腳。這意味著我們需要以不同于 PS 中的 MIO 的方式處理它們，輔助輸出使能引腳低電平有效，因此我們需要在使用 EMIO 時對信號使用反相器。

配置好 DisplayPort 后，我們就可以啟用 PL 的實時視頻輸入。這在 PS-PL 配置下可用。

最后配置是設置 GPIO 以提供一個 1 位的 EMIO，這樣我們就可以打開和關閉 PCAM5。

Sensor將通過 I2C 進行配置，最后通過兩個 MIPI 通道以 280 Mbps 的數據速率輸出 10 位 RAW 視頻。

因此，我們需要配置 MIPI CSI-2 RX 子系統

由于我們只有一個 MIPI 接口，我們將配置 MIPI 內核以包含所有共享邏輯。如果我們在同一個 bank 上有多個 MIPI 接口，則下一個 MIPI 接口將被配置為使用示例設計中的共享邏輯。

MIPI 接口的最終設置是為 MIPI 通道和時鐘選擇 IO bank 和引腳分配。正如我們在這里定義的那樣，我們不需要將它們添加到定義引腳位置的 XDC 文件中。

創建可用圖像的下一步是轉換原始圖像，其中包含有關每個像素一個顏色通道的信息。

在包含紅色、綠色和藍色元素的圖像中，這稱為去拜耳化，由 Sensor Demosaic IP 塊實現。

對于我們的應用程序，PCAM5 將以以下格式輸出像素 BGBG/GRGR

綠色是紅色和藍色的兩倍，因為我們的眼睛對綠色更敏感，如果可見光譜位于中間，則綠色比位于兩端的紅色和藍色更敏感。

處理的下一步是實現Gamma校正 IP 內核

最后一個階段是插入一個VDMA，這將使視頻數據能夠從 PS DDR 寫入到內存中。

為了向顯示端口提供輸出視頻的時序，我們在發生器模式下使用VTC。

最后階段是 AXIS 到視頻輸出 IP，這將采用視頻時序控制器、時序信號和 AXI 視頻流來創建具有正確時序的輸出視頻。

其輸出將連接到顯示端口視頻實時輸入。

這需要一點思考，實時視頻輸入具有 36 位視頻輸入，像素的每個元素為 12 位。我們正在使用每個元素 10 位，這使其整體為 30 位。

通過填充 LSB，到視頻輸出的 AXIS 流將按比例放大輸出塊，從每像素 30 位到每像素 36 位。

確保 AXIS 到 Video Out IP 內核輸出的顏色通道與 DisplayPort 實時視頻輸入正確對齊。最簡單的方法是在 AXI Stream 中使用 AXIS 子集轉換器根據需要切換顏色通道。

為了幫助調試和理解設計，我還在設計中包含了幾個集成邏輯分析儀。

隨著設計的完成，我們現在可以構建硬件設計并使用 SDK 實現軟件應用程序。

軟件開發

完成硬件設計后，下一步是編寫將在可編程邏輯中配置 IP 的軟件。此配置將允許他們通過視頻，可以顯示在 DisplayPort 監視器上。

因此，我們的應用軟件將執行以下步驟

配置 GPIO 并啟用 PCAM5 電源

將 Video Mode 1280 x 720 設置為 60 FPS 并配置VTC

3）配置VDMA幀大小和內存存儲

配置 Senso Demosaic

配置伽瑪校正

使用 I2C 鏈路配置 PCAM5

啟用從 VDMA 讀取和寫入幀緩沖區

設置顯示端口

就像我們處理其他項目一樣，我們需要導入硬件規范、創建應用程序和 BSP。

為了能夠在顯示端口上使用實時視頻源，我們需要首先更新 BSP 設置并重新生成它。

在 BSP 設置中將 avbuf 更改為 dppsu 并等待 BSP 重新生成。

正確配置 BSP 后，我們可以創建應用程序代碼。BSP 將提供使用 PL 中的 IP 塊所需的所有 API 函數。

主要應用如下

?

#include?
#include?"platform.h"
#include?"xil_printf.h"
#include?"xvtc.h"
#include?"vga_modes.h"
#include?"xv_tpg.h"
#include?"xvidc.h"
#include?"xavbuf.h"
#include?"xavbuf_clk.h"
#include?"xvidc.h"
#include?"xdpdma_video_example.h"
#include?"xiicps.h"
#include?"i2c.h"
#include?"xaxivdma.h"
#include?"xaxivdma_i.h"
#include?"xgpiops.h"
#include?"xv_demosaic.h"
#include?"xv_gamma_lut.h"
#include?"math.h"
XVtc?VtcInst;
XVtc_Config?*vtc_config?;
XV_tpg?tpg;
XV_tpg_Config?*tpg_config;
XIicPs??iic_cam;
XAxiVdma?vdma;
XAxiVdma_DmaSetup?vdmaDMA;
XAxiVdma_Config?*vdmaConfig;
XGpioPs?gp_cam;
VideoMode?video;
XV_demosaic?cfa;
XV_gamma_lut?gamma_inst;
u8?SendBuffer?[10];
u8?RecvBuffer?[10];
u16?gamma_reg[1024];
#define?DEMO_MAX_FRAME?(720*1280)
#define?DEMO_STRIDE?(1280*2)
#define?DISPLAY_NUM_FRAMES?3
#define?IIC_cam????XPAR_XIICPS_0_DEVICE_ID
#define?cam_gpio????XPAR_XGPIOPS_0_DEVICE_ID
#define?CAM_ID??????????????0x78
#define?IIC_CAM_ADDR????0x3c
#define?IIC_SCLK_RATE??100000
#define?MUX_ADDR???0x70
void?detect_camera();
int??Initial_setting_1?(?u32?*cfg_init?,?int?cfg_init_QTY??);
void?read_camera();
void?gamma_calc(float?gamma_val);
u32?frameBuf[DISPLAY_NUM_FRAMES][DEMO_MAX_FRAME];
u32?*pFrames[DISPLAY_NUM_FRAMES];
int?main()
{
XVtc_Timing?vtcTiming;
XVtc_SourceSelect?SourceSelect;
XGpioPs_Config?*GPIO_Config;
int?Status;
init_platform();
disable_caches();
print("Hello?World

");
vtc_config?=?XVtc_LookupConfig(XPAR_VTC_0_DEVICE_ID);
XVtc_CfgInitialize(&VtcInst,?vtc_config,?vtc_config->BaseAddress);
GPIO_Config?=?XGpioPs_LookupConfig(cam_gpio);
Status=?XGpioPs_CfgInitialize(&gp_cam,GPIO_Config,GPIO_Config->BaseAddr);
XGpioPs_SetOutputEnablePin(&gp_cam,78,1);
XGpioPs_SetDirectionPin(&gp_cam,78,1);
XGpioPs_WritePin(&gp_cam,78,0x0);
usleep(2000000);
XGpioPs_WritePin(&gp_cam,78,0x1);
video?=?VMODE_1280x720;
vtcTiming.HActiveVideo?=?video.width;?/**BaseAddress);
//video?=?VMODE_1280x720;
vdmaDMA.FrameDelay?=?0;
vdmaDMA.EnableCircularBuf?=?1;
vdmaDMA.EnableSync?=?0;
vdmaDMA.PointNum?=?0;
vdmaDMA.EnableFrameCounter?=?0;
vdmaDMA.VertSizeInput?=?video.height;
vdmaDMA.HoriSizeInput?=?(video.width)*4;
vdmaDMA.FixedFrameStoreAddr?=?0;
vdmaDMA.FrameStoreStartAddr[0]?=?(u32)??pFrames[0];
vdmaDMA.Stride?=?(video.width)*4;
XAxiVdma_DmaConfig(&vdma,?XAXIVDMA_WRITE,?&(vdmaDMA));
Status?=?XAxiVdma_DmaSetBufferAddr(&vdma,?XAXIVDMA_WRITE,vdmaDMA.FrameStoreStartAddr);
XAxiVdma_DmaConfig(&vdma,?XAXIVDMA_READ,?&(vdmaDMA));
XAxiVdma_DmaSetBufferAddr(&vdma,?XAXIVDMA_READ,vdmaDMA.FrameStoreStartAddr);
XV_demosaic_Initialize(&cfa,?XPAR_V_DEMOSAIC_0_DEVICE_ID);
XV_demosaic_Set_HwReg_width(&cfa,?video.width);
XV_demosaic_Set_HwReg_height(&cfa,?video.height);
XV_demosaic_Set_HwReg_bayer_phase(&cfa,?0x03);
XV_demosaic_EnableAutoRestart(&cfa);
XV_demosaic_Start(&cfa);
gamma_calc(1.6);
XV_gamma_lut_Initialize(&gamma_inst,?XPAR_V_GAMMA_LUT_0_DEVICE_ID);
XV_gamma_lut_Set_HwReg_width(&gamma_inst,?video.width);
XV_gamma_lut_Set_HwReg_height(&gamma_inst,?video.height);
XV_gamma_lut_Set_HwReg_video_format(&gamma_inst,?0x00);
XV_gamma_lut_Write_HwReg_gamma_lut_0_Bytes(&gamma_inst,?0,(int?*)?gamma_reg,?2048);
XV_gamma_lut_Write_HwReg_gamma_lut_1_Bytes(&gamma_inst,?0,(int?*)?gamma_reg,?2048);
XV_gamma_lut_Write_HwReg_gamma_lut_2_Bytes(&gamma_inst,?0,(int?*)?gamma_reg,?2048);
XV_gamma_lut_Start(&gamma_inst);
XV_gamma_lut_EnableAutoRestart(&gamma_inst);
detect_camera();
SendBuffer[0]=?0x31;
SendBuffer[1]=?0x03;
SendBuffer[2]=?0x11;
Status?=?XIicPs_MasterSendPolled(&iic_cam,?SendBuffer,?3,?IIC_CAM_ADDR);
//writeReg(0x3103,?0x11);
//[7]=1?Software?reset;?[6]=0?Software?power?down;?Default=0x02
SendBuffer[0]=?0x30;
SendBuffer[1]=?0x08;
SendBuffer[2]=?0x82;
Status?=?XIicPs_MasterSendPolled(&iic_cam,?SendBuffer,?3,?IIC_CAM_ADDR);
//writeReg(0x3008,?0x82);
usleep(1000000);
Initial_setting_1?(?cfg_init?,?63??);
Initial_setting_1?(?cfg_simple_awb,?19??);
Initial_setting_1?(?cfg_720p_60fps?,?38??);
xil_printf("Configuration?Complete

");
Status?=?XAxiVdma_DmaStart(&vdma,?XAXIVDMA_WRITE);
Status?=?XAxiVdma_StartParking(&vdma,?0,?XAXIVDMA_WRITE);
XAxiVdma_DmaStart(&vdma,?XAXIVDMA_READ);
XAxiVdma_StartParking(&vdma,?0,?XAXIVDMA_READ);
run_dppsu();
while(1){
}
cleanup_platform();
return?0;
}
void?gamma_calc(float?gamma_val)
{
int?i;
for(i?=?0;?i<1024;?i++){
gamma_reg[i]?=?(pow((i?/?1024.0),?(1/gamma_val))?*?1024.0);
}
}
void?setup_tpg()
{
u32?height,width,status;
tpg_config?=?XV_tpg_LookupConfig(XPAR_XV_TPG_0_DEVICE_ID);
XV_tpg_CfgInitialize(&tpg,?tpg_config,?tpg_config->BaseAddress);
#ifdef?DEBUG
status?=?XV_tpg_IsReady(&tpg);
printf("TPG?Status?%u?

",?(unsigned?int)?status);
#endif
XV_tpg_Set_height(&tpg,?(u32)?video.height);
XV_tpg_Set_width(&tpg,?(u32)?video.width);
height?=?XV_tpg_Get_height(&tpg);
width?=?XV_tpg_Get_width(&tpg);
XV_tpg_Set_colorFormat(&tpg,XVIDC_CSF_RGB);
XV_tpg_Set_maskId(&tpg,?0x0);
XV_tpg_Set_motionSpeed(&tpg,?0x4);
#ifdef?DEBUG
printf("info?from?tpg?%u?%u?

",?(unsigned?int)height,?(unsigned?int)width);
#endif
XV_tpg_Set_bckgndId(&tpg,XTPG_BKGND_SOLID_BLUE);?//XTPG_BKGND_TARTAN_COLOR_BARS);
#ifdef?DEBUG
status?=?XV_tpg_Get_bckgndId(&tpg);
printf("Status?%x?

",?(unsigned?int)?status);
#endif
XV_tpg_EnableAutoRestart(&tpg);
XV_tpg_Start(&tpg);
#ifdef?DEBUG
status?=?XV_tpg_IsIdle(&tpg);
printf("Status?%u?

",?(unsigned?int)?status);
#endif
}
void?detect_camera()
{
XIicPs_Config?*iic_conf;
u32?Status;
iic_conf?=?XIicPs_LookupConfig(IIC_cam);
XIicPs_CfgInitialize(&iic_cam,iic_conf,iic_conf->BaseAddress);
XIicPs_SetSClk(&iic_cam,?IIC_SCLK_RATE);
SendBuffer[0]=?0x01;
SendBuffer[1]=?0x00;
Status?=?XIicPs_MasterSendPolled(&iic_cam,?SendBuffer,?1,?MUX_ADDR);
if?(Status?!=?XST_SUCCESS)?{
print("SW?I2C?write?error

");
return?XST_FAILURE;
}
usleep(2000000);
SendBuffer[0]=?0x31;
SendBuffer[1]=?0x00;
Status?=?XIicPs_MasterSendPolled(&iic_cam,?SendBuffer,?2,?IIC_CAM_ADDR);
if?(Status?!=?XST_SUCCESS)?{
print("I2C?write?error

");
return?XST_FAILURE;
}
Status?=?XIicPs_MasterRecvPolled(&iic_cam,?RecvBuffer,1,?IIC_CAM_ADDR);
if?(Status?!=?XST_SUCCESS)?{
print("I2C?read?error

");
return?XST_FAILURE;
}
if(RecvBuffer[0]?!=?CAM_ID?){
print("Camera?not?detected

");
}
else{
print("Camera?detected?

");
}
}
void?read_camera()
{
XIicPs_Config?*iic_conf;
u32?Status;
iic_conf?=?XIicPs_LookupConfig(IIC_cam);
XIicPs_CfgInitialize(&iic_cam,iic_conf,iic_conf->BaseAddress);
XIicPs_SetSClk(&iic_cam,?IIC_SCLK_RATE);
SendBuffer[0]=?0x30;
SendBuffer[1]=?0x0e;
Status?=?XIicPs_MasterSendPolled(&iic_cam,?SendBuffer,?2,?IIC_CAM_ADDR);
if?(Status?!=?XST_SUCCESS)?{
print("I2C?write?error

");
return?XST_FAILURE;
}
Status?=?XIicPs_MasterRecvPolled(&iic_cam,?RecvBuffer,1,?IIC_CAM_ADDR);
if?(Status?!=?XST_SUCCESS)?{
print("I2C?read?error

");
return?XST_FAILURE;
}
}
int??Initial_setting_1?(?u32?*cfg_init?,?int?cfg_init_QTY??)
{
s32??Status?,?byte_count;
int?i?;
u8?SendBuffer[10];
for(i=0;i<(cfg_init_QTY*2);i+=2){
SendBuffer[1]=??*(cfg_init?+?i);
SendBuffer[0]=??(*(cfg_init?+?i))>>8;
SendBuffer[2]=??*(cfg_init?+?i?+?1);
Status?=?XIicPs_MasterSendPolled(&iic_cam,?SendBuffer,?3,?IIC_CAM_ADDR);
if?(Status?!=?XST_SUCCESS)?{
print("I2C?read?error

");
return?XST_FAILURE;
}
usleep(1000);
}
return?XST_SUCCESS;
}

?

具有 I2C 配置的文件

?

//config_word_t?const?cfg_init_[]?=
static?u32??cfg_init?[][2]??=
{
//[7]=0?Software?reset;?[6]=1?Software?power?down;?Default=0x02
{0x3008,?0x42},
//[1]=1?System?input?clock?from?PLL;?Default?read?=?0x11
{0x3103,?0x03},
//[3:0]=0000?MD2P,MD2N,MCP,MCN?input;?Default=0x00
{0x3017,?0x00},
//[7:2]=000000?MD1P,MD1N,?D3:0?input;?Default=0x00
{0x3018,?0x00},
//[6:4]=001?PLL?charge?pump,?[3:0]=1000?MIPI?8-bit?mode
{0x3034,?0x18},
//PLL1?configuration
//[7:4]=0001?System?clock?divider?/1,?[3:0]=0001?Scale?divider?for?MIPI?/1
{0x3035,?0x11},
//[7:0]=56?PLL?multiplier
{0x3036,?0x38},
//[4]=1?PLL?root?divider?/2,?[3:0]=1?PLL?pre-divider?/1
{0x3037,?0x11},
//[5:4]=00?PCLK?root?divider?/1,?[3:2]=00?SCLK2x?root?divider?/1,?[1:0]=01?SCLK?root?divider?/2
{0x3108,?0x01},
//PLL2?configuration
//[5:4]=01?PRE_DIV_SP?/1.5,?[2]=1?R_DIV_SP?/1,?[1:0]=00?DIV12_SP?/1
{0x303D,?0x10},
//[4:0]=11001?PLL2?multiplier?DIV_CNT5B?=?25
{0x303B,?0x19},
{0x3630,?0x2e},
{0x3631,?0x0e},
{0x3632,?0xe2},
{0x3633,?0x23},
{0x3621,?0xe0},
{0x3704,?0xa0},
{0x3703,?0x5a},
{0x3715,?0x78},
{0x3717,?0x01},
{0x370b,?0x60},
{0x3705,?0x1a},
{0x3905,?0x02},
{0x3906,?0x10},
{0x3901,?0x0a},
{0x3731,?0x02},
//VCM?debug?mode
{0x3600,?0x37},
{0x3601,?0x33},
//System?control?register?changing?not?recommended
{0x302d,?0x60},
//??
{0x3620,?0x52},
{0x371b,?0x20},
//???DVP
{0x471c,?0x50},
{0x3a13,?0x43},
{0x3a18,?0x00},
{0x3a19,?0xf8},
{0x3635,?0x13},
{0x3636,?0x06},
{0x3634,?0x44},
{0x3622,?0x01},
{0x3c01,?0x34},
{0x3c04,?0x28},
{0x3c05,?0x98},
{0x3c06,?0x00},
{0x3c07,?0x08},
{0x3c08,?0x00},
{0x3c09,?0x1c},
{0x3c0a,?0x9c},
{0x3c0b,?0x40},
//[7]=1?color?bar?enable,?[3:2]=00?eight?color?bar
{0x503d,?0x00},
//[2]=1?ISP?vflip,?[1]=1?sensor?vflip
{0x3820,?0x46},
//[7:5]=010?Two?lane?mode,?[4]=0?MIPI?HS?TX?no?power?down,?[3]=0?MIPI?LP?RX?no?power?down,?[2]=1?MIPI?enable,?[1:0]=10?Debug?mode;?Default=0x58
{0x300e,?0x45},
//[5]=0?Clock?free?running,?[4]=1?Send?line?short?packet,?[3]=0?Use?lane1?as?default,?[2]=1?MIPI?bus?LP11?when?no?packet;?Default=0x04
{0x4800,?0x14},
{0x302e,?0x08},
//[7:4]=0x3?YUV422,?[3:0]=0x0?YUYV
//{0x4300,?0x30},
//[7:4]=0x6?RGB565,?[3:0]=0x0?{b[4:0],g[5:3],g[2:0],r[4:0]}
{0x4300,?0x6f},
{0x501f,?0x01},
{0x4713,?0x03},
{0x4407,?0x04},
{0x440e,?0x00},
{0x460b,?0x35},
//[1]=0?DVP?PCLK?divider?manual?control?by?0x3824[4:0]
{0x460c,?0x20},
//[4:0]=1?SCALE_DIV=INT(3824[4:0]/2)
{0x3824,?0x01},
//MIPI?timing
//??{0x4805,?0x10},?//LPX?global?timing?select=auto
//??{0x4818,?0x00},?//hs_prepare?+?hs_zero_min?ns
//??{0x4819,?0x96},
//??{0x482A,?0x00},?//hs_prepare?+?hs_zero_min?UI
//
//??{0x4824,?0x00},?//lpx_p_min?ns
//??{0x4825,?0x32},
//??{0x4830,?0x00},?//lpx_p_min?UI
//
//??{0x4826,?0x00},?//hs_prepare_min?ns
//??{0x4827,?0x32},
//??{0x4831,?0x00},?//hs_prepare_min?UI
//[7]=1?LENC?correction?enabled,?[5]=1?RAW?gamma?enabled,?[2]=1?Black?pixel?cancellation?enabled,?[1]=1?White?pixel?cancellation?enabled,?[0]=1?Color?interpolation?enabled
{0x5000,?0x07},
//[7]=0?Special?digital?effects,?[5]=0?scaling,?[2]=0?UV?average?disabled,?[1]=1?Color?matrix?enabled,?[0]=1?Auto?white?balance?enabled
{0x5001,?0x03}
};
static?u32??cfg_simple_awb[][2]?=
{
//?Disable?Advanced?AWB
{0x518d?,0x00},
{0x518f?,0x20},
{0x518e?,0x00},
{0x5190?,0x20},
{0x518b?,0x00},
{0x518c?,0x00},
{0x5187?,0x10},
{0x5188?,0x10},
{0x5189?,0x40},
{0x518a?,0x40},
{0x5186?,0x10},
{0x5181?,0x58},
{0x5184?,0x25},
{0x5182?,0x11},
//?Enable?simple?AWB
{0x3406?,0x00},
{0x5183?,0x80},
{0x5191?,0xff},
{0x5192?,0x00},
{0x5001?,0x03}
};
static?u32??cfg_720p_60fps[][2]?=
{//1280?x?720?binned,?RAW10,?MIPISCLK=280M,?SCLK=56Mz,?PCLK=56M
//PLL1?configuration
{0x3008,?0x42},
//[7:4]=0010?System?clock?divider?/2,?[3:0]=0001?Scale?divider?for?MIPI?/1
{0x3035,?0x21},
//[7:0]=70?PLL?multiplier
{0x3036,?0x46},
//[4]=0?PLL?root?divider?/1,?[3:0]=5?PLL?pre-divider?/1.5
{0x3037,?0x05},
//[5:4]=01?PCLK?root?divider?/2,?[3:2]=00?SCLK2x?root?divider?/1,?[1:0]=01?SCLK?root?divider?/2
{0x3108,?0x11},
//[6:4]=001?PLL?charge?pump,?[3:0]=1010?MIPI?10-bit?mode
{0x3034,?0x1A},
//[3:0]=0?X?address?start?high?byte
{0x3800,?(0?>>?8)?&?0x0F},
//[7:0]=0?X?address?start?low?byte
{0x3801,?0?&?0xFF},
//[2:0]=0?Y?address?start?high?byte
{0x3802,?(8?>>?8)?&?0x07},
//[7:0]=0?Y?address?start?low?byte
{0x3803,?8?&?0xFF},
//[3:0]?X?address?end?high?byte
{0x3804,?(2619?>>?8)?&?0x0F},
//[7:0]?X?address?end?low?byte
{0x3805,?2619?&?0xFF},
//[2:0]?Y?address?end?high?byte
{0x3806,?(1947?>>?8)?&?0x07},
//[7:0]?Y?address?end?low?byte
{0x3807,?1947?&?0xFF},
//[3:0]=0?timing?hoffset?high?byte
{0x3810,?(0?>>?8)?&?0x0F},
//[7:0]=0?timing?hoffset?low?byte
{0x3811,?0?&?0xFF},
//[2:0]=0?timing?voffset?high?byte
{0x3812,?(0?>>?8)?&?0x07},
//[7:0]=0?timing?voffset?low?byte
{0x3813,?0?&?0xFF},
//[3:0]?Output?horizontal?width?high?byte
{0x3808,?(1280?>>?8)?&?0x0F},
//[7:0]?Output?horizontal?width?low?byte
{0x3809,?1280?&?0xFF},
//[2:0]?Output?vertical?height?high?byte
{0x380a,?(720?>>?8)?&?0x7F},
//[7:0]?Output?vertical?height?low?byte
{0x380b,?720?&?0xFF},
//HTS?line?exposure?time?in?#?of?pixels
{0x380c,?(1896?>>?8)?&?0x1F},
{0x380d,?1896?&?0xFF},
//VTS?frame?exposure?time?in?#?lines
{0x380e,?(984?>>?8)?&?0xFF},
{0x380f,?984?&?0xFF},
//[7:4]=0x3?horizontal?odd?subsample?increment,?[3:0]=0x1?horizontal?even?subsample?increment
{0x3814,?0x31},
//[7:4]=0x3?vertical?odd?subsample?increment,?[3:0]=0x1?vertical?even?subsample?increment
{0x3815,?0x31},
//[2]=0?ISP?mirror,?[1]=0?sensor?mirror,?[0]=1?horizontal?binning
{0x3821,?0x01},
//little?MIPI?shit:?global?timing?unit,?period?of?PCLK?in?ns?*?2(depends?on?#?of?lanes)
{0x4837,?36},?//?1/56M*2
//Undocumented?anti-green?settings
{0x3618,?0x00},?//?Removes?vertical?lines?appearing?under?bright?light
{0x3612,?0x59},
{0x3708,?0x64},
{0x3709,?0x52},
{0x370c,?0x03},
//[7:4]=0x0?Formatter?RAW,?[3:0]=0x0?BGBG/GRGR
{0x4300,?0x00},
//[2:0]=0x3?Format?select?ISP?RAW?(DPC)
{0x501f,?0x03},
{0x3008,?0x02},
};

?

顯示端口配置文件

?

/*****************************?Include?Files?*********************************/
#include?"xil_exception.h"
#include?"xil_printf.h"
#include?"xil_cache.h"
#include?"xdpdma_video_example.h"
/**************************?Constant?Definitions?*****************************/
#define?DPPSU_DEVICE_ID??XPAR_PSU_DP_DEVICE_ID
#define?AVBUF_DEVICE_ID??XPAR_PSU_DP_DEVICE_ID
#define?DPDMA_DEVICE_ID??XPAR_XDPDMA_0_DEVICE_ID
#define?DPPSU_INTR_ID??151
#define?DPDMA_INTR_ID??154
#define?INTC_DEVICE_ID??XPAR_SCUGIC_0_DEVICE_ID
#define?DPPSU_BASEADDR??XPAR_PSU_DP_BASEADDR
#define?AVBUF_BASEADDR??XPAR_PSU_DP_BASEADDR
#define?DPDMA_BASEADDR??XPAR_PSU_DPDMA_BASEADDR
#define?BUFFERSIZE???1280?*?720?*?4??/*?HTotal?*?VTotal?*?BPP?*/
#define?LINESIZE???1280?*?4???/*?HTotal?*?BPP?*/
#define?STRIDE????LINESIZE???/*?The?stride?value?should
be?aligned?to?256*/
/**************************?Variable?Declarations?***************************/
u8?Frame[BUFFERSIZE]?__attribute__?((__aligned__(256)));
XDpDma_FrameBuffer?FrameBuffer;
/****************************?Type?Definitions?*******************************/
/*****************************************************************************/
/**
*
*?Main?function?to?call?the?DPDMA?Video?example.
*
*?@param?None
*
*?@return?XST_SUCCESS?if?successful,?otherwise?XST_FAILURE.
*
*?@note??None
*
******************************************************************************/
int?run_dppsu()
{
int?Status;
Xil_DCacheDisable();
Xil_ICacheDisable();
xil_printf("DPDMA?Generic?Video?Example?Test?
");
Status?=?DpdmaVideoExample(&RunCfg);
if?(Status?!=?XST_SUCCESS)?{
xil_printf("DPDMA?Video?Example?Test?Failed
");
return?XST_FAILURE;
}
xil_printf("Successfully?ran?DPDMA?Video?Example?Test
");
return?XST_SUCCESS;
}
/*****************************************************************************/
/**
*
*?The?purpose?of?this?function?is?to?illustrate?how?to?use?the?XDpDma?device
*?driver?in?Graphics?overlay?mode.
*
*?@param?RunCfgPtr?is?a?pointer?to?the?application?configuration?structure.
*
*?@return?XST_SUCCESS?if?successful,?else?XST_FAILURE.
*
*?@note??None.
*
*****************************************************************************/
int?DpdmaVideoExample(Run_Config?*RunCfgPtr)
{
u32?Status;
/*?Initialize?the?application?configuration?*/
InitRunConfig(RunCfgPtr);
Status?=?InitDpDmaSubsystem(RunCfgPtr);
if?(Status?!=?XST_SUCCESS)?{
return?XST_FAILURE;
}
SetupInterrupts(RunCfgPtr);
//xil_printf("Generating?Overlay.....

");
GraphicsOverlay(Frame,?RunCfgPtr);
/*?Populate?the?FrameBuffer?structure?with?the?frame?attributes?*/
FrameBuffer.Address?=?(INTPTR)Frame;
FrameBuffer.Stride?=?STRIDE;
FrameBuffer.LineSize?=?LINESIZE;
FrameBuffer.Size?=?BUFFERSIZE;
XDpDma_DisplayGfxFrameBuffer(RunCfgPtr->DpDmaPtr,?&FrameBuffer);
return?XST_SUCCESS;
}
/*****************************************************************************/
/**
*
*?The?purpose?of?this?function?is?to?initialize?the?application?configuration.
*
*?@param?RunCfgPtr?is?a?pointer?to?the?application?configuration?structure.
*
*?@return?None.
*
*?@note??None.
*
*****************************************************************************/
void?InitRunConfig(Run_Config?*RunCfgPtr)
{
/*?Initial?configuration?parameters.?*/
RunCfgPtr->DpPsuPtr???=?&DpPsu;
RunCfgPtr->IntrPtr???=?&Intr;
RunCfgPtr->AVBufPtr??=?&AVBuf;
RunCfgPtr->DpDmaPtr??=?&DpDma;
RunCfgPtr->VideoMode?=?XVIDC_VM_1280x720_60_P;
RunCfgPtr->Bpc???=?XVIDC_BPC_12;//XVIDC_BPC_8;
RunCfgPtr->ColorEncode???=?XDPPSU_CENC_RGB;
RunCfgPtr->UseMaxCfgCaps??=?1;
RunCfgPtr->LaneCount???=?LANE_COUNT_2;
RunCfgPtr->LinkRate????=?LINK_RATE_540GBPS;
RunCfgPtr->EnSynchClkMode??=?0;
RunCfgPtr->UseMaxLaneCount??=?1;
RunCfgPtr->UseMaxLinkRate??=?1;
}
/*****************************************************************************/
/**
*
*?The?purpose?of?this?function?is?to?initialize?the?DP?Subsystem?(XDpDma,
*?XAVBuf,?XDpPsu)
*
*?@param?RunCfgPtr?is?a?pointer?to?the?application?configuration?structure.
*
*?@return?None.
*
*?@note??None.
*
*****************************************************************************/
int?InitDpDmaSubsystem(Run_Config?*RunCfgPtr)
{
u32?Status;
XDpPsu??*DpPsuPtr?=?RunCfgPtr->DpPsuPtr;
XDpPsu_Config?*DpPsuCfgPtr;
XAVBuf??*AVBufPtr?=?RunCfgPtr->AVBufPtr;
XDpDma_Config?*DpDmaCfgPtr;
XDpDma??*DpDmaPtr?=?RunCfgPtr->DpDmaPtr;
/*?Initialize?DisplayPort?driver.?*/
DpPsuCfgPtr?=?XDpPsu_LookupConfig(DPPSU_DEVICE_ID);
XDpPsu_CfgInitialize(DpPsuPtr,?DpPsuCfgPtr,?DpPsuCfgPtr->BaseAddr);
/*?Initialize?Video?Pipeline?driver?*/
XAVBuf_CfgInitialize(AVBufPtr,?DpPsuPtr->Config.BaseAddr,?AVBUF_DEVICE_ID);
/*?Initialize?the?DPDMA?driver?*/
DpDmaCfgPtr?=?XDpDma_LookupConfig(DPDMA_DEVICE_ID);
XDpDma_CfgInitialize(DpDmaPtr,DpDmaCfgPtr);
/*?Initialize?the?DisplayPort?TX?core.?*/
Status?=?XDpPsu_InitializeTx(DpPsuPtr);
if?(Status?!=?XST_SUCCESS)?{
return?XST_FAILURE;
}
/*?Set?the?format?graphics?frame?for?DPDMA*/
Status?=?XDpDma_SetGraphicsFormat(DpDmaPtr,?RGBA8888);
if?(Status?!=?XST_SUCCESS)?{
return?XST_FAILURE;
}
/*?Set?the?format?graphics?frame?for?Video?Pipeline*/
Status?=?XAVBuf_SetInputNonLiveGraphicsFormat(AVBufPtr,?RGBA8888);
if?(Status?!=?XST_SUCCESS)?{
return?XST_FAILURE;
}
/*?Set?the?QOS?for?Video?*/
XDpDma_SetQOS(RunCfgPtr->DpDmaPtr,?11);
/*?Enable?the?Buffers?required?by?Graphics?Channel?*/
//XAVBuf_EnableGraphicsBuffers(RunCfgPtr->AVBufPtr,?1);
XAVBuf_SetInputLiveVideoFormat(&AVBufPtr,?RGB_10BPC);
XAVBuf_EnableVideoBuffers(&AVBufPtr,?1);
/*?Set?the?output?Video?Format?*/
XAVBuf_SetOutputVideoFormat(AVBufPtr,?RGB_10BPC);
/*?Select?the?Input?Video?Sources.
*?Here?in?this?example?we?are?going?to?demonstrate
*?graphics?overlay?over?the?TPG?video.
*/
XAVBuf_InputVideoSelect(AVBufPtr,?XAVBUF_VIDSTREAM1_LIVE,?XAVBUF_VIDSTREAM2_NONE);
/*?Configure?Video?pipeline?for?graphics?channel?*/
//XAVBuf_ConfigureGraphicsPipeline(AVBufPtr);
/*?Configure?the?output?video?pipeline?*/
XAVBuf_ConfigureOutputVideo(AVBufPtr);
/*?Disable?the?global?alpha,?since?we?are?using?the?pixel?based?alpha?*/
XAVBuf_SetBlenderAlpha(AVBufPtr,?0,?0);
/*?Set?the?clock?mode?*/
XDpPsu_CfgMsaEnSynchClkMode(DpPsuPtr,?RunCfgPtr->EnSynchClkMode);
/*?Set?the?clock?source?depending?on?the?use?case.
*?Here?for?simplicity?we?are?using?PS?clock?as?the?source*/
XAVBuf_SetAudioVideoClkSrc(AVBufPtr,?XAVBUF_PL_CLK,?XAVBUF_PS_CLK);
/*?Issue?a?soft?reset?after?selecting?the?input?clock?sources?*/
XAVBuf_SoftReset(AVBufPtr);
return?XST_SUCCESS;
}
/*****************************************************************************/
/**
*
*?The?purpose?of?this?function?is?to?setup?call?back?functions?for?the?DP
*?controller?interrupts.
*
*?@param?RunCfgPtr?is?a?pointer?to?the?application?configuration?structure.
*
*?@return?None.
*
*?@note??None.
*
*****************************************************************************/
void?SetupInterrupts(Run_Config?*RunCfgPtr)
{
XDpPsu?*DpPsuPtr?=?RunCfgPtr->DpPsuPtr;
XScuGic??*IntrPtr?=?RunCfgPtr->IntrPtr;
XScuGic_Config?*IntrCfgPtr;
u32??IntrMask?=?XDPPSU_INTR_HPD_IRQ_MASK?|?XDPPSU_INTR_HPD_EVENT_MASK;
XDpPsu_WriteReg(DpPsuPtr->Config.BaseAddr,?XDPPSU_INTR_DIS,?0xFFFFFFFF);
XDpPsu_WriteReg(DpPsuPtr->Config.BaseAddr,?XDPPSU_INTR_MASK,?0xFFFFFFFF);
XDpPsu_SetHpdEventHandler(DpPsuPtr,?DpPsu_IsrHpdEvent,?RunCfgPtr);
XDpPsu_SetHpdPulseHandler(DpPsuPtr,?DpPsu_IsrHpdPulse,?RunCfgPtr);
/*?Initialize?interrupt?controller?driver.?*/
IntrCfgPtr?=?XScuGic_LookupConfig(INTC_DEVICE_ID);
XScuGic_CfgInitialize(IntrPtr,?IntrCfgPtr,?IntrCfgPtr->CpuBaseAddress);
/*?Register?ISRs.?*/
XScuGic_Connect(IntrPtr,?DPPSU_INTR_ID,
(Xil_InterruptHandler)XDpPsu_HpdInterruptHandler,?RunCfgPtr->DpPsuPtr);
/*?Trigger?DP?interrupts?on?rising?edge.?*/
XScuGic_SetPriorityTriggerType(IntrPtr,?DPPSU_INTR_ID,?0x0,?0x03);
/*?Connect?DPDMA?Interrupt?*/
XScuGic_Connect(IntrPtr,?DPDMA_INTR_ID,
(Xil_ExceptionHandler)XDpDma_InterruptHandler,?RunCfgPtr->DpDmaPtr);
/*?Initialize?exceptions.?*/
Xil_ExceptionInit();
Xil_ExceptionRegisterHandler(XIL_EXCEPTION_ID_IRQ_INT,
(Xil_ExceptionHandler)XScuGic_DeviceInterruptHandler,
INTC_DEVICE_ID);
/*?Enable?exceptions?for?interrupts.?*/
Xil_ExceptionEnableMask(XIL_EXCEPTION_IRQ);
Xil_ExceptionEnable();
/*?Enable?DP?interrupts.?*/
XScuGic_Enable(IntrPtr,?DPPSU_INTR_ID);
XDpPsu_WriteReg(DpPsuPtr->Config.BaseAddr,?XDPPSU_INTR_EN,?IntrMask);
/*?Enable?DPDMA?Interrupts?*/
XScuGic_Enable(IntrPtr,?DPDMA_INTR_ID);
XDpDma_InterruptEnable(RunCfgPtr->DpDmaPtr,?XDPDMA_IEN_VSYNC_INT_MASK);
}
/*****************************************************************************/
/**
*
*?The?purpose?of?this?function?is?to?generate?a?Graphics?frame?of?the?format
*?RGBA8888?which?generates?an?overlay?on?1/2?of?the?bottom?of?the?screen.
*?This?is?just?to?illustrate?the?functionality?of?the?graphics?overlay.
*
*?@param?RunCfgPtr?is?a?pointer?to?the?application?configuration?structure.
*?@param?Frame?is?a?pointer?to?a?buffer?which?is?going?to?be?populated?with
*????rendered?frame
*
*?@return?Returns?a?pointer?to?the?frame.
*
*?@note??None.
*
*****************************************************************************/
u8?*GraphicsOverlay(u8*?Frame,?Run_Config?*RunCfgPtr)
{
u64?Index;
u32?*RGBA;
RGBA?=?(u32?*)?Frame;
/*
*?Red?at?the?top?half
*?Alpha?=?0x0F
*?*/
for(Index?=?0;?Index?

	?

	測試

	應用程序完成后，我們可以創建調試配置并下載位文件并運行應用程序軟件。

	在監視器上應該能看到圖像，但是我們也可以檢查 ILA。這些顯示 ILA 將顯示從 MIPI CSI-2 IP 內核和 VDMA 接收的輸入視頻流。

	

	AXIS 使用邊帶信號 Tuser 和 Tlast 傳輸視頻幀。Tuser 表示新幀的開始，而 Tlast 表示一行的結束。

	

	第三個 ILA 監控 AXI Stream to Video Output，使我們能夠監控輸出上的鎖定信號。

	

	當所有這些都運行時，將能夠看到圖像輸出:

	

	解決方案的最終資源利用率如下圖所示，我們還有足夠的空間來實現有趣的算法

	

	源代碼

	




	審核編輯：劉清