linux5.4 下使用rapidio(tsi721)的笔记记录

目录

1 简介

2 下载驱动 和测试程序代码 并编译

2.1 下载源码

2.2 编译驱动

2.3 编译自带的用来测试的应用程序

3 安装驱动

3.1 安装驱动

3.2 触发枚举 和 发现

3.3 安装网络驱动rionet.ko

4 测试

4.1 doorbell测试

4.2 DMA测试

4.2.1 小数据量(2MB)的DMA测试

4.2.2 大数据量的DMA测试(数据量大于4MB，系统的页大小为4KB)

4.3 rionet测试

---

1 简介

        硬件环境是2块同样的板子(带有TSI721芯片)，一块板子作为 rapidio 接收端，另一块板子作为 rapidio 发送端。本文中用“A板” 和 “B板”来称呼这两块办卡。

        本文使用的rapidio驱动不是kernel-5.4 自带的驱动，而是从rapidio网站上下载的驱动。下载网址是：Releases · RapidIO/kernel-rapidio · GitHub

        rapidio、PCIE 和 以太网之间的对比，参考：以太网、PCIe和RapidIO的比较

2 下载驱动 和测试程序代码 并编译

2.1 下载源码

        从rapidio网站上(Releases · RapidIO/kernel-rapidio · GitHub)下载源码，并解压，解压后的源码根目录名字为“kernel-rapidio-2.0_HS”。

2.2 编译驱动

        # cd kernel-rapidio-2.0_HS

        # make

编译成功后，会在当前目录生成一个类似"kernel-5.15.0-79-generic"的目录，里面是编译好的.ko模块。

2.3 编译自带的用来测试的应用程序

        # cd kernel-rapidio-2.0_HS/libmport/

        # make samples

编译成功后，会在当前目录生成下面绿色的可以执行文件(libmport.so除外)。

3 安装驱动

将kernel-rapidio-2.0_HS/kernel-5.15.0-79-generic/拷贝到开发板上。 

3.1 安装驱动

A板

insmod rapidio.ko hdid=-1
insmod tsi721_mport.ko dbg_level=0 mbox_sel=0xf dma_sel=0x7f pcie_mrrs=5 dma_txqueue_sz=4096 dma_desc_per_channel=4096
insmod idt_gen2.ko
insmod rio-scan.ko

安装上面驱动后，dmesg中可以看到以下信息 

[ 37.135091] rapidio: loading out-of-tree module taints kernel.
[ 37.135162] rapidio: module verification failed: signature and/or required key missing - tainting kernel
[ 37.138546] tsi721_mport: unknown parameter 'dbg_level' ignored
[ 37.138864] tsi721 0000:03:00.0: limiting MRRS to 256
[ 37.138899] tsi721 0000:03:00.0: tsi721_probe: SRIO Link Speed 5.0 Gbaud

B板

insmod rapidio.ko hdid=0    //B板的hdid=0,B板负责枚
insmod tsi721_mport.ko dbg_level=0xff mbox_sel=0xf dma_sel=0x7f pcie_mrrs=5 dma_txqueue_sz=4096 dma_desc_per_channel=4096
insmod idt_gen2.ko
insmod rio-scan.ko
insmod rio_mport_cdev.ko rio_res_mem=0x40000000 rio_res_size=0x10000000
insmod rio_cm.ko

安装上面驱动后，dmesg中可以看到以下信息 

[ 27.639092] rapidio: loading out-of-tree module taints kernel.
[ 27.639161] rapidio: module verification failed: signature and/or required key missing - tainting kernel
[ 27.642641] tsi721_mport: unknown parameter 'dbg_level' ignored
[ 27.642948] tsi721 0000:03:00.0: limiting MRRS to 256
[ 27.642983] tsi721 0000:03:00.0: tsi721_probe: SRIO Link Speed 5.0 Gbaud
[ 27.651301] rio_mport: Added tsi721(0000:03:00.0) cdev(238:0)

3.2 触发枚举 和 发现

When automatic start of enumeration/discovery is used a user has to ensure that all discovering endpoints are started before the enumerating endpoint and are waiting for enumeration to be completed.

Enumeration is performed by a master port if it is configured as a host port by assigning a host destination ID greater than or equal to zero.

                                                                                                                                        《Documentation/driver-api/rapidio/rapidio.rst》

        A板的hdid=-1，所以A板负责“发现”；B板的hdid=0，所以B板负责“枚举”。“发现”流程要先于“枚举”流程运行，所以要现在A板上操作。

在A 板执行命令

echo -1 > /sys/bus/rapidio/scan

命令执行完后的dmesg信息

[ 97.381681] RIO: discovery work for mport 0 tsi721(0000:03:00.0)         //开始执行: echo -1 > /sys/bus/rapidio/scan
[ 97.381688] RIO: discover master port 0, tsi721(0000:03:00.0)
[ 97.381693] RIO: wait for enumeration to complete...
[ 113.639420] RIO: ... enumeration done                                  //等待 B 板执行:echo -1 > /sys/bus/rapidio/scan
[ 113.639539] RIO: rio_setup_device Register Map 1 device
[ 113.639705] RIO: found 00:s:0003 (vid 0038 did 0375) with 16 ports
[ 113.639723] RIO: scanning device on port 2
[ 113.639848] RIO: rio_setup_device Register Map 1 device
[ 113.639947] RIO: found 00:s:0002 (vid 0038 did 0375) with 16 ports
[ 113.639956] RIO: scanning device on port 0
[ 113.640067] RIO: rio_setup_device Register Map 1 device
[ 113.640151] RIO: found 00:e:0001 (vid 0038 did 80ab)
[ 113.640168] RIO: scanning device on port 3
[ 113.646213] RIO: scanning device on port 6
[ 113.653261] RIO: scanning device on port 7
[ 113.660369] RIO: scanning device on port 3
[ 113.666411] RIO: scanning device on port 6
[ 113.673452] RIO: scanning device on port 7
[ 113.694707] RIO: destroy discovery workqueue

马上在B板执行命令

echo -1 > /sys/bus/rapidio/scan

命令执行完后的dmesg信息

[ 120.911283] RIO: enumerate master port 0, tsi721(0000:03:00.0)                 //开始执行: echo -1 > /sys/bus/rapidio/scan
[ 120.911332] rio_enable_rx_tx_port(local = 1, destid = 0, hopcount = 0, port_num = 0)
[ 120.911449] RIO: rio_setup_device Register Map 1 device
[ 120.912664] RIO: found 00:s:0002 (vid 0038 did 0375) with 16 ports
[ 120.912666] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 0, port_num = 0) 
[ 120.912732] RIO: scanning device on port 2
[ 120.912733] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 0, port_num = 2)
[ 120.912901] RIO: rio_setup_device Register Map 1 device
[ 120.914055] RIO: found 00:s:0003 (vid 0038 did 0375) with 16 ports
[ 120.914064] RIO: scanning device on port 0
[ 120.914066] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 1, port_num = 0)
[ 120.914226] RIO: rio_setup_device Register Map 1 device
[ 120.914282] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 2, port_num = 0)
[ 120.914340] RIO: found 00:e:0004 (vid 0038 did 80ab)
[ 120.914399] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 1, port_num = 2)
[ 120.914439] RIO: scanning device on port 3
[ 120.914440] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 1, port_num = 3)
[ 120.914522] RIO: PE already discovered by this host
[ 120.914531] RIO: redundant path to 00:s:0002
[ 120.914587] RIO: scanning device on port 6
[ 120.914588] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 1, port_num = 6)
[ 120.914670] RIO: PE already discovered by this host
[ 120.914678] RIO: redundant path to 00:s:0002
[ 120.914687] RIO: scanning device on port 7
[ 120.914688] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 1, port_num = 7)
[ 120.914770] RIO: PE already discovered by this host
[ 120.914778] RIO: redundant path to 00:s:0002
[ 120.915661] RIO: scanning device on port 3
[ 120.915662] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 0, port_num = 3)
[ 120.915744] RIO: PE already discovered by this host
[ 120.915752] RIO: redundant path to 00:s:0003
[ 120.915808] RIO: scanning device on port 6
[ 120.915809] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 0, port_num = 6)
[ 120.915890] RIO: PE already discovered by this host
[ 120.915899] RIO: redundant path to 00:s:0003
[ 120.915907] RIO: scanning device on port 7
[ 120.915909] rio_enable_rx_tx_port(local = 0, destid = 255, hopcount = 0, port_num = 7)
[ 120.915990] RIO: PE already discovered by this host
[ 120.915998] RIO: redundant path to 00:s:0003

3.3 安装网络驱动rionet.ko

A板

insmod rio_mport_cdev.ko rio_res_mem=0x40000000 rio_res_size=0x10000000
insmod rio_cm.ko
insmod rionet.ko

dmesg信息如下

[ 1208.360869] rio_mport: Added tsi721(0000:03:00.0) cdev(238:0) //insmod rio_mport_cdev.ko
[ 1208.367916] eth0: rionet Ethernet over RapidIO Version 0.3, MAC 00:01:00:01:00:01, tsi721(0000:03:00.0) //insmod rionet.ko

B板

insmod rionet.ko

dmesg信息如下

[ 1341.562909] eth0: rionet Ethernet over RapidIO Version 0.3, MAC 00:01:00:01:00:00, tsi721(0000:03:00.0) //insmod rionet.ko

4 测试

4.1 doorbell测试

接收端

# ./rio_test_db -M 0 -S 0x1a1a -E 0x5a5a -r
+++ SRIO mport configuration +++
mport: hdid=1, id=0, idx=0, flags=0x3, sys_size=small    //hdid=1，表示当前设备的destination ID是1。发送端通过destination ID来指定将数据发给谁
link: speed=5.0Gb width=4x
DMA: max_sge=0 max_size=67108864 alignment=0 (HW SG)
+++ RapidIO Doorbell Receive Mode +++mport0 PID:1678filter: destid=ffffffff start=1a1a end=5a5aDB 0x1a5a from destID 0 //发送端发送过来的数据DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0DB 0x1a5a from destID 0

发送端

./rio_test_db -M 0 -D 0x1 -I 0x1a5a    //“-D 0x1”，指定将数据发给hdid=1的接收端

发送端的dmesg信息

[ 203.836404] tsi721 0000:03:00.0: tsi721_dsend: Send Doorbell 0x1a5a to destID 0x1

4.2 DMA测试

4.2.1 小数据量(2MB)的DMA测试

接收端运行接收程序

# ./rio_test_dma -M 0 -I 0x1000000 -R 0x2000000 -v
+++ SRIO mport configuration +++
mport: hdid=0, id=0, idx=0, flags=0x3, sys_size=small
link: speed=5.0Gb width=4x
DMA: max_sge=0 max_size=67108864 alignment=0 (HW SG)
+++ RapidIO Inbound Window Mode +++mport0 ib_size=0x1000000 PID:1843Allocated/mapped IB buffer (rio_base=0x0_02000000).... press Enter key to exit ....

接收端 dmesg 信息

[ 1012.293052] tsi721 0000:03:00.0: tsi721_rio_map_inb_mem: Translated (RIO_0x2000000 -> PCIe_0x000000043e000000), size=0x1000000
[ 1012.293063] tsi721 0000:03:00.0: tsi721_rio_map_inb_mem: Configured IBWIN0 (RIO_0x2000000 -> PCIe_0x000000043e000000), size=0x1000000
[ 1018.033461] tsi721 0000:03:00.0: tsi721_rio_unmap_inb_mem: Unmap IBW mapped to PCIe_0x000000043e000000
[ 1018.033468] tsi721 0000:03:00.0: tsi721_rio_unmap_inb_mem: Disable IBWIN_0

发送端发送2MB数据的命令

# ./rio_test_dma -M 0 -D 0x0 -A 0x2000000 -S 0x200000 -T 2 -d -v
+++ SRIO mport configuration +++
mport: hdid=1, id=0, idx=0, flags=0x3, sys_size=small
link: speed=5.0Gb width=4x
DMA: max_sge=0 max_size=67108864 alignment=0 (HW SG)
+++ RapidIO DMA Test +++mport0 destID=0 rio_addr=0x2000000 align=0 repeat=2 PID:2211sync=0 (SYNC)dma_size=2097152 offset=0x0
<1>: len=0x200000 src_off=0x0 dst_off=0x0Write 2097152 bytes from src offset 0x0Read 2097152 bytes to dst offset 0x0Buffer verification is turned off!WR time: 0.001866 s @ 1071.98 MB/sRD time: 0.001830 s @ 1092.71 MB/sFull Cycle time: 0.003702 s
<2>: len=0x200000 src_off=0x0 dst_off=0x0Write 2097152 bytes from src offset 0x0Read 2097152 bytes to dst offset 0x0Buffer verification is turned off!WR time: 0.001411 s @ 1417.61 MB/sRD time: 0.001359 s @ 1472.03 MB/sFull Cycle time: 0.002773 s

发送端的dmesg信息

[ 338.944178] dma dma0chan0: tsi721_alloc_chan_resources: DMAC0
[ 338.944184] dma dma0chan0: tsi721_bdma_ch_init: DMAC0
[ 338.944200] dma dma0chan0: tsi721_bdma_ch_init: DMAC0 descriptors @ 00000000d8a79ecb (phys = 0x000000037a880000)
[ 338.944233] dma dma0chan0: tsi721_bdma_ch_init: DMAC0 desc status FIFO @ 000000004ee70bd4 (phys = 0x000000037a900000) size=0x2000
[ 338.944685] dma dma0chan0: tsi721_prep_rio_sg: DMAC0 WRITE
[ 338.944689] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.944694] dma dma0chan0: tsi721_submit_sg: DMAC0 BD ring status: rdi=0 wri=0
[ 338.944697] dma dma0chan0: tsi721_submit_sg: DMAC0 sg0/128 addr: 0x410308010 len: 16368
[ 338.944700] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000d8a79ecb did=0 raddr=0x2000000
[ 338.944702] dma dma0chan0: tsi721_submit_sg: DMAC0 sg1/128 addr: 0x3ef070000 len: 16384
[ 338.944704] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16368
[ 338.944706] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 000000004a131af7 did=0 raddr=0x2003ff0
[ 338.944707] dma dma0chan0: tsi721_submit_sg: DMAC0 sg2/128 addr: 0x3a8c90000 len: 16384
[ 338.944709] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.944711] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000ceafa227 did=0 raddr=0x2007ff0
[ 338.944713] dma dma0chan0: tsi721_submit_sg: DMAC0 sg3/128 addr: 0x3b277c000 len: 16384
[ 338.944714] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
……
[ 338.945324] dma dma0chan0: tsi721_submit_sg: DMAC0 sg126/128 addr: 0x37d128000 len: 16384
[ 338.945325] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.945327] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 000000001a9b98b4 did=0 raddr=0x21fbff0
[ 338.945329] dma dma0chan0: tsi721_submit_sg: DMAC0 sg127/128 addr: 0x37da14000 len: 16
[ 338.945330] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.945332] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000f9580096 did=0 raddr=0x21ffff0
[ 338.945333] dma dma0chan0: tsi721_submit_sg: DMAC0 last desc final len: 16
[ 338.945336] dma dma0chan0: tsi721_start_dma: DMAC0 (wrc=128) 2588
[ 338.945339] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.945341] dma dma0chan0: tsi721_issue_pending: DMAC0
[ 338.946634] dma dma0chan0: tsi721_dma_tasklet: DMAC0_INT = 0x8
[ 338.946637] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.946640] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.946946] dma dma0chan0: tsi721_prep_rio_sg: DMAC0 READ
[ 338.946948] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.946953] dma dma0chan0: tsi721_submit_sg: DMAC0 BD ring status: rdi=128 wri=128
[ 338.946955] dma dma0chan0: tsi721_submit_sg: DMAC0 sg0/99 addr: 0x3f03fc010 len: 16368
[ 338.946957] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000732f8730 did=0 raddr=0x2000000
[ 338.946958] dma dma0chan0: tsi721_submit_sg: DMAC0 sg1/99 addr: 0x37d53c000 len: 16384
[ 338.946960] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16368
[ 338.946961] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000e8ad552d did=0 raddr=0x2003ff0
[ 338.946965] dma dma0chan0: tsi721_submit_sg: DMAC0 sg2/99 addr: 0x37cea0000 len: 16384
[ 338.946966] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.946968] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000c19d1d22 did=0 raddr=0x2007ff0
[ 338.946969] dma dma0chan0: tsi721_submit_sg: DMAC0 sg3/99 addr: 0x37d8d8000 len: 16384
[ 338.946970] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.946972] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 0000000053540148 did=0 raddr=0x200bff0
……
[ 338.947456] dma dma0chan0: tsi721_submit_sg: DMAC0 sg97/99 addr: 0x3808e8000 len: 65536
[ 338.947458] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 32768
[ 338.947461] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 000000006420b5c7 did=0 raddr=0x21efff0
[ 338.947465] dma dma0chan0: tsi721_submit_sg: DMAC0 sg98/99 addr: 0x3f75f8000 len: 16
[ 338.947468] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 65536
[ 338.947471] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 000000004239733d did=0 raddr=0x21ffff0
[ 338.947473] dma dma0chan0: tsi721_submit_sg: DMAC0 last desc final len: 16
[ 338.947476] dma dma0chan0: tsi721_start_dma: DMAC0 (wrc=227) 2588
[ 338.947481] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.947487] dma dma0chan0: tsi721_issue_pending: DMAC0
[ 338.948773] dma dma0chan0: tsi721_dma_tasklet: DMAC0_INT = 0x8
[ 338.948776] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.948780] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.948870] dma dma0chan0: tsi721_prep_rio_sg: DMAC0 WRITE
[ 338.948873] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.948878] dma dma0chan0: tsi721_submit_sg: DMAC0 BD ring status: rdi=227 wri=227
[ 338.948880] dma dma0chan0: tsi721_submit_sg: DMAC0 sg0/128 addr: 0x410308010 len: 16368
[ 338.948882] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 000000008672dc4c did=0 raddr=0x2000000
[ 338.948884] dma dma0chan0: tsi721_submit_sg: DMAC0 sg1/128 addr: 0x3ef070000 len: 16384
[ 338.948885] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16368
[ 338.948887] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000e915eee4 did=0 raddr=0x2003ff0
[ 338.948889] dma dma0chan0: tsi721_submit_sg: DMAC0 sg2/128 addr: 0x3a8c90000 len: 16384
[ 338.948890] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.948892] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 0000000091833282 did=0 raddr=0x2007ff0
[ 338.948893] dma dma0chan0: tsi721_submit_sg: DMAC0 sg3/128 addr: 0x3b277c000 len: 16384
[ 338.948895] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
接收端的 hdid 接收端如果加上 -v ，发送端也要加上 -v
[ 338.948896] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000209615cd did=0 raddr=0x200bff0
……
[ 338.949633] dma dma0chan0: tsi721_submit_sg: DMAC0 sg126/128 addr: 0x37d128000 len: 16384
[ 338.949635] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.949638] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000b76696ad did=0 raddr=0x21fbff0
[ 338.949642] dma dma0chan0: tsi721_submit_sg: DMAC0 sg127/128 addr: 0x37da14000 len: 16
[ 338.949644] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.949648] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000cfd81cc2 did=0 raddr=0x21ffff0
[ 338.949650] dma dma0chan0: tsi721_submit_sg: DMAC0 last desc final len: 16
[ 338.949655] dma dma0chan0: tsi721_start_dma: DMAC0 (wrc=355) 2588
[ 338.949659] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.949661] dma dma0chan0: tsi721_issue_pending: DMAC0
[ 338.950953] dma dma0chan0: tsi721_dma_tasklet: DMAC0_INT = 0x8
[ 338.950956] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.950958] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.950995] dma dma0chan0: tsi721_prep_rio_sg: DMAC0 READ
[ 338.950997] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.951002] dma dma0chan0: tsi721_submit_sg: DMAC0 BD ring status: rdi=355 wri=355
[ 338.951003] dma dma0chan0: tsi721_submit_sg: DMAC0 sg0/99 addr: 0x3f03fc010 len: 16368
[ 338.951005] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000ae8cb52a did=0 raddr=0x2000000
[ 338.951007] dma dma0chan0: tsi721_submit_sg: DMAC0 sg1/99 addr: 0x37d53c000 len: 16384
[ 338.951009] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16368
[ 338.951011] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000f083cb61 did=0 raddr=0x2003ff0
[ 338.951012] dma dma0chan0: tsi721_submit_sg: DMAC0 sg2/99 addr: 0x37cea0000 len: 16384
[ 338.951013] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 16384
[ 338.951015] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 0000000093629186 did=0 raddr=0x2007ff0
[ 338.951017] dma dma0chan0: tsi721_submit_sg: DMAC0 sg3/99 addr: 0x37d8d8000 len: 16384
……
[ 338.951478] dma dma0chan0: tsi721_submit_sg: DMAC0 sg97/99 addr: 0x3808e8000 len: 65536
[ 338.951480] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 32768
[ 338.951482] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 000000004dabbcda did=0 raddr=0x21efff0
[ 338.951483] dma dma0chan0: tsi721_submit_sg: DMAC0 sg98/99 addr: 0x3f75f8000 len: 16
[ 338.951485] dma dma0chan0: tsi721_submit_sg: DMAC0 prev desc final len: 65536
[ 338.951486] dma dma0chan0: tsi721_submit_sg: DMAC0 bd_ptr = 00000000a0e9b510 did=0 raddr=0x21ffff0
[ 338.951488] dma dma0chan0: tsi721_submit_sg: DMAC0 last desc final len: 16
[ 338.951490] dma dma0chan0: tsi721_start_dma: DMAC0 (wrc=454) 2588
[ 338.951493] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.951498] dma dma0chan0: tsi721_issue_pending: DMAC0
[ 338.952786] dma dma0chan0: tsi721_dma_tasklet: DMAC0_INT = 0x8
[ 338.952789] dma dma0chan0: tsi721_advance_work: DMAC0
[ 338.952791] dma dma0chan0: tsi721_advance_work: DMAC0 Exit
[ 338.952936] dma dma0chan0: tsi721_free_chan_resources: DMAC0

4.2.2 大数据量的DMA测试(数据量大于4MB，系统的页大小为4KB)

linux下rapidio(TSI721)的DMA通讯相关问题_u010936265的博客-CSDN博客

4.3 rionet测试

        根据上面3.3章节中的dmesg信息可知，在安装rionet.ko后，系统下生成了一个基于rapidio的eth0网络接口。可以像常规的网卡一样来操作它，如果配置IP，进行ping 和 运行iperf等。