bash实现线程池,动态分析页面

2024-01-03 09:58

本文主要是介绍bash实现线程池,动态分析页面,希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

#总结来说,bash实现方便但是没有锁,是的实现过于晦涩,打算使用python改写之


#!/bin/bashdeclare -a SDM=($@) #inputdeclare -a printArray=() #no use nowdeclare -a printKey=() #avoid dead circledeclare -a thread_pid=() #multhreadexport threadNum=30export bexistFlag=0export filename="$1.status.txt"export tempsubdir="$1.subdir"export mtfilename="$tempsubdir/$1.status"export dbfilename="$tempsubdir/$1.debug"export begin_time=""export end_time=""function fetch(){ for loop in $@ do for loop1 in ${printKey[@]} do if [ "$loop1" = "$loop" ];then bexistFlag=1 break fi done if [ "$bexistFlag" = "1" ];then bexistFlag=0 continue fi#rm -fr ${tempsubdir}/${loop}.txt if [ ! -e ${tempsubdir}/${loop}.txt ];then curl -s -u tailianl:1qazxsw@ https://atlassianwave.web.alcatel-lucent.com/jira/browse/${loop} -o ${tempsubdir}/${loop}.txt elif [ -s ${tempsubdir}/${loop}.txt ];then echo "${loop}.txt exist once" >> ${dbfilename}.$! sleep 1 else echo "${tempsubdir}/${loop}.txt size is 0" >> ${dbfilename}.$! while [ 1 ]; do if [ -s ${tempsubdir}/${loop}.txt ];then echo "${loop}.txt wait for done" >> ${dbfilename}.$! sleep 1 break else echo "${loop}.txt wait for exist" >> ${dbfilename}.$! sleep 1 fi done fi # echo ""echo -n "---$loop---" echo "----------------------$loop----------------------------" >>${dbfilename}.$! #linkJira=`cat ${loop}.txt | grep "data-issue-key" | grep -v "div" | awk -F= '{print $3}' | awk '{print $1}' | awk '{print $1}'|sort -u|awk -F\" '{print $2}'|grep SDM` checkVliad priority=`cat ${tempsubdir}/${loop}.txt | grep priorities | grep -v class | awk '{print $2}' | awk -F= '{print $2}'|awk -F\" '{print $2}'` isfixed=`cat ${tempsubdir}/${loop}.txt | grep fixforversion | awk -F">" '{print $2}' | awk -F"<" '{print $1}'` firstStatus=`cat ${tempsubdir}/${loop}.txt | grep -n "jira-issue-status-lozenge" | awk '{print $1}'` nowVersion $firstStatus theStatus=`cat ${tempsubdir}/${loop}.txt | grep -n jira-issue-status-lozenge | grep "$theVersion" | awk -F\> '{print $2}'|awk -F\< '{print $1}'` printKey=(${printKey[@]} $loop) #echo ${printKey[@]} printArray=(${printArray[@]} "$loop $priority $isfixed") if [ "$isfixed" != "" ];then #printf "%-10s%-10s%-15s%10s\n" $loop $isfixed $theStatus $priority >> status.txt echo "$lline#$loop#$isfixed#$theStatus#$priority" >> $mtfilename.$! fetch $linkJira fi done return 0}function checkVliad(){#echo $@ declare -a numDuplicate=(`cat ${tempsubdir}/${loop}.txt | grep -n "dt title"| grep -i duplicate|awk -F: '{print $1}'`)#echo $numDuplicate if [ ${#numDuplicate[@]} -eq 0 ];then linkJira=`cat ${tempsubdir}/${loop}.txt | grep "data-issue-key" | grep -v "div" |grep SDM| grep issue-link | grep link-title| awk -F= '{print $3}' | awk '{print $1}' | awk '{print $1}'|sort -u|awk -F\" '{print $2}'` echo "linkJira: $linkJira" >> ${dbfilename}.$! else declare -a checkDuplite=(`cat ${tempsubdir}/${loop}.txt| grep -n "dt title" | awk -F: '{print $1}'`) uplevel=20000 downlevel=0#echo ${#checkDuplite[@]}# echo ${checkDuplite[@]} for (( j=0; j < ${#numDuplicate[@]}; j++ )) do for (( i=0; i < ${#checkDuplite[@]}; i++ )) do# echo ${numDuplicate[$j]} ${checkDuplite[$i]} if [ ${numDuplicate[$j]} -ge ${checkDuplite[$i]} ];then downlevel=${checkDuplite[$i]} # echo "downlevel=${checkDuplite[$i]}" fi if [ ${numDuplicate[$j]} -lt ${checkDuplite[$i]} ];then uplevel=${checkDuplite[$i]}# echo "uplevel=${checkDuplite[$i]}" break fi done done declare -a linkJiraIndex=(`cat ${tempsubdir}/${loop}.txt |grep -n "data-issue-key" | grep -v div | grep SDM| grep issue-link | grep link-title|awk -F: '{print $1}'`) declare -a linkJiraTmp=(`cat ${tempsubdir}/${loop}.txt | grep "data-issue-key" | grep -v "div" |grep issue-link | grep link-title|grep SDM| awk -F= '{print $3}' | awk '{print $1}' | awk '{print $1}'|awk -F\" '{print $2}'`) j=0# echo "$downlevel $uplevel" linkJira=""# echo ${linkJiraIndex[@]}# echo ${linkJiraTmp[@]}# echo $downlevel $uplevel for loop4 in ${linkJiraIndex[@]} do# echo $j if [ $loop4 -lt $downlevel -o $loop4 -gt $uplevel ];then # echo $downlevel $loop4 $uplevel linkJira="${linkJiraTmp[$j]} $linkJira" fi ((++j)) done echo "this is duplicate Jira:---" >> ${dbfilename}.$! echo "down and up: $downlevel $uplevel" >> ${dbfilename}.$! echo "linkJiraIndex: ${linkJiraIndex[@]}" >> ${dbfilename}.$! echo "linkJiraTmp: ${linkJiraTmp[@]}" >> ${dbfilename}.$! echo "numDuplicate: ${numDuplicate[@]}" >> ${dbfilename}.$! echo "checkDuplite: ${checkDuplite[@]}" >> ${dbfilename}.$! echo "linkJira: ${linkJira[@]}" >> ${dbfilename}.$! fi return 0}function do_fetch(){ thread_pid=() for loop2 in $@ do for lline in `cat $loop2` do #fetch $lline subprocess $lline printKey=() done done while [ ${#thread_pid[@]} -ne 0 ]; do for pid_idx in ${!thread_pid[*]}; do pid_val=${thread_pid[$pid_idx]} if [ ${#pid_val} -ne 0 ]; then kill -s 0 $pid_val &>/dev/null [ $? -ne 0 ] && unset thread_pid[$pid_idx] fi done done return 0}function nowVersion(){ theVersion=$1 return 0}function formatPrint(){#rm -fr docollect.sh#echo "#!/bin/bash" > docollect.sh#echo "cat ${mtfilename}.* > ${filename}" >> docollect.sh#chmod u+x docollect.sh#echo "please run docollect.sh after analys!!!!!!!!" cat ${mtfilename}.* > ${filename} cat ${dbfilename}.* > ${dbfilename} end_time=`date` echo "end_time: $end_time" >> ${dbfilename} echo "--------------------------------------------" echo "---Begin time: $begin_time" echo "---End time: $end_time" echo "--------------------------------------------" echo "--------------------------------------------" echo "the result file is : ${filename}" echo "the debug file is : ${dbfilename}" echo "--------------------------------------------" return 0}function hello_thread(){ echo "hello" sleep $1 echo "end hello"}function subprocess(){ while [ 1 ]; do if [ ${#thread_pid[@]} -lt ${threadNum} ]; then fetch $1 & #hello_thread 5 & thread_pid=("${thread_pid[@]}" "$!") break else for pid_idx in ${!thread_pid[*]}; do pid_val=${thread_pid[$pid_idx]} if [ ${#pid_val} -ne 0 ]; then kill -s 0 $pid_val &>/dev/null [ $? -ne 0 ] && unset thread_pid[$pid_idx] fi done fi done}function main(){ begin_time=`date` trap "kill -9 $$" SIGINT rm -fr $filename rm -fr $tempsubdir rm -fr $dbfilename mkdir -p $tempsubdir#formatPrint echo "begin_time: $begin_time" > ${dbfilename} do_fetch $@ formatPrint return 0}echo $@main $@

这篇关于bash实现线程池,动态分析页面的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/565325

相关文章

Python实现精准提取 PDF中的文本,表格与图片

《Python实现精准提取PDF中的文本,表格与图片》在实际的系统开发中,处理PDF文件不仅限于读取整页文本,还有提取文档中的表格数据,图片或特定区域的内容,下面我们来看看如何使用Python实... 目录安装 python 库提取 PDF 文本内容:获取整页文本与指定区域内容获取页面上的所有文本内容获取

基于Python实现一个Windows Tree命令工具

《基于Python实现一个WindowsTree命令工具》今天想要在Windows平台的CMD命令终端窗口中使用像Linux下的tree命令,打印一下目录结构层级树,然而还真有tree命令,但是发现... 目录引言实现代码使用说明可用选项示例用法功能特点添加到环境变量方法一:创建批处理文件并添加到PATH1

Java使用HttpClient实现图片下载与本地保存功能

《Java使用HttpClient实现图片下载与本地保存功能》在当今数字化时代,网络资源的获取与处理已成为软件开发中的常见需求,其中,图片作为网络上最常见的资源之一,其下载与保存功能在许多应用场景中都... 目录引言一、Apache HttpClient简介二、技术栈与环境准备三、实现图片下载与保存功能1.

canal实现mysql数据同步的详细过程

《canal实现mysql数据同步的详细过程》:本文主要介绍canal实现mysql数据同步的详细过程,本文通过实例图文相结合给大家介绍的非常详细,对大家的学习或工作具有一定的参考借鉴价值,需要的... 目录1、canal下载2、mysql同步用户创建和授权3、canal admin安装和启动4、canal

Nexus安装和启动的实现教程

《Nexus安装和启动的实现教程》:本文主要介绍Nexus安装和启动的实现教程,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录一、Nexus下载二、Nexus安装和启动三、关闭Nexus总结一、Nexus下载官方下载链接:DownloadWindows系统根

SpringBoot集成LiteFlow实现轻量级工作流引擎的详细过程

《SpringBoot集成LiteFlow实现轻量级工作流引擎的详细过程》LiteFlow是一款专注于逻辑驱动流程编排的轻量级框架,它以组件化方式快速构建和执行业务流程,有效解耦复杂业务逻辑,下面给大... 目录一、基础概念1.1 组件(Component)1.2 规则(Rule)1.3 上下文(Conte

MySQL 横向衍生表(Lateral Derived Tables)的实现

《MySQL横向衍生表(LateralDerivedTables)的实现》横向衍生表适用于在需要通过子查询获取中间结果集的场景,相对于普通衍生表,横向衍生表可以引用在其之前出现过的表名,本文就来... 目录一、横向衍生表用法示例1.1 用法示例1.2 使用建议前面我们介绍过mysql中的衍生表(From子句

Mybatis的分页实现方式

《Mybatis的分页实现方式》MyBatis的分页实现方式主要有以下几种,每种方式适用于不同的场景,且在性能、灵活性和代码侵入性上有所差异,对Mybatis的分页实现方式感兴趣的朋友一起看看吧... 目录​1. 原生 SQL 分页(物理分页)​​2. RowBounds 分页(逻辑分页)​​3. Page

Python基于微信OCR引擎实现高效图片文字识别

《Python基于微信OCR引擎实现高效图片文字识别》这篇文章主要为大家详细介绍了一款基于微信OCR引擎的图片文字识别桌面应用开发全过程,可以实现从图片拖拽识别到文字提取,感兴趣的小伙伴可以跟随小编一... 目录一、项目概述1.1 开发背景1.2 技术选型1.3 核心优势二、功能详解2.1 核心功能模块2.

MYSQL查询结果实现发送给客户端

《MYSQL查询结果实现发送给客户端》:本文主要介绍MYSQL查询结果实现发送给客户端方式,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录mysql取数据和发数据的流程(边读边发)Sending to clientSending DataLRU(Least Rec