[Shell script] parse through text file, search on matching values

Question

0.00/5 (No votes)

See more:

I'm trying to scan a text file for values that match some values that I obtain earlier. For clarity I'm statically assigning them here. The input file is a CSV but doesn't contain any commas. I'm open to using a plain text file if that helps.

QTY=157
ITEM="Housewares"

Logic:

Take 2 variables. Above, they were statically assigned. (ITEM & QTY)
Parse through file and IGNORE lines that match the current ITEM value.
For the remaining lines, display the lines that have same QTY

File contents:

           ITEM 	   SAMPLE  LOSS QTY	A 	CC DESCRIPTION
           Clothing 	Xxxx 	-92	157	Y  	-- 	WPA2(PSK/AES/AES) 
           Housewares	Yyyy 	-90	157	Y  	US 	NONE
           Automotive 	Zzzzz 	-89	48,-1   	Y  	-- 	WPA2(PSK/AES/AES) 
           Home repair	Aaaa 	-87	10,-1   	Y  	-- 	WPA2(PSK/AES/AES)

What I have tried:

while read record
  do


    if [[ ! $record  =~ "${ITEM}" && $record =~ "${QTY}" ]]; then  
      read -ra ADDR <<< "$record"


      for i in "${ADDR[@]}"; do   # access each element of array
        echo "Possible matches: "${ADDR[@]}.  #display possible matches


        ITER=$(expr $ITER + 1)

      done

    else
        echo "Possible matches: ${green}0${reset}". #display 0 matches in green

        break

    fi
  done < scanlist.csv

Posted 23-Mar-21 18:49pm

wifinut

Updated 24-Mar-21 4:20am

v2

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

k5054 · Accepted Answer · 2021-03-24T04:20:00

Problem one seems to be a mix of UTF-8 and ASCII quotation marks (") in your code -- assuming you did a cut&paste from your source.

Next, your logic is slightly off. You break the while loop and report no matches on the first non-match. One possible solution:

Shell

let ITER=0  #use bash integer math
while read record
do
    if [[ ! "$record"  =~ "${ITEM}" && "$record" =~ "${QTY}" ]]; then
       echo "posible match : $record"
       let ITER+=1
       #  process record as needed
    fi
done  < scanlist.csv

if [[ $ITER -eq 0 ]]; then
    echo "no matches found"
fi

Also note that this

Shell

for i in "${ADDR[@]}"; do   # access each element of array
  echo "Possible matches: "${ADDR[@]}.  #display possible matches

prints all items in the array for each array element, which is probably not what you want. Since i is an array element, not the index, you can manipulate the array element using $i. To access the array via an index, you can use i = ${!ADDR[@]}