How can I save duplicate domains in the list to another file?

Question

0.00/5 (No votes)

See more:

my code:

Python

import os
import re

desktop = os.path.join(os.path.join(os.environ['USERPROFILE']), 'Desktop') 

pattern = re.compile(r'((http|https)\:\/\/)?[a-zA-Z0-9\.\/\?\:@\-_=#]+\.([a-zA-Z]){2,6}([a-zA-Z0-9\.\&\/\?\:@\-_=#])*')
urlsFile = open(desktop + "/random/in.txt", "r")
outFile = open(desktop + "/random/out.txt", "w")
urlsDict = {}

for linein in urlsFile.readlines():
    match = pattern.search(linein)
    url = match.groups()
    domain = url[3]
    urlsDict[domain] = linein

outFile.write("".join(urlsDict.values()))

urlsFile.close()
outFile.close()

when i run this code it gives me this error

Terminal

line 13, in <module>
    url = match.groups()
AttributeError: 'NoneType' object has no attribute 'groups'

What I have tried:

Python

url = match.string()

but it didn't work, I searched many sites but couldn't find any solution
please help

Posted 9-Aug-22 20:11pm

Jon-Nut

Updated 9-Aug-22 20:49pm

Add a Solution

1 solution

Add a Solution

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

OriginalGriff · Accepted Answer · 2022-08-09T20:24:00

Solution 1

If the match fails, search returns None: re — Regular expression operations — Python 3.10.6 documentation[^]
You don't check the return at all, so when there is no match your code - rightly - fails.
Try:

Python

match = pattern.search(linein)
if match:
    url = match.groups()
    domain = url[3]
    urlsDict[domain] = linein
else:
    ...

Posted 9-Aug-22 20:24pm

OriginalGriff

Comments

Jon-Nut 10-Aug-22 3:11am

i think my pattern is not getting some urls with problem

How can I save duplicate domains in the list to another file?

1 solution

Solution 1

Add your solution here

Preview 0

How can I save duplicate domains in the list to another file?

1 solution

Solution 1

Add your solution here

Preview 0

Existing Members

...or Join us