how to record website data into csv format

Question

1.00/5 (1 vote)

See more:

Dear all,

I am looking for guideline to read data from websitephoton . & load into csv file. Whenever new supplier selection or typesection change data should recorded into same excel with new sheet. Can some guide how to get started using python
This code to develop for database. Is there any easy method to do it will be appreciable.

http://www.photon.info/photon_site_db_solarmodule_en.photon[^]

Posted 28-Sep-15 1:41am

Member 10515225

Add a Solution

Comments

Patrice T 3-Nov-15 23:13pm

Question not clear, give details

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

PythonHeadBanger · Answer 1 · 2015-11-03T16:33:00

Hi, I'm so sorry, what specifically are you looking to do? Your instructions are a bit unclear.

Here is some python 3.4 code that I use to pull data from websites. It basically pulls data from a site and then saves it as a txt file. I have changed the code to something for .csv

It will be incomplete and need proofing and modifying but it should get the basic beginnings of getting data in csv for you.

SQL

savePath = 'C:/' + # whereever you save data
z = [] #list of website sub domains
for x in range (0, len(z)):
    print('Currently Pulling', z[x])
    urlToVisit = 'http://www.photon.info/' + z[x]
    websiteFile =[]

    sourceCode = urllib.request.urlopen(urlToVisit).read().decode()
    splitSource = sourceCode.split('\n')
    for eachLine in splitSource:
    '''' do your thing ''''
        
    completeName = os.path.join(savePath, z[x]+'.csv')
    with open(completeName, 'w') as file:
          for eachLine in websiteFile:
              file.write("{}\n".format(eachLine))